jeu de geste : an educational app for learning with Buddy
Educational robot for autistic children: augmented reality application for motor skills, laterality, and color learning
Thanks to Gesture Play, an educational app for the Buddy robot, interactive learning is transformed into a fun, engaging, and accessible experience. By combining social robotics, gesture recognition, and emotional interactions, this educational app encourages participation, stimulates motor skills, and fosters user engagement in a variety of contexts: education, inclusion, mediation, or specialized support. Suitable for both children and innovative learning environments, Buddy creates natural interactions where movement becomes a true learning tool.
INCLUSION / EDUCATION
A playful experience based on gestures and interaction
Thanks to the jeu de geste educational app, your Buddy robot offers an interactive experience that combines social robotics, motion recognition, and augmented reality to stimulate learning through play. Designed around a simple and intuitive principle, the app invites the user to physically interact with the robot through dynamic and engaging motor exercises.
Using its onboard camera, Buddy detects the presence of a user in front of it and analyzes their movements in real time. Colored bubbles then appear on the screen, and the goal is to pop them by performing the correct gestures. This playful mechanic transforms human-machine interaction into an immersive activity that promotes active participation and cognitive engagement.
The app uses augmented reality technology to create natural interactions between the user and the robot. By engaging movement, coordination, and visual perception, jeu de geste encourages multisensory learning, making it particularly well-suited to educational environments and digital mediation activities.
How Buddy stimulates learning and engagement
Beyond its playful aspect, this experience also helps develop several essential skills:
- lateralization,
- motor coordination,
- gross motor skills,
- color recognition and learning,
- attention and responsiveness.
Thanks to its interactive and accessible approach, Buddy fosters more natural user engagement, particularly in educational settings, inclusive workshops, and cognitive stimulation activities. Movement becomes a true learning tool, strengthening engagement while creating a positive and intuitive experience with educational robotics.
The educational benefits of gestural play
The jeu de geste’s educational approach is based on a fundamental principle: learning through interaction and movement. By combining social robotics, gesture recognition, and game mechanics, the educational app for your Buddy robot transforms the learning experience into an immersive and stimulating activity, fostering engagement, memorization, and active participation.
Unlike more passive approaches, the jeu de geste directly engages the user through simple and intuitive physical actions. This bodily involvement promotes greater attention and strengthens learning through a multisensory experience where sight, movement, and cognitive response are simultaneously activated.

Develop motor skills and coordination
By asking the user to interact with visual elements appearing on the screen, jeu de geste stimulates gross motor skills, movement coordination, and spatial awareness. The exercises also encourage laterality, by alternately engaging the right and left sides of the body.
This motor dimension is particularly valuable in educational settings and mediation activities, where movement becomes a natural and engaging learning tool.

Strengthening attention and cognitive abilities
This application also engages several important cognitive functions:
- Concentration,
- reaction time,
- visual attention,
- color recognition,
- memorizing instructions.
The interactive and evolving nature of the game helps maintain attention longer than a traditional activity, while also encouraging positive repetition of exercises. User remains an active participant in the experience, which improves engagement and motivation.

Promoting learning through play
Games are a powerful educational tool. Thanks to its playful approach, Buddy creates a reassuring and stimulating environment that naturally encourages participation. Users learn without feeling the pressure of a traditional exercise, which facilitates engagement and reduces certain learning barriers.
This gamification approach is particularly well-suited:
- to educational contexts,
- to digital workshops,
- to extracurricular activities,
- to inclusion programs,
- or even to cognitive stimulation programs.
A more human and engaging interaction
By integrating social robotics into the experience, Buddy adds an extra emotional and relational dimension. Interactions become more natural, more vibrant, and more engaging than with a simple, traditional digital interface. The robot acts as an interactive mediator, capable of capturing attention, sparking curiosity, and encouraging active participation. This ability to create a more intuitive user relationship is a real asset in innovative learning environments, where user engagement and experience play a central role in learning.
DOWNLOAD
Find all the documentation relating to this application here.
