Live Face Doodle
2026
Web interactive
This work turns the face into a live drawing canvas. Using hand tracking and face tracking, it allows users to doodle playful effects directly onto their face in real time, creating personalized face filters that move and respond with facial motion.
Web interactive
This work turns the face into a live drawing canvas. Using hand tracking and face tracking, it allows users to doodle playful effects directly onto their face in real time, creating personalized face filters that move and respond with facial motion.
Concept
Many social media apps now include fun face effects in their camera features, but most of them are pre-made by the platform. My concept is to let users DIY their own face effects by doodling directly on their face.In this interaction, the user’s face becomes the canvas. Using simple hand gestures, they can draw playful effects that track and move with facial motion, whether to express personality or to create their own playful face sticker expressions in real time. Each face effect becomes a unique creation—designed by the user, not the app.
Interaction Flow
The interaction includes two drawing modes: Face Paint and Decor.In Face Paint mode, doodles are attached directly to the face surface, so the lines follow facial movement and deform naturally with expressions.
In Decor mode, doodles are positioned around the head rather than on the face itself, allowing elements such as stars, marks, or graphic shapes to stay more stable as the head moves.
Hand gestures are used throughout the interaction: the user hovers over the color palette to choose a color, pinches to start and stop drawing, and makes a fist to clear the canvas.