Demo Links:

Hand Gesture Painting

One-sentence description

Browser-based interactive drawing tool. Users can draw by detecting gestures through the camera.

Summary

Gesture Painting is a digital art application. Utilizes computer vision and gesture recognition technology to create an innovative touch-free painting experience. Based on p5.js and ml5.js, the project enables users to control brush strokes, change colors, and select different painting tools through gestures. The right hand is used to draw while the left hand controls the brush thickness. The app supports multiple brush styles, including pen, watercolor, marker and spray, making the painting experience more dynamic and intuitive.

Visualization

录屏2025-03-07 11.27.38.mov

Inspirations

d6bfb65b02b92ae02d809cc5d2fe7a49.jpg

587e5fefb83d3ce8c949f4131ca742ba.jpg

The project was inspired by a keen interest in digital art and gestural interaction. Inspired by sci-fi movies and VR/AR technologies, the goal was to create a convenient experience to draw without the need to touch the device; technologies such as Leap Motion and Microsoft Kinect have demonstrated the potential of gesture control, but this project aims to achieve a similar effect using only camera and browser technologies.

Challenge:

1.Gesture recognition is inaccurate or invalid

2.UI design/function

The drawing tool functions abnormally

  Paintbrush Drawing Problem

Eraser Tool

Window resizing issues