Initial idea

HandFish: Big Fish Eat Small Fish Game with Gesture Swimming

HandFish is a gesture-driven interactive game that allows players to control a small, gluttonous fish as it continues to swim, feed, and grow larger on the screen by simply waving their hands. Through machine learning to recognize gesture movements, the game translates hand movements into gameplay behaviors, enabling a relaxing, immersive growth experience.

“I hope to control a growing digital life in the most natural way possible - with my hands.”

I hope to publicize sign language through the game

Inspiration

This project is inspired by the classic childhood game “Big Fish Eat Small Fish”. I wanted to reinterpret its simple mechanics by making gesture recognition the core of control. I also drew inspiration from various interactive works, such as:

• Flow: A game that organically guides users to grow stronge

• The hand-tracking capabilities demonstrated by MediaPipe and ml5.js
• Explorations around “gestures input" and the development of digital identity

In this project I combine gesture recognition, 3D graphics

Interaction: Your gestures is the Controller

In HandFish, your hands become the game controller:

• Bringing both hands together and swaying side to side → Controls the direction and speed of the fish's movement
• Opening both hands wide → Triggers the fish to open its mouth, ready to eat
• Approaching smaller fish → Automatically eats the fish and gains growth