Year 2022 | Metalabs Telkom University

Project Hand Tracking Game Virals Play - Count Me

A hand tracking game designed to identify individuals with Dyslexia, where the objective is to move the ball into the bowl and match the number of balls to the given set of numbers.

Status : Finished

Platform : Desktop

Technology : Ultraleap 3Di Hand Tracker, Unity Game Engine, Blender 3D

Demo video of Virals Play - Count Me

I was assigned to this project by my lecturer to develop a game using the Ultraleap 3Di device. The gameplay mechanics were designed by my lecturer, and I was responsible for implementing them using the Ultraleap 3Di hand tracking device in Unity.

For this project, I made a game to check if someone might have Dyslexia. Dyslexia is a learning difference that messes with how our brains process and understand words. It can make it hard for people to recognize and tell apart certain letters, numbers, or symbols. So, reading, writing, and spelling can be a bit tougher for people with dyslexia.

For example, they might find it difficult to tell apart numbers like 9 and 6, 2 and 5, 3 and 8 or other digits that look similar. It's like they might see these numbers turned around or flipped, which can make it tough for them to tell which is which.

Core Mechanics

The gameplay of Virals Play - Count Me

In this game, the main goal is to move the ball into the bowl and match the number of balls with the given set of numbers. For example, if the number displayed is 3, you should put 3 balls into the blue bowl. If you put 8 balls instead, it may indicate a strong possibility of dyslexia. Similarly, if the number 8 is displayed and you put 3 balls in it, it may also suggest a strong possibility of dyslexia. However, if you don't match either 8 or 3, then there's no problem.

What have I worked on?

Testing the gameplay of Virals Play - Count Me in Unity Editor

The screenshot in Unity Editor

  • Developed a game mechanic that dynamically displays pairs of numbers as game objectives by using List.

  • Developed a dynamic level selection system using ScriptableObject to easily add and manage levels.

  • Utilized Ultraleap 3Di device and Ultraleap SDK to implement the hand tracking mechanic.

  • Designed and implemented precautionary measures to address potential application failures.

  • Developed clean C# scripts for the game architecture

  • Created all the visual elements (3D and 2D) assets for the game, except the hand and audio elements.

Try the game

You can try the game by clicking the download button below. If you want to see the source code, you can visit the GitHub page by clicking the button below. However, please note that the game requires the Ultraleap 3Di device to track your hand for gameplay. Make sure you have the device before playing.