Home - aliciamarie15/Cave_Funfair GitHub Wiki

Project Goal

The goal of this project was to develop software that can be controlled using both voice commands and movement, utilizing the Kinect sensor.

Our team consisted of five members: four of us focused primarily on software development, while one served as the Scrum Master, responsible for structuring the project and workflow. Work was documented, and tasks were allocated on a shared MiroBoard, while GitHub was used for project management.

Concept

image

We quickly settled on the concept of implementing a funfair-style experience with a selection of mini-games. Given that the CAVE (Cave Automatic Virtual Environment) technology originates from the 1990s, we decided to embrace nostalgia by selecting well-known games that might evoke sentimental feelings. The games we implemented were:

  • Fruit Ninja
  • Can Knockdown
  • Buzz! Jungle Party

Speech and Movement Recognition

Once we selected the games, we considered how best to integrate speech and movement recognition while keeping usability in mind.

The Kinect’s speech recognition, while mostly reliable, has a slight delay and does not work in real time. This posed a challenge for Fruit Ninja, a game that relies on speed and slicing movements. Therefore, we opted to implement Fruit Ninja using movement recognition exclusively. Similarly, Buzz! Jungle Party was also implemented with movement, as the objective is to make colored blocks disappear as quickly as possible using buttons.

For Can Knockdown, players control the direction of their throw by moving their hand to position the target. Once satisfied with the position, they release the ball by holding their hand still.

We didn't use speech recognition in the actual games but in the main menu, speech recognition is used for game selection. Players can start a mini-game by speaking specific German words.

Game Guide

Main Menu

In the main menu, players can select a game by speaking the corresponding German word:

  • Buzz! Jungle Party – Say "Stein"
  • Fruit Ninja – Say "Frucht"
  • Can Knockdown – Say "Dose"
  • To exit a mini-game, say "Stop"

Game Instructions

Buzz! Jungle Party

  • The game features colored blocks stacked on top of each other.
  • The objective is to remove the bottom blocks by pressing the corresponding colored button on the podium.
  • To press a button, simply hold your hand over it.
  • A timer records how long it takes to remove the entire stack.

Fruit Ninja

  • Similar to the mobile game, but instead of swiping a screen, players slice fruits by moving their arms in the air.
  • Players have three lives and must avoid missing fruit or hitting bombs.
  • When the game is over, it can be restarted by pressing the middle button.
  • Unfortunately, we were not able to perfect this game and there are still some bugs, so that you are not able to accurately slice the fruits.

Can Knockdown

  • Players move an emitter to select in which direction to throw the ball.
  • Once satisfied with the position, they hold their hand still to release the ball.

This project successfully integrates voice and movement recognition to create an interactive, nostalgic gaming experience.