Introduction

In the testing session, we aim to evaluate how users interact with the prototype, their reactions, and whether they can understand and complete the task.

Testing Methods

We apply "think aloud" method during the testing and interview after testing.

Reasons for methods we apply

We use the think-aloud method because it allows us to gain insights into users' thought verbalizing their thoughts. This method also helps us capture real-time feedback, providing a deeper understanding of user behavior and cognitive challenges they may face. We conduct interview after testing to clarify any observations and understand users in more detail.

Observation Tasks

• Do users know how to interact with the prototype?
• How do users interact with it?
• Any difficulties?

Interview

• How would you describe your experience using this product?
• What parts of the product do you think could be improved? Why?
• Do you think this product is effective in shifting your attention away from your smartphone?
• Can you share any difficulties you encountered?

1st Testing

Prototype

Target Audience

• University Students

Evidence of Genuine User Involvement

Testing	Participant A	Participant B
Images
Video Link	Link	Link

Evaluation Outcomes

Participant A

1. Observation:

• "It's quite challenging for participants to interact with the sensors using their feet to move ingredients on the screen. The participant takes so much time to try hovering on sensors."
• At the beginning, the participant was unaware of the correct pairing between the ingredients and the sensors.
• "How do I play game? Use my hands? Feet?"
• "It's so fun! Ohhh..I can kick it to the opposite side. But how do I know to do the next?"

2. Interview:

• "The gamfication idea is cool and pretty fun that makes me stop using my smartphones. The experience is good. I can easily understand that I need to kick ingrediants, but I think the interface of menu could be improved because I would not know I need to collect ingriendt to match the menu."
• "When I was playing, I don't know when the game will stop."
• "I know you want to address the issue fo using smartphone while crossing the road, but I'm not sure it could also result in addiction, becuase I feel like I will keep playing this game even the light turns green. "
• "I think if there is some instruction, I will play it smoother"

Participant B

1. Observation:

• "I don't know...what should I do now? Just use my feet on the sensor?"
• "okay...I feel confused....so the thing in the middle is menu, and I need to match it, right? "
• "How do I know I complete the task? There is no feedback for me to know, so I feel a lit bit confused."

2. Interview:

• "I'm not sure it could be effective to catch my eye because when I am on the street I would ignore this application."
• "The one problem is that if there is no person on the opposite side, so I can't play the game right? "
• "I think the sensors' detection sensitivity can be improved because they seem easily affected by unintended movements "

1st Testing Results Evaluation

1. Participants are confused about the interface of menu and ingredient they need to collect due to these two areas are close and users don’t know what should they do.
2. Participants may not sure what should they do for the sensor because they don’t know the connection between ingredients and sensors.
3. ⁠⁠It’s hard for users to do calculation in their mind while playing. They need to think about the ordering of the ingredients and kick the sensor match to the ingredient.
4. ⁠⁠A problem for the scenario that what if there is no person playing a game in other side.

Iteration & Improvement

• Only one person plays the game: We will design the mechanism to detect whether there is a person or not. And if one person is ready for playing, but the other side is no person. Then, the screen will show “Waiting for the other player…” At the same time, the panel in other side (no player) will show up “Play me” to attract people attention to play.
• Add the feedback for ending the game. "Time's up! Time for crossing!"
• Improve the sensor sensitivity.
• Add initial frame for the beginning of the game.
• Fix some bugs:⁠Ingredient do not match the recipe but still yummy, Recipe and ingredients automatically match at the beginning of the round
• To remind users which sensor they need to interact for the ingrediants, we decided to add colour background behind the ingredients.

2nd Testing

Iteration Prototype

What we improve?

• Unity
  • Add the design of traffic light countdown as the beginning of the game: When users start the game, a traffic light countdown background music will play and the animation of countdown will display.
  • Add background color behind the ingredients: This will solve the problem of users being unsure which sensor they need to interact with to match the ingredients.
  • Add Ending: "Time's up. Look up!"
  • Add "Yummy Yummy" Sound
  • Add close button to exit the game
  • Add restart button to reload the game
• Implement sensors on wooden plant and color the plant.

Evidence of Genuine User Involvement

Evaluation Outcomes

1. All participants enjoy the prototype and also are able to interact with it appropriately.
2. We found that some participants may need time to learn and become familiar with which ingredient/sensor they need to interact with.
3. Due to environmental limitations, we used a projector to display the game, which was intended to be placed on the ground. All participants understand that situation and the way of simulation.
4. Most participants think this solution will catch their attention while they use their phone and wait for the traffic light turning green. However, two participants expressed concern about whether the distraction could potentially lead to safety issues or reduce their awareness of their surroundings during the wait.