Methodology

Overview

User testing is done on the final boss level for the Fireflies game. Gameplay must be tested to ensure that the final level is playable, assessed through multiple factors such as difficultly, enjoyment, learnability and more. Think alouds, observations and interviews will be conducted in order to gather information to assess each of these factors, which will be noted to further improve the final boss level.

Justification

This is a design process for collecting valuable data in order to improve the game playability. The user testing is done by several steps, such as determine target users, create testing tasks for users, interacting with users etc. This documentation records the detailed information from our user testing for the final boss level as well as the conclusion and insights from the testing.

Testing Process

• finding types of testers
• giving tasks to testers and observing
• testers thinking aloud
• interviewing with testers
• ethics

User Brief

Initially, so that the user has a good understanding of the standard game mechanics, they will be instructed to play the first level. This is not part of the official testing, this is just a baseline for their understanding, so that the results from their final boss level gameplay are purely results that can be applied to the improvement of that level.

User Tasks

As previously mentioned above, the user was instructed to play the first level of the game to allow them to be acquainted with the controls. Next, they were then instructed to attempt the final boss level, while voicing their thoughts about the game in real time. Simultaneously, observations were taken to further understand their gameplay.

Results

User 1

The first user gave lots of valuable feedback. Some observations are written below:

• The enemies spawned out of the red circle they initially started in
• The user is unable to properly aim TNT, as they are unsure of the range
• User learns a new tactic - they figure out they can hide outside the game bounds for a while
• Very concentrated and stops speaking over time
• They spam the bandages button in frustration

In the think aloud, the user mentioned many important points:

• Too many enemies spawning after a while, and becomes too difficult
• The boss enemy stops working after a while
• The eyes are very overpowered - they shoot too many blood bullets
• Blood bullets cannot be attacked
• They believed bandages were given to them after some time
• They can't see their rocks, attacks and some of the health bar items. It is also skewed, and not on the bottom left.

Here are some questions and answers for the interview, after testing:

What improvements can be made?

• Definitely want to go back to the shop when I die so I can spend the coins and try beat the level
• Make it easier. Too many enemies, and after a while, I lose motivation

Why did you suddenly become silent while playing?

• The game became difficult and I really had to concentrate

Why did you keep spamming the bandage button?

• I figured after a while they kept giving me bandages, and I wanted to quickly heal myself.

Think aloud tests were completed with the next 5 testers and the main points made can be seen below. Tester 1: Main points We’re initially confused as to what the boss is although I’m unsure if it’s important Needed more light Found it engaging

Tester 2: I like the boss Very effective and entertaining I was a bit confused by the laser but I learnt it as I went

Tester 3: Took me a second to get the story line Once I got it it was effective

Tester 4: I love the boss The bullets are cool I found it hard but that’s a good thing

Tester 5: It is a little dark But I think it fits the vibe of the game I like the types of fighting they are hard but in a good way

Tester 6:

[observations]

• pre excited at the beginning
• easily pass the level 1
• died a few times at level 2 then quit

[think aloud]

• mentioned too many enemies, couldn't kill them all
• asked where to press to talk to NPC

[questions and answers]

• How do you think of this game? A: It's a good game, I like it. the graphic is cute.
• What don't you like about? A: maybe it's too dark? and the difficulty is a bit of high in level 2, I died quite a few times.

Common Issues & General Options for improvement:

• apart from level1, the game start to become a bit of difficult for users.
• almost all the users mentioned that the game theme is a bit of too dark (low visibility).
• some levels have so many enemies and a few of them a bit of overpowered.
• confused about hot to play especially in the final level.

Currently Actionable Improvements:

• edit number of bullets fired per second/minute
• ensure proper lighting during fighting
• ability to return to safe house with coins collected
• ensure users are able to complete level with some difficulty however, not so much they become unmotivated

Additional Comments/Suggestions

• should have a instruction for users so that they know how to play, and what abilities they have.
• would be cooler/better to have a level difficulty settings for users to choose, so they won't be frustrated sometimes.

Evaluations of results

It can be seen that the balancing of enemies could be improved as several testers mentioned the amount of spawned enemies as well as the rate at which some enemies fire their bullets. this should not be decreased to a point where users are not engaged as currently users do find the rest of the game engaging and are motivated to continue. Also, the lighting could be improved to ensure visibility while maintaining the overall 'vibe' of the game.