Overview

Two rounds of user testing were conducted for this part. Since the pictures of the clock and scoreboard have only changed in design, their basic functions and main elements of the pictures have not changed. Therefore, the same questions are used in the two rounds of testing, and it is easier to analyze the results.

Purpose

The main purpose of this user testing is to investigate and evaluate the style of the scoreboard and clock(timer) as well as the scoring system. This user testing will be significant toward our project since there can be some deficiency of our team's final design. Hence, the outcome of testing will be conducted for the improvement of the system.

Process

Due to the current COVID-19 situation, user testing will be done by an online zoom meeting. Testers will experience the system through the remote control of zoom functionality.

1. We tell the tester what to observe in the game, such as "As time increases, the score rises or falls", "When the score is 0, will the game end automatically" "Can the attack of the aircraft reduce the score"
2. Write down the important observations, such as "the time to complete the first item intersects with others".
3. After the end of the game experience, we will ask the testers some open-ended key questions about the game.

Keypoint questions

• What do you think of the scoreboard icon?
• What do you think of the clock icon?
• If you can decide what the clock and scoreboard look like, how will you design it?
• What do you think about the scoreboard system?

Results for sprint 1

USER 1

Observations

Quickly find the influence of each element in the scoring system on the score. No difficulties were encountered.

Scoreboard icon

Can understand the meaning of the picture but feel that the colour of the picture is somewhat similar to the background colour, and the position is also a little strange.

Clock icon

Can understand the meaning of the icon, but I feel that the style is a little simple, but it can be more complicated. For example, the pointer inside can rotate like a real watch.

Design theme

Will put the scoreboard in the upper middle of the screen, and then adjust the colour and love of the alarm clock into a series.

Scoreboard system

The scoring system is very clear and the scoring system is perfect, but the design can be improved.

USER 2

Observations

"Since this isn’t a finished and designed game. User 2 seems like he was having a little confusion toward the game. However, he only had simple tasks to do for the game so there was no difficulty with the controls."

Scoreboard icon

"Design is simple and easy" "The word ‘Score’ looks a little unclear, it could be better if different word style is used" "Scoreboard frame is nice and eye-catching" "Colour balance looks alright"

Clock icon

"Clock icon is simple and clear" "Easy to understand it is directing the game time" "Maybe thicker icon can be more eye-catching" "Colour can be added to the clock icon"

Design Theme

"Currently the design theme looks very simple, maybe some detailed design theme can be implemented to look better to give more realism to the game story."

Scoreboard system

"Understandably, the score increases as the game time increases. However, I don’t get the point of having two different aspects which show the same result. Maybe the scoring system can be defined differently?"

USER 3

Observations

Players can quickly identify the functions of different parts and become familiar with how the game works. It seems simple to the player.

Scoreboard icon

The scoreboard is clear. Maybe it should be bigger.

Clock icon

The pattern of the clock also makes people directly aware that it is used to calculate time, which is a relatively simple function and seems to be nothing to evaluate.

Scoreboard system

I'm a little confused about the whole system, so maybe I'll put a little introduction next to the score sheet, just to explain how to integrate.

Overall design

The overall design style and colour is very cartoon, more in line with the overall design style.

Summary

Almost all testers were able to understand how the game works and the relationship between the Scoring system and clock and scoreboard. Some testers were a little confused because the game's functions were not perfect.

Everyone can understand the meaning of the scoreboard. In terms of design, some people feel that the "scoreboard" is not obvious enough because of the colour, and some people feel that the image of the scoreboard is a bit small.

Everyone can understand the meaning of the clock. In terms of design, some people think that the current clock is too monotonous and need to add a background colour. Some people think that the clock, as a simple icon, can be more complicated in terms of design, for example, the hands can rotate.

The evaluation of the scoring system is more differentiated. Some people find it very clear, and some people find it a little vague. It is recommended to put an introduction on the left or right side of the game page.

In the first sprint, we decide to add a background colour for the clock icon. For the scoreboard, we stick to the current design.

We need to continue to improve the design of the icon in the subsequent sprint to make it more ornamental.

Results for sprint 2

USER 1

Scoreboard icon

Really like the design of the score table, which has a sense of the future."

Clock icon

Tester said that there are games because the size of the picture is relatively small, but it is very cute after seeing the original picture.

Design theme

Tester said it's very good now.

Scoreboard system

The scoring system is very well designed in terms of coding and design. What can be improved is maybe that the icon looks a little small and can be enlarged.

USER 2

Scoreboard icon

The design of the characters is very beautiful, and the box below is a bit monotonous.

Clock icon

Very cute design, the pointer inside is a little boy running, very interesting.

Design Theme

The overall design looks good and interesting, but a bit complicated.

Scoreboard system

"I understand that the score increases with time, and I like the overall design very much."

USER 3

Scoreboard icon

Like the design of the scoreboard very much, and it matches the background of the game. But the black background colour looks a little strange.

Clock icon

The design of the clock is very interesting, and especially like the villain inside.

Scoreboard system

Can understand the entire scoring system, and like the design.

Overall design

Feel that the overall design is very futuristic and will attract testers to play this game.

Summary

Almost all testers liked the design of the clock and scoreboard very much and felt that it was in line with the whole theme and had a sense of the future. They also understand how the scoring system works.

There are two opinions on the design. The first is that the existing icons are a bit small, and I hope they can be enlarged. Another is that the black background of the scoreboard is a bit strange, and I hope to remove the black background.

Regarding the first suggestion, the size of the clock is the same as that of other icons. If only the clock is changed, it will be very abrupt, so the clock remains unchanged in sprint2, and sprint3 will discuss this issue with the designers of other icons.

Regarding the second suggestion, since the color of the floor is yellow, after removing the black background of the scoreboard, the overall look is inconsistent, so the scoreboard maintains the existing design and does not change it.