Game Instruction User Testing - UQdeco2800/2021-ext-studio-2 GitHub Wiki

Background and Goals

We have designed and implemented a game tutorial to explain them:

  • A new button is shown on the main menu called "Game Tutorial".

  • The user can click the button to enter a page that explains all icons and characters in the game.

  • This user test is to get enough feedback to improve our design.

  • Please note that this feature has two names "game instruction" and "game tutorial".

Changes from Sprint 4:

  • The background is redesigned, and a more appropriate font is selected for a better suit of the style of the game.

Process

Our survey is divided into two parts:

  1. Potential target population:
  • We invite them to watch the prototype of the game tutorial;
  • After the demonstration, we interviewed a few questions for whether they could understand the game by reading the game tutorial.
  1. Professional developer/designer:
  • Show them prototypes;
  • Ask them questions about the layout and font setting of the game tutorial.

Key Questions

Potential target population:

  • Do you think the game tutorial clearly described all interactive characters and the game's control method?
  • Do you fully understand the control and interactive features after reading this game tutorial?
  • What do you think needs to be improved？

Professional developer/designer:

  • Do you think the game tutorial clearly described all the interactive features?
  • From the aesthetic point of view, what do you think needs to be improved?
  • From the principle of interaction, do you think the font setting and the tutorial's entrance is suitable?

Sprint3 Survey Result

User 1: Student A (Has joined user evaluation test for previous sprints)

  • Thoughts: The brief description of keyboard use is fantastic.
  • Like: You guys put a keyboard schematic diagram which is excellent.
  • Not so good: Nothing bad.
  • Comment: I love this helpful tutorial.

User 2: Student B (Has joined user evaluation test for previous sprints)

  • Thoughts: Such an operation tutorial is pretty necessary.
  • Like: The description is straightforward and easy to understand. I like it.
  • Not so good: The background looks a bit empty. But they are overall beautiful.
  • Comment: Overall good, but maybe try adding a background picture?

User 3: Professional Student C

  • Thoughts: Creating a tutorial for players to operate is an excellent idea since there are heaps of interactive characters in the game, which can confuse new players.
  • Like: The idea is great, and the layout design and description context are awesome.
  • Not so good: New players may not be aware that there is such a great tutorial for them.
  • Suggestion: Since this tutorial is too important, I would recommend showing this tutorial to every new player.

User 4: Professional Student D

  • Thoughts: Useful and handy tutorial.
  • Like: The font is vivid, and I like it very much. And new players of the game really need such a detailed tutorial to play the game.
  • Not so good: The tutorial should be automatically shown to new players.
  • Suggestion: Good design, so I advise showing it to every new player.

Sprint3 Version Summary

  • After interviewing four students (result above), many participants claimed that the game tutorial was handy and useful. In addition, they are all highly valued for the graphic design of the tutorial, font setting and page layout.
  • This game tutorial received unanimous praise from both groups of participants. All participants realise that this game tutorial is essential for new players since the game is detailed and offers a significant amount of helpful information.
  • Regarding the downside of the design, some participants pointed out that the game tutorial page should come with a better background.
  • All feedbacks are valuable and will be considered for the next sprint.

Sprint4 Interview Result

Interview photos

GT-1

GT-2

GT-3

GT-4

User 1: Student A (Has joined user evaluation test for previous sprints)

  • Thoughts: The new background is awesome.
  • Like: The new background and new font style are better suited to the overall style of the game.
  • Not so good: Somehow too many words.
  • Comment: Nice job!

User 2: Student B (Has joined user evaluation test for previous sprints)

  • Thoughts: Nice background.
  • Like: Good background and font decision.
  • Not so good: Texts blocks are crowded.
  • Comment: Well done!

User 3: Professional Student C

  • Thoughts: Good pixel style background.
  • Like: A suitable background and the font.
  • Not so good: The layout is improvable.
  • Suggestion: Nothing to improve.

User 4: Professional Student D

  • Thoughts: Yes, that's what I expected.
  • Like: New background and font is great.
  • Not so good: Too many words are squeezed together.
  • Suggestion: Good job, everything is finished.

System Usability Scale Evaluation

SUS Template

Template

Participant 1

GT1

Participant 2

GT2

Participant 3

GT3

Participant 4

GT4

Brief Analysis

  • In terms of the details:

Q1: All 4 evaluators choose Strongly Agree.

Q2: There are 1 of 4 evaluators who choose Strongly Agree, 2 choose Agree and 1 chooses Netural.

Q3: There are 1 of 4 evaluators who choose Strongly Agree, 1 chooses Agree and 2 choose Netural.

Q4: All 4 evaluators choose Strongly Agree.

Q5: There are 1 of 4 evaluators who choose Strongly Agree and 3 choose Agree.

Q6: There are 2 of 4 evaluators who choose Strongly Agree, 1 choose Agree and 2 choose Netural.

  • Most evaluators found this change necessary and evident to notice.
  • All evaluators strongly agree that this change is aesthetically beautiful.
  • All evaluators strongly agree that this change closer cooperate with the game's emotional goal, probably because we use pixel style fonts and background.

Sprint4 Version Summary

  • Thanks for all the valuable feedback from participants, their suggestions have made a huge contribution to the development of this feature.
  • The additional System Usability Scale evaluation helps us better understand how our users enjoy the design.
  • Participants are pretty satisfied with the new background and the new font style which is great and that's what we planned to do for this sprint. In other words, we successfully achieved the goal for the sprint.
  • As this is the last Sprint of the course, there will be no further refinement. This user testing evaluation is set to make sure the improvement we have done so far is on the right track.