2. Usability Testing - frk2689/UXDM-AVRP-VRgardening GitHub Wiki

User Study

12/08/2021

Questions:

  • What does the user like/dislike?
  • What should be changed and why?
  • How interactable is the prototype?
  • Does it work as expected?

Method

  • task-based observation with think aloud
  • task: Make the plant (we show you) grow.
  • qualitative measures: gestures, expressions, comments, mood
  • quantitative measures: completion time of tasks
  • Post-task-questionnaire UEQ short

Evaluation

  • 4 participants (3 female, 1 male)
  • average age: 25

Likes

  • VR environment: low poly style, the night scene, campfire vibe, glowing flowers
  • simplicity of usage
  • fun game concept
  • walking using the thumbstick because the world is big
  • walk around and watch landscape

Dislikes

  • starting point (didn't see the bucket, went to the river to get water)
  • watering can is pouring too early and when tipped to the side/backwards
  • walking is too fast
  • animation too fast, not possible to watch plant grow
  • watering can fell down, not possible to pick it up again

Suggestions

  • adding animals that players can interact with
  • more plants with a slower growing animation

Interaction

interaction working as expected

UEQs

Both pragmatic and hedonic quality have been evaluated as positive. The prototype was described as conventional and usual and not especially inventive. UEQs

Compared to the benchmark, the evaluation is in the positive range, however, due to the very small sample size these results can't be used to represent the true usability of the prototype. UEQ benchmark

Observation

observation table
Estimated completion time: 20 seconds
Average completion time: 36,75 seconds

Main Findings

findings1


findings 2


findings3

Next Steps

  • add different seeds that players can plant and grow different color flowers
  • add pots where flowers can be planted (pots would serve as an affordance and help users realize where they can plant the seeds without providing written instructions)
  • add relaxing nature ambient sounds
  • add another feature that will interest users in exploring the whole map (e.g. search for animals or hidden objects)
  • add an option to toggle between day and night scene
  • add animals to interact with
  • improve grab of watering can
  • improve walking mechanics

Applied Changes

Added features

  • different seeds -> now players can plant and grow different color flowers
  • planting pots -> they act as affordances where flowers can be planted
  • relaxing nature ambient sounds -> for a more immersive experience
  • a night and day toggle -> now players can switch between night and day scene, since the night scene was very popular
  • a squirrel which can be watched and petted -> with further development, players will be able to interact with wild animals

Optimized features

  • optimized collider from the watering can -> now the watering can is easier to grab
  • optimized colliders from the tree stump and the table -> now the player is able to walk closer to the table and tree stump
⚠️ **GitHub.com Fallback** ⚠️