20240904 1800 disclosure navigation longer after keys - bocoup/aria-at-gh-actions-helper GitHub Wiki

[email protected] stress-test node --loader ts-node/esm stress-test.mts

(node:33186) ExperimentalWarning: --experimental-loader may be removed in the future; instead use register(): --import 'data:text/javascript,import { register } from "node:module"; import { pathToFileURL } from "node:url"; register("ts-node/esm", pathToFileURL("./"));' (Use node --trace-warnings ... to show where the warning was created) Test Plans: [ 'tests/disclosure-navigation' ] Testing Matrix: [ { workflowId: 'voiceover-test.yml', browsers: [ 'safari', 'chrome', 'firefox' ] } ] Will dispatch 3 test combinations 5 times, for a total of 15 workflow runs. Local server started at port 8888 Ngrok tunnel started at https://c901-107-184-56-99.ngrok-free.app

Test plan: tests/disclosure-navigation

Summary

  • voiceover-test.yml + safari
    • Unequal responses between all 5 runs: 25.33%
  • voiceover-test.yml + chrome
    • Unequal responses between all 5 runs: 28.00%
  • voiceover-test.yml + firefox
    • Unequal responses between all 5 runs: 25.33%

voiceover-test.yml / firefox.

Stats

  • Total Rows: 75
  • Percentage Unequal: 25.33%

TestId 3

Comparison

Mythical University
            navigation
 list 3 items
About
              collapsed             button             1 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #0
- Expected
+ Received

  Array [
    "Mythical University
-             navigation
   list 3 items
  About
                collapsed             button             1 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]
Run #4
- Expected
+ Received

  Array [
    "Mythical University
-             navigation
   list 3 items
  About
                collapsed             button             1 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 6

Comparison

 end of
 end of list
Academics
              collapsed             button             3 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed. ,About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #2
- Expected
+ Received

  Array [
    " end of
+             Mythical University
   end of list
  Academics
                collapsed             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 9

Comparison

Mythical University
 list 3 items
About
              expanded             button             1 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              expanded             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #0
- Expected
+ Received

  Array [
    "Mythical University
+             navigation
   list 3 items
  About
                expanded             button             1 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                expanded             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
  About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
  About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]
Run #1
- Expected
+ Received

  Array [
    "Mythical University
+             navigation
   list 3 items
  About
                expanded             button             1 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                expanded             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
  About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
  About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 12

Comparison

 end of
 end of list
Academics
              expanded             button             3 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed. ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed.

Deviances

Run #0
- Expected
+ Received

  Array [
    " end of
+             Mythical University
   end of list
  Academics
                expanded             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
  ]
Run #4
- Expected
+ Received

  Array [
    " end of
   end of list
  Academics
                expanded             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
-   "Run Test Setup
-               dimmed             button
- You are currently on a button. This item is dimmed. ",
+   "Form element not found",
  ]

TestId 35

Comparison

About
              collapsed             button             is in the VoiceOver cursor             ,About
              collapsed             button             has keyboard focus

Deviances

TestId 38

Comparison

About
              expanded             button             is in the VoiceOver cursor             ,About
              expanded             button             has keyboard focus

Deviances

Run #1
- Expected
+ Received

  Array [
    "About
-               expanded             button             is in the VoiceOver cursor             ",
+               collapsed             button             is in the VoiceOver cursor             ",
    "About
                expanded             button             has keyboard focus              ",
  ]

TestId 41

Comparison

About
About
              expanded             button ,About
About
              expanded             button ,About
About
              expanded             button

Deviances

Run #0
- Expected
+ Received

  Array [
    "About
  About
                expanded             button ",
-   "About
- About
-               expanded             button ",
+   "",
    "About
  About
                expanded             button ",
  ]

TestId 44

Comparison

About
About
              collapsed             button ,About
About
              collapsed             button ,About
About
              collapsed             button

Deviances

Run #1
- Expected
+ Received

  Array [
    "About
  About
                collapsed             button ",
-   "About
- About
-               collapsed             button ",
+   "",
    "About
  About
                collapsed             button ",
  ]

TestId 47

Comparison

 list 4 items             level 2
link
              Overview
            1 of 4
You are currently on a link. To click this link, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,,
About
              collapsed             button
You are currently on a button. This item is dimmed. ,link
              Overview
            list 4 items             level 2
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

TestId 50

Comparison

 list 4 items             level 2
current page             link
              Overview
            1 of 4
You are currently on a link. To click this link, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,,
About
              collapsed             button
You are currently on a button. This item is dimmed. ,current page             link
              Overview
            list 4 items             level 2
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

Run #4
- Expected
+ Received

  Array [
-   " list 4 items             level 2
- current page             link
-               Overview
-             1 of 4
- You are currently on a link. To click this link, press Control            -Option            -Space. ",
+   "Admissions
+               collapsed             button             2 of 3
+ Academics
+               collapsed             button             3 of 3
+ You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    ",
  About
                collapsed             button
  You are currently on a button. This item is dimmed. ",
    "current page             link
                Overview
              list 4 items             level 2
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
  ]

TestId 53

Comparison

Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,list 4 items             level 2
About
              expanded             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #0
- Expected
+ Received

  Array [
-   "Admissions
-               collapsed             button
- You are currently on a button. To click this button, press Control            -Option            -Space. ",
+   "Button not found",
    "list 4 items             level 2
  About
                expanded             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 56

Comparison

About
list 3 items
You are currently on a list. To move between items in this list, press Control            -Option            -Right Arrow or Control            -Option            -Left Arrow. ,Academics
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,  Navigate backwards from here
            link
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

Run #3
- Expected
+ Received

  Array [
-   "About
- list 3 items
- You are currently on a list. To move between items in this list, press Control            -Option            -Right Arrow or Control            -Option            -Left Arrow. ",
+   " end of list             1 of 3
+ link
+               Campus Tours
+             4 of 4
+ You are currently on a link. To click this link, press Control            -Option            -Space. ",
    "Academics
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "  Navigate backwards from here
              link
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
  ]
Run #4
- Expected
+ Received

  Array [
-   "About
- list 3 items
- You are currently on a list. To move between items in this list, press Control            -Option            -Right Arrow or Control            -Option            -Left Arrow. ",
+   " end of list             1 of 3
+ link
+               Campus Tours
+             4 of 4
+ You are currently on a link. To click this link, press Control            -Option            -Space. ",
    "Academics
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
-   "  Navigate backwards from here
-             link
- You are currently on a link. To click this link, press Control            -Option            -Space. ",
+   "Link not found",
  ]

TestId 59

Comparison

end of list
Admissions
              collapsed             button             2 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #2
- Expected
+ Received

  Array [
    "end of list
  Admissions
                collapsed             button             2 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
-   "Admissions
-               collapsed             button             list 3 items
+   "Academics
+               collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 62

Comparison

About
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #1
- Expected
+ Received

  Array [
    "About
+ About
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 65

Comparison

,main
            Mythical University sample page content
            region
You are currently on a region.

Deviances

Run #0
- Expected
+ Received

  Array [
    "",
-   "main
-             Mythical University sample page content
-             region
- You are currently on a region. ",
+   "About
+ About
+               expanded             button ",
  ]
Run #2
- Expected
+ Received

  Array [
    "",
-   "main
-             Mythical University sample page content
-             region
- You are currently on a region. ",
+   "",
  ]
Run #4
- Expected
+ Received

  Array [
    "",
-   "main
-             Mythical University sample page content
-             region
- You are currently on a region. ",
+   "About
+ About
+               expanded             button ",
  ]

voiceover-test.yml / safari.

Stats

  • Total Rows: 75
  • Percentage Unequal: 25.33%

TestId 3

Comparison

Mythical University
 list 3 items
About
              collapsed             button             1 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

TestId 6

Comparison

 end of
 end of list
Academics
              collapsed             button             3 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed. ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed.

Deviances

Run #2
- Expected
+ Received

  Array [
    " end of
   end of list
  Academics
                collapsed             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
-   "Run Test Setup
-               dimmed             button
- You are currently on a button. This item is dimmed. ",
+   "About
+               collapsed             button
+ You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]
Run #4
- Expected
+ Received

  Array [
    " end of
+             Mythical University
   end of list
  Academics
                collapsed             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
-   "Run Test Setup
-               dimmed             button
- You are currently on a button. This item is dimmed. ",
+   "About
+               collapsed             button
+ You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 9

Comparison

Mythical University
 list 3 items
About
              expanded             button             1 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              expanded             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

TestId 12

Comparison

 end of
 end of list
Academics
              expanded             button             3 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed. ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed.

Deviances

Run #1
- Expected
+ Received

  Array [
    " end of
   end of list
  Academics
                expanded             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
-   "Run Test Setup
-               dimmed             button
- You are currently on a button. This item is dimmed. ",
-   "Run Test Setup
-               dimmed             button
- You are currently on a button. This item is dimmed. ",
+   "Button not found",
+   "Form element not found",
  ]
Run #2
- Expected
+ Received

  Array [
    " end of
+             Mythical University
   end of list
  Academics
                expanded             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
  ]
Run #3
- Expected
+ Received

  Array [
    " end of
+             Mythical University
   end of list
  Academics
                expanded             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
-   "Run Test Setup
-               dimmed             button
- You are currently on a button. This item is dimmed. ",
+   "Form element not found",
  ]
Run #4
- Expected
+ Received

  Array [
    " end of
   end of list
  Academics
                expanded             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
-   "Run Test Setup
-               dimmed             button
- You are currently on a button. This item is dimmed. ",
+   "Button not found",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
  ]

TestId 35

Comparison

About
              collapsed             button             is in the VoiceOver cursor             ,About
              collapsed             button             has keyboard focus

Deviances

TestId 38

Comparison

About
              expanded             button             is in the VoiceOver cursor             ,About
              expanded             button             has keyboard focus

Deviances

Run #0
- Expected
+ Received

  Array [
    "About
-               expanded             button             is in the VoiceOver cursor             ",
+               collapsed             button             is in the VoiceOver cursor             ",
    "About
                expanded             button             has keyboard focus              ",
  ]
Run #3
- Expected
+ Received

  Array [
    "About
-               expanded             button             is in the VoiceOver cursor             ",
+               collapsed             button             is in the VoiceOver cursor             ",
    "About
                expanded             button             has keyboard focus              ",
  ]

TestId 41

Comparison

About
About
              expanded             button ,About
About
              expanded             button ,About
About
              expanded             button

Deviances

Run #3
- Expected
+ Received

  Array [
    "About
  About
                expanded             button ",
-   "About
- About
-               expanded             button ",
+   "",
    "About
  About
                expanded             button ",
  ]

TestId 44

Comparison

About
About
              collapsed             button ,About
About
              collapsed             button ,About
About
              collapsed             button

Deviances

Run #0
- Expected
+ Received

  Array [
    "About
  About
-               collapsed             button ",
+               expanded             button ",
    "About
  About
                collapsed             button ",
    "About
  About
                collapsed             button ",
  ]

TestId 47

Comparison

 list 4 items             level 2
link
              Overview
            1 of 4
You are currently on a link. To click this link, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,,
About
              collapsed             button
You are currently on a button. This item is dimmed. ,link
              Overview
            list 4 items             level 2
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

Run #1
- Expected
+ Received

  Array [
    " list 4 items             level 2
  link
                Overview
              1 of 4
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
-   ",
- About
-               collapsed             button
- You are currently on a button. This item is dimmed. ",
+   "  Navigate backwards from here
+             link
+ You are currently on a link. To click this link, press Control            -Option            -Space. ",
    "link
                Overview
              list 4 items             level 2
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
  ]

TestId 50

Comparison

 list 4 items             level 2
current page             link
              Overview
            1 of 4
You are currently on a link. To click this link, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,,
About
              collapsed             button
You are currently on a button. This item is dimmed. ,current page             link
              Overview
            list 4 items             level 2
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

Run #0
- Expected
+ Received

  Array [
-   " list 4 items             level 2
- current page             link
-               Overview
-             1 of 4
- You are currently on a link. To click this link, press Control            -Option            -Space. ",
+   "Admissions
+ Academics
+               collapsed             button             3 of 3
+ You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    ",
  About
                collapsed             button
  You are currently on a button. This item is dimmed. ",
    "current page             link
                Overview
              list 4 items             level 2
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
  ]
Run #4
- Expected
+ Received

  Array [
-   " list 4 items             level 2
- current page             link
-               Overview
-             1 of 4
- You are currently on a link. To click this link, press Control            -Option            -Space. ",
+   "Admissions
+ Academics
+               collapsed             button             3 of 3
+ You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    ",
  About
                collapsed             button
  You are currently on a button. This item is dimmed. ",
    "current page             link
                Overview
              list 4 items             level 2
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
  ]

TestId 53

Comparison

Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,list 4 items             level 2
About
              expanded             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #1
- Expected
+ Received

  Array [
-   "Admissions
-               collapsed             button
- You are currently on a button. To click this button, press Control            -Option            -Space. ",
+   "Last button
+             Run Test Setup
+               dimmed             button",
    "list 4 items             level 2
  About
                expanded             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 56

Comparison

About
list 3 items
You are currently on a list. To move between items in this list, press Control            -Option            -Right Arrow or Control            -Option            -Left Arrow. ,Academics
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,  Navigate backwards from here
            link
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

Run #4
- Expected
+ Received

  Array [
-   "About
- list 3 items
- You are currently on a list. To move between items in this list, press Control            -Option            -Right Arrow or Control            -Option            -Left Arrow. ",
+   " end of list             1 of 3
+ link
+               Campus Tours
+             4 of 4
+ You are currently on a link. To click this link, press Control            -Option            -Space. ",
    "Academics
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "  Navigate backwards from here
              link
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
  ]

TestId 59

Comparison

end of list
Admissions
              collapsed             button             2 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #0
- Expected
+ Received

  Array [
    "end of list
  Admissions
                collapsed             button             2 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
-   "Admissions
-               collapsed             button             list 3 items
+   "Academics
+               collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 62

Comparison

About
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #4
- Expected
+ Received

  Array [
    "About
-               collapsed             button             list 3 items
+ About
+ About
+               collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 65

Comparison

,main
            Mythical University sample page content
            region
You are currently on a region.

Deviances

Run #1
- Expected
+ Received

  Array [
    "",
-   "main
-             Mythical University sample page content
-             region
- You are currently on a region. ",
+   "About
+ About
+               expanded             button ",
  ]
Run #4
- Expected
+ Received

  Array [
-   "",
+   "About
+ About
+               expanded             button ",
    "main
              Mythical University sample page content
              region
  You are currently on a region. ",
  ]

voiceover-test.yml / chrome.

Stats

  • Total Rows: 75
  • Percentage Unequal: 28.00%

TestId 3

Comparison

Mythical University
 list 3 items
About
              collapsed             button             1 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #2
- Expected
+ Received

  Array [
    "Mythical University
+             navigation
   list 3 items
  About
                collapsed             button             1 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]
Run #3
- Expected
+ Received

  Array [
    "Mythical University
+             navigation
   list 3 items
  About
                collapsed             button             1 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 6

Comparison

 end of
            Mythical University
 end of list
Academics
              collapsed             button             3 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed. ,About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #0
- Expected
+ Received

  Array [
    " end of
-             Mythical University
   end of list
  Academics
                collapsed             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
    "About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]
Run #1
- Expected
+ Received

  Array [
    " end of
-             Mythical University
   end of list
  Academics
                collapsed             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
-   "About
-               collapsed             button
- You are currently on a button. To click this button, press Control            -Option            -Space. ",
+   "Run Test Setup
+               dimmed             button
+ You are currently on a button. This item is dimmed. ",
  ]
Run #4
- Expected
+ Received

  Array [
    " end of
-             Mythical University
   end of list
  Academics
                collapsed             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
-   "About
-               collapsed             button
- You are currently on a button. To click this button, press Control            -Option            -Space. ",
+   "Run Test Setup
+               dimmed             button
+ You are currently on a button. This item is dimmed. ",
  ]

TestId 9

Comparison

Mythical University
            navigation
 list 3 items
About
              expanded             button             1 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
              expanded             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,About
About
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #1
- Expected
+ Received

  Array [
    "Mythical University
-             navigation
   list 3 items
  About
                expanded             button             1 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
                expanded             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
  About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
-   "About
- About
-               collapsed             button
- You are currently on a button. To click this button, press Control            -Option            -Space. ",
+   "Button not found",
  ]
Run #4
- Expected
+ Received

  Array [
    "Mythical University
-             navigation
   list 3 items
  About
                expanded             button             1 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
-               expanded             button             list 3 items
+               collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
  About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "About
  About
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 12

Comparison

 end of
 end of list
Academics
              expanded             button             3 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed. ,Run Test Setup
              dimmed             button
You are currently on a button. This item is dimmed.

Deviances

Run #0
- Expected
+ Received

  Array [
    " end of
   end of list
  Academics
                expanded             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
-   "Run Test Setup
-               dimmed             button
- You are currently on a button. This item is dimmed. ",
+   "Form element not found",
  ]
Run #4
- Expected
+ Received

  Array [
    " end of
+             Mythical University
   end of list
  Academics
                expanded             button             3 of 3
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Leaving Example Disclosure Navigation Menu. Entering toolbar.               show sidebar             button
  Show sidebar             You are currently on a button, inside of a toolbar. To click this button, press Control            -Option            -Space. To navigate items on this toolbar, press Control            -Option, and then Up Arrow, Down Arrow, Left Arrow, or Right Arrow. To exit this toolbar, press Control            -Option            -Shift            -Up Arrow.               ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
    "Run Test Setup
                dimmed             button
  You are currently on a button. This item is dimmed. ",
  ]

TestId 35

Comparison

About
              collapsed             button             is in the VoiceOver cursor             ,About
              collapsed             button             has keyboard focus

Deviances

TestId 38

Comparison

About
              expanded             button             is in the VoiceOver cursor             ,About
              expanded             button             has keyboard focus

Deviances

Run #0
- Expected
+ Received

  Array [
    "About
-               expanded             button             is in the VoiceOver cursor             ",
+               collapsed             button             is in the VoiceOver cursor             ",
    "About
                expanded             button             has keyboard focus              ",
  ]
Run #1
- Expected
+ Received

  Array [
    "About
-               expanded             button             is in the VoiceOver cursor             ",
+               collapsed             button             is in the VoiceOver cursor             ",
    "About
                expanded             button             has keyboard focus              ",
  ]

TestId 41

Comparison

About
About
              expanded             button ,About
About
              expanded             button ,About
About
              expanded             button

Deviances

Run #0
- Expected
+ Received

  Array [
    "About
  About
                expanded             button ",
    "About
  About
                expanded             button ",
-   "About
- About
-               expanded             button ",
+   "",
  ]

TestId 44

Comparison

About
About
              collapsed             button ,About
About
              collapsed             button ,About
About
              collapsed             button

Deviances

Run #4
- Expected
+ Received

  Array [
    "About
  About
-               collapsed             button ",
+               expanded             button ",
    "About
  About
                collapsed             button ",
    "About
  About
                collapsed             button ",
  ]

TestId 47

Comparison

 list 4 items             level 2
link
              Overview
            1 of 4
You are currently on a link. To click this link, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,,
About
              collapsed             button
You are currently on a button. This item is dimmed. ,link
              Overview
            list 4 items             level 2
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

TestId 50

Comparison

 list 4 items             level 2
current page             link
              Overview
            1 of 4
You are currently on a link. To click this link, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,,
About
              collapsed             button
You are currently on a button. This item is dimmed. ,current page             link
              Overview
            list 4 items             level 2
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

Run #1
- Expected
+ Received

  Array [
-   " list 4 items             level 2
- current page             link
-               Overview
-             1 of 4
- You are currently on a link. To click this link, press Control            -Option            -Space. ",
+   "Admissions
+               collapsed             button             2 of 3
+ Academics
+               collapsed             button             3 of 3
+ You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    ",
  About
                collapsed             button
  You are currently on a button. This item is dimmed. ",
    "current page             link
                Overview
              list 4 items             level 2
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
  ]
Run #3
- Expected
+ Received

  Array [
-   " list 4 items             level 2
- current page             link
-               Overview
-             1 of 4
- You are currently on a link. To click this link, press Control            -Option            -Space. ",
+   "Admissions
+ Academics
+               collapsed             button             3 of 3
+ You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    ",
  About
                collapsed             button
  You are currently on a button. This item is dimmed. ",
    "current page             link
                Overview
              list 4 items             level 2
  You are currently on a link. To click this link, press Control            -Option            -Space. ",
  ]

TestId 53

Comparison

Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,list 4 items             level 2
About
              expanded             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

TestId 56

Comparison

 end of list             1 of 3
link
              Campus Tours
            4 of 4
You are currently on a link. To click this link, press Control            -Option            -Space. ,Academics
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,  Navigate backwards from here
            link
You are currently on a link. To click this link, press Control            -Option            -Space.

Deviances

TestId 59

Comparison

end of list
Admissions
              collapsed             button             2 of 3
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space. ,Admissions
              collapsed             button
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #0
- Expected
+ Received

  Array [
-   "end of list
- Admissions
-               collapsed             button             2 of 3
- You are currently on a button. To click this button, press Control            -Option            -Space. ",
+   "heading level 1
+ The following example demonstrates using the
+ You are currently on a selectable text. ",
    "Admissions
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]
Run #2
- Expected
+ Received

  Array [
-   "end of list
- Admissions
-               collapsed             button             2 of 3
- You are currently on a button. To click this button, press Control            -Option            -Space. ",
+   "end of             main ",
    "Admissions
                collapsed             button             list 3 items
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
    "Admissions
                collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 62

Comparison

About
              collapsed             button             list 3 items
You are currently on a button. To click this button, press Control            -Option            -Space.

Deviances

Run #0
- Expected
+ Received

  Array [
    "About
-               collapsed             button             list 3 items
+ About
+ About
+               collapsed             button
  You are currently on a button. To click this button, press Control            -Option            -Space. ",
  ]

TestId 65

Comparison

,main
            Mythical University sample page content
            region
You are currently on a region.

Deviances

Run #0
- Expected
+ Received

  Array [
    "",
-   "main
-             Mythical University sample page content
-             region
- You are currently on a region. ",
+   "About
+ About
+               expanded             button ",
  ]
Run #2
- Expected
+ Received

  Array [
-   "",
+   "About
+ About
+               expanded             button ",
    "main
              Mythical University sample page content
              region
  You are currently on a region. ",
  ]
Run #4
- Expected
+ Received

  Array [
    "",
-   "main
-             Mythical University sample page content
-             region
- You are currently on a region. ",
+   "",
  ]
⚠️ **GitHub.com Fallback** ⚠️