Test Framework - smathersgit/scottish-football-league-info GitHub Wiki

UITest

The Xamarin.UITest C# testing framework shall be used to test the App's functionality on a number of targeted Android devices. Some preliminary test cases have been successfully executed locally using this framework via Visual Studio's Test Explorer.

Python scripts are used to convert an OpenDocument Spreadsheet based information source into the SQLite database used by the App. A number of interim CSV and SQL files are created during this conversion process. To mitigate for regressions, a golden reference set of these files is being maintained in the code base. Newly generated CSV & SQL files are therefore compared against the golden reference files, using KDiff3, as an integrity check after any script change is made. Pylint is also run on the script files and a score of 10.0 made mandatory prior to any submission.

Local Testing

Tests shall be run locally using real Android phones or emulated devices created using the Android Device Manager. Skins shall be used where possible such as from the Samsung Developers website.

Cloud Based Testing

There is a potential to also run the test cases on a selection of real Android devices in the Visual Studio App Center. This capability has still to be trialled.