Results v3 - RodentDataAnalytics/mwm-ml-gen GitHub Wiki

This section will focus only on the results generated by pressing the buttons of the Results panel of the main menu.

Contents

  1. Demo
  2. Metrics
  3. Strategies
  4. Transitions
  5. Probabilities
  6. Class Statistics
  7. The Friedman Test
  8. Other Results

Demo

The demo button runs a full analysis using the original rat data from EPFL (see Vouros et al.).

Metrics

Generates three figures showing the (a) the escape latency; (b) the average movement speed and (c) the average path length of the animals over the trials for one or two animal groups. Requires a default segmentation to be selected in order to run and in case more than one animal groups are specified then a dialog box with pop-up asking for which one or two groups the result will be generated. If two groups are provided then the white lines will refer to the first specified group and the black lines to the second. Moreover, in this case, the p-values of the Friedman test will be computed (see Friedman Test).

Any result will be saved on the results folder of the project inside a folder called metrics.

metrics

Strategies

Generates figures showing the average segment lengths for each strategy adopted by the animals. Requires a default segmentation and a default classification to be selected in order to run and in case more than one animal groups are specified then a dialog box with pop-up asking for which one or two groups the result will be generated. If two groups are provided then the white lines will refer to the first specified group and the black lines to the second. Moreover, in this case, the p-values of the Friedman test will be computed (see Friedman Test). This process will be repeated number of iterations times.

Any result will be saved on the results folder of the project inside a folder with name Strategies-class _ [number of labels] _ [number of segments] _ [segments length] _ [segments overlap] _ [number of classifiers used] _ [number of iterations] _ [merging rule] [optional: -user note]. This folder will contain a number of subfolders depending on the [number of iterations] used to generate the selected default classification named after g[animal group(s)]res_[x] ([x] equals 1 to [number of iterations]) and one more subfolder g[animal group(s)]res_summary. Each of these subfolders will contain the figures exported in image files (their format specified by the main menu options, the data of the figures exported in CSV-files (.csv) and a TEXT-file (.txt) containing the p-values of the Friedman test in case of two animal groups. Specifically the final 'summary' subfolder will contain the figures expressing the average of all the generated results, again exported in image files and their data saved in CSV-files (.csv), and in addition it will contain two more files: one CSV-file (.csv) containing a summary of all the p-values with an additional column having a score showing the agreement, and two figures, exported in image files, expressing the summary of all the p-values using a box plot.

strategies

Transitions

Generates a figure showing the number of transitions between strategies adopted by the animals over the trials. Requires a default segmentation and a default classification to be selected in order to run and in case more than one animal groups are specified then a dialog box with pop-up asking for which one or two groups the result will be generated. If two groups are provided then the white lines will refer to the first specified group and the black lines to the second. Moreover, in this case, the p-values of the Friedman test will be computed (see Friedman Test). This process will be repeated number of iterations times.

Any result will be saved on the results folder of the project inside a folder with name Transitions-class _ [number of labels] _ [number of segments] _ [segments length] _ [segments overlap] _ [number of classifiers used] _ [number of iterations] _ [merging rule] [optional: -user note]. This folder will contain a number of subfolders depending on the [number of iterations] used to generate the selected default classification named after g[animal group(s)]res_[x] ([x] equals 1 to [number of iterations]) and one more subfolder g[animal group(s)]res_summary. Each of these subfolders will contain a figure exported in image files (their format specified by the main menu options, the data of the figures exported in CSV-files (.csv) and a TEXT-file (.txt) containing the p-values of the Friedman test in case of two animal groups. Specifically the final 'summary' subfolder will contain the figures expressing the average of all the generated results, again exported in image files and their data saved in CSV-files (.csv), and in addition it will contain two more files: one CSV-file (.csv) containing a summary of all the p-values with an additional column having a score showing the agreement, and two figures, exported in image files, expressing the summary of all the p-values using a box plot.

transitions

Probabilities

Calculates the transition probabilities of strategies adopted by the animals within trials. Requires a default segmentation and a default classification to be selected in order to run and in case more than one animal groups are specified then a dialog box with pop-up asking for which one or two groups the result will be generated.

Any result will be saved on the results folder of the project inside a folder with name Transitions-class _ [number of labels] _ [number of segments] _ [segments length] _ [segments overlap] _ [number of classifiers used] _ [number of iterations] _ [merging rule] [optional: -user note]. This folder will contain a number of subfolders depending on the [number of iterations] used to generate the selected default classification named after g[animal group(s)]res_[x] ([x] equals 1 to [number of iterations]) and one more subfolder g[animal group(s)]res_summary. Each of these subfolders a TEXT-file (.txt) containing the results. The final 'summary' subfolder will contain the average results exported in a CSV-file (.csv).

probabilities

Class Statistics

Calculates the number of strategies detected by each merged classifier along with the average and computes the agreement between the merged classifiers. Requires a default segmentation and a default classification to be selected in order to run.

Generates two CSV-files (.csv) which holds the results, one contains numerical results and the other percentages. These files are generated inside the subfolder statistics-class _ [number of labels] _ [number of segments] _ [segments length] _ [segments overlap] _ [number of classifiers used] _ [number of iterations] _ [merging rule] [optional: -user note].

statistics

Moreover, it generates a series of CSV-files (.csv) which contain the agreement of each merged classifier with the other merged classifiers (results also exported in MAT-format (.mat)):

agreement

Finally an overall 'agreement matrix' of the classification agreement is generated and exported as an image file (multiple files may be generated each one holding a 10x10 grid of the overall matrix. In that case the 10x10 grid will move from up to down and from right to left), agreement _matix_icon1.[specified image format], a CSV-file (.csv), agreement _matrix.csv and a MAT-file (.mat), agreement _matrix.mat.

agreement matrix

The Friedman Test

In case two animal groups are specified with uneven number of animals then a some animals needs to be excluded from the group with the most animals in order for both groups to have the same number of animals. This is a requirement of the Friedman test. To discard animals the following window will appear:

equalize_groups

  1. Information on how many animals exist in each of the two specified groups and how many animals need to be removed from one of them in order for both groups to have the same number of animals.

  2. The left listbox lists all the animal ids of the group with the larger number of animals. Each of these ids can be selected and moved to the right listbox which will contain the excluded animals. The buttons => and <= are used to move the animal ids between the two listboxes. If the button => is greyed then no more animals may be excluded as the two groups are now having the same number of animals. If <= is greyed then the right listbox does not have any animal ids.

  3. In order to ease the exclusion process four sort buttons are placed which sort the animal ids by animal speed (Sort by Speed), animal path length (Sort by Path Length), animal latency (Sort by Latency) and animal id value (Sort by Value). The animals are always sorted in ascending order.

  4. After the appropriate number of animal ids has been reached the OK button will become clickable and pressing it would resume the program's result process. Clicking the Cancel button will return the main menu.

Other Results

  • The folder exported_pics_segmentation_[number] contains image files (.jpeg) of the segments exported via Browse Trajectories. Each file has a specific name traj[number].jpeg or traj[number]seg[number].jpeg showing the exact location of the trajectory or segment.

  • The folder labels _ [number of labels] _ [segments length] _ [segments overlap] _ cross _ validation contains the three figures of Labelling Quality and a CSV-file (.csv) containing the figures' values.