Reports in Shoonya - AI4Bharat/Shoonya GitHub Wiki

Hierarchical Reports

This section covers the various reports available in Shoonya at various levels. As of now, the available reports are :

Report Type Supported Levels
Annotator Organization Workspace Project
Reviewer Organization Workspace Project

Annotator Report

Field Field Definition
Annotator Username of the annotator
Email Email of the annotator
Assigned Number of tasks assigned to the annotator
Accepted Number of annotator's tasks under 'Accepted' status
Accepted With Major Changes Number of annotator's tasks under 'Accepted With Major Changes' status
Accepted With Minor Changes Number of annotator's tasks under 'Accepted With Minor Changes' status
Labeled Number of annotator's tasks under 'Labeled' status
To Be Revised Number of annotator's tasks under 'To Be Revised' status
Unlabeled Number of annotator's tasks under 'Unlabeled' status
Skipped Number of annotator's tasks under 'Skipped' status
Draft Number of annotator's tasks under 'Draft' status
Word Count Number of words translated by the annotator (Only for Translation Projects)
Total Audio Duration Total Duration of the audio files of all labeled tasks (Only for Audio Projects)
Avg Annotation Time (sec) The average time (in seconds) taken by the annotator to complete a single annotation

Reviewer Report

Field Field Definition
Reviewer Name Username of the reviewer
Email Email of the reviewer
Assigned Number of tasks assigned to the reviewer
Accepted Number of tasks accepted by the reviewer
Accepted With Minor Changes Number of tasks which has been accepted by the reviewer after making minor changes to the annotator's annotation
Accepted With Major Changes Number of tasks which has been accepted by the reviewer after making major changes to the annotator's annotation
Unreviewed Number of unreviewed tasks
Draft Number of tasks under draft status
Skipped Number of skipped tasks
To Be Revised Number of tasks the reviewer has placed under 'To Be Revised'

Analytic Reports

These are the reports expressed as Charts.

Selection Type Definitions Options
Analytics Type The variation in chart with respect to the number of selected time ranges. In 'Individual', chart for a single time range is displayed. In 'Comparison', two different charts can be compared based on the time ranges selected. Default selection is 'Individual'. Individual Comparison
Project Type Refer to this link for the project types MonolingualTranslation,TranslationEditing,SemanticTextualSimilarity_Scale5,ContextualTranslationEditing,OCRAnnotation,MonolingualCollection,SentenceSplitting,ContextualSentenceVerification,ContextualSentenceVerificationAndDomainClassification,ConversationTranslation,ConversationTranslationEditing,AudioTranscription,AudioSegmentation,AudioTranscriptionEditing
Base Period The time range selected for the first plot of the chart. The default selection is 'Cumalative' Cumulative Yearly Monthly Weekly
Comparison Period The time range selected for the second plot of the chart. This is applicable when the analytics type is 'Comparison'. Cumulative Yearly Monthly Weekly

Progress Analytics

This chart talks about the completed annotations by language. A sample chart is shown below :