models Fluency Evaluator - Azure/azureml-assets GitHub Wiki
Score range | Integer [1-5]: 1 is the lowest quality and 5 is the highest quality. |
What is this metric? | Fluency measures the effectiveness and clarity of written communication, focusing on grammatical accuracy, vocabulary range, sentence complexity, coherence, and overall readability. It assesses how smoothly ideas are conveyed and how easily the text can be understood by the reader. |
How does it work? | The fluency metric is calculated by instructing a language model to follow the definition (in the description) and a set of grading rubrics, evaluate the user inputs, and output a score on a 5-point scale (higher means better quality). Learn more about our definition and grading rubrics. |
When to use it? | The recommended scenario is generative business writing such as summarizing meeting notes, creating marketing materials, and drafting email. |
What does it need as input? | Response |
Version: 5
hiddenlayerscanned
View in Studio: https://ml.azure.com/registries/azureml/models/Fluency-Evaluator/version/5
is-promptflow: True
is-evaluator: True
show-artifact: True
_default-display-file: ./FluencyEvaluator/fluency.prompty