models bring your own data chat qna - Azure/azureml-assets GitHub Wiki
The "Bring Your Own Data Chat QnA" is a pre-trained chat model, enhanced by GPT3.5, that leverages your personally indexed data and chat history to deliver more concrete and relevant answers. It involves processing the raw query through an embedding procedure, followed by a "Vector Search" to pinpoint the most pertinent context within the user's data. Subsequently, GPT3.5 is employed to generate a comprehensive answer to the question using the sourced documents.
Inference type | CLI | VS Code Extension |
---|---|---|
Real time | deploy-promptflow-model-cli-example | deploy-promptflow-model-vscode-extension-example |
Batch | N/A | N/A |
{
"inputs": {
"question": "What is Azure compute instance?"
}
}
{
"outputs": {
"answer": "An Azure Machine Learning compute instance is a fully managed cloud-based workstation for data scientists. It provides a pre-configured and managed development environment in the cloud for machine learning. Compute instances can also be used as a compute target for training and inferencing for development and testing purposes. They have a job queue, run jobs securely in a virtual network environment, and can run multiple small jobs in parallel. Additionally, compute instances support single-node multi-GPU distributed training jobs."
}
}
Version: 7
View in Studio: https://ml.azure.com/registries/azureml/models/bring-your-own-data-chat-qna/version/7
is-promptflow: True
azureml.promptflow.section: gallery
azureml.promptflow.type: chat
azureml.promptflow.name: Multi-Round Q&A on Your Data
azureml.promptflow.description: Create a chatbot that uses LLM and data from your own indexed files to ground multi-round question and answering capabilities in enterprise chat scenarios.
inference-min-sku-spec: 2|0|14|28
inference-recommended-sku: Standard_DS3_v2