models qna with your own data using faiss index - Azure/azureml-assets GitHub Wiki
The "QnA with Your Own Data Using Faiss Index" is a Q&A model with GPT3.5 using information from vector search to make the answer more grounded. It involves embedding user's question with LLM, and then using Faiss Index Lookup to find relevant documents based on vectors. By utilizing vector search, users can incorporate their domain knowledge into the prompts, leading to more accurate and relevant answers. The model then uses GPT3.5 to generate an answer to the question with the documents as augmented prompt.
Inference type | CLI | VS Code Extension |
---|---|---|
Real time | deploy-promptflow-model-cli-example | deploy-promptflow-model-vscode-extension-example |
Batch | N/A | N/A |
{
"inputs": {
"question": "What's AML SDK V2? Should I use V1 or V2?"
}
}
{
"outputs": {
"output": "Using the additional knowledge provided in the prompt, Azure Machine Learning (AML) SDK v2 is a tool that allows you to build a single command or a chain of commands like Python functions. It is useful for constructing workflows, moving from simple to complex concepts incrementally, and managing reusable components in pipelines. It also offers endpoints to streamline model deployments for both real-time and batch inference deployments. In terms of whether to use v1 or v2, it depends on your needs. If you have significant investments in Python SDK v1 and don't need any new features offered by SDK v2, you can continue to use SDK v1. However, you should consider using SDK v2 if you want to use new features like reusable components, managed inferencing, and if you're starting a new workflow or pipeline. All new features and future investments will be introduced in v2. Additionally, SDK v2 offers improved usability, including the ability to compose jobs and pipelines using Python functions and easy evolution from simple to complex tasks. SOURCES: https://learn.microsoft.com/en-us/azure/machine-learning/concept-v2"
}
}
Version: 4
hiddenlayerscanned
View in Studio: https://ml.azure.com/registries/azureml/models/qna-with-your-own-data-using-faiss-index/version/4
is-promptflow: True
azureml.promptflow.section: gallery
azureml.promptflow.type: standard
azureml.promptflow.name: QnA with Your Own Data Using Faiss Index
azureml.promptflow.description: Q&A with GPT3.5 using domain knowledge from Faiss index to make the answer more grounded.
inference-min-sku-spec: 2|0|14|28
inference-recommended-sku: Standard_DS3_v2