components llm_rag_validate_deployments - Azure/azureml-assets GitHub Wiki
Validates that completion model, embedding model, and Azure Cognitive Search resource deployments is successful and connections works. For default AOAI, it attempts to create the deployments if not valid or present. This validation is done only if customer is using Azure Open AI models or creating an ACS index.
Version: 0.0.80
Preview
View in Studio: https://ml.azure.com/registries/azureml/components/llm_rag_validate_deployments/version/0.0.80
Name | Description | Type | Default | Optional | Enum |
---|---|---|---|---|---|
embeddings_model | The model to use to embed data. E.g. 'hugging_face://model/sentence-transformers/all-mpnet-base-v2' or 'azure_open_ai://deployment/{deployment_name}/model/{model_name}' | string | False | ||
embeddings_connection | The connection id of the Embeddings Model provider to use. | string | True | ||
llm_config | JSON Configuration for what model to use for question generation. Must contain following keys: 'type' (value must be 'azure_open_ai' or 'azure'), 'model_name' (name of model to use for summary), 'deployment_name' (name of deployment for model), 'temperature' (randomness in response, float from 0 to 1), 'max_tokens' (number of tokens for response). | string | {"type": "azure_open_ai", "model_name": "gpt-35-turbo", "deployment_name": "gpt-35-turbo", "temperature": 0, "max_tokens": 2000} | True | |
llm_connection | string | True | |||
acs_config | JSON string containing the ACS configuration. e.g. {"index_name": "my-index"} | string | True | ||
index_connection | The connection id of the ACS provider to use. | string | True |
Name | Description | Type |
---|---|---|
output_data | uri_file |
azureml:llm-rag-embeddings@latest