models Deci DeciLM 7B instruct - Azure/azureml-assets GitHub Wiki

Deci-DeciLM-7B-instruct

Overview

DeciLM-7B-instruct is a model for short-form instruction following, built by LoRA fine-tuning on the SlimOrca dataset. It is a derivative of the recently released DeciLM-7B language model, a pre-trained, high-efficiency generative text model with 7 billion parameters. DeciLM-7B-instruct is one of the best 7B instruct models obtained using simple LoRA fine-tuning, without relying on preference optimization techniques such as RLHF and DPO. DeciLM-7B-instruct is intended for commercial and research use in English. However, like all large language models, its outputs are unpredictable and may generate responses that are inaccurate, biased, or otherwise objectionable. Developers planning to use DeciLM-7B-instruct should undertake thorough safety testing and tuning designed explicitly for their intended applications of the model before deployment.

Model Evaluation Sample

Task Use case Dataset Python sample (Notebook) CLI with YAML
Text generation Text generation cnn_dailymail evaluate-model-text-generation.ipynb evaluate-model-text-generation.yml

Inference samples

Inference type Python sample (Notebook) CLI with YAML
Real time text-generation-online-endpoint.ipynb text-generation-online-endpoint.sh
Batch text-generation-batch-endpoint.ipynb coming soon

Sample inputs and outputs (for real-time inference)

Sample input

{
  "input_data": {
    "input_string": [
      "How do I make the most delicious pancakes the world has ever tasted?"
    ],
    "parameters": {
      "top_p": 0.95,
      "temperature": 0.6,
      "max_new_tokens": 100,
      "do_sample": true
    }
  }
}

Sample output

[
  {
    "0": "How do I make the most delicious pancakes the world has ever tasted?\n\nAnswer: In a large bowl, whisk together the flour, sugar, baking powder, and salt. In a separate bowl, whisk together the milk, eggs, and melted butter. Pour the wet ingredients into the dry ingredients and stir until just combined. Add more milk if the batter seems too thick. Heat a non-stick pan or griddle over medium heat. Lightly grease the pan with butter or cooking spray. Pour about 1/4 cup of batter onto the"
  }
]

Version: 5

Tags

Featured inference_compute_allow_list : ['Standard_NC12s_v3', 'Standard_NC24s_v3', 'Standard_ND40rs_v2', 'Standard_ND96asr_v4', 'Standard_ND96amsr_A100_v4'] evaluation_compute_allow_list : ['Standard_NC12s_v3', 'Standard_NC24s_v3', 'Standard_ND40rs_v2', 'Standard_ND96asr_v4', 'Standard_ND96amsr_A100_v4'] SharedComputeCapacityEnabled task : text-generation hiddenlayerscanned license : apache-2.0 author : Deci AI huggingface_model_id : Deci/DeciLM-7B-instruct datasets : Open-Orca/SlimOrca

View in Studio: https://ml.azure.com/registries/azureml/models/Deci-DeciLM-7B-instruct/version/5

License: apache-2.0

Properties

SharedComputeCapacityEnabled: True

SHA: d4aa148911823924d7b91e36535260decb190179

inference-recommended-sku: Standard_NC12s_v3, Standard_NC24s_v3, Standard_ND40rs_v2, Standard_ND96asr_v4, Standard_ND96amsr_A100_v4

inference-min-sku-spec: 12|2|224|1474

evaluation-recommended-sku: Standard_NC12s_v3, Standard_NC24s_v3, Standard_ND40rs_v2, Standard_ND96asr_v4, Standard_ND96amsr_A100_v4

evaluation-min-sku-spec: 12|2|224|1474

languages: EN

⚠️ **GitHub.com Fallback** ⚠️