How to customize the prompt - UNC-Project-Open-AAC/OS-DPI GitHub Wiki

To make it easier for researchers to test custom prompts, the frontend allows users to input their own prompts by updating the Excel file. While we provide default prompts that have been sufficient for our use cases, users are encouraged to experiment with their own.

Here are the default prompts:

Task Generate Default Prompt
Text Keyword What are 10 words related to the keyword?
Text Utterance Use all keywords provided to complete 6 grammatically correct comments/questions. Make the utterances about five words in length.
Image Keyword What are 10 words related to the image?
Image Utterance Generate 6 conversational comments/questions according to the theme of the image.

Step 1. Make sure the Socket Handler has the Filters section

  • Filters: Field - #sheetName, Operator - equals, Value - 'prompts'
  • If there is no Socket Handler under Methods, please see the wiki page How to connect the backend.

Step 2. Save sheet or Download sheet(Excel)

Step 3. Modify the prompt field in the latest row of the prompts spreadsheet (yellow cell)

  • The latest prompt contains the prompt you want to experiment with. The backend model will use this prompt to generate keywords or utterances.
  • The v1/v2 prompt stores previous prompts you've tested and wish to preserve for research purposes.
  • The default prompt represents the default prompt currently used by the model.

Step 4. Load sheet

Step 5. Enter a keyword or an image to test the new prompt!

  • Repeat step 3-5 to test the prompt!
  • If you want to know how to interact with the AI-plugin features, please see the wiki page How to interact with the plugins.