Positioning Entries: The Scaffold - TravelingRobot/NAI_Community_Research GitHub Wiki

This page is outdated!

The research notes in here concern the Sigurd model. You are welcome to experiment with the ideas here, but it is unclear if this applies to newer models (e.g. Euterpe or Krake).

The current (May 2022) consensus is that positioning matters far less for Euterpe and Krake because both models are good at pulling information from the beginning of the context. That being said, a logical order of your information in context (say for example concepts first, then places, then characters) might help. But this is just speculation - not much research has been done on positioning entries.

Table of Contents

The Scaffold: Foundations
Explanation of the 2 Author's Notes
Example Context
Additional Tweak: Using ***
Scaffold with Custom Categories
Scaffold Version with Split Entries

The Scaffold: Foundations

The scaffold was designed by OPVAM's and is meant to be a guideline on what advanced settings you should set for each lore entry (and advanced context settings). To implement it, you do the following:

  1. Set the Advanced Context Settings for Story, Author's Note and Memory as specified in the scaffold then forget about them .. they never have to be touched again for this story.
    • Advanced Context Settings: Can be found in the right sidebar -> Story -> View Current Context (at the very bottom) -> Advanced Context Settings
  2. Every time you create a lore entry you go.. "Is this a Character? Then use the Lore: Characters advanced settings in the scaffold."
  • What the scaffold is trying to achieve is to insert the lore as close to the front/bottom of context as possible, but still allow the story some "breathing room" in between the lore.
  • Uses newline insertion
Position Priority Reserve Type
-12 -100 200 Memory
-10 -200 100 Lore: Concepts (multiple)
-10 -300 100 Lore: Places (multiple)
-10 -400 100 Lore: Races (multiple)
-10 -500 100 Lore: Factions (multiple)
-8 -600 200 Lore: Author's Note - General (Defined in Lore Book, forced activation)
-6 -700 100 Lore: Characters (multiple)
-4 -1000 - Lore: *** (forced activation; addition by Monkey & Kalmar see below)
-4 -800 200 Author's Note - Dynamic (Defined in Author's Note field)
0 0 512 Story

Note on token limit (ght901)

Just as a note for people using these settings. If you don't keep the tokens used by that Lorebook entry under the number of reserved tokens it will be almost guaranteed (there's a small chance the first might not) to be trimmed

Why are there 2 Author's Notes?

OPVAM had the idea to split up the Author's note into two entries:

  • Author's Note - General: The overall theme/structure to your story
  • Author's Note - Dynamic: Things you want to change as the story progresses

Example:

Original Author's Note:
[ Author's note: This is a story about the Game of Thrones. Writing Style: detailed, gritty. Setting: medieval. Theme: violence, gore. Rating: M.]

New Authors's Note - General (at insertion -8):
[ Author's note: This is a story about the Game of Thrones. Writing Style: detailed, gritty. Setting: medieval. Theme: gore.]

New Author's Note - Dynamic (at insertion -4, closer to front of context and thus more likely to be used by the AI):\

[ Author's note: In this scene Jon battles a White Walker]
[ Rating: M]
[ Theme: action]

Okay, but what does this actually do with the context?

here is an example output using some test lore:

(click to open larger version)

Additional Tweak: Seperate Lore from Story with *** (Monky & Kalmarr)

Forcing a *** might lead to less verbatim repetition from Lore entries. Position it at -5 -4 position and -1000 priority.

(Empty newline, triple asterisk, empty newline) in a forced on entry at -5 position, when combined with the aforementioned stuff, is helping to de-loop the AI by getting it to not verbatim repeat things from 10-15 lines ago without apparent negative effect (ie: recall still works fine)

I think, relevant to people who don't use OPVAM's LB settings, is that character entries under his settings are at -6 position, and AN is at -4, meaning that the signpost entry was going between the two.

I found that the outputs for descriptive testing were more accurate, the descriptions made more sense, and were less unnecessarily repetitive of the information in the prompt/story.

(Later addition)

I've found that it actually seems to work a little better, with outputs that are more coherent, at -4. -5 puts it right before the AN (with writing style etc.), and -4 puts it right after.

Using the scaffold with your own custom categories

The categories themselves are rather arbitrary and could be anything, for example:

Position Priority Reserve Type
-12 -100 200 Memory
-10 -200 100 Lore: Backstory (multiple)
-10 -300 100 Lore: Drop Bears (multiple)
-10 -400 100 Lore: Snakes (multiple)
-10 -500 100 Lore: Spiders (multiple)
-8 -600 200 Lore: Story Overview (forced activation)
-6 -700 100 Lore: Waifus (multiple)
-4 -800 200 Author's Note
0 0 512 Story

How should I decide where to place my custom categories?

It really depends on what you want to be more important.. If I was doing a sci-fi where there were a lot of custom races (and it was important that the ai got it right) then I would move races down in priority
The above example show what I mean.. Beer is a Lore: Concept, Sally and Jack are Lore: Characters, Halfing is a Lore: Races etc.

Scaffold with splitting up of entries (Fuzzy)

Some of my characters accumulated 6 lines of Info-dump and when I looked at the context it looked like one giant void of story, so I once again let myself get inspired by SC2 from ye olden days and have started to split up the LB for Characters and Groups (Races atm, but could be used for Classes or something like that as well?) into General(MAIN),Appear(SEEN) and Mental(HEARD)

The A/N [Dynamic] is my bruteforce "THIS IS HAPPENING NOW" if I got an idea WHAT I want to happen, but not HOW.

Position Priority Type
0 5000 Story
-13 700 Concepts
-13 350 Faction: Overview
-11 325 Faction: Group
-8 450 Place: General
-8 300 Faction: Rank
-8 225 Race: General
-8 200 Character: General
-7 100 Character: Side
-6 425 Place: Appearance
-6 125 Race: Appearance
-6 100 Character: Appearance
-4 25 Character: Mental
-4 0 Race: Mental
-3 4900 Author's Note - Dynamic (Defined in Author's Note field)
-2 -5000 Lore: Author's Note - General (Defined in Lore Book, forced activation)
0 4999 Memory