How to use Loras, Embeddings (textual inversion), Hypernetworks - stassius/StableHoudini GitHub Wiki

What is Embedding?

Embedding is a vector representation of your prompt. You can train embeddings using a process called Textual Inversion - by trying to find the better "prompt" for every image in your dataset. For example you can train it for a particular style or even object, but only if the model already knows about them.

What are Lora and Hypernetwork?

Lora and Hypernetwork are additional weights used to finetune your checkpoint. You can train them on images of particular object, person or style. They are very effective, robust and relatively easy to train. If you interested in training, I would recommend a set of scripts called Kohya-ss.

Where to get extra networks?

You can train embeddings, loras or hypernetworks yourself, or you can download them on https://civitai.com/, where there are a lot of ready to use extra-networks from the community.

How to install them?

When you trained or downloaded embedding, Lora or Hypernetwork, put them in the corresponding folder in A1111 installation directory:

webui/Embeddings

webui/Models/Hypernetworks

webui/Models/Lora

After that open Webui in the browser, press the red icon under the "Generate" button. It will open the list of available extra-networks.

Choose the proper folder and press "Refresh". After that it will be added to the list.

How to use extra-networks?

You can click on any of them, they will be added to the prompt. Yes, you add them right into your prompt with the particular syntax.

For Embeddings the syntax is simple - just put the filename without extension and you're good to go.

For Loras and Hypernetworks it's a bit more interesting. The syntax is as follows: <lora:name:1>, <hypernet:name:1>. Name is the name of your file without extension. 1 is weight, you can lower or even raise the number to get different results. You can use any number of extra-networks and mix them in any proportion.

How to use them in Stable Houdini?

In Stable Houdini you can just copy and paste them to your prompt, or in SD Prompt node open the Extra Networks foldout, choose the desired extra-network and press the Plus icon on the right. It will add the selected network to your prompt with the proper syntax. After that you can even animate the weight using the Custom value property.