AdvancedUsage - nmchan/waidayo GitHub Wiki

Advanced usage

Increase the number of Blendshape Proxy targeted for facial capture

  • In waidayo, in addition to the Blend shape defined in the VRM standard, the following are available

    • EYEBROW_ANGRY Eyebrows (Sync mode)
    • EYEBROW_ANGRY_L Anger eyebrows L (Separate mode)
    • EYEBROW_ANGRY_R Anger eyebrows R (Separate mode)
    • EYEBROW_SORROW Sad eyebrows (Sync mode)
    • EYEBROW_SORROW_L Sad Eyebrows L (Separate mode)
    • EYEBROW_SORROW_R Sad Eyebrows R (Separate mode)
    • TONGUE_OUT Stick out your tongue
    • PUKUU Hoppe Puku

  • The cheeks that stick out your tongue can be used as a trigger for another facial expression.

    • Example) Register "> <" and "white eyes" in "PUKUU" of Blendshape Proxy

Supports Perfect Sync

  • Precautions:
    • For Perfect Sync compatible models, the above blend shapes will not work (because of conflicts)
    • Be sure to define JawOpen (used to determine the perfect sync compatible model)
  • About the production of compatible models

I want to use it with VMC Protocol compatible apps other than waidayo for PC / Mac and virtual motion capture

  • The following information is sent in each mode of waidayo
    • Face Only
      • BlendshapeProxy, Eye Target
    • Face Position ＋ Rotation
      • BlendshapeProxy, Eye Target, Bone
    • Face Rotation Only
      • BlendshapeProxy, Eye Target, Bone
  • VSeeFace does not support Eye Target, so if you want to use the line of sight, you need to use the avatar with bones in the eyes and use Face Position + Rotation or Face Rotation Only.

◀ Back