| Component |
value |
| Face-body coordinate system |
MPEG-4 FBA |
| Number of face parameters |
66 |
| Number of body parameters |
196 |
| Digrees of freedom (for each hand) |
29 |
(Last updated: 8 April, 2025)
| Port |
Connection (left: server, right: client) |
Comment |
| 1234 |
LM-studio - Mistral.py |
when you run LLM locally |
| 3150 |
meaning_miner_adapter_server.py - meaning_miner_adapter_client.py |
MeaningMiner |
| 4000 |
|
Conflict: Mistral, ASAP |
| 4040 |
DeepGramFrame.java - DeepGram.py |
DeepGram ASR |
| 4444 |
opensmile_greta.py - realtime_PerceptNGen.py |
ASAP, send/receive OpenSmile features |
| 5000 |
OpenFaceOfflineZeroMQ.exe - any |
send user's AU by OpenFace |
| 5560 |
OpenFaceOutputStreamReader.java - RealTimePipeFinal.py |
MODIFF, transmit user's AU by OpenFace to python |
| 5561 |
RealTimePipeFinal.py - MODIFFFrame.java |
MODIFF, send generated AU to java from python |
| 5960 |
turnManagement.java - turnManager.py |
TurnManagement, receive feedback from java in python |
| 5961 |
turnManagement.java - turnManager.py |
TurnManagement, send turn-taking behaviors from python to java |
| 8087 |
SpeechRecognizerFrame.java - nothing |
GoogleASR receiver |
| 8088 |
SpeechRecognizerFrame.java - nothing |
GoogleASR receiver |
| 9000 |
mic_server.py - any |
Microphone |
| 9999 |
func_util.py - func_util.py |
TurnManagement, communication within timeout process |
| 50200 |
RealTimePipeFinal.py - "MICounselorIncrementalDA - Drinking.py" |
MODIFF, ExternalTensorClient for DA, server1 |
| 50201 |
RealTimePipeFinal.py - "MICounselorIncrementalDA - Drinking.py" |
MODIFF, ExternalTensorClient for DA, server2 |
| 61616 |
Broker.java - any |
ActiveMQ |
| Component |
value |
comment |
| FML/BML files |
bin/Examples |
|
| Configurations |
bin/Configurations |
|
| Python files |
bin/Common/Data (bin/Scripts for ASAP module) |
|
| Batch files |
bin/Common/Data |
|
| NVBG |
bin/NVBG |
|
| charniak parser for NVBG |
bin/charniak |
|
| CereProc lisence |
bin/Common/Data/CereProc |
not included in github |
| Character .ini file |
bin/Common/Data/characters |
|
| External library .jar file |
bin/Common/Lib/External |
|
| Face gestuary |
e.g. bin/BehaviorRealizer/BehaviorLexicon/facelibrary.xml
|
|
| Body gestuary |
e.g. bin/BehaviorRealizer/BehaviorLexicon/gestuary_camille.xml
|
|
Name correspondence between Greta modules and Java projects
(Last updated: 24 April, 2025)
| Menu group in Modular |
Greta module in Modular |
Java project |
comment |
| Animation Filters - Face |
Face Blender |
MPEG4 |
|
| Animation Filters - Face |
Lip Blender |
MPEG4 |
|
| Animation Filters - Body |
Body Blender |
MPEG4 |
|
| Player |
Capture Controller |
OgrePlayer |
|
| Planners |
Behavior Planner |
BehaviorPlanner |
|
| Realizers |
Behavior Realizer |
BehaviorRealizer |
|
| Inputs |
FML File Reader |
Intentions |
|
| Inputs |
BML File Reader |
Signals |
|
| Inputs |
Body Head Noise |
BodyAnimationPerformer |
|
| Inputs - Meaning Miner |
MM FML File Reader |
MeaningMiner |
|
| Inputs |
MODIFF |
MODIFF |
|
| Inputs |
Rest_Pose_Setter |
Signals |
|
| Outputs |
Audio File Writer |
Util |
|
| Outputs |
FML File Writer |
Intentions |
|
| Outputs |
BML File Writer |
Signals |
|
| Outputs |
FAP File Writer |
MPEG4 |
|
| Outputs |
BAP File Writer |
MPEG4 |
|
| Tools |
FML Editor |
Editors |
|
| Tools |
BML Editor |
Editors |
|
| Tools |
Gesture Animation Editor |
Editors |
|
| Tools |
Hand Shape Editor |
Editors |
|
| Tools |
Face Library Viewer |
Editors |
class name in the Java project is FaceLibraryEditor
|
| Network Connections |
Greta Furhat Interface |
GretaFurhatInterface |
|
| Dialogue - LLM |
Mistral |
LLM |
|
| Dialogue - DeepASR |
DeepGram |
DeepASR |
|
| Dialogue - TurnManagement |
TurnManagement |
TurnManagement |
|
If you cannot find what you want here, you can find it with the following steps:
- Open
bin\Modular.xml
- Check
<item module="XXX" name="YYY" /> entry of your target module in <menu> block
- Search
<module name="XXX" style="ZZZ"> block by the module name
- Check the object class path from
<object class="greta.CCC.CCC..." lib_id="LLL">
- Search the library definition with the key
lib id="LLL"
- From the
<lib id="LLL" path="PPP">, the path is the project you should check in the Netbeans
| Abbreviation |
full name |
comment |
| BAP |
body animation parameter |
from MPEG-4 FBA |
| FAP |
face animation parameter |
from MPEG-4 FBA |
| APML |
affective presentation markup language |
|
| FML |
functional markup language |
functional behavior (e.g., beat, smile) |
| BML |
behavior markup language |
raw-level behavior (e.g., head, gaze, gesture) and speech content |
| NVBG |
nonverbal behavior generator |
module for gesture generation |
| MI |
motivational interview |
|
| MM |
meaning miner |
module for gesture generation |
| MODIFF-MI |
|
adaptive facial expression |