Multilanguage Usage Guide ‐ WORK‐IN‐PROGRESS - julieraptor/DIFFSINGER-LIEE-Immortal-Idol GitHub Wiki

THIS PAGE IS A WORK-IN-PROGRESS

LIEE : Immortal Idol 'Lilia' was created in collaboration with PixPrucer to expand LIEE's language capabilities to include Polish. Through cross-language synthesis, their language capabilities can now support virtually any language.

【 General Notes 】

Languages recorded in: Japanese, English, Korean, Latin, Tagalog, Spanish, Chinese, Cebuano

Using Phonetic Hints

Through cross-language synthesis, LIEE : Immortal Idol 'Lilia''s language capabilities can now support virtually any language through using phonetic hints.

Phonetic hints are words and sounds broken down into phonemes in OpenUTAU. Phonemes, which are distinct sounds, are represented by letters in PixPrucer LIEE Adapted Phonemes.

For a comprehensive list of phonemes and substitutions, please see here: [link]

Word Phonetic Hint
hello [hh eh ll ow]
LIEE [ll iy eh]
immortal [ih m ao r0 t0 ax ll]
idol [ay d0 ah ll]

【 Phoneme Sheet 】

Additional information is provided in the language's respective dsdict.yaml.

【 Phonemizer Status 】

More language compatibility via phonemizer will be available in the future.

Language Status Language Status
English Complete Chinese Complete
Filipino 🔜 In-progress French Complete
German 🔜 In-progress Japanese Complete
Korean Complete Italian 🔜 In-progress
Polish Complete Portuguese Complete
Russian 🔜 In-progress Thai 🔜 In-progress
Vietnamese Complete --- ---

【 English 】

🎵 I want to connect all the ends of the earth, just with this voice of mine 🎶

[cl ay] [w aa n t0] [t0 uw] [k ah n eh k t] [ao l] [dh iy] [eh n d0 s] [ah w] [dh iy] [er th] [jh ah s t0] [w ih dh] [dh ih s] [w oy s] [ah w] [m ay n]

Sample

harukaKanata_EN.mp4
Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance PixPrucer

English data is recorded with the Northern American accent, specifially New York metropolitan dialect which is rhotic, or "r-pronouncing".

Edit dsdict-en.yaml for pronunciation configuration.

🔤 Special Phonemes

Phoneme IPA
d0 d
r0 ɹ
t0 d

【 Chinese - Mandarin 】

🎵 讓我的歌聲可以連結每個世界的人響遍天涯海角 🎶

*Ràng wǒ de gēshēng kěyǐ liánjié měi gè shìjiè de rén xiǎng biàn tiānyáhǎijiǎo*
Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance Melody

Data is recorded with a non-native but beginner understanding of pronunciation.

Edit dsdict-zh.yaml for pronunciation configuration.

【 Filipino 】

🎵 Gusto kong makita ang mundo ay magkakasama kung boses ko lamang 🎶

[g u s t o] [k o ng] [m a k i t a] [cl a ng] [m u n d o] [cl ay] [m a g k a k a s a m a] [k u ng] [b o s e s] [k o] [l a m a ng]

Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance julieraptor

Edit dsdict-fil.yaml for pronunciation configuration.

【 French 】

🎵 Je veux connecter les coeurs du monde entier au seul son de ma voix 🎶

Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance Mim/UFR

Edit dsdict-fr.yaml for pronunciation configuration.

Phoneme Substitution Notes

Nasal Vowel Replacement

LIEE does not have any nasal vowels. Words with nasal vowels will need to be written manually as a phonetic hint.

Nasal vowel indicator is [aa] for Millefeuille phoneme [en].

Examples

Word It will appear as Phonetic hint
chantant [sh aa t aa] [sh aa nn t aa n]

Substitution Chart

Original Phoneme LIEE Substitute Notes
en aa Add [aa N] or write phonetic hint instead

【 Japanese 】

🎵 はるかかなたつながり結びたい この声から 🎶

*haruka kanata tsunagari musubitai, kono koe kara

Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance PixPrucer

Data is recorded with a non-native but beginner understanding of pronunciation.

Edit dsdict.yaml for pronunciation configuration.

【 Korean 】

🎵 온 세상의 끝을 잇고 싶어 하나가 되어 나의 목소리로 🎶

*on sesang-ui kkeut-eul isgo sip-eo hanaga doeeo naui mogsolilo*

Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance naff-san

Data is recorded with a non-native but beginner understanding of pronunciation.

Edit dsdict-ko.yaml for pronunciation configuration.

Special Phonemes

See LIEE Adapted Phonemes for English approximations and usage.

Phoneme IPA
A eo

【 Polish 】

🎵 ................ 🎶

Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance PixPrucer

Additional data is supported by training alongside the Megamodel.

Edit dsdict-pl.yaml for pronunciation configuration.

Special Phonemes

See LIEE Adapted Phonemes for English approximations and usage.

Phoneme IPA
A ɔ̃
E ɛ̃
y ɨ
C
dX
dZ
dz dz
h h
S ɕ
sz ʂ
X ç
dZ

【 Portuguese 】

🎵 Quero ligar todos os cantos da terra só com esta minha voz 🎶

Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance MintyAlien (PT-EU), padrauwn (PT-BR)

Additional data is supported by training alongside the Megamodel.

Phoneme Substitution Notes

See LIEE Adapted Phonemes for English approximations and usage.

Edit dsdict-pt.yaml for pronunciation configuration. Thank you to HAI-D for checking pronunciations and additional notes.

‼️ By default, LIEE's dsdict-pt.yaml is formatted for Brazilian Portuguese (PT-BR).
Notes on European Portuguese (PT-EU) are below.

Nasal Vowel Replacement

LIEE does not have any nasal vowels. They must be manually edited.

Nasal vowel indicators are [ah] [eh] [iy] [ow] [uw] [y] [L].

Words with nasal vowels must be written with "h" or "m" to let the phonemizer know to add [N] or [m].
TIP: Arpabet vowels tend to indicate where a nasal vowel should be.

Then, edit [N] to [nn] [ng] or [m] as needed.

Word Type word as It will appear as Edit to
cantando canhtanhdo [k a N ta N d u] [k a nn ta nn d u]
bem bemm [b e N] [b ey nn] or [b ey mm]

‼️ You may need to add 2 consonants following [n] [m] to appear correctly.

Word Type word as It will appear as Edit to
alegremente alegremenntte [a ll E g r E m eh n ch i] [a ll E g r E m e nn ch i]

Sometimes, this may not work and the word will need to be written manually as a phonetic hint.

Substitution Chart

Original Phoneme LIEE Substitute Notes
a a Can also be [ah] [aa] [a]
a~ ah See Nasal Vowel Replacement Notes
e e Can also be [eh] [ae]
e~ eh See Nasal Vowel Replacement Notes
i~ iy See Nasal Vowel Replacement Notes
o~ ow See Nasal Vowel Replacement Notes
u~ uw See Nasal Vowel Replacement Notes
j~ iy See Nasal Vowel Replacement Notes
w~ ah See Nasal Vowel Replacement Notes
L ll Can also be [ll y] [ll j]
R h Can also be [H]
r r Can also be [dx] for less harsh tap
s s Can also be [sh] [zh] depending on regional pronunciation
X H Can also be [r0] depending on regional pronunciation

【 Spanish 】

🎵 Quiero conectar a todo el mundo de norte a sur solo con mi voz 🎶

Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance Cadlaxa (base dictionary)

Data is recorded with a non-native but advanced understanding of pronunciation. Spanish singing accent is a combination of speaking English, Tagalog (similar phonemes and loanwords), and learning Spanish from teachers from Colombia.

Phoneme Substitution Notes

See LIEE Adapted Phonemes for English approximations and usage.

Edit dsdict-es.yaml for pronunciation configuration.

Original Phoneme LIEE Substitute Notes
WORK IN PROGRESS

【 Vietnamese 】

🎵 Để kết nối cả thế giới, kết nối trái đất này, bằng giọng hát này của tôi 🎶

Summary
Data recorded in this language
Phonemizer Support
Phonemizer Assistance Jani Tran

Additional data is supported by training alongside the Megamodel.

Phoneme Substitution Notes

See LIEE Adapted Phonemes for English approximations and usage.

Edit dsdict-vi.yaml for pronunciation configuration.

Original Phoneme LIEE Substitute Notes
WORK IN PROGRESS
⚠️ **GitHub.com Fallback** ⚠️