Multilanguage Usage Guide ‐ WORK‐IN‐PROGRESS - julieraptor/DIFFSINGER-LIEE-Immortal-Idol GitHub Wiki
LIEE : Immortal Idol 'Lilia'
was created in collaboration with PixPrucer to expand LIEE's language capabilities to include Polish.
Through cross-language synthesis, their language capabilities can now support virtually any language.
Languages recorded in: Japanese, English, Korean, Latin, Tagalog, Spanish, Chinese, Cebuano
Through cross-language synthesis, LIEE : Immortal Idol 'Lilia'
's language capabilities can now support virtually any language through using phonetic hints.
Phonetic hints are words and sounds broken down into phonemes in OpenUTAU. Phonemes, which are distinct sounds, are represented by letters in PixPrucer LIEE Adapted Phonemes.
For a comprehensive list of phonemes and substitutions, please see here: [link]
Word | Phonetic Hint |
---|---|
hello | [hh eh ll ow] |
LIEE | [ll iy eh] |
immortal | [ih m ao r0 t0 ax ll] |
idol | [ay d0 ah ll] |
Additional information is provided in the language's respective dsdict.yaml
.
More language compatibility via phonemizer will be available in the future.
Language | Status | Language | Status |
---|---|---|---|
English | ✅ Complete | Chinese | ✅ Complete |
Filipino | 🔜 In-progress | French | ✅ Complete |
German | 🔜 In-progress | Japanese | ✅ Complete |
Korean | ✅ Complete | Italian | 🔜 In-progress |
Polish | ✅ Complete | Portuguese | ✅ Complete |
Russian | 🔜 In-progress | Thai | 🔜 In-progress |
Vietnamese | ✅ Complete | --- | --- |
harukaKanata_EN.mp4
Summary | |
---|---|
Data recorded in this language | ✅ |
Phonemizer Support | ✅ |
Phonemizer Assistance | PixPrucer |
English data is recorded with the Northern American accent, specifially New York metropolitan dialect which is rhotic, or "r-pronouncing".
Edit dsdict-en.yaml
for pronunciation configuration.
Phoneme | IPA |
---|---|
d0 | d |
r0 | ɹ |
t0 | d |
Summary | |
---|---|
Data recorded in this language | ✅ |
Phonemizer Support | ✅ |
Phonemizer Assistance | Melody |
Data is recorded with a non-native but beginner understanding of pronunciation.
Edit dsdict-zh.yaml
for pronunciation configuration.
Summary | |
---|---|
Data recorded in this language | ✅ |
Phonemizer Support | ✅ |
Phonemizer Assistance | julieraptor |
Edit dsdict-fil.yaml
for pronunciation configuration.
Summary | |
---|---|
Data recorded in this language | ❌ |
Phonemizer Support | ✅ |
Phonemizer Assistance | Mim/UFR |
Edit dsdict-fr.yaml
for pronunciation configuration.
LIEE does not have any nasal vowels. Words with nasal vowels will need to be written manually as a phonetic hint.
Nasal vowel indicator is [aa]
for Millefeuille phoneme [en].
Word | It will appear as | Phonetic hint |
---|---|---|
chantant | [sh aa t aa] |
[sh aa nn t aa n] |
Original Phoneme | LIEE Substitute | Notes |
---|---|---|
en | aa | Add [aa N] or write phonetic hint instead |
Summary | |
---|---|
Data recorded in this language | ✅ |
Phonemizer Support | ✅ |
Phonemizer Assistance | PixPrucer |
Data is recorded with a non-native but beginner understanding of pronunciation.
Edit dsdict.yaml
for pronunciation configuration.
Summary | |
---|---|
Data recorded in this language | ✅ |
Phonemizer Support | ✅ |
Phonemizer Assistance | naff-san |
Data is recorded with a non-native but beginner understanding of pronunciation.
Edit dsdict-ko.yaml
for pronunciation configuration.
See LIEE Adapted Phonemes for English approximations and usage.
Phoneme | IPA |
---|---|
A | eo |
Summary | |
---|---|
Data recorded in this language | ❌ |
Phonemizer Support | ✅ |
Phonemizer Assistance | PixPrucer |
Additional data is supported by training alongside the Megamodel.
Edit dsdict-pl.yaml
for pronunciation configuration.
See LIEE Adapted Phonemes for English approximations and usage.
Phoneme | IPA |
---|---|
A | ɔ̃ |
E | ɛ̃ |
y | ɨ |
C | tɕ |
dX | dʑ |
dZ | dʐ |
dz | dz |
h | h |
S | ɕ |
sz | ʂ |
X | ç |
dZ | dʐ |
Summary | |
---|---|
Data recorded in this language | ❌ |
Phonemizer Support | ✅ |
Phonemizer Assistance | MintyAlien (PT-EU), padrauwn (PT-BR) |
Additional data is supported by training alongside the Megamodel.
See LIEE Adapted Phonemes for English approximations and usage.
Edit dsdict-pt.yaml
for pronunciation configuration. Thank you to HAI-D for checking pronunciations and additional notes.
dsdict-pt.yaml
is formatted for Brazilian Portuguese (PT-BR).
Notes on European Portuguese (PT-EU) are below.
LIEE does not have any nasal vowels. They must be manually edited.
Nasal vowel indicators are [ah]
[eh]
[iy]
[ow]
[uw]
[y]
[L]
.
Words with nasal vowels must be written with "h" or "m" to let the phonemizer know to add [N]
or [m]
.
TIP: Arpabet vowels tend to indicate where a nasal vowel should be.
Then, edit [N]
to [nn] [ng]
or [m]
as needed.
Word | Type word as | It will appear as | Edit to |
---|---|---|---|
cantando | canhtanhdo | [k a N ta N d u] |
[k a nn ta nn d u] |
bem | bemm | [b e N] |
[b ey nn] or [b ey mm]
|
[n] [m]
to appear correctly.
Word | Type word as | It will appear as | Edit to |
---|---|---|---|
alegremente | alegremenntte | [a ll E g r E m eh n ch i] |
[a ll E g r E m e nn ch i] |
Sometimes, this may not work and the word will need to be written manually as a phonetic hint.
Original Phoneme | LIEE Substitute | Notes |
---|---|---|
a | a | Can also be [ah] [aa] [a]
|
a~ | ah | See Nasal Vowel Replacement Notes |
e | e | Can also be [eh] [ae]
|
e~ | eh | See Nasal Vowel Replacement Notes |
i~ | iy | See Nasal Vowel Replacement Notes |
o~ | ow | See Nasal Vowel Replacement Notes |
u~ | uw | See Nasal Vowel Replacement Notes |
j~ | iy | See Nasal Vowel Replacement Notes |
w~ | ah | See Nasal Vowel Replacement Notes |
L | ll | Can also be [ll y] [ll j]
|
R | h | Can also be [H]
|
r | r | Can also be [dx] for less harsh tap |
s | s | Can also be [sh] [zh] depending on regional pronunciation |
X | H | Can also be [r0] depending on regional pronunciation |
Summary | |
---|---|
Data recorded in this language | ✅ |
Phonemizer Support | ✅ |
Phonemizer Assistance | Cadlaxa (base dictionary) |
Data is recorded with a non-native but advanced understanding of pronunciation. Spanish singing accent is a combination of speaking English, Tagalog (similar phonemes and loanwords), and learning Spanish from teachers from Colombia.
See LIEE Adapted Phonemes for English approximations and usage.
Edit dsdict-es.yaml
for pronunciation configuration.
Original Phoneme | LIEE Substitute | Notes |
---|---|---|
WORK | IN | PROGRESS |
Summary | |
---|---|
Data recorded in this language | ❌ |
Phonemizer Support | ✅ |
Phonemizer Assistance | Jani Tran |
Additional data is supported by training alongside the Megamodel.
See LIEE Adapted Phonemes for English approximations and usage.
Edit dsdict-vi.yaml
for pronunciation configuration.
Original Phoneme | LIEE Substitute | Notes |
---|---|---|
WORK | IN | PROGRESS |