ENUNU NNSVS Support - stakira/OpenUtau GitHub Wiki

  • Note: ENUNU/NNSVS support is experimental. There will be quirks. Be patient. Be ready to troubleshoot.

  • Note: This page will change regularly.

  • Version list of ENUNU for OpenUtau (Click here to download)

How to use

Download the suitable ENUNU server version according to the voicebank you want to use. Unzip it.

Before opening OpenUtau, double click enunu_server.bat to launch the server and leave it open.

To use NNSVS generated pitch, finish rendering first, then execute "Notes -> Load Rendered Pitch" from the piano roll menu. You can select some phrases to load or load the entire part. Only the pitch of phrases finished rendering will be loaded.

If there is a problem with the operation, please put the following in config.yaml.
If you do not want to perform timing correction, delete the timing_editor line.
If you turn off the wav_synthesizer setting, you can edit the Pitch, but the quality is very low.

extensions:
    timing_editor: "%v/timing_auto_correct/enunu_timing_auto_correct.py"
    wav_synthesizer: synthe
    acoustic_calculator: nnsvs
    timing_calculator: nnsvs
    ust_converter: built-in

Notes for voicebank developers

For SimpleENUNU compatible models, please add the following to character.yaml.

singer_type: Enunu

FAQ

Q: FileNotFoundException: Could not find file '...\acoustic-f0.npy'.

A: it's an NNSVS issue (https://github.com/r9y9/nnsvs/issues/94), sometimes it generates invalid data and fails by itself. Tweaking timing (the vertical red line in phoneme view) by just a little usually solves it.

Update: a retry mechanism has been implemented to "fix" (actually workaround) this issue. It pads the start of input with a very short silence, then trims this silence from the output. This tiny difference in input is usually enough to make the issue disappear. Let me know if you still see it.

Q: It's very slow.

A: Yes it is very slow when notes and lyrics are modified (editing curves should be very fast). The way it works now is that python.exe is started for every phrase (a group of consecutive notes). Python is not great at startup speed. Every time python.exe is started, there are a few seconds wasted loading python packages. There are ways to improve, but that's the status quo.

Roadmap

Roadmap