Skip to content

Commit d1e9b55

Browse files
jesseengelMagenta Team
authored andcommitted
Improve text of VST training. Update version.
PiperOrigin-RevId: 443703095
1 parent 1cca34d commit d1e9b55

File tree

1 file changed

+48
-17
lines changed

1 file changed

+48
-17
lines changed

ddsp/colab/demos/Train_VST.ipynb

Lines changed: 48 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -23,45 +23,75 @@
2323
"# limitations under the License.\n",
2424
"# ------------------------------------------------------------------------------\n",
2525
"\n",
26-
"#@title Train your own DDSP-VST Model\n",
27-
"#@markdown Just press the ▶️ button!\n",
26+
"#@markdown # Train your own DDSP-VST Model \n",
27+
"#@markdown 🎻🎺🎸🎵 [g.co/magenta/train-ddsp-vst](g.co/magenta/train-ddsp-vst)\n",
2828
"\n",
29-
"#@markdown \u003cbr/\u003e Custom models can train on as little as 10 minutes of audio (`.wav` or `.mp3`). Best results from \"monophonic\" (only one note at a time) audio from a single recording session (same mic, same reverb).\n",
29+
"#@markdown \u003cbr/\u003e \n",
3030
"\n",
31-
"#@markdown Training typically takes ~2-3 hours with free Colab, and less than an hour with ColabPro.\n",
31+
"#@markdown ## Instructions\n",
3232
"\n",
3333
"\n",
34-
"#@markdown We recommend using Google Drive for training to load faster and save your model during training. Just create a folder on your drive with your audio files in it, and select the folder. If you don't use drive, you can still upload audio through the browser (slower) and download the final trained model.\n",
34+
"#@markdown * Create a folder in Google Drive with your training audio (`.wav` or `.mp3`)\n",
3535
"\n",
36-
"#@markdown Colab often kicks people off after ~12 hours, but hopefully that shouldn't be a problem.\n",
36+
"Name = 'My Instrument' #@param {type:\"string\"}\n",
37+
"Name = Name.replace(' ', '_')\n",
3738
"\n",
38-
"#@markdown After training, it should automatically export and download your model as `{my_name}.tflite` that you can use by dropping in the VST custom models folder. If it doesn't automatically download, you can find the file in the `ddsp-training-{date-time}/export` folder either on this page (click the 📁 icon on the left), or in the folder you selected from your drive.\n",
39+
"\n",
40+
"#@markdown * Press the ▶️ button in the upper left!\n",
41+
"\n",
42+
"#@markdown * Login to your Google account when asked\n",
43+
"\n",
44+
"#@markdown * Select your folder with the file chooser below when asked\n",
45+
"\n",
46+
"#@markdown * Wait (with this window open) for training to finish and download the model\n",
47+
"\n",
48+
"#@markdown * If something breaks, resume training by refreshing this page, press ▶️, and choose the same folder\n",
3949
"\n",
4050
"\n",
41-
"#@markdown \u003cbr/\u003e \u003cbr/\u003e\n",
42-
"#@markdown Name your model!\n",
43-
"Name = 'MyInstrument' #@param {type:\"string\"}\n",
44-
"Name = Name.replace(' ', '_')\n",
4551
"\n",
4652
"#@markdown \u003cbr/\u003e\n",
47-
"#@markdown Use Google Drive for training?\n",
48-
"Google_Drive = True #@param {type:\"boolean\"}\n",
53+
"\n",
54+
"#@markdown \u003cbr/\u003e\n",
55+
"\n",
56+
"#@markdown ## Data\n",
57+
"#@markdown Custom models can train on as little as 10 minutes of audio (`.wav` or `.mp3`). You can get the best results from \"monophonic\" (only one note at a time) audio from a single recording session (same mic, same reverb). All of your data is private, used locally, and erased as soon as your colab session ends.\n",
58+
"\n",
59+
"\n",
60+
"#@markdown ## Training\n",
61+
"#@markdown Training typically takes ~2-3 hours with free Colab, and less than an hour with ColabPro+. Free colab can sometimes disconnects before models finish training, but there are some unofficial [ways around this](https://stackoverflow.com/questions/57113226/how-to-prevent-google-colab-from-disconnecting). If you do get disconnected, don't worry, just press play again and choose the same folder. The training will resume where it left off.\n",
62+
"\n",
63+
"\n",
64+
"\n",
65+
"#@markdown ## Export\n",
66+
"\n",
67+
"#@markdown After training, it should automatically export and download your model as `{my_name}.tflite` that you can use by dropping in the VST custom models folder, which you can access by pushing the 'Models' button within the plugin itself. If it doesn't automatically download, you can find the file in the `ddsp-training-{date-time}/export` folder, either on this page (click the 📁 icon on the left), or in the folder you selected from your drive.\n",
68+
"\n",
69+
"##@markdown We recommend using Google Drive to load data faster and save your model during training. Just create a folder on your drive with your audio files in it, and select the folder. If you don't use drive, you can still upload audio through the browser (slower) and download the final trained model.\n",
4970
"\n",
5071
"\n",
5172
"\n",
5273
"#@markdown \u003cbr/\u003e \u003cbr/\u003e\n",
53-
"#@markdown ### Advanced Options\n",
74+
"#@markdown ## Advanced Options\n",
5475
"\n",
55-
"#@markdown \u003ca href=\"https://colab.research.google.com/github/magenta/ddsp/blob/main/ddsp/colab/demos/Train_VST.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n",
76+
"##@markdown \u003ca href=\"https://colab.research.google.com/github/magenta/ddsp/blob/main/ddsp/colab/demos/Train_VST.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n",
77+
"\n",
78+
"#@markdown \u003cbr/\u003e\n",
79+
"#@markdown Usually we will produce good results after training between 30k-50k steps, but your results may vary depending on your audio files/instrument. Too few steps will often have the model sound bland/generic, too many steps can often lead to more \"sputtering\" and big volume fluctuations\n",
5680
"\n",
5781
"Training_Steps = 30000 #@param {type:\"integer\"}\n",
5882
"\n",
5983
"#@markdown \u003cbr/\u003e\n",
60-
"#@markdown Ignore previous checkpoints and start a fresh run\n",
84+
"#@markdown Ignore previous checkpoints in the folder and start a fresh run from step 0\n",
6185
"\n",
6286
"Ignore_Previous = False #@param {type:\"boolean\"}\n",
6387
"\n",
6488
"\n",
89+
"#@markdown \u003cbr/\u003e\n",
90+
"#@markdown Use Google Drive for training? Otherwise, loads audio from browser, which is much slower\n",
91+
"Google_Drive = True #@param {type:\"boolean\"}\n",
92+
"\n",
93+
"\n",
94+
"\n",
6595
"# Sample_Rate = '16kHz' #@param ['16kHz', '32kHz', '48kHz']\n",
6696
"# Sample_Rate = {'16kHz': 16000, '32kHz': 32000, '48kHz': 48000}[Sample_Rate]\n",
6797
"# Model_Gin_File = 'models/vst/vst.gin'\n",
@@ -74,7 +104,7 @@
74104
"# ------------------------------------------------------------------------------\n",
75105
"print('Installing DDSP...')\n",
76106
"print('This should take about 2 minutes...')\n",
77-
"!pip install -U ddsp[data_preparation]==3.3.4 \u0026\u003e /dev/null\n",
107+
"!pip install -U ddsp[data_preparation]==3.4.0 \u0026\u003e /dev/null\n",
78108
"!pip install ipyfilechooser \u0026\u003e /dev/null\n",
79109
"\n",
80110
"\n",
@@ -304,6 +334,7 @@
304334
"accelerator": "GPU",
305335
"colab": {
306336
"collapsed_sections": [],
337+
"last_runtime": {},
307338
"name": "Train_VST.ipynb",
308339
"private_outputs": true,
309340
"provenance": []

0 commit comments

Comments
 (0)