[HN Gopher] Show HN: Catchy melodies made with a diffusion-based...
___________________________________________________________________
Show HN: Catchy melodies made with a diffusion-based neural net
assistant
I've created a diffusion-based neural net generative assistant that
makes creating new melodies much easier, even for non-musicians
like me. These are meant to be just the catchy "hook" parts of
songs, so more work is required to make them into full songs, but
this is already handled well by existing products (e.g. there are
plugins that can suggest a few possible chord progressions based on
the melody and there is even good singing software that I used
without any tweaks to make the "voice" playlist: Synthesizer V
Studio). This side project turned out to be quite challenging
because of how little data there is to train on - several orders of
magnitude less than DALL-E or GPT-3 had available for its training,
so it required a deep dive into research of new generalization and
augmentation techniques and some feature engineering. Various
other instruments: Voice:
https://www.youtube.com/playlist?list=PLoCzMRqh5SkE1yC8_WtJ-...
Synth:
https://www.youtube.com/playlist?list=PLoCzMRqh5SkFj7RNZvjr7...
Bell:
https://www.youtube.com/playlist?list=PLoCzMRqh5SkEYHYvHX9m9...
Guitar:
https://www.youtube.com/playlist?list=PLoCzMRqh5SkGKvfkP2Oex...
Sax:
https://www.youtube.com/playlist?list=PLoCzMRqh5SkHfsZgzzdSh...
Grand Piano:
https://www.youtube.com/playlist?list=PLoCzMRqh5SkFMch5x60uh...
SoundCloud electric piano: https://soundcloud.com/lech-
mazur-995769534/sets/ai-assistan... SoundCloud vocal:
https://soundcloud.com/lech-mazur-995769534/sets/ai-assistan...
Author : zone411
Score : 13 points
Date : 2022-05-11 18:30 UTC (4 hours ago)
(HTM) web link (www.youtube.com)
(TXT) w3m dump (www.youtube.com)
| [deleted]
| armchairhacker wrote:
| I think AI in music generation will end up being a big thing like
| with DALL-E for images and GPT3 for text. Possibly more because
| it seems like people have less intuition for creating music than
| they do for images and words.
| stolenmerch wrote:
| This is really neat. Is there a colab or Jupyter notebook we can
| look at?
| zone411 wrote:
| Not yet. The current version is not fully automated and it
| requires human input, so it will take a decent amount of work
| and documentation to make it ready for users. It also mixes C++
| with Python in a few places for performance reasons when
| generating melodies and I don't know if that's even possible on
| Colab?
| mcphage wrote:
| After listening to the same pieces over and over again on my
| kids' music boxes and whatnot, I've really wanted a music box
| that just auto-generated new 0:15 second pieces every time
| instead of a static loop.
| cuttysnark wrote:
| This is fascinating. I've always loved the idea of a .midi melody
| being able to be mapped to a "vocal" track and transformed
| accordingly--akin to Autotune The News, but with AI/ML instead of
| by-hand.
|
| In a sense, the lyrics could be spoken and then applied to the
| .midi melody. The result would sound similar to the SoundCloud
| vocal OP link, but with "words".
| zone411 wrote:
| > In a sense, the lyrics could be spoken and then applied to
| the .midi melody. The result would sound similar to the
| SoundCloud vocal OP link, but with "words".
|
| Yes, Synthesizer V Studio can do it quite well! I've added some
| silly lyrics to a few of these melodies and I was quite happy
| with the results. I'll upload them to the same YouTube channel.
| Here is a cover song that somebody made:
| https://www.youtube.com/watch?v=ettSVy4K_DY.
___________________________________________________________________
(page generated 2022-05-11 23:02 UTC)