[HN Gopher] MusicGen-Looper: Generate fixed-bpm loops from text ...
___________________________________________________________________
MusicGen-Looper: Generate fixed-bpm loops from text prompts
Author : fagerhult
Score : 107 points
Date : 2023-06-19 09:10 UTC (13 hours ago)
(HTM) web link (replicate.com)
(TXT) w3m dump (replicate.com)
| yoz wrote:
| Many thanks for this joyous thing. I tried a few different
| prompts and always got something weird and interesting, but never
| quite what I wanted:
|
| Firstly, with temperature set to 2:
|
| "Amen break with a bag of spanners" (140 bpm): If the amen break
| is in there, I can't tell. There does seem to be a kind of
| harp/bell thing doing the melody, though.
|
| "John Bonham with kettle drums" (90 bpm): Lots of guitar, subdued
| drums, but could definitely be late-period Zeppelin. Variation 2
| is the exception: Zep at the start and end, long pause in the
| middle so John can drag his sticks along a LEGO oil tanker.
|
| "John Bonham with kettle drums and angry cat" (90 bpm): We are
| now _inside_ the oil tanker.
|
| Now setting the temperature to 1:
|
| "Hardfloor in Luton Primark" (90 bpm): The bpm setting was an
| accidental leftover from the previous experiment, and the result
| sounds much more Primark than Hardfloor.
|
| "Portishead at cheezy funfair" (110 bpm): It's a very folk-y
| funfair. Accordions? Organs? What the hell?
|
| Hours of fun! Again, many thanks!
| crawsome wrote:
| "You must sign in to run this model"
|
| In this day and age, curiosity is not worth the risk.
| fagerhult wrote:
| Oops sorry about that, fixed now!
| JodieBenitez wrote:
| That thing refused to make me a 160 bpm chicago acid house
| loop... what a severe lack of imagination :-P
| dylan604 wrote:
| > what a severe lack of imagination
|
| I think you just described chicago acid house :-P
| tessierashpool wrote:
| fuck you
| dang wrote:
| Please don't respond to a bad comment by breaking the site
| guidelines yourself. That only makes things worse.
|
| https://news.ycombinator.com/newsguidelines.html
| JodieBenitez wrote:
| Ahaha... granted. Upvoting this even though I still groove to
| old Phuture tracks.
| dylan604 wrote:
| I could see where it would be much more simple for an "AI"
| to generate a techno sound compared to something more
| melodic. I tried getting it to make things, and just had no
| luck with anything that sounded close to what was being
| requested. Some of it had a beat, but I don't think I could
| dance to it (can't tell since it's not actually loopable),
| so I gave it a 2
| KRAKRISMOTT wrote:
| How is this possible? I thought deep learning models struggle
| with approximating periodic functions like sin.
| bravura wrote:
| bigvgan paper (https://arxiv.org/pdf/2206.04658.pdf)
|
| "We introduce a proper inductive bias of periodicity to the
| generator by applying a recently proposed periodic activation
| called Snake function (Liu et al., 2020), defined as fa(x) = x
| + 1 a sin2 (ax), where a is a trainable parameter that controls
| the frequency of the periodic component of the signal and
| larger a gives higher frequency. The use of sin2 (x) ensures
| monotonicity and renders it amenable to easy optimization. Liu
| et al. (2020) demonstrates this periodic activation exhibits an
| improved extrapolation capability for temperature and financial
| data prediction."
| fagerhult wrote:
| Here is the MusicGen paper from Facebook research:
| https://arxiv.org/abs/2306.05284
|
| MusicGen is an LLM on top of EnCodec tokens, instead of working
| directly with audio. EnCodec is neural audio compression
| algorithm that encodes audio as tokens from a codebook. It's a
| really clever trick!
| IanCal wrote:
| The samples are outstanding. Even if they are cherry picked
| (not saying they _are_ but _even if_ ) the output seems
| incredible.
|
| https://ai.honu.io/papers/musicgen/
| onion2k wrote:
| I think it broke for me because I selected 140.06bpm. Adding
| 'step=1' to the range slider would help if the floating part was
| the cause.
| marban wrote:
| Long way to go before this is going to replace Splice et al.
| itairall wrote:
| [dead]
| Minor49er wrote:
| Prompting with "harsh noise wall" resulted in some cool
| industrial breakbeats instead of raw noise. Looks like AI will
| not be taking Merzbow's job any time soon
| [deleted]
| dylan604 wrote:
| is it just me that finds it weird that a thing that generates
| music loops can't loop the results in the provided player?
|
| Edit: am i mis-interpreting the term looper here? it just made an
| output with a fade out.
| [deleted]
| nerdbert wrote:
| Required me to make an account on github? No thanks.
| jnurmine wrote:
| I got some unexpected melodic mellow Indian-sounding sitar-music
| with the input prompt "suomisaundi". Not at all what I expected,
| but quite nice nevertheless!
|
| It worked better with "suomisaundi psychedelic trance
| spugedelic".
|
| This is a neat idea in many ways.
| verst wrote:
| It doesn't seem to like slow music. I jokingly gave it a prompt
| to create a wedding ceremony processional music for the entrance
| of the bride at ~60bpm (I'm getting married in 2.5 weeks). EDIT:
| Exact prompt "wedding procession bride entrance"
|
| File "predict.py", line 211, in predict raise ValueError(
| ValueError: Failed to generate a loop in the requested 60.23 bpm.
| Please try again.
|
| EDIT: At 52 bpm (exact) it seems to work. What it generated would
| not sound good if looped however. In terms of style.. it sounded
| a little music box like - celesta or so (think of the beginning
| of the Harry Potter soundtrack) with some sustained strings and
| pizzicato strings. That would be appropriate, except the rhythm
| and chords are fairly random and I wouldn't exactly call this
| musical :)
___________________________________________________________________
(page generated 2023-06-19 23:01 UTC)