[HN Gopher] Omniscient Mozart: library for automatic transcripti...
___________________________________________________________________
Omniscient Mozart: library for automatic transcription of every
aspect of music
Author : pizza
Score : 90 points
Date : 2021-12-18 19:15 UTC (3 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| jawns wrote:
| I tried transcribing from a YouTube link via the Colab link, but
| it generated a bunch of errors.
|
| I found this link to be more helpful than the GitHub repo for
| understanding what it does:
|
| https://music-and-culture-technology-lab.github.io/omnizart-...
| crawsome wrote:
| The colab has been downloading dependencies for 20+ minutes for
| me. The project is a great feat but this part could be
| improved.
| vji wrote:
| I'm still looking over this to see its capabilities, but if
| reading this right, we can turn any mp3/wav into a set of midis,
| which allows us to import into music editing software (like
| Finale). If this works, this is huge. Congrats to the team.
| emerged wrote:
| That is a tremendously big "if" considering how many times that
| problem has been attempted. Even just detecting the key of a
| song is awfully fuzzy.
| weinzierl wrote:
| Sounds incredible and I'm curious how well it works. For a quick
| intro about the state of the art in this space, watch the
| Melodyne videos on Youtube. In short and without having tried
| Omniscent Mozart: I would not expect that it gives perfect
| results without manual help. If it could aid transcription in a
| semi-automtic way, like Melodyne does, that would already be a
| big victory for an open source alternative.
| redka wrote:
| For anyone interested I've transcribed this song [1] using the
| replicate link the author provided (Colab throws errors for me)
| using mode music-piano-v2. It spits out mp3s there instead of
| midis so you can hear how it did [2]
|
| [1] https://www.youtube.com/watch?v=h-eEZGun2PM [2]
| https://replicate.com/p/qr4lfzsqafc3rbprwmvg2cw5ve
| slantedview wrote:
| How do you get a midi?
| redka wrote:
| You'd have to run it yourself. There's a docker image
| available but it's a pretty big download (11.7GB)
| vagabund wrote:
| Probably not feasible but I've always thought an app that graded
| your ability to sing along to your favorite music would be fun.
| Being able to automate the isolation of the vocal track to judge
| the user against would obviously be required, so it's nice to see
| some advancements in that direction.
| [deleted]
| revskill wrote:
| What does transcription mean ?
| yesenadam wrote:
| Well, usually (?) it means turning a piece of music (audio)
| into written sheet music/a score. It means that in jazz and...I
| believe many kinds of contemporary music. (In classical music
| I've heard it applied to e.g. turning an orchestral score into
| a piano score, i.e. an arrangement.) Here they appear to just
| make MIDI files, avoiding the problem of how to write the notes
| most readably, which is a significant part of transcription, in
| both these senses.
|
| All the examples given here, though, appear to be of a super-
| simple variety, with dead-simple chords, all notes with
| robotic, mathematically-simple timing over fixed tempos
| produced apparently by drum machines - like toy music, the kind
| of music that's no challenge at all to transcribe, and in the
| real world I wouldn't bother transcribing by hand as there's
| nothing to be learnt by doing so, as you can hear exactly
| what's going on without it. So, that's weird.
| tomcam wrote:
| In this context it means listening to music and writing it down
| in music notation.
| IggleSniggle wrote:
| To transfer / scribe something that you have heard. Just like a
| "transcript" is the written record of spoken words,
| transcription is the act of transferring something heads into
| written form.
|
| Transcription is a valued skill among musicians. The ability to
| hear a piece of music and write it down can be more than a
| little more difficult than transcribing speech.
|
| Not sure if apocryphal, but Mozart is known an expert
| transcriber, able to hear an orchestral work and write down all
| the different instruments as they played their parts on just
| one listen.
| jacquesm wrote:
| Anybody experimenting with this for piano: I highly recommend the
| Google 'Onsets and Frames' algorithm as embodied in their demo:
|
| https://piano-scribe.glitch.me/
|
| I built something similar which is a lot faster but on a large
| scale test the google software handily outperforms my own (92%
| accuracy versus 87% or so, and that is a huge difference because
| it translates into ~30% fewer errors).
| frutiger wrote:
| I just tried this with Sexy Sadie and the result was awful.
| pizza wrote:
| Wow the Onsets and Frames algorithm is insanely interesting.
| It's like a mixture of run-length encoding of (vertical and
| horizontal) strings of (0dim/time) and (1d/time) structures
| (onsets as points in time, activations as lines in time).
| But..hm.. why stop at such low dimensionality structures..! :^)
| slantedview wrote:
| I just tried this and it works very very nicely! Thank you for
| sharing!
___________________________________________________________________
(page generated 2021-12-18 23:00 UTC)