Any self-hosted alternatives to Plex's sonic analysis feature so far? reddit / selfhosted ---------------------------------------------------------------------- guygizmo · 2023-11-23 14:21 The recent debacle with Plex has gotten me looking into alternatives again. However they have one really killer feature that, last I looked into it, had no alternatives, which is the sonic analysis features that you can use with Plexamp. I'm specifically talking about the feature that scans each song in your music library (using a deep learning algorithm) and determines detailed metadata about its qualities like genre, instruments, types of vocals, mood, and other timbral qualities, and then lets you generate playlists based on this data. [Here's the page detailing the feature.](https://support.plex.tv/articles/sonic-analysis-music/) My favorite so far is being able to create a "Sonic Adventure" playlist, which lets you pick two or more tracks and then generate a playlist of tracks between them that gradually moves from one track you picked to the next. Has anyone made an attempt at an open source or self-hosted version of this so far? (Is there even an open source tool for scanning audio to obtain this sort of metadata?) ---------------------------------------------------------------------- XxNerdAtHeartxX · 2023-11-23 14:24 No, I wish. Its one of the things keeping me on plex too, because all other music players don't have those tools to help explore and not just listen. Ive explored a bit personally with 'analyzing music', but ended up putting it to the side in favor of other projects at the moment ---------------------------------------------------------------------- dweymouth · 2023-11-23 14:26 Yeah there isn't an open source alternative to this (the scanning tool itself). If someone were to create a sonic analysis library, eg something like `song2vec`, it would be easy for selfhosted servers to build in those features. It's the analysis itself that's missing and also is probably a huge undertaking. ---------------------------------------------------------------------- Conscious-Fault-8800 · 2023-11-23 14:35 Not that I know of. But maybe also ask in /r/musichoarders ---------------------------------------------------------------------- clintkev251 · 2023-11-23 15:00 Not that I've found. Plexamp + Sonic analysis (and everything that comes along with that) is one of the major factors that keeps me committed to Plex as my primary media server. I run Jellyfin alongside, but the music experience (as well as other things) just can't stand up to Plex yet ---------------------------------------------------------------------- Legitimate_Farm_3095 · 2023-11-23 15:06 > The recent debacle with Plex what debacle? ---------------------------------------------------------------------- matt0317 · 2023-11-23 15:13 Plex sent out emails to server owners with information about what their users have been watching. It was a "Check out what your users have been watching most!" kind of thing. Basically the data everyone already knows Plex collects was sent back to them as a feature and everyone freaked out. ---------------------------------------------------------------------- Legitimate_Farm_3095 · 2023-11-23 15:17 oh that .... yeah i remember getting the pop up awhile back and adjusting my settings instead of blindly clicking through and then not giving it a second thought. ---------------------------------------------------------------------- ScribeOfGoD · 2023-11-23 16:35 But how else can you blame the company later then 😂😂😂 ---------------------------------------------------------------------- SalamandaSandwich · 2023-11-23 17:37 From what I understand it is really just using this under the hood: https://essentia.upf.edu/index.html I wager they have picked a few of the ML models to generate all the features. All the sonic features then are based on a nearest neighbour type algorithm. Acousticbrainz used to exist as a repository of this information, but sadly has been discontinued