site banner
naraburns  nihil supernum  1yr ago (text post)   4432 thread views

Friday Fun Thread for February 17, 2023

Be advised: this thread is not for serious in-depth discussion of weighty topics (we have a link for that), this thread is not for anything Culture War related. This thread is for Fun. You got jokes? Share 'em. You got silly questions? Ask 'em.

4
Top Bottom Old Controversial Comments
Jump in the discussion.

No email address required.

Why does there not seem to be much progress with AI in the field of music? I am loving all the AI art and chatGPT stuff coming out but I'm really looking forward to AI implementations in music that are interesting. As a layperson it seems like it shouldn't be too difficult, as music is really rather formulaic at its most basic form.

Most of the AI music stuff I've seen so far has been music generated completely from scratch by AI but that isn't very interesting to me. How far away are we from convincing style transfer for example? I'd love to be able to convert a song into another style of music.

A few years ago I found this soundcloud account but the music is pretty garbled and prone to overfitting. Just seems like miles away from AI in other domains so I'm wondering if anyone has any insight into why AI music seems to be lagging behind AI in visual art and chat.

One theory I've seen bandied about is that the recording industry has a long and storied history of being very trigger-happy with lawsuits about their intellectual property, which led to AI devs being a bit more hesitant about training models on professionally published music. This is in contrast with Stable Diffusion, ChatGPT, and GitHub Copilot, which were all trained on publicly published but copyright protected images/text/code as well as public domain works. I don't know how much of an impact this actually had, but I imagine it's something at least on the back of the minds of devs. That said, there's no shortage of public domain music out there, and I wouldn't expect an AI trained only on classical music to be particularly bad - just limited.

Also, perhaps data size is an issue. A typical 3 minute song, even compressed, is far bigger in filesize than a typical image or text file. Sheet music could be used, though I'm also not sure how easy and cheap it is to get huge databases of sheet music. Scraping the internet for songs is also likely a bit more complicated than doing so for images and text, since generally music tends to be streamed by services which try intentionally to make it annoying to download the actual files, versus images and text which are trivial to right click + save.

There was, a couple months ago, some Stable Diffusion enthusiasts who developed what they called Riffusion which made use of the Stable Diffusion architecture to generate music. It involved training a model on image representations of sound waves, making the model generate new images of them and converting them back to sound. They got surprisingly decent results but the state of the tech then didn't seem like it could be used for much more than a toy, due in part to how short each output was. There are obviously workarounds to such limitations, but I don't know how far the development has come since then on actually bringing those workarounds to reality. Given that using Stable Diffusion to generate music is a hack, I'm not sure it'd be particularly worth it for devs to keep following that thread, but it's still a really clever and fun application of the tech.

Google's MusicLM is the most advanced model that have been publicly demonstrated as far as I know.

What is this place?

This website is a place for people who want to move past shady thinking and test their ideas in a court of people who don't all share the same biases. Our goal is to optimize for light, not heat; this is a group effort, and all commentators are asked to do their part.

The weekly Culture War threads host the most controversial topics and are the most visible aspect of The Motte. However, many other topics are appropriate here. We encourage people to post anything related to science, politics, or philosophy; if in doubt, post!

Check out The Vault for an archive of old quality posts. You are encouraged to crosspost these elsewhere.


Why are you called The Motte?

A motte is a stone keep on a raised earthwork common in early medieval fortifications. More pertinently, it's an element in a rhetorical move called a "Motte-and-Bailey", originally identified by philosopher Nicholas Shackel. It describes the tendency in discourse for people to move from a controversial but high value claim to a defensible but less exciting one upon any resistance to the former. He likens this to the medieval fortification, where a desirable land (the bailey) is abandoned when in danger for the more easily defended motte. In Shackel's words, "The Motte represents the defensible but undesired propositions to which one retreats when hard pressed."

On The Motte, always attempt to remain inside your defensible territory, even if you are not being pressed.


New post guidelines

If you're posting something that isn't related to the culture war, we encourage you to post a thread for it. A submission statement is highly appreciated, but isn't necessary for text posts or links to largely-text posts such as blogs or news articles; if we're unsure of the value of your post, we might remove it until you add a submission statement. A submission statement is required for non-text sources (videos, podcasts, images).

Culture war posts go in the culture war thread; all links must either include a submission statement or significant commentary. Bare links without those will be removed.

If in doubt, please post it!


Rules


Recommended Posts And Communities

Recommended Realtime Chats