Udio

Udio
Developer(s)Udio
Initial releaseApril 10, 2024; 6 months ago (2024-04-10)
Stable release
v1.5 / July 23, 2024
TypeGenerative artificial intelligence
Websiteudio.com

Udio is a generative artificial intelligence model that produces music based on simple text prompts. It can generate vocals and instrumentation. Its free beta version was released publicly on April 10, 2024. Users can pay to subscribe monthly or annually to unlock more capabilities such as audio inpainting.

Founded in December 2023 by a team of former researchers for Google DeepMind headed by Udio's CEO, David Ding, the program received financial backing from the venture capital firm Andreessen Horowitz and musicians will.i.am and Common, among others. Critics praised its ability to create realistic-sounding vocals while others raised concerns over the possibility that its training data contained copyrighted music.

History

[edit]

Udio was created in December 2023 by a team of four former researchers for Google DeepMind, including Udio's CEO David Ding, Conor Durkan, Charlie Nash, Yaroslav Ganin, as well as Andrew Sanchez[1][2] under the name of Uncharted Labs.[3] The venture capital firm Andreessen Horowitz; the music distributor UnitedMasters; musicians will.i.am, Tay Keith, and Common; investor Kevin Wall; Instagram cofounder Mike Krieger; and DeepMind researcher Oriol Vinyals all provided financial backing for Udio, and it was valued at $10 million in seed funding (plus the original $8.5 million raised previously).[3][4] It spent several months in a closed beta phase before being publicly released in its beta phase on April 10, 2024 on the Udio website.[5] As of April 2024, it allows users to generate 600 songs per month for free.[6] Sanchez described it as "enabl[ing musicians] to create great music and ... to make money off of that music in the future".[1] Udio's release followed the releases of other text-to-music generators such as Suno AI and Stability Audio.[7]

Udio was used to create "BBL Drizzy" by Willonius Hatcher, a parody song that went viral in the context of the Drake–Kendrick Lamar feud, with over 23 million views on Twitter and 3.3 million streams on SoundCloud the first week.[8]

In August 2024, Verknallt in einen Talahon (In Love with a Talahon ) a song generated with Udio by Austrian producer Butterbro became the first AI-generated song in the German Top 50.[9]

Capabilities

[edit]

Udio bases the songs it creates on text prompts, which can include their genre (including barbershop quartet, country, classical, hip hop, German pop, and hard rock, among others), lyrics, story direction, and other artists to base their sound on. Its lyrics are created with a large language model (LLM), while the process used to generate the music itself, as of April 2024, has not been disclosed.[10] The program generates two songs based on the prompts and users can "remix" their songs with further text prompts.[11] Songs are first generated as roughly 30 second-long pieces, and can be extended by additional 30 second increments.[6] Paying subscribers can access advanced functionality such as audio inpainting. [12][13]

Reception

[edit]

Mark Hachman, the senior editor of PC World, compared Udio to AI art generators and praised its ability to turn "a few rather poor lyrics" into a "rather catchy" song, also calling the vocals it generated "incredibly realistic and even emotional".[6] Sabrina Ortiz of ZDNET described the songs it generated as being "impressive" and sounding "as though they were produced professionally". She also called them "fuller and richer" than those of other text-to-music generators, which she said it had "more personalization options" than.[5] Tom's Guide's Ryan Morrison wrote that Udio had "an uncanny ability to capture emotion in synthetic vocals" and was the only AI music generator "to have captured the passion, pain and spirit of a vocal performance".[14] He added that the program was geared toward "people with no or minimal musical ability".[2] Brian Hiatt of Rolling Stone wrote that Udio was "more customizable but also perhaps less intuitive to use" than Suno AI and added that "some early users have suggested that on average, Udio's output may sound crisper than Suno's".[1]

For Ars Technica, Benj Edwards wrote that Udio's generation capability was imperfect and "less impressive" than Suno AI's, noting that its songs were substantially shorter than Suno AI's. He also called the songs it produced "half-baked and almost nightmarish".[10] In response to the company's announcement of Udio's beta release on Twitter, Telefon Tel Aviv member Joshua Eustis tweeted that Udio was "an app to replace musicians" and called into question the data that it used. Udio has also been criticized online as "soulless" and for having the potential to create audio deepfakes.[11][7] Lucas Ropek of Gizmodo stated that Udio was "full of acoustical nonsense" and that its songs were "extraordinarily bad".[15]

[edit]

Critics of Udio have questioned what data was used to train it and if that data consisted of copyrighted music. Rolling Stone wrote that there was "substantial reason to believe" that both Udio and Suno AI were trained with copyrighted music, while Benj Edwards of Ars Technica wrote that its training data was "likely filled with copyrighted material".[10][11] Udio does not directly recreate copyrighted songs if prompted.[6] Ding has stated that Udio has "extensive automated copyright filters" and that the company is "continually refining [its] safeguards".[7] Stability AI took a different approach with Stable Audio 2.0, and used an explicitly licensed dataset of music called AudioSparx.[16]

In June 2024, a lawsuit, lead by the Recording Industry Association of America, was filed against Udio and Suno alleging widespread infringement of copyrighted sound recordings. The lawsuit sought to bar the companies from training on copyrighted music, as well as damages of up to $150,000 per work from infringements that have already taken place.[17][18]

See also

[edit]

References

[edit]
  1. ^ a b c Hiatt, Brian (April 10, 2024). "AI-Music Arms Race: Meet Udio, the Other ChatGPT for Music". Rolling Stone. Retrieved April 15, 2024.
  2. ^ a b Morrison, Ryan (April 10, 2024). "Meet Udio — the most realistic AI music creation tool I've ever tried". Tom's Guide. Retrieved April 15, 2024.
  3. ^ a b Louise, Nickie (2024-01-31). "Uncharted Labs, an AI startup founded by three Google Deepmind researchers, raises $8.5 million in funding - Tech Startups". Tech Startups. Retrieved 2024-06-01.
  4. ^ Tencer, Daniel (April 10, 2024). "New AI-powered 'instant' music-making app Udio raises $10m; launches with backing from will.i.am, Common, UnitedMasters, a16z". Music Business Worldwide. Retrieved April 15, 2024.
  5. ^ a b Ortiz, Sabrina (April 10, 2024). "Is Udio really the best AI music generator yet? I put it to the test and so can you". ZDNET. Retrieved April 15, 2024.
  6. ^ a b c d Hachman, Mark (April 11, 2024). "Udio's AI music is my new obsession". PC World. Retrieved April 15, 2024.
  7. ^ a b c Nuñez, Michael (April 11, 2024). "Former Google DeepMind researchers launch AI-powered music creation app Udio". VentureBeat. Retrieved April 15, 2024.
  8. ^ Lawrence, Andrew (May 9, 2024). "'I bet Drake heard it and laughed': BBL Drizzy is the real winner of the Drake-Kendrick feud". The Guardian. Retrieved May 12, 2024.
  9. ^ Oltermann, Philip; Cole, Deborah (2024-08-18). "AI-generated parody song about immigrants storms into German Top 50". The Guardian. ISSN 0261-3077. Retrieved 2024-10-13.
  10. ^ a b c Edwards, Benj (April 10, 2024). "New AI music generator Udio synthesizes realistic music on demand". Ars Technica. Retrieved April 15, 2024.
  11. ^ a b c Eede, Christian (April 12, 2024). "'Game-changing' new app generates music from text prompts". DJ Mag. Retrieved April 15, 2024.
  12. ^ Bastian, Matthias (2024-05-10). "AI music app Udio rolls out new features and subscription plan". the decoder. Retrieved 2024-05-30.
  13. ^ "How do I make music with Udio?". Udio. May 8, 2024. Retrieved May 29, 2024.
  14. ^ Morrison, Ryan (April 11, 2024). "Udio is a game changer for AI music — 9 best prompts to try now". Tom's Guide. Retrieved April 15, 2024.
  15. ^ Ropek, Lucas (April 11, 2024). "Dune, the Broadway Musical and 8 Other Brain-Dead Songs From Udio's AI Music Generator". Gizmodo. Retrieved April 15, 2024.
  16. ^ "Introducing Stable Audio 2.0". Stability AI. April 3, 2024. Retrieved 2024-06-01.
  17. ^ Sato, Mia (2024-06-24). "Major record labels sue AI company behind "BBL Drizzy"". The Verge. Retrieved 2024-06-24.
  18. ^ Robinson, Kristin (2024-06-24). "Major Labels Sue AI Firms Suno and Udio for Alleged Copyright Infringement". Billboard. Retrieved 2024-06-24.
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=Udio&oldid=1253935998"