Home Technology AudioCraft is a new open-source music generation tool from Meta

AudioCraft is a new open-source music generation tool from Meta

by News7

TechSpot is celebrating its 25th anniversary. TechSpot means tech analysis and advice you can trust.

The big picture: Generative AI products are typically designed to easily create still images or text snippets by interpreting users’ instructions. The company formerly known as Facebook wants to expand this capability to include audio and music content in the equation.

Meta recently launched AudioCraft, its framework to generate “high-quality,” realistic audio and music, with an open-source license. The technology is designed to address a gap in the generative AI market, where audio creation has historically lagged behind. While some progress has already been made in this area, the company acknowledges that existing solutions are highly complicated, not very open, and not easily accessible for experimentation.

The AudioCraft framework is a PyTorch library for deep learning research on audio generation, comprising three main components: MusicGen, AudioGen, and EnCodec. According to Meta, MusicGen generates music from text-based user inputs, while AudioGen is designed to create audio effects. EnCodec, which was introduced in 2022, is a powerful encoding technology capable of “hypercompressing” audio streams.

The MusicGen AI model can generate catchy tunes and songs from scratch. Meta is providing some examples generated from text prompts such as “Pop dance track with catchy melodies, tropical percussions, and upbeat rhythms, perfect for the beach,” or “Earthy tones, environmentally conscious, ukulele-infused, harmonic, breezy, easygoing, organic instrumentation, gentle grooves.”

AudioGen can be used to generate environmental background audio effects, such as a dog barking or a siren approaching and passing the listener. The open-source release of EnCodec is an improved version of the codec showcased in 2022, as it now allows for higher-quality music generation with fewer artifacts.

AudioCraft provides a simplified approach to audio generation, which has always been a challenge. Creating any kind of high-fidelity audio requires modeling complex signals and patterns at varying scales, the company explains. Music is the most challenging type of audio to generate, as it consists of local and long-range patterns. Previous models used symbolic representations like MIDI or piano rolls to generate content, Meta explains, but this approach falls short when trying to capture all the “expressive nuances and stylistic elements” found in music.

Meta states that MusicGen was trained on approximately 400,000 recordings along with text descriptions and metadata. The model absorbed 20,000 hours of music directly owned by the company or licensed specifically for this purpose. Compared to OpenAI and other generative models, Meta appears to be striving to avoid any licensing controversies or potential legal issues related to unethical training practices.

Source : TechSpot

You may also like

AudioCraft is a new open-source music generation tool from Meta https://www.tentes-pour-enfants.com   https://francerestos.com   https://www.1nfo.net   https://petanimal.org   https://www.arkinos.net   -/- StripLac Mini Travel & Repair Set 130 First Kiss Red *  McGrey DJ système de karaoké Party-2000 1200W *  HUMMEL – Celestial X5 marine/rouge *  -*- Shropshire lady’s head shave assist for good friend with breast most cancers – Shropshire Stay *  Base Sports Nature : des stages de canoë-kayak et de multi-sports cet été – Ville de Cesson-Sévigné *  */* Pistolet Ecobrands Ltd Zap-it, soulage les démangeaisons après une piqûre d’insecte, vert *  Vikings receivers provide plenty of intrigue for upcoming season *  US-Bürger in Iran unter Hausarrest: Hoffnung auf Gefangenenaustausch *  * Seine-Saint-Denis : Le Blanc-Mesnil veut mettre les enfants au golf *  Cofra 19120-000.W47 Halfback S3 SRC Chaussure de sécurité Taille 47 Noir *  *-* https://navirotel.fr   https://www.epicerie-epicerie.com   https://www.village-global.com   https://boutique-maillot-bain.com   https://www.enigmesghisdiem.fr   https://www.chaussures-enligne.be/   AudioCraft is a new open-source music generation tool from Meta *AudioCraft is a new open-source music generation tool from Meta

news7.asia AudioCraft is a new open-source music generation tool from Meta