AudioCraft logo

AudioCraft

Verified

AudioCraft is a research code base from Meta AI for generative audio, covering music generation, sound effect generation, and audio compression. It is built around three components: MusicGen for text-to-music generation, AudioGen for text-to-sound generation, and EnCodec, a neural audio codec that converts raw audio into discrete tokens. These tokens are modeled with a single autoregressive language model, which can be conditioned on text to control what is generated. It is aimed at researchers, developers and audio enthusiasts who want to experiment with or build on generative audio models, and the code is available publicly for those with the technical background to use it.

Visit Official Website

AudioCraft at a glance

What it is
AudioCraft is a research code base from Meta AI for generative audio, covering music generation, sound effect generation, and audio compression.
Who it's for
Most useful for anyone who needs results in the Voice Generators area without a specialist on staff.
Primary use case
AudioCraft is a single-stop code base for all your generative audio needs: music, sound effects, and compression after training on raw audio signals.
  • CategoryAI Music & Audio
  • PricingFree Tier
  • Starting priceFree, paid plans available
  • Credit cardNo credit card required
  • Foundation modelProprietary
  • Bring your own keyNot supported
  • RatingNo reviews yet. Be the first to rate.

Video Spot

No creator video yet. “Stop Getting Lost in the AI Labyrinth” — the official Zoipi platform showcase.

Overview

AudioCraft is a research code base from Meta AI for generative audio, covering music generation, sound effect generation, and audio compression. It is built around three components: MusicGen for text-to-music generation, AudioGen for text-to-sound generation, and EnCodec, a neural audio codec that converts raw audio into discrete tokens. These tokens are modeled with a single autoregressive language model, which can be conditioned on text to control what is generated. It is aimed at researchers, developers and audio enthusiasts who want to experiment with or build on generative audio models, and the code is available publicly for those with the technical background to use it.

AudioCraft is a single-stop code base for all your generative audio needs: music, sound effects, and compression after training on raw audio signals.

In detail

AudioCraft is a code base developed by Meta AI for generative audio tasks, including music generation, sound effect generation, and audio compression. Rather than offering a polished consumer app, it provides the underlying models and code that researchers and developers can use to generate audio from raw waveforms.

The system is built on three main components. EnCodec is a neural audio codec that converts raw audio signals into discrete tokens, splitting the audio into one or several parallel streams. MusicGen and AudioGen then use a single autoregressive language model to generate new sequences of these tokens, which are decoded back into audio using EnCodec. MusicGen focuses on text-to-music generation, producing diverse and long music samples from text inputs, while AudioGen focuses on text-to-sound generation, producing environmental sounds from text descriptions.

AudioCraft is intended for people working in audio research and machine learning, such as developers, researchers, and technically minded audio creators who want to experiment with or build on generative audio models. It is less suited to casual users looking for a simple point-and-click tool, since it is presented as a code base rather than a finished product with a user interface.

What differentiates AudioCraft is its simplified design compared to prior generative audio work. Instead of using multiple separate models or complex pipelines, it relies on a single autoregressive language model combined with an elegant token interleaving pattern to model parallel streams of audio tokens. This approach aims to capture long-term dependencies in audio while still producing high-quality output, using a unified framework across music generation, sound generation, and compression tasks.

Because it conditions generation using a pretrained text encoder, AudioCraft supports text-to-audio applications, allowing users to describe what they want in text and have the model attempt to generate matching audio, whether that is music or environmental sound effects.

Common uses

  • Generating music samples from text descriptions
  • Generating environmental sound effects from text descriptions
  • Researching generative audio modeling techniques
  • Compressing raw audio into discrete tokens using EnCodec
  • Building custom applications on top of MusicGen, AudioGen, or EnCodec

Pros

  • Covers multiple generative audio tasks (music, sound, compression) in one code base
  • Simplified single-model design compared to prior multi-model approaches
  • Open code with model cards and technical details available
  • Supports text-to-audio conditioning for more controllable generation

Cons

  • Presented as a research code base rather than a polished end-user application
  • Requires technical knowledge to set up and run
  • No stated information about a hosted interface, API, or support for non-technical users

Generated from the listing's details and not yet checked by a Zoipi editor.

Key Features

  • MusicGen: text-to-music generation that produces diverse and long music samples from text inputs
  • AudioGen: text-to-sound generation focused on producing environmental sounds from text
  • EnCodec: a neural audio codec that converts raw audio into discrete tokens
  • Single autoregressive language model: models parallel streams of audio tokens with a token interleaving pattern
  • Text conditioning: uses a pretrained text encoder to enable text-to-audio generation
  • Public code base: available code, model cards, and technical details for the models

Best For

  • Specialists looking for a dedicated tool rather than a general assistant
  • Users working with Voice Generators
  • Anyone testing the space without an upfront budget
  • Buyers who want a highly rated, well-established option

Pricing Model

Free Tier. Generous ongoing free tier you can start with, no credit card needed. Paid plans unlock higher limits.

Pricing Breakdown

Starting price
Free, paid plans available
Free trial / credits
Ongoing free tier, no time limit
Credit card
No credit card required
Freemium

Screenshots

Live preview of AudioCraft's website.

Frequently asked questions

AudioCraft is used for generative audio tasks, including generating music and sound effects from text and compressing raw audio into discrete tokens.

Community Reviews & Discussion

0 reviews · replies are moderated before they appear.

  • No reviews yet — be the first to review AudioCraft.