ACE-Step 1.5: Local Music Generation That Outperforms Suno v5 on Benchmark Evaluations

ACE-Step 1.5, developed by ACE Studio and StepFun, scores 8.09 on the SongEval benchmark and outperforms Suno v5, according to arXiv paper 2602.00744. The model generates a full song in under 2 seconds on an NVIDIA A100 GPU, runs on consumer hardware with less than 4GB of VRAM, and is released under an MIT license with downloadable weights on HuggingFace.

Suno Pro costs $24 per month. Udio costs $30 per month. ACE-Step 1.5 is free.

Nine Ways to Use It

The model covers nine distinct generation and editing modes. The three foundation modes are Text2Music (original song from a text prompt with optional lyrics), Lyric2Vocal (LoRA fine tuned vocal synthesis), and Text2Samples (short audio sample generation). The three editing modes are Variations, Repaint (region level regeneration of an existing track), and Edit (Flow-Edit prompt guided audio editing, added in v0.1.8). Three specialized ControlNet and LoRA variants round out the application map: RapMachine, StemGen (stem isolation and generation), and Singing2Accom (generate a full backing arrangement from a vocal track).

For film production, the most directly useful modes are Singing2Accom for turning a scratch vocal into a scored backing track, StemGen for isolating or replacing individual instruments, Repaint for editing a specific section of a cue without regenerating the full track, and Text2Music for original score generation from scene descriptions.

The v0.1.8 update (May 18, 2026) added Flow-Edit, a prompt guided editing redesign on top of the remix workflow, and Retake variation generation, which regenerates a specific section with a variance parameter from 0.0 to 1.0.

Architecture: Language Model as Planner, Diffusion Transformer as Generator

ACE-Step 1.5 uses a hybrid architecture that pairs a Language Model with a Diffusion Transformer. Per the paper abstract, the LM "functions as an omni-capable planner" that handles musical structure, lyric alignment across 50+ languages, and style conditioning. The Diffusion Transformer then generates the actual audio from the LM's plan.

Alignment is achieved through intrinsic reinforcement learning, using the model's own internal signals as reward feedback rather than external evaluation models. On the audio encoding side, a Deep Compression AutoEncoder compresses 44.1kHz stereo audio at 8× compression for efficient latent space generation, with MERT and m-Hubert representations providing musical understanding during training.

Performance Against Commercial Music AI

On SongEval, the authors report a score of 8.09, outperforming Suno v5. Additional benchmark scores from arXiv 2602.00744: AudioBox 7.42, Style Alignment 6.47, Lyric Alignment 8.35. The developers write: "On common evaluation metrics (SongEval & AudioBox), it beats SUNO and other commercial music models."

Generation speed is the other headline claim. The model produces a full song in under 2 seconds on an NVIDIA A100 and under 10 seconds on a GeForce RTX 3090. The authors report 100× faster generation than traditional pure language model architectures, and 15× faster than LLM based music baselines for compositions up to 4 minutes.

Film Production Applications

A film score generated from a text description of a scene, specifying tempo, instrumentation, and mood, can be produced in seconds locally without a subscription. The Singing2Accom mode takes a vocal track and generates a full backing arrangement from it. StemGen can isolate or regenerate individual instruments from a mixed cue, useful for creating variations on a licensed track.

The v0.1.8 Flow-Edit feature brings audio editing closer to how video editors work with footage. You describe what you want changed in a section using a text prompt rather than regenerating the full track. The Retake feature provides variance controlled regeneration for specific segments, the same pattern that exists in image generation workflows applied to audio.

The HuggingFace model card states the model was trained on legally compliant datasets including licensed music and royalty free content. For commercial productions, that provenance statement is meaningful: it reduces downstream copyright exposure in a way that models with undisclosed training data sources cannot. The MIT license permits use in commercial production pipelines without restriction.

The AI FILMS Studio music workspace provides access to AI music generation tools for film and video production. For other open source models in the audio space, see Magenta RealTime 2 and Stable Audio 3. The Suno tutorial covers a commercial alternative; ACE-Step 1.5 offers a locally runnable option with a verifiable benchmark comparison against Suno v5.

Getting Started

ACE-Step 1.5 requires Python 3.11 or 3.12. Installation uses the uv package manager: clone the GitHub repository, run uv sync, then launch the web UI with uv run acestep or the REST API with acestep-api. The model runs on NVIDIA CUDA, AMD ROCm, Intel XPU, and Apple CPU.

VRAM	Recommended variant
6GB or less	2B turbo with INT8 quantization
6–8GB	2B turbo + 0.6B LM
8–16GB	2B turbo/sft + 0.6B or 1.7B LM
20GB and above	XL 4B DiT without offload

Four model variants are downloadable from HuggingFace: acestep-v15-base, acestep-v15-sft, and acestep-v15-turbo. The XL 4B DiT series was added April 3, 2026. Weights are available at ACE-Step/Ace-Step1.5 on HuggingFace.

Try It Live

The embedded demo below runs the full ACE-Step 1.5 model. Enter a genre description or mood, add optional lyrics, and generate. Works on all browsers.

The table below shows sample prompts from the General Songs section of the official project page. To hear the pre-generated audio examples, visit ace-step.github.io directly. The sample files use a format that requires Chrome or Firefox.

Prompt	Section
electronic, rock, pop	General Songs
funk, pop, soul, melodic	General Songs
background music for parties, radio broadcasts, streaming platforms, female voice	General Songs
surf music	General Songs

The project page includes additional demo sections for Instrumentals, Cover Generation, Repainting, Retake variation, Flow-Edit audio editing, Multi-language lyrics, RapMachine, and Lyric-to-Vocal conversion.

---

Sources

arXiv: ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generation
arXiv: ACE-Step: A Step Towards Music Generation Foundation Model
GitHub: ace-step/ACE-Step-1.5
HuggingFace: ACE-Step/Ace-Step1.5
HuggingFace Space: ACE-Step/Ace-Step-v1.5
Project page: ace-step.github.io
AMD Developer Blog | Medium (@acemusic)