Meet Google’s Magenta RealTime 2: a nifty open model that allows musician to play any instrument. It is a real-time neural synthesis engine that lets you build your own musical instrument on your laptop. MRT2 is a live, interactive model that you can control with MIDI and audio as well as text. It relies on low-latency on-device inference to respond.
Introducing Magenta RealTime 2, a new open model musicians can play as an instrument!
Run low-latency, live music synthesis natively on your MacBook using MIDI, text, and audio. 🎶
We love seeing Google’s open model ecosystem grow! pic.twitter.com/80jc3S5uua
— Google Gemma (@googlegemma) June 4, 2026
You can use something like this to clone sounds and blend styles. It has an open source Python library for inference via JAX/MLX using SequenceLayers. You will need a MacBook to run this effectively.
[HT]
