Riffusion is a free online web application that enables you to generate music using not audio but images of audio that are generated from lyrics. If it sounds weird to you, do not worry because that is the reality.
It was developed by Seth Forsgren and Hayk Martiros who collaborated on its development as an enhancement of Stable Diffusion, an open-source model designed to generate images based on plain language text prompts. Riffusion employs Stable Diffusion’s capabilities to generate spectrogram visuals, which depict the amplitude of various frequencies over time from audio data. Subsequently, these spectrogram visuals undergo a sophisticated machine learning process to be transformed into audio.
Working:
1. Click on this link to navigate to Riffusion and sign up for a free account using your Google credentials.
2. Click on the ‘Get started’ button and simply type or paste the lyrics in the text box. You can also record your lyrics by clicking on the ‘microphone icon and recording them. You can click on the ‘Write lyrics’ button to get some lyrics auto-generated for inspiration.
3. Next, describe the sound namely the Genre, Vocal style, Vibes and more and click on the ‘Riff’ icon. Click on the ‘Prompt Genius’ button and Riffusion will automatically describe the sound for you if you are not sure of the prompt.
4. Wait for some time while the AI models of Riffusion process your inputs and generate 3 variants of the audio for you along with the corresponding title. You can click on the ‘Play’ button and listen to any of the audio variants.
5. To copy the link to the audio, hover your cursor over the variant and click on the corresponding button. Likewise, click on the 3-dots icon at the top right of the audio variant and choose to download it in the form of an audio or video file. 
6. Alternatively, you can click on ‘Split out stems’ that can help you to grab the multiple individual tracks, such as drums, vocals, bass and more.
Closing Comments:
AI-generated music is a groundbreaking concept in itself, but Riffusion elevates it to a unique and unconventional level by creating intriguing and unconventional music through the utilization of image representations of sound, rather than traditional audio inputs.
We encourage you to give the product a try and kindly share your feedback with us about your experience. Click here to navigate to Riffusion.
