Convert audio to stems to MIDI! Extract vocals, melody, bass, drums to midi with customizable settings!

• Supported fomats: wav, mp3 and flac 🗣️
• Usage: Use in command-line 🖥️ or through Web UI 🌐
• Stem Separation: Extract vocals, melody, drums, or bass from audio 🎙️
• BPM Detection: Auto-detect tempo or set manually ⏱️
• MIDI Conversion: Convert stems or audio to MIDI with adjustable sensitivity and pitchbend 📊
• Playback: Listen to exported MIDI files instantly 🎹
• Quantization: Align notes to 16th-note grids (or custom ticks) 🔧
• Maximum input file size: 100MB 📢

# python version >= 3.8
git clone or download this repo and unzip
cd MIDIfren/
pip install -r requirements.txt

python MIDIfren.py --web
# Go to localhost:7860 to see the UI

python MIDIfren.py -i <input_audio> -t <sound_type> [options]

Options:

• -t, --type : Choose type: vocals, melody, drums, bass
• -b, --bpm : Set BPM (e.g., 120) or skip this and MIDIfren will autodetect
• -m, --midi : Convert audio to midi
• -s, --stem : Extract stem based on type selected
• -q, --quantize : Quantize generated midi
• -p, --pitchbend : Detect pitchbend
• -n, --note : Set minimal note length, everything below that will be ignored
• -o, --onset : Adjust note trigger sensitivity (0-1, default = 1)
• -g, --groove : Set timesignature for drums e.g., '4/4'
• -l, --listen : Play generated MIDI file or exported stem immediately 🎶
• -w, --web : Launch localhost gradio webUI

# extract vocal stem from the audio and convert it to midi (with pitchbend) and listen to it
python MIDIfren.py -i input.wav -type vocals --stem --midi --pitchbend --listen

# extract drums from audio and convert it to midi (with quantization) and listen to it
python MIDIfren.py -i input.wav -type drums --stem --midi --quantize --listen

# extract bass stem from audio file and listen to it
python MIDIfren.py -i input.wav -type bass --stem --listen

# convert audio file to midi directly and listen (no stem extraction)
python MIDIfren.py -i input.wav -type drums --midi --listen

Output:

Midi files, sonified midi and stems will be in the output folder.

• output/drums.wav (stem)
• output/drums.mid (MIDI)
• ...

Note:

• All audio is automatically normalized and trimmed for silence before processing.
• Depending on the input audio (fast drums or sustained notes and drones) you may need to play with sensitivity and minimal note length. In general, if you want less notes in you midi file raise sensitivity to 0.8 or 1.0.

Made with ❤️ for audio enthusiasts & music devs! 🎶