DrumBot

Need a drummer but don't know anybody? Try DrumBot! Play real-time music with a machine learning drummer that drums based on your melody.

Settings

You're going to play music on your...
Keyboard
MIDI

How to use

Press the record button. This will start a metronome, but you don't have to start recording your melody as soon as it starts!
When you're ready, start playing something -- the more "on beat" you are, the better your results will be
After you've played up two 2-bars (including whatever leading silence you had), that melody will start looping (and will be shown in the visualizer in yellow
This loop will be used to generate a drum pattern that matches the melody (this will be shown in the visualizer in blue
The drums will be re-generated on every 2-bar chunk. You can control their randomness (or entropy) with the temperature input. You can keep the current drum loop and not re-generate it on the next 2-bar chunk by pressing v
You can mute or unmute any of the loops (including the metronome) using the sliders on the left of the keyboard

Keyboard shortcuts

m mutes/unmutes the melody loop
n mutes/unmutes the drums loop
v toggles between re-generating the drums on every new 2-bar chunk, or keeping the current drum loop
b key restarts your current recording from scratch
z or x change the piano octave

How does it work?

This app uses an open-source Magenta model called Drumify. It is able to convert a constant-velocity 'tap' pattern into a drum pattern
DrumBot records 2 bars of your melody, removes the pitches from it (so that it's a sequence of taps), and then sends it to the model
All of the machine learning code happens in the background, on a Node server, so that your realtime audio is never interrupted
You can read more about how the model was trained on the Magenta blog, or see the code for this app on GitHub