Piano Genie in Bangkok, Thailand: how a Google Magenta project let anyone improvise on 88 keys with eight buttons, and why Bee reads the tempo in her AI piano lessons

Bee is twelve and goes to a school that runs a technology fair every November in Bangkok, Thailand. This year her group wanted to show something musical and clever. Her older cousin, who studies computer engineering, showed her a website where she could press just eight keys on a laptop and hear flowing keyboard melodies. Bee was hooked immediately.

The project was called Piano Genie. It came from Magenta, a research team at Google that explores how machine learning can support music and art. The researchers behind it, Chris Donahue, Ian Simon and Sander Dieleman, described the system in a paper presented at an academic conference on intelligent user interfaces in 2019.

The idea is simple to try and sophisticated underneath. A player presses eight buttons, arranged from low to high. The system does not simply map each button to one note. Instead, a neural network listens to the pattern of presses, such as moving upwards or repeating, and chooses notes across all 88 keys of a piano that fit that shape.

To learn how real pianists move, the model was trained on a large collection of recorded piano performances by skilled competition players. From that data it learned which note choices tend to follow one another and how melodies rise and fall. When Bee pressed buttons from left to right, the music climbed in a way that sounded natural.

The researchers framed Piano Genie as a kind of intelligent instrument. A beginner can improvise expressively within seconds, while the AI handles the detailed note choices. The experience shows how machine learning might lower barriers to music-making, especially for people who have never studied an instrument or who have physical difficulties with a full keyboard.

Bee noticed its limits too. She could control direction and rhythm but not exactly which notes sounded. That meant she could never play a specific song she wanted. Her cousin explained that the tool was designed for improvisation and exploration, not for performing written music, and that this is an important difference.

Bee's own piano lessons happen through TiGA AI, an online piano learning app that her parents chose because they both work long hours. The app's AI piano teacher listens to her real playing on a keyboard and tells her when notes or timing go wrong. She realised it uses AI in the opposite direction: Piano Genie makes the choices for you, while her app helps you make them yourself.

For the fair, her group built a display comparing the two. Visitors could try Piano Genie on a laptop, then try a short melody on a real keyboard with Bee guiding them. Many people laughed with delight at Piano Genie, then concentrated hard on the real keys. Bee explained that both experiences have value but teach different things.

The structured piano course in the app helped Bee prepare a short demonstration piece, a gentle melody with a simple accompaniment. She practised it every evening for two weeks, watching the feedback screen to see where her left hand hesitated. By fair day, she could play it reliably while answering questions from visitors.

Before her demonstration, Bee spends a second on the tempo word at the top of the first line, Andante or Allegro, deciding how fast to start before any key goes down. She explained to visitors that Piano Genie listens to how fast you press buttons, while a real pianist chooses speed from the music. That comparison made her display one of the most popular stands.

Eight buttons, eighty-eight keys

For any child who wants to learn piano, tools like Piano Genie can be a delightful introduction to the joy of improvising. They show that music can feel natural and fun from the very first minute. Real learning then builds the skill to choose every note yourself, which makes it possible to play music exactly as you imagine it.

Her music lessons at school now include a brief module on technology and creativity, partly inspired by the fair. Bee's teacher invited her to demonstrate Piano Genie to younger pupils, then show them a few notes on the classroom keyboard. Several children asked how they could start learning, and Bee happily pointed them to the music room.

Bee still visits the Piano Genie website now and then, pressing the eight buttons for fun after homework. Then she turns to her keyboard and continues her AI piano lessons, practising the pieces that she can play note by note. She says the genie is a great friend, but she would rather be the magician herself when she wants to play piano for her family.

Frequently asked questions

Q: What is Piano Genie? A: Piano Genie is a research project from Google's Magenta team, created by Chris Donahue, Ian Simon and Sander Dieleman. It lets a person improvise on a full piano range using only eight buttons, with a neural network choosing the actual notes.

Q: How was Piano Genie trained? A: The model learned from a large collection of recorded piano performances by competition pianists, so it could predict which piano notes matched the up-and-down patterns of the buttons.

Q: Does Piano Genie replace AI piano lessons? A: No. It is an experiment in playful music-making. An online piano learning app teaches real keyboard skills, while tools like Piano Genie show how AI can open music to new players.

Want a clear next step for your playing? Prefer opening Prefer opening TIGA AI: https://tigaalpha.github.io/landing-en/ — this is our top recommendation. First 100 users get 1 month free. Prefer live studio teaching instead? See https://www.tigastudio.net/, where live piano lessons are capped at at most 30 hours per week, so seats stay limited.