2017 was our 20th year online!

Welcome to the Piano World Piano Forums
Over 3 million posts about pianos, digital pianos, and all types of keyboard instruments
Join the World's Largest Community of Piano Lovers (it's free)
It's Fun to Play the Piano ... Please Pass It On!

Shop our online store for music lovers
SEARCH
Piano Forums & Piano World
(ad)
Petrof Pianos
Petrof Pianos
(ad)
Best of Piano Buyer
 Best of Piano Buyer
(ad)
Faust Harrison Pianos
Faust Harrison 100+ Steinway pianos
Who's Online Now
57 members (AlphaBravoCharlie, bobrunyan, 3B43, Animisha, Beowulf, 36251, 22 invisible), 464 guests, and 295 robots.
Key: Admin, Global Mod, Mod
(ad)
Estonia Pianos
Estonia Pianos
Previous Thread
Next Thread
Print Thread
Hop To
Glenn Gould on MIDI Transcribed Using Google Magenta
#3011255 08/07/20 04:33 PM
Joined: Aug 2020
Posts: 8
E
Junior Member
OP Offline
Junior Member
E
Joined: Aug 2020
Posts: 8
I'm using Google's new Magenta project to transcribe piano audio recordings to MIDI.

For those interested, I've posted a MIDI converter script on GitHub that makes resulting MIDI's compatible with Yamaha Modus and Clavinova digital pianos. I've included transcribed Glenn Gould MIDI's as part of this repo.

I have not been able to find any documentation on Yamaha's sequencer specific meta messages, and would appreciate any pointers on this.

Nonetheless, the Magenta-transcribed MIDIs sound quite good. It's remarkable to have a Gould performance on a modern digital piano.

Here's an example: a transcription of Gould's performance of Bach's Well-Tempered Clavier, Fugue No 20 in A minor (BWV 865):
[Linked Image]

(ad int) Petrof Pianos
Petrof Pianos
Re: Glenn Gould on MIDI Transcribed Using Google Magenta
essandess #3011385 08/08/20 12:40 AM
Joined: Apr 2018
Posts: 289
H
Full Member
Offline
Full Member
H
Joined: Apr 2018
Posts: 289
Fantastic! I’m wondering how you generate the midi for the gould performances? Did you train the model locally using the dataset and run the model by yourself?

Re: Glenn Gould on MIDI Transcribed Using Google Magenta
essandess #3011427 08/08/20 06:07 AM
Joined: Aug 2020
Posts: 8
E
Junior Member
OP Offline
Junior Member
E
Joined: Aug 2020
Posts: 8
All the processing details are at GitHub and embedded within the MIDI files there.

I simply ran onsets_frames_transcription using the MAESTRO pre-trained dataset with this checkpoint:

Code
 onsets_frames_transcription_transcribe \
  --model_dir="path/to/checkpoint" \
  <piano_recording1.wav, piano_recording2.wav, ...>

The MAESTRO dataset used to train this transcription model is comprised in part of MIDI's created by John Walker's (Zenph founder) code. Text message from the MIDI dataset:

Code
File processed for distribution with software designed and coded by Dr. John Q. Walker

Originally Posted by Harpuia
Fantastic! I’m wondering how you generate the midi for the gould performances? Did you train the model locally using the dataset and run the model by yourself?

Re: Glenn Gould on MIDI Transcribed Using Google Magenta
essandess #3011507 08/08/20 11:23 AM
Joined: Jun 2004
Posts: 824
500 Post Club Member
Online Content
500 Post Club Member
Joined: Jun 2004
Posts: 824
This is very interesting. Thank you for sharing.
Would you post a brief sound clip as well?


Andrew Kraus, Pianist
Educated Amateur Tuner/Technician
I Make Music that Lifts People Up & Brings Them Together
Rockville, MD USA
www.AndrewKraus.com
www.YouTube.com/RockvillePianoGuy
Twitter at @IAmAPianist

1929 Steinert 6'10" (Close copy of New York S&S "B")
Re: Glenn Gould on MIDI Transcribed Using Google Magenta
essandess #3011538 08/08/20 12:41 PM
Joined: Feb 2019
Posts: 2,523
L
2000 Post Club Member
Offline
2000 Post Club Member
L
Joined: Feb 2019
Posts: 2,523
I can’t wait to try this on a Disklavier. Midi is midi, it should work, no? Does it create Type 0 or 1 midi files?

If Gould, why not other artists?

Last edited by LarryK; 08/08/20 12:41 PM.
Re: Glenn Gould on MIDI Transcribed Using Google Magenta
essandess #3011542 08/08/20 12:50 PM
Joined: Feb 2019
Posts: 2,523
L
2000 Post Club Member
Offline
2000 Post Club Member
L
Joined: Feb 2019
Posts: 2,523
Uchida!

Re: Glenn Gould on MIDI Transcribed Using Google Magenta
Seeker #3011551 08/08/20 01:14 PM
Joined: Aug 2020
Posts: 8
E
Junior Member
OP Offline
Junior Member
E
Joined: Aug 2020
Posts: 8
Originally Posted by Seeker
Would you post a brief sound clip as well?

It’s MIDI, so the sound reproductions depends on the sequencer, device, and room acoustics. Simply download the MIDIs and listen to them on a MIDI device or computer.

Re: Glenn Gould on MIDI Transcribed Using Google Magenta
LarryK #3011562 08/08/20 01:32 PM
Joined: Aug 2020
Posts: 8
E
Junior Member
OP Offline
Junior Member
E
Joined: Aug 2020
Posts: 8
Originally Posted by LarryK
I can’t wait to try this on a Disklavier. Midi is midi, it should work, no? Does it create Type 0 or 1 midi files?

If Gould, why not other artists?

I had to hack the MIDIs to get working playback on a Modus. They’re type 0, and it’s easy to convert to type 1.

They may just play on a Disklavier. If not, the `sysex` and `sequencer_specific` messages may have to be swapped out for the ones that the Disklavier uses. This is a straightforward modification of the script midi_yamaha_modus_convert.py using the Disklavier-specific MIDI headers from the tracks at Yamaha's Disklavier Education Network.

It’s worth the effort to be able to listen to these performances on a decent instrument. Magenta transcription can be run on any audio recording, whether from Gould, Uchida, Argerich, or your own recordings.

Re: Glenn Gould on MIDI Transcribed Using Google Magenta
essandess #3011576 08/08/20 02:15 PM
Joined: Feb 2019
Posts: 2,523
L
2000 Post Club Member
Offline
2000 Post Club Member
L
Joined: Feb 2019
Posts: 2,523
Originally Posted by essandess
Originally Posted by LarryK
I can’t wait to try this on a Disklavier. Midi is midi, it should work, no? Does it create Type 0 or 1 midi files?

If Gould, why not other artists?

I had to hack the MIDIs to get working playback on a Modus. They’re type 0, and it’s easy to convert to type 1.

They may just play on a Disklavier. If not, the `sysex` and `sequencer_specific` messages may have to be swapped out for the ones that the Disklavier uses. This is a straightforward modification of the script midi_yamaha_modus_convert.py using the Disklavier-specific MIDI headers from the tracks at Yamaha's Disklavier Education Network.

It’s worth the effort to be able to listen to these performances on a decent instrument. Magenta transcription can be run on any audio recording, whether from Gould, Uchida, Argerich, or your own recordings.

Thanks. One way or another, they can be made to play on the Disklavier, I think. I work with a couple of machine learning guys, I'll run this project by them.

If all goes well, I'll take delivery of a Yamaha DYUS5, a Disklavier YUS5, in the near future. This project opens up a whole new world for me. How exciting!

Last edited by LarryK; 08/08/20 02:16 PM.
Re: Glenn Gould on MIDI Transcribed Using Google Magenta
LarryK #3011593 08/08/20 03:04 PM
Joined: Aug 2020
Posts: 8
E
Junior Member
OP Offline
Junior Member
E
Joined: Aug 2020
Posts: 8
Originally Posted by LarryK
Thanks. One way or another, they can be made to play on the Disklavier… If all goes well, I'll take delivery of a Yamaha DYUS5, a Disklavier YUS5, in the near future. This project opens up a whole new world for me. How exciting!

They’ll definitely play.

I’m curious to hear opinions about the transcription quality. It’s highly musical and enjoyable to my ear.

The Magenta team’s paper reports F1 scores of around 80% for the frame and notes, around 50% for the note+offset, and 35% for note+offset+velocity, significant improvements over past work. I haven’t dug into their P-R approach, but the sound is a lot better than what I was expecting from these state-of-the-art performance metrics, and I’m scratching my head about that.

The competition pieces used for training are really great in their own right.

Enjoy the Disklavier.

Re: Glenn Gould on MIDI Transcribed Using Google Magenta
essandess #3011966 08/09/20 02:42 PM
Joined: Jan 2013
Posts: 286
W
Full Member
Offline
Full Member
W
Joined: Jan 2013
Posts: 286
I'd love to see and hear some Dr. John transcriptions.


-Bill L.
Re: Glenn Gould on MIDI Transcribed Using Google Magenta
WBLynch #3012001 08/09/20 03:54 PM
Joined: Feb 2019
Posts: 2,523
L
2000 Post Club Member
Offline
2000 Post Club Member
L
Joined: Feb 2019
Posts: 2,523
Originally Posted by WBLynch
I'd love to see and hear some Dr. John transcriptions.

Ha, I'd love to hear him too, I'll put him on my list. I saw him a number of years ago at the French Quarter Jazz Festival in New Orleans.

We need to set up a sever somewhere to collect people's efforts.

Re: Glenn Gould on MIDI Transcribed Using Google Magenta
LarryK #3012008 08/09/20 04:28 PM
Joined: Aug 2020
Posts: 8
E
Junior Member
OP Offline
Junior Member
E
Joined: Aug 2020
Posts: 8
Originally Posted by LarryK
We need to set up a sever somewhere to collect people's efforts.

A little cold water: I’ve been listening to other transcriptions and the results are uneven. My transcription of Tan’s Für Elise is so bad it cannot be listened to, unless you want to have a laugh at early machine learning piano skills.

I don’t have enough experience with Magenta yet to know if this is an isolated bad case, or if Gould is an isolated good case. The field is new, and there’s lots of room for innovation and improvement.

In any event, the training data is wonderful, so there’s always that to listen to.

Re: Glenn Gould on MIDI Transcribed Using Google Magenta
essandess #3012049 08/09/20 06:33 PM
Joined: Feb 2019
Posts: 2,523
L
2000 Post Club Member
Offline
2000 Post Club Member
L
Joined: Feb 2019
Posts: 2,523
Originally Posted by essandess
Originally Posted by LarryK
We need to set up a sever somewhere to collect people's efforts.

A little cold water: I’ve been listening to other transcriptions and the results are uneven. My transcription of Tan’s Für Elise is so bad it cannot be listened to, unless you want to have a laugh at early machine learning piano skills.

I don’t have enough experience with Magenta yet to know if this is an isolated bad case, or if Gould is an isolated good case. The field is new, and there’s lots of room for innovation and improvement.

In any event, the training data is wonderful, so there’s always that to listen to.


That’s ok, I’m assuming that the software will get better with time. I have plenty of other uses for the Disklavier.

Have you seen what Tesla did with machine learning, vision, and self-driving cars? The results are amazing. I’m sure with more training data the transcriptions will get better.


Moderated by  Ken Knapp, Piano World 

Link Copied to Clipboard
(ad)
Pianoteq
PianoTeq Karsten Collection
(ad)
Piano Life Saver - Dampp Chaser
Dampp Chaser Piano Life Saver
Download Sheet Music
Virtual Sheet Music - Classical Sheet Music Downloads
New Topics - Multiple Forums
Practice schedule
by Pilotryan - 09/18/20 09:34 AM
Pedal curve?
by MacMacMac - 09/18/20 05:59 AM
achieveable "bucket list" pieces
by Lingyis - 09/18/20 04:05 AM
What are these chords
by ManishP - 09/18/20 03:39 AM
What's Hot!!
News from the Piano World
3,000,000+!
------------------
Posting Pictures on the Forums
-------------------
Forums RULES & HELP
-------------------
ADVERTISE on Piano World
Forum Statistics
Forums41
Topics201,691
Posts3,004,131
Members98,581
Most Online15,252
Mar 21st, 2010
Please Support Our Advertisers


Faust Harrison 100+ Steinways

Dampp Chaser Piano Life Saver

 Best of Piano Buyer

PianoTeq Bechstein
Visit our online store for gifts for music lovers

Virtual Sheet Music - Classical Sheet Music Downloads



 
Help keep the forums up and running with a donation, any amount is appreciated!
Or by becoming a Subscribing member! Thank-you.
Donate   Subscribe
 
Our Piano Related Classified Ads
| Dealers | Tuners | Lessons | Movers | Restorations | Pianos For Sale | Sell Your Piano |

Advertise on Piano World
| Subscribe | Piano World | PianoSupplies.com | Advertise on Piano World |
| |Contact | Privacy | Legal | About Us | Site Map | Free Newsletter |


copyright 1997 - 2020 Piano World ® all rights reserved
No part of this site may be reproduced without prior written permission
Powered by UBB.threads™ PHP Forum Software 7.7.4