Computers that Learn to Listen / Institute of Computational Perception, Johannes Kepler University (JKU) Linz (AT)
This video demonstrates some results of scientific research in the field of AI and Music being carried out at the Institute of Computational Perception at Johannes Kepler University Linz (Austria). Based on the latest advances in machine learning, our computers learn to “listen to” and “understand” music, recognizing beat and rhythm, instantly identifying music pieces from a few played notes, following pianists and whole orchestras live in the concert hall, and learning to read music directly from images. Demos are shown of autonomous drum robots and other kinds of musical companions that turn music pages for pianists, provide synchronized scores to concert audiences, and accompany soloists. In a final video, we use a MIDI theremin to control expressive aspects of a piano performance in real time.
Credit: Jürgen Grünwald
Computers that Learn to Listen / Institute of Computational Perception, Johannes Kepler University (JKU) Linz (AT)
This video demonstrates some results of scientific research in the field of AI and Music being carried out at the Institute of Computational Perception at Johannes Kepler University Linz (Austria). Based on the latest advances in machine learning, our computers learn to “listen to” and “understand” music, recognizing beat and rhythm, instantly identifying music pieces from a few played notes, following pianists and whole orchestras live in the concert hall, and learning to read music directly from images. Demos are shown of autonomous drum robots and other kinds of musical companions that turn music pages for pianists, provide synchronized scores to concert audiences, and accompany soloists. In a final video, we use a MIDI theremin to control expressive aspects of a piano performance in real time.
Credit: Jürgen Grünwald