MIT researchers have developed a New Artificial Intelligence (AI) System named as " PixelPlayer" that can look at a video of a musical performance, and isolate the sounds of specific instruments and make them louder or softer. PixelPlayer uses methods of ?deep learning,? meaning that it finds patterns in data using so-called ?neural networks? that have been trained on existing videos. Specifically, one neural network analyzes the visuals of the video, one analyzes the audio, and a third ?synthesizer? associates specific pixels with specific soundwaves to separate the different sounds.
