CMU School of Drama


Monday, October 24, 2016

A Robot Is Collecting Sound Samples and Turning Them into Collages

The Creators Project: The human ear selects the most relevant sounds in a space, then attempts to make sense out of the noise. Media artist ::vtol::, a.k.a., Dimitry Morozov, does something similar with a robot that records sound from its surrounding space. Selecting sounds on the basis of volume, the robot collages samples together into a composition that plays itself in the order the sounds were recorded. Morozov explains that the robot, named collector, eliminates instances of silence while also compressing the time between the sampled sounds.

2 comments:

Alex Kaplan said...

This robot seems really cool! Sure, the sounds it was producing wasn’t really music, but it is still amazing at the process it goes through to get the outcome. I can’t help but wonder what different inputs would sound like. It seems in the video that the sounds were mainly of people talking, clapping and stomping, and city noises. I am curious to hear what it would sound like if music, either a pop song or an instrument, was the input to the robot. I feel like there could be some really interesting outcomes, as from the video we know the robot has a good grasp on rhythm and sound. I think we got some of what could be at the end of the video, it seemed like it was spitting out a sped up version of some sort of music. I think if that was explored more, it could create something amazing. I am interested to see where this technology will go and if it will grow into something else.


Daniel Silverman said...

I probably wouldn’t have read this article were it not for the mechanical rainstorm project in technical direction three. I think that this robot could be very useful in capturing the sounds of rain as well as capturing different types of materials hitting each other to recreate the sounds of rain. I’m not sure what the practical application of this is. But it is really cool. And it is also driven by Arduino, which I’m just getting into. It is interesting listening to the “song” that it has created, but as the article says it is sonically interesting, but it isn’t really music. This could be useful in creating a soundscape or an immersive experience as a soundscape. I’m impressed with the ingenuity of this project and the technology that went into it, but I don’t really know what it accomplishes.