scrap pad

music video remixing by audio input

sCrAmBlEd? HaCkZ!. the video really shows it off (it's on the site or on YouTube). via hack a day.

The video is broken up into pieces by looking at its sound; the sound pieces are indexed in a database as "192-dimensional vectors" (did I hear that right?) (alternative expression: indexed in a database by 192 attributes. or something). When sound input is gathered, it's broken up into pieces and compared to the database. Then the closest-matching sound, with its associated piece of video, is played. Apparently one of the intents was to use this live, playing it like an insturment, though in the demo video I preferred the just-goofing-off bits.

Archives

who I am