I helped Marshmallow Laser Feast create some interactive visuals on a massive LED screen for a U2 music video that also got made into a superbowl advert, directed by Mark Romanek. We put firewire IR cameras on the stage so we could drive the particle systems in the visuals directly from the band. It was filmed at the Barker Hanger in Santa Monica.
We built it in openFrameworks, using ofxXmlGui to control it, and used an app called “Lemur” on the iPad to control the parameters and switch between preset looks. We christened the resulting software “The Punkerator”. A lot of the parameters were pre-recorded and cued by the lighting desk (a GrandMA) over OSC. It was weird to see all the sliders moving by themselves as the show was running.