Axis Communications introduced an experiment referred to as The thing detection orchestra, the world’s first musical efficiency performed totally on AI-powered video surveillance cameras and audio system. An initiative designed to discover what lies past conventional safety for video surveillance.
Pairing high-performance video surveillance cameras with AI-based analytics, Axis created a brand new type of instrument that reads on a regular basis objects like tennis balls, espresso cups and fireplace extinguishers as musical cues. As a predetermined merchandise strikes throughout the digital camera’s area of view, completely different zones set off completely different notes, turning a video surveillance digital camera into a completely purposeful musical instrument.
“With this experiment, we needed to problem what is feasible with our video surveillance cameras and AI-based analytics on the subject of detecting customized objects and triggering actions in actual time,” stated Ghaith Sankari, Skilled Software program Engineer at Axis Communications. “We made an orchestra. However our prospects can use the identical cutting-edge expertise to create a broad vary of superior options tailor-made to our prospects’ wants.”
The piece carried out is a reimagining of Richard Strauss’s Additionally Sprach Zarathustra, made iconic by its use in 2001: A House Odyssey. However as an alternative of strings and horns, this model makes use of tennis balls, a espresso cup, and a hearth extinguisher.
“We may have used any objects actually, even sounds. What you practice the cameras and analytics to detect is completely up to you. For instance, we’ve got prospects who use this expertise to robotically spot design flaws or manufacturing errors,”stated Sankari.
Swedish music producer Jonas Quant, identified for his work with Kylie Minogue, No Doubt, and Hurts, took on the problem of composing for this unconventional ensemble.
“What fascinated me was treating object detection itself as a brand new type of instrument. Since we’re not utilizing a keyboard this experiment posed some fascinating inventive challenges. Like educating the musicians easy methods to play an invisible instrument in skinny air,” stated Jonas Quant.
Whereas surprising and playful, The thing detection orchestra is greater than a novelty. It’s a proof-of-concept experiment, showcasing how the corporate’s superior AI-based analytics, when paired with high-performance video surveillance cameras and audio system – might be educated to determine virtually something you want and set off quite a lot of actions. In actual time. The identical expertise that makes this efficiency attainable can also be powering automation, enabling good cities, and shaping the way forward for machine interplay, taking video surveillance far past safety.