Interactive Art Installation with Sensors
MADE WITH HeavyM SOFTWARE

What is Interactive Art?
Interactive art is a captivating form of art that invites spectators to become an integral part of the artwork itself. Unlike traditional art forms that are static and passive, interactive art installations are dynamic and immersive, encouraging visitors to engage directly with the piece. This engagement often involves technology, sensors, and user input, creating a unique and personalized experience for each participant.
The roots of interactive art can be traced back to the 1920s, but it wasn’t until the late 1990s that digital art began to gain widespread recognition. Today, interactive art installations can be found in galleries, museums, and public spaces around the world, offering a fresh and innovative way to experience art. Whether navigating through, over, or around the installation, or even becoming part of the artwork, spectators play a crucial role in bringing the art to life.
The Hacking Paris 2020 show
The scene takes place in Paris before the global lockdown due to COVID-19, at a trade show called “Hacking Paris 2020“. It’s a massive show gathering 3500 participants from various backgrounds: startups, experts, investors, major French and foreign corporates. The purpose is to highlight innovation on a broad scope with a special focus on innovative approaches to preserving our resources and retro-innovation. This day is punctuated by several highlights such as meets ups, demos, workshops, and showcases. In order to immerse visitors in the universe of the show, the organizers asked the HeavyM team to create an impressive visual installation at the entrance. Quickly, the idea of proposing an interactive art installation based on projection mapping appears obvious, creating a memorable interactive experience for all attendees.
Interactive art to impress visitors
Concept of the installation
For the organizers, the brief was clear: Impress and immerse the visitors as soon as they arrived at the show site. And of course “Sublimate these majestic stairs, typical of the architecture of the building. It had to be memorable!”.
The creative process involved in developing this interactive artwork was meticulous, ensuring that every detail contributed to the overall immersive experience.
On our side, to fully immerse the visitor, we had to put him at the heart of the video mapping installation. And, nothing better than proposing an interactive artwork to do it! To go further, we wanted to offer the visitors the possibility to play with the installation. Which reinforces the idea of making it interactive. Our choice turned to tracking cameras to detect the presence of the visitor and thus display interactive visuals according to his movements.
Here is the specific scenario we built:
- If there are no visitors: the installation is paused and no visuals are projected.
- When a visitor approaches the stairs: The video mapping starts and a digital cascade spreads from top to bottom on the side of the stairs.
- When the visitor goes up/down the stairs: The central part of the staircase lights up. The steps come alive, depending on the movement, and follow the path of the people.
- The system works with several people at the same time on the stairs.
How did we set up this interactive video mapping?
Here the equipment we used:
- A computer with the HeavyM Live software.
- A WU630 Optoma projector. The projector is no longer available. New model ZU606e here.
- A tracking camera ZED 1.0
- The Augmenta tracking software in beta
Digital artists played a crucial role in integrating these technologies to create a seamless and engaging interactive experience.
Step 1 - Installation of the hardware
We installed the Optoma projector high up and in front of the stairs, about 20 meters away. We used a standard lens. If you have any questions about projectors and how to choose them please take a look at our specific tutorial.
Then, the projector is connected in HDMI to a Windows desktop computer. Moreover, the specifications are Intel I7 4Ghz / 32Gb RAM / Nvidia GTX 1080. We also installed the ZED camera on one side of the stairs using a USB cable.


Step 2 - Mapping of the stairs
Here, with HeavyM, no difficulty at all: the mapping is fast and simple. We just created 2 big rectangles for the sides of the stairs. And each step is mapped individually. There are less than 30 shapes in the project.
Step 3 - Create the magic
The bulk of the work was to make HeavyM and the ZED camera work together. This stereo camera has two “eyes” that give a detailed 3D view of the scene. This depth is obtained by comparing the movements of the pixels captured between the right and left images. By the way, the camera works perfectly up to 20m and guarantees an FPS of 30Hz in Full HD resolution. That was enough of our needs.
The application of the ZED allows sending the tracked information thanks to the OSC protocol. We have therefore linked this information with the shapes created in HeavyM using OSC.


The Role of Sensors in Interactive Art
Sensors are the unsung heroes of interactive art installations, enabling the artwork to respond to user input and environmental changes in real-time. These devices can detect a variety of inputs, such as motion, heat, and even meteorological changes, allowing the artwork to adapt and transform based on the presence and actions of individuals.
For instance, motion sensors can detect when a visitor approaches an installation, triggering a response such as a change in lighting, sound, or visual effects. This creates a dynamic and engaging experience, as the artwork evolves in response to the movements and interactions of the participants. By tracking the movements of visitors, sensors enable the artwork to respond and adapt in real-time, making each interaction unique and personal.
Examples of Interactive Art Installations
Interactive art installations come in many forms, each offering a unique and engaging experience. One notable example is “Behaviours of Light” by JNZNBRK, which transforms a gallery space with 39 acrylic triangles treated with a semi-reflective film. This installation creates a mesmerizing interplay of light and reflection, responding to the movements of visitors.
Another fascinating example is “Plane White,” an interactive digital experience based on Kandinsky’s painting “Composition VIII.” This installation allows visitors to interact with the artwork, exploring the painting in a new and immersive way.
Meow Wolf’s “Convergence Station” in Denver, Colorado, is an interactive art museum that offers a multi-sensory experience, blending art, technology, and storytelling. Similarly, teamLab’s “Borderless” in Tokyo is a digital art museum that features immersive and interactive art experiences, allowing visitors to become part of the artwork.
Visitors appreciated this beautiful interactive art installation
The installation was a huge success. The smiles and amazement of the participants speak volumes. As soon as the mapping started, their first reflex: Grab their phone to take photos and videos. The sharing on social networks made the organizers happy, and they didn’t expect so much! We are also happy because the visitors played the game by participating in the interactive part. Many were having fun going up and down several times to test the robustness of the system and it was perfect every time!

HeavyM Live: the best fellow for interactive mapping projects
HeavyM will allow you to create and easily set up video mapping projects for different types of events, especially for interactive ones.
HeavyM Live has a module for synchronization with live music. In 1 click, your animations adapt automatically to the music without complex parameterization. You get a perfect sound/image coherence without effort.
Moreover, HeavyM is compatible with MIDI and OSC protocols. MIDI controllers and touch devices, such as tablets, for example, can control the software. It is then possible to imagine installations where the audience acts on the mapping via these interfaces to create engagement.
The Future of Interactive Art
The future of interactive art is brimming with exciting possibilities, driven by rapid advancements in technology. Virtual reality (VR) and augmented reality (AR) are at the forefront of this evolution, offering new and innovative ways to create immersive art experiences that engage audiences like never before.
As these technologies continue to develop, interactive art installations are becoming more sophisticated and accessible. Digital art platforms and online exhibitions are making it easier for artists to reach a global audience, breaking down traditional barriers and democratizing the art experience.
Looking ahead, we can expect to see even more groundbreaking interactive art installations that push the boundaries of traditional art forms. These future installations will not only captivate and inspire but also encourage visitors to engage with art in new and meaningful ways, creating unforgettable experiences that resonate long after the interaction has ended.
If you have any questions, please feel free to contact our team of experts by chat or email here: