{"id":40209,"date":"2026-07-16T09:50:44","date_gmt":"2026-07-16T07:50:44","guid":{"rendered":"https:\/\/www.heavym.net\/?p=40209"},"modified":"2026-07-16T09:50:44","modified_gmt":"2026-07-16T07:50:44","slug":"interacting-live-with-a-video-mapping","status":"publish","type":"post","link":"https:\/\/www.heavym.net\/ja\/interacting-live-with-a-video-mapping\/","title":{"rendered":"Interacting live with a video mapping"},"content":{"rendered":"\n

Photo mapping above : https:\/\/limbiccinema.com\/portfolio-item\/the-temple\/<\/a><\/em><\/p>\n\n\n\n

With the Keyboard<\/h2>\n\n\n\n

Did you know that it\u2019s possible to control HeavyM with more than just your mouse or touchpad?<\/strong> Because, let\u2019s be honest, while those tools are very convenient for drawing and adjusting settings while seated at your desk, having to scroll through panels to find a small effect button during a live performance isn\u2019t exactly fun. That\u2019s why you can make your life easier with external controls and use a keyboard, for instance.<\/strong><\/p>\n\n\n\n

Default Keyboard Shortcuts<\/h3>\n\n\n\n

To make your experience smoother and reduce the number of clicks needed to access certain features, some keyboard shortcuts are already built into the software. The updated list of key combinations for your version can be accessed directly in the software via the menu Controls \u2192 Keyboard Shortcuts List…<\/strong> or by using the shortcut [CTRL\/Cmd + \/]<\/strong>.<\/p>\n\n\n\n

Custom Shortcuts<\/h3>\n\n\n\n

In addition to these default shortcuts, you can also define your own keyboard commands for HeavyM. To do this, you need to make the application\u2019s interface “learn” which key it should respond to.<\/p>\n\n\n\n

Activating Keyboard Learning<\/h4>\n\n\n\n

To assign keys, you first need to activate the Keyboard Learning interface. Activate it from the menu:<\/p>\n\n\n\n

Controls \u2192 Edit MIDI Assignments<\/strong>, or go to the Keyboard<\/strong> tab in the Controls<\/strong> settings window (accessible via Controls \u2192 Settings…<\/strong> or the icon)<\/p>\n\n\n\n

From the toolbar) and click on the “Keyboard Learning mode”<\/strong> button. A colored filter will appear on many elements of the HeavyM interface.<\/p>\n\n\n\n

With MIDI<\/h2>\n\n\n\n

MIDI<\/strong> stands for “Musical Instrument Digital Interface.”<\/strong> It\u2019s a protocol used for communication between electronic instruments and other digital music tools.<\/p>\n\n\n\n

You can configure a MIDI instrument to send instructions to HeavyM. In short, this protocol allows you to remotely control HeavyM features using a controller connected to your computer, usually via USB.<\/p>\n\n\n\n

Since a MIDI controller typically includes various types of control elements, it offers more possibilities than a keyboard. Once configured, you won\u2019t even need to touch your computer anymore!<\/p>\n\n\n\n

Connecting a MIDI Device<\/h3>\n\n\n\n

Once you\u2019ve connected your MIDI controller to your computer, go to the MIDI<\/strong> tab in the control settings window (accessible via Controls \u2192 Settings…<\/strong> or the icon:<\/p>\n\n\n\n

From the toolbar) and select your device from the “Device” dropdown list.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

If your device is correctly recognized, you will see values appear in the Channel\/Control\/Value<\/strong> fields when you press a button or move a fader. If there is no response, it might mean that the device is already connected to another application. Indeed, it is not possible to use the same device in multiple programs simultaneously.<\/p>\n\n\n\n

Note:<\/strong> For now, you can only connect one MIDI instrument at a time in HeavyM.<\/p>\n\n\n\n

Managing Assignments<\/h3>\n\n\n\n

Activating MIDI Learning<\/h4>\n\n\n\n

Once your controller is set up, you can assign buttons, faders, pads, or any other control elements it includes to HeavyM commands. To do this, you need to make the application\u2019s interface “learn” which MIDI element it should respond to.<\/p>\n\n\n\n

To enable the MIDI Learning interface, use the “MIDI Learning mode”<\/strong> button in the Controls window or go to the menu (Controls \u2192 Edit MIDI Assignments<\/strong>). A colored filter will appear on the interface, highlighting the buttons that can be assigned.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Adding Assignments<\/h4>\n\n\n\n

Select a button or slider by clicking on it<\/strong> (it will be highlighted in yellow), then simply move or click on the control element of your MIDI device that you want to use. This will link the two elements, and you will see the connection appear in the list in the Controls settings window.<\/p>\n\n\n\n

Once you’re finished, you can deactivate the Learning mode using the same button\/menu or by pressing [Escape]<\/strong>.<\/p>\n\n\n\n

If your controller supports MIDI Out, the assigned LED buttons will reflect the status of their associated action in the software.<\/strong> For example, on compatible controllers, the buttons will display the color of their assigned sequence in HeavyM, or if a toggle is assigned, the button lights up when it\u2019s ON.<\/p>\n\n\n\n

With OSC<\/h2>\n\n\n\n

What is OSC?<\/h3>\n\n\n\n

OSC<\/strong> stands for “Open Sound Control.”<\/strong> It\u2019s a protocol used for communication between multimedia devices, similar to the  MIDI protocol,<\/a> but it allows for more data transfer, faster speeds, and works over networks like WIFI or Ethernet. In short, this protocol lets you control HeavyM features remotely, for example, using a smartphone. The good news is that there\u2019s no need for long cables \u2014 your devices simply need to be on the same network.<\/strong><\/p>\n\n\n\n

This opens up endless possibilities for interactive installations!<\/p>\n\n\n\n

We\u2019ll primarily detail instructions for use with an iOS or Android app<\/strong>, thanks to tools that enable simple and quick setup. However, note that many other OSC connections are possible: for example, the protocol also allows you to use timeline-based automation software like Vez\u00e9r<\/strong><\/a> or the conductor tool Chataigne<\/strong><\/a>.<\/p>\n\n\n\n

Connecting TouchOSC and HeavyM<\/h3>\n\n\n
\n
\"\"<\/figure><\/div>\n\n\n

The following paragraphs provide specific instructions to help you connect the TouchOSC<\/strong><\/a> app with HeavyM. (We\u2019re not sponsored by this app, we promise.)<\/p>\n\n\n\n

To follow these instructions, you need to have HeavyM, TouchOSC, and a layout ready. If you are using another application, this guide may still help, as you\u2019ll find many similarities. Otherwise, please refer to your application\u2019s manual.<\/p>\n\n\n\n

Note:<\/strong> Your devices must be connected to the same network to communicate, but they don\u2019t necessarily need to be connected wirelessly: your smartphone can use Wi-Fi while your computer is on Ethernet, for example.<\/strong><\/p>\n\n\n\n

In TouchOSC<\/h4>\n\n\n\n

Note:<\/strong> These instructions outline the procedure for the iOS version of the app. The interface on Android is slightly different, but the actions are similar unless specified otherwise.<\/p>\n\n\n\n

    \n
  1. First, open the “Connections”<\/strong> settings by using the button with the chain link icon in the toolbar, and go to the “OSC”<\/strong> tab.<\/li>\n<\/ol>\n\n\n\n
    \"\"<\/figure>\n\n\n\n
      \n
    1. In the “Host”<\/strong> field of the first “Connection”<\/strong>, enter your computer’s IP address. You can usually find it in Settings<\/strong> or System Preferences<\/strong>, under Network<\/strong> properties.<\/li>\n\n\n\n
    2. In the “Send Port”<\/strong> and “Receive Port”<\/strong> fields, enter any numbers (different) between 7,000 and 10,000.<\/li>\n\n\n\n
    3. Keep this tab open, as you\u2019ll need to copy some information, and then switch to HeavyM.<\/li>\n<\/ol>\n\n\n\n

      In HeavyM<\/h4>\n\n\n\n
        \n
      1. Open the Controls<\/strong> settings window from Controls \u2192 Controls Settings…<\/strong> or the icon<\/li>\n<\/ol>\n\n\n\n

        and go to the “OSC” tab. Make sure that OSC Control is ON<\/strong> using the button at the top of the window.<\/p>\n\n\n\n

        \"\"<\/figure>\n\n\n\n
          \n
        1. Next, in the “Incoming port”<\/strong> field, enter the number provided in the “Send Port”<\/strong> field of TouchOSC. Conversely, in the “Outgoing port”<\/strong> field, enter the number specified in the “Receive Port”<\/strong> field of TouchOSC.<\/li>\n\n\n\n
        2. In the “Output IP address”<\/strong> field, enter the IP address of your phone or tablet. You can usually find it in your device\u2019s Network<\/strong> settings, or some OSC apps display it directly for you.<\/li>\n<\/ol>\n\n\n\n

          Now, return to your layout and follow the next section of this guide to learn how to link layout elements to HeavyM commands.<\/p>\n\n\n\n

          Note:<\/strong> If you encounter difficulties after following these instructions, you can refer to the TouchOSC documentation<\/strong><\/a> on their website (in English). It\u2019s quite detailed and also covers procedures for iOS devices as well as other advanced features in the app.<\/p>\n\n\n\n

          Managing Assignments<\/h3>\n\n\n\n

          Using HeavyM’s OSC API<\/h4>\n\n\n\n

          In addition to assigning your own OSC addresses with Learning Mode<\/strong><\/a>, you can usethe default OSC addresses<\/a> already built into HeavyM.<\/p>\n\n\n\n

          Every assignable element of the interface is associated with at least one address. If it has more than one address, it means the same result can be achieved in multiple ways. For example, if you want to edit a sequence, you can access it by its name or by its position<\/strong>, meaning there are two addresses for the same action.<\/p>\n\n\n\n

          In this case, all assignment configuration is done directly in your OSC-sending application; HeavyM doesn\u2019t even need to be open.<\/p>\n\n\n\n

          Using OSC Learning to Add Assignments<\/h4>\n\n\n\n

          Once your connection is set up, you can assign buttons, faders, pads, or any other control element included in your layout to HeavyM commands. To do this, you need to make the software interface “learn” which layout OSC element it should respond to.<\/p>\n\n\n\n

          To enable the OSC Learning interface, use the “OSC learning mode”<\/strong> button in the Controls window or go to the menu (Controls \u2192 Edit OSC Assignments<\/strong>). A colored filter will appear on the interface, highlighting the buttons that can be assigned.<\/p>\n\n\n\n

          \"\"<\/figure>\n\n\n\n

          Select a button or slider by clicking on it (it will then be highlighted in yellow), and then simply move or click on the control element in your layout that you want to use. This will link the two elements, and you will see the connection appear in the list within the Controls settings window.<\/p>\n\n\n\n

          Once you\u2019re finished, you can disable Learning mode using the same button\/menu or by pressing [Escape]<\/strong>.<\/p>\n\n\n\n

          Note:<\/strong> You can assign the same OSC control element to multiple commands simultaneously. For example, a single button on your device can be associated with multiple effect switches, meaning that when you press it, all those effects will activate at the same time!<\/p>\n\n\n\n

          \u26a0\ufe0f If you create your own templates and messages, please note that HeavyM responds to “float” arguments between 0.0 and 1.0<\/strong> in OSC. For sliders, 0.0 represents the minimum value and 1.0 the maximum. For switches, 0.0 corresponds to OFF, and 1.0 to ON.<\/p>\n\n\n\n

          With DMX \/ Art-Net<\/h2>\n\n\n\n

          DMX<\/strong> is a standard widely used in stage design for communication between controllers (such as software or lighting consoles) and lights or other stage special effects.<\/p>\n\n\n\n

          HeavyM supports DMX input control, specifically via the Art-Net protocol. This means you can use a lighting console to send commands to HeavyM over a network.<\/p>\n\n\n\n

          Setting Up an Art-Net Connection<\/h3>\n\n\n\n

          First, go to the DMX \/ Art-Net<\/strong> tab in the control settings window (accessible via Controls \u2192 Settings…<\/strong> or the toolbar icon).<\/p>\n\n\n\n

          \"\"<\/figure>\n\n\n\n

          You need to configure three things:<\/p>\n\n\n\n