Interactive Artwork at ACM MM 2022, Lisbon
Emily Graber, Charles Picasso, Elaine Chew
The Mobile Music Lab is an interactive music system for controlling the temporal expression of Contemporary Classical Music and recording time-aligned physiological data outside of traditional psychology labs. This system is used to understand how embodiment impacts listener experience and preference.
For more information see: https://dl.acm.org/doi/abs/10.1145/3503161.3549980
Using the Conductor Interface
Start tapping/pushing into the Roli interface. If your gesture has been registered, the laptop will flash and the synth “piano” keys will move.
When you tap and push into the interface, the music will stay synchronized with your motion. This will lead to prediction and entrainment which may help shape perception and reception of challenging music!
Try the conductor interface for a canonical example or contemporary classical music examples!
(Optional) Put on an EEG headset or heart rate monitor
EEG (brain)
- To prep the EEG, use hand gel and cotton pad to clean your forehead just above the eyebrows and behind the ears.
- Turn on the Muse 2 headset with the power button on the device.
- Put on the headset as you would glasses. The headset can be extended or tightened to improve the fit just above the eyebrows. Please do not grab the sensors directly (gold-colored ribbon).
- Once the headset is on, the raw EEG data will be visible on the iPad.
- If you are done using the Muse headset, wipe it off with minimal gel and cotton pad. Turn the headset off by holding the power button.
ECG (heart)
- Attach the Polar sensor to the elastic belt.
- Clip the belt around your waist so that the inside of the belt makes direct skin contact. The “Polar” button should be centered in front.
- Lift the belt partway up the rib cage to get the cleanest data.
- In the terminal on the left-hand side of the computer monitor, run >>python Polar2LSL.py.
- When finished, stop the python script and unsnap the Polar sensor from the belt.