Tchaikovsky museum
Tchaikovsky museum
Back
Tchaikovsky museum
Immersive • XR/AR
Date
2019
Info
We let visitors become conductors and lead a virtual orchestra through real-time baton movements. Sensors detect their rhythm and speed, while illuminated musical instruments add to the immersive experience. It's an educational and enchanting way to connect with Tchaikovsky's music and the conductor's art.
What did i do
I formed the interactive stand design, animation and gameplay interface.
To achieve the greatest realism in movements, we turned to professional conductors and filmed the Helikon-Opera orchestra. The orchestra performed all the musical compositions that visitors to the installation can conduct. Thanks to this, the orchestra even reacts to how well the "conductor" performs.
Idle
level_selection
notes
score_screen
Stage 2
Later we consulted with a professional conductor. As a result, the main mechanics closely resemble the real movements of a conductor's baton.
Functionality
The visitor stands behind the conductor's panel with electronic music sheets and selects a musical composition. In front of them, they see the orchestra they will conduct or rather its projection.
The projection also displays the conductor's baton movements.
Sensors detect the speed of the player's playing according to the rhythm of the composition. Musical instruments are placed around the installation on figures that light up during the play of the particular quartet. At the end, the user sees their conducting result on the projection screen.
