The world's first
Brain-Computer Interface orchestra
The world's first Brain-Computer Interface orchestra |
|
At the closing session of the European Future Technologies Conference and Exhibition (FET) the world's first mind powered orchestra using Brain-Computer Interfaces was presented. There were 4 members in the orchestra playing music with the power of their thoughts. They used two different non-invasive Brain-Computer Interface (BCI) technology concepts to control their virtual and multi-modal instruments. Two of them controlled the volume with the so-called Steady-State Visual-Evoked Potentials (SSVEP). The musician has to look at a small box with 4 lights flickering with different frequencies and he has to focus on one specific. The frequency of the light is then induced in the EEG (EEG – Electroencephalogram) and can be detected. Different lights are associated with different commands like: “louder”. Given a cue from the conductor, the performers switch their attention from one flashing frequency to another. The other two members of the orchestra played the music with the so called P300 response. In principle different control icons are flashing on the computer screen and the musician has the task to concentrate on the icon/command he wants to select. This allows him to play different music instruments,… There is a large video-wall behind them and on the left part the audience could see the brainwaves of all four members of the orchestra. When the music conductor instructed the musicians to play the different sounds, small icons on the video wall showed these events to the auditorium. For the realization of the BCI g.tec's equipment, the g.USBamp and g.tec's active electrode system was used.
There was one music conductor who leaded them all through the composition and defined the variations of visuals, sounds, frequencies, volumes and the style of the music. In addition, an emotional conductor (the woman at the right picture above) drives the affective content of a multi-modal composition by means of her physiological state. She is equipped with glasses, where she could see the pictures shown also at the video wall and additional she could listen to the music. The graph of her electrocardiogram and the conductance of her skin are also shown at the video wall on the picture down to the left. The audience could see changes in the biosignals after changes in the pictures. Stills from Cekëh visuals, directed by Behdad Rezazadeh for MBO performance.:
The XMotion performance of the brain orchestra is realized by specs.upf.edu Orchestra: - Emotional conductor: Encarni Marcos Concept: SPECS - Director: Paul Verschure Realization of "Chekëh" visuals: - Director: Behdad Rezazadeh "Chekëh" visuals cast: Merce Campos Trepat (Girl of the desert) SPONSORS - SPECS Special thanks for "Chekëh" visuals: True Ligth Entertainment U.K (TL) At BBC you will find a clip about the BCI Concert. |
