Projects


PRESENCCIA

ReNaChip

ARGE Alpinmedizin

synthetic forager

SM4ALL Rehabilitation Gaming System
Brainable Better



PRESENCCIA

This Integrated Project will undertake a Research Programme that has as its major goal the delivery of presence in wide area distributed mixed reality environments.

The environment will include a physical installation that people can visit both physically and virtually. The installation will be the embodiment of an artificial intelligent entity that understands and learns from its interaction with people. People who inhabit the installation will at any one time be physically there, virtually there but remote, or entirely virtual beings with their own goals and capabilities for interacting with one another and with embodiments of real people.

Specific subclasses of the installation will be used for the construction of a number of application scenarios, such as a persistent virtual community that embodies the project itself.

The core methodology will be to achieve this through the identification, understanding and exploitation of cerebral mechanisms for presence in conjunction with advances in the underlying technology for mixed reality display and interaction, with special attention to the interaction between people, and also between people and virtual people. Such cerebral mechanisms will be the basis for a core aspect of the IP which is the exploitation of brain-computer interfaces.

Processes within the environments adapt and correlate with the behaviour and state of people, and in addition people are able to effect changes within the environment through thought as well as through motor actions.

The following partner institutions are working within the project PRESENCCIA:

Particpant name

Principal Investigator

Universitat Politècnica de Catalunya (Coordinator)

Prof. Mel Slater

Prof. Pere Brunet

University College London

Dr Anthony Steed (CS)

Dr Beau Lotto (IoO)

IDIBAPS

Dr Mavi Sanchez Vives

TU-Graz - Institute for Knowledge Discovery

Prof. Gert Pfurtscheller

TU-Graz - Institute for Computer Graphics and Vision

Prof. Dieter Schmalstieg

Guger Technologies OEG

Dr Christoph Guger

Technion - Israel Institute of Technology

Prof. Miriam Reiner

PERCRO Scuola Superiore Sant'Anna

Prof. Massimo Bergamasco

Dr Antonio Frisoli

University of Zurich

Prof. Lutz Jäncke

Universitat Pompeu Fabra

Prof. Paul Verschure

Dr Ulysses Bernardet

Goldsmiths College - University of London

Prof. John Gruzelier

University of Cambridge

Prof. Peter Robinson

Technische Universität München, Fachbereich für Informatik, Fachgebiet für Augmented Reality

Prof. Gudrun Klinker

Chalmers University of Technology

Prof. Mendel Kleiner

Karolinska Institutet

Dr Henrik Ehrsson

 

 

For further information please visit http://www.presenccia.org/


Up


ARGE Alpinmedizin

The ARGE Alpinmedizin was founded 2004 at the Karl-Franzens University in Graz. It is an inter-disciplinary co-operation of scientists interested in high-altitude and tourism medicine.

Activities of the organization are:

point co-ordination and support of research projects dealing with high-altitude and tourism medicine
point publication of scientific articles
point organization of scientific meetings, conferences and talks
point co-operation with other high-altitude societies

We are pleased to present one of the projects we accomplished together:

Effects of a fast cable car ascent to an altitude of 2700 meters on EEG and ECG (PDF 195 kByte)

In the Eastern Alps, the Dachstein massif with a height of almost 3000 m is an ideal location for investigating the effects of changes in altitude on the human body. A cable car allows to ascent to 2700 m where the partial pressure of oxygen is about 550 mm of mercury compared to 760 mm at sea level within a few minutes.
Ten healthy subjects performed a reaction time task at 990 m and 2700 m altitude. The subjects were instructed to perform a right hand index finger movement as fast as possible after a green light flash. The green light flashed 50 times. Simultaneously to the task the electrocardiogram (ECG) and the electroencephalogram (EEG) were recorded. The ECG analysis showed that the heart rate increased from about 69 to 80 bpm and that the heart rate variability parameters decreased: RMSSD decreased from 33.0 to 14.8 ms, pNN50 from 9.6 to 0.9 %. The spectral analysis of the ECG showed an increase of the normalized LF component from 51.1 to 65.4, a decrease of the normalized HF component from 35.1 to 25.0 and an increase of the LF/HF ratio from 2.1 to 4.4. The event-related desynchronization (ERD) analysis of the EEG data showed that changes in alpha ERD values are not significant, but event-related synchronization (ERS) values in the beta band decrease significantly from around 50 % to 10 %.
The study showed that with the fast ascent to 2700 m the sympathetic nervous system is getting more dominant compared to the parasympathetic system and that the beta ERS in the 14 to 18 Hz frequency range is significantly reduced. The suppressed post-movement beta ERS at the altitude of 2700 m may therefore be interpreted as results of an increased cortical excitability level when compared with the reference altitude at 990 m above sea level.

For further information please visit http://www.argealpinmed.at/


Up


ReNaChip

Rehabilitation of a discrete motor learning function by a prosthetic chip

The ReNaChip project is funded by the EC Framework 7 FET Programme in Bio-ICT Convergence. The full project website will be available from the project start date in February 2008.

Project Abstract

The objective of this project is to develop a full biohybrid rehabilitation and substitution methodology; replacing the aged cerebellar brain circuit with a biomimetic chip bidirectionally interfaced to the inputs and outputs of the system. Information processing will interface with the cerebellum to actuate a normal, real-time functional behavioural recovery, providing a proof-of-concept test for the functional rehabilitation of more complex neuronal systems.
1 The model neuronal system we have chosen is the cerebellar microcircuit involved in conditioning of the motor eyeblink response. Localized experimental or clinical damage to this microcircuit disrupts irreversibly the eyeblink conditioning while aging invariably compromises the acquisition and retention of the eyeblink response.
Using the aged rat as an experimental model we plan to integrate a biomimetic chip to rehabilitate a discrete sensory-motor learning function lost in the senescent cerebellar microcircuit, through the development of multiple enabling technologies.
We will develop novel electrodes to both detect the stimulus and trigger the eyeblink response. The stimulus signals will be extracted from background neuronal activity and undergo conditioning, processing and interpretation in a silicon chip which mimics the function of the deficient cerebellar circuit. The output from this biomimetic chip will then trigger the eyeblink response by way of implanted stimulation electrodes.
Complete success would be achieved through real-time demonstration of functional recovery of the lost motor learning response in aged rats. Advances in any or all of the component technologies, their integration and clinical implementation, and improved understanding of the neuronal circuit would represent incomplete but valuable progress in the treatment of deficient neuronal systems.

The following partner institutions are working within the project ReNaChip:

Particpant name

Newcastle University, United Kingdom

WizSoft Data and Text Mining, Israel

Universitat Pompeu Fabra, Spain

Lund University, Sweden

Tel Aviv University, Israel

Guger Technologies OEG, Austria

For further information please visit http://www.renachip.org/Default.aspx


Up


synthetic forager

The single overarching goal of the SF consortium is to identify the neuronal, cognitive and behavioural principles underlying optimal foraging in rodents and to implement these principles in a real-world foraging artefact or the Synthetic Forager (SF.01). SF.01 constitutes a novel biologically based cognitive technology for autonomous exploration and foraging in real-world man-made indoor and outdoor environments. SF exploits our growing understanding of exploration and foraging behaviour in rodents, advances current theories of the neuronal and behavioural organization of foraging and transfers this understanding towards the construction of novel realworld synthetic cognitive technologies.

The behaviour and neurophysiology of foraging will be studied in rodents behaving in automatically controlled multi-modal environments. The physical features of these environments can be fully controlled in real-time in relation to the behavioural and/or physiological state of the animal using an advanced experimental technology developed by the consortium. The overall integration of the perceptual, cognitive and behavioural control systems of SF will be accomplished using a well established robot based cognitive architecture, called Distributed Adaptive Control (DAC) further informed by the formal analysis of rodent foraging. The perceptual, cognitive and behavioural control systems of SF will be based on statistical analysis and detailed game theoretic models of the behavioural and neurophysiological data. The SF control systems are validated against the behavioural and physiological data. The SF phenotype comprises a high-mobility robotic platform equipped with visual, auditory, olfactory and tactile sensors. The SF will be evaluated in a number of stringent benchmarks ranging from robot equivalents of rodent foraging tasks to simulated de-mining.

Although the goal of the project is to demonstrate the SF technology for autonomous exploration and foraging, we expect that the approach and technologies developed in SF will have long-term implications to a number of other application areas including: cleaning robots, search and rescue systems, terrestrial and planetary exploration, delivery systems, autonomous transportation systems, military intelligence and battle field information control systems, environmental monitoring, internet information analysis and retrieval, information and communication networks and humanitarian de-mining.

The following partner institutions are working within the project Synthetic Forager:

Particpant name

Universitat Pompeu Fabra, Spain

Tel Aviv University, Israel

Consorci Institut d’Investigacions Biomèdiques August Pi i Sunyer, Spain

Universiteit van Amsterdam, Netherlands

Universität Osnabrück, Germany

Guger Technologies OEG, Austria

Robosoft, France

For further information please visit http://iua.upf.edu/sf/


Up


Rehabilitation Gaming System (RGS)

The rehabilitation gaming system is a virtual reality (VR) based training device that provides new prospects for the rehabilitation of patients suffering from motor disabilities after stroke or brain injury. The developed RGS training tool supports restoring motor functions of the upper limbs that is essential in a patient's every day life. Therapeutic approaches towards relearning of motor activity rely on brain plasticity that is maintained throughout life. This adaptive mechanism is based on a reorganisation of affected brain regions and leads to a neurological recovery of damaged motor areas. Recent studies suggest that regaining of motor functions strongly depend on the starting point and frequency of training sessions after brain lesion hence making access to rehabilitation units fundamental requirements for successful motor function relearning.

The VR training environment enables patients to perform rehabilitation at home and thereby supports supplemental long-term training in addition to conventional therapies. The VR gaming scenarios implemented in the RGS system feature a first person perspective of the upper limbs where the motion of a patient’s arms is correlated to the movement of virtual limbs on the computer screen. The user is prompted to perform various motional tasks on different levels of difficulty dependent on the patients’ motor dysfunction. The movement of arms is monitored via a camera based tracking system together with performance of hand flexion and extension with an interactive hand training device. Biosignals are additionally recorded throughout the training session to monitor brain activity and physiological conditions of practicing patients. A feedback of performance parameters guarantees optimal training settings and also assists to keep the motivation of users at a high level. The RGS will be connected to a medical information web platform that allows for continuous monitoring of gaming sessions of patients and helps physicians or therapists to remotely supervise the individual training improvements. The impact of the RGS system on the improvement of motor functions will be evaluated in a clinical trial using also physiological parameters.

The following partner institutions are working within the RGS project:

Particpant name

Universitat Pompeu Fabra, Spain

Heinrich Heine Universität, Germany

Hospital Universitari Vall d'Hebro, Spain

Tyromotion, Austria

Hospital de la Esperanza, Spain

Guger Technologies OEG, Austria

TicSalut, Spain

For further information please visit http://www.iua.upf.edu/rgs/


Up


BRAINABLE

BrainAble will conceive, research, design, implement and validate an ICT-based human computer interface (HCI) composed of BNCI sensors combined with affective computing and virtual environments. This combination will dramatically improve the quality of life of people with disabilities by overcoming the two main shortcomings they suffer - exclusion from home and social activities - by providing inner functional independence for daily life activities and autonomy (HCI connected to accessible and interoperable home and urban automation) and outer social inclusion (HCI connected to advanced and adapted social networks services).

In terms of HCI, BrainAble will improve both direct and indirect interaction with computers. Direct control will be upgraded by creating tools that allow people to control those inner and outer environments using a “hybrid” Brain Computer Interface (BCI) system (BCIs, Electro Oculogram (EOG), Electromyography (EMG), and Heart Rate). Furthermore, BNCI information will be used for indirect interaction, such as by changing interface or overall system parameters based on measures of boredom, confusion, frustration, or information overload. These self-adaptive tools will increase effective bandwidth because users will be able to use a plurality of signals to effect control, and also because adaptation will reduce errors and help provide the user with the desired control.

BrainAble’s HCI will be complemented by an intelligent Virtual Reality-based user interface with avatars and scenarios that will help disabled people to move around on their wheelchairs, interact with all sort of devices, create self-expression assets using music, pictures and text, communicate online and offline with other people, play games to counteract cognitive decline, and get trained in new functionalities and tasks

The following partner institutions are working within the Brainable project:

Particpant name

Barcelona Digital Technology Centre , Spain

TU-Graz - Institute for Knowledge Discovery, Austria

Universitat Pompeu Fabra, Spain

Meticube Software Engineering, Portugal

Guger Technologies OEG, Austria

Ability Net, United Kingdom

Institut Guttmann, Spain

For further information please visit http://www.brainable.org/en/Pages/Home.aspx


Up


Better

Most promising interventions to restore walking function in stroke are based on robotic systems that intend to restore function by focusing on actions at periphery of the body (a BOTTOM-UP approach). By imposing gait-like movements at a more normal speed and without restricted duration, such robotic devices are thought to provide many of the afferent cues regarded as critical to retraining locomotion. BETTER is a European project that will develop a new approach for gait training in which such assistive technologies (ATs) might be improved if combined with non-invasive BNCI in order to increase the effectiveness in recovering function.

The principal goal of BETTER is to improve physical rehabilitation therapies of gait disorders in stroke patients based on BNCI assistive technologies, producing improved systems, providing guidelines for improving future systems, and developing benchmarking and evaluation tools. The project will validate, technically, functionally and clinically, the concept of improving stroke rehabilitation with wearable exoskeletons and robotic gait trainers based on a TOP-DOWN approach: The robot exerts physical stimulation -at the periphery- as a function of targeted neural activation patterns (related to user involvement). This intervention is expected to result in reorganizations in the cortex. Such Top-Down therapeutic treatment would aim to encourage plasticity of the affected brain structures to improve motor function.

1
The system will provide means to assess compliance through a multimodal BNCI
1 The proposed BNCI will combine CNS and PNS data with biomechanical data.
1
It will determine if training the activation of signals that control lower limb tasks in combination with robotics devices is beneficial for restoring lower limb function.
1 BETTER will provide means for objective evaluation of the BNCI-based physical rehabilitation therapy and its usability and acceptability.
1
BETTER proposes a multimodal BNCI which main goal is to explore the representations in the cortex, characterize the user involvement and modify the intervention at the periphery with ambulatory and non-ambulatory robotic gait trainers.

The following partner institutions are working within the Better project:

Particpant name

Consejo Superior de Investigaciones Científicas, Spain

Instituto de Biomecánica de Valencia, Spain

Aalborg University, Denmark

Graz University of Technology, Austria

Guger Technologies OEG, Austria

Fondazione Santa Lucia, Italy

Össur hf, Iceland

Eberhard-Karls Universität, Germany
Technaid S.L., Spain

For further information please visit http://www.iai.csic.es/better/


Up