New Initiatives in Mental Health

Although my sabbatical stay at the Black Dog Institute in Sydney, Australia, is only half over, four new research initiatives have taken form already :

1) Body Mapping on the Body : Body Mapping is an initiative led by Dr. Katherine Boydell that involves people creating full-sized body maps that incorporate their visualizations of different conditions. Body maps have been developed for anxiety, psychosis and planning. What we are doing is using augmented reality technology to project these maps back onto people's bodies. We hypothesize that these self-applied maps may intensify or change how people experience the body maps and potentially affect the interventions that incorporate them in useful ways.

2) Abuse Monitoring : Among the potential areas of application for smart garments in the area of mental health, one application jumps out as a priority. Although the technology to make this truly workable in an unobtrusive and low maintenance manner needs to be refined, the basic technology exists today to develop a garment with pressure-sensitive pads that could record and track blows to the body. Combined with a microphone and some accelerometers to monitor sudden movements, it appears that a garment could be developed in conjunction with an app that identifies situations likely to involve abuse. Currently we are working with specialists of physical abuse to better determine the specifications for such a garment, as well as exploring the technological requirements.

3) Symptom Monitoring : In a way that parallels the Abuse Monitoring application, the incorporation of accelerometers, microphones as well as sensors for monitoring changes in mood could be used to track and assess a range of mental health conditions and disorders, including anxiety, depression and bipolar disorder. This would compliment existing smartphone apps that rely on self reporting. The issues, as for all smart garments, is to develop a way to incorporate the electronics in a manner that allows their removal and reconnection quickly and easily to support garment maintenance, as well as to find circuit architectures that keep power requirements to a minimum. Designs are being developed and appropriate technologies identified.

4) Brief Contact Support : One of the functions currently supported by certain smart phone apps is the ability to send brief "pick-me-up" messages to people with self image issues. By incorporating actuators such as vibrators or tiny heating elements, it would be possible to send more visceral, physical messages of caring to another person, perhaps accompanied by verbal messages if necessary. A design for such a garment is being prepared.

Embodied Entanglements

Haven't posted here in a while, but it isn't because activity has been slow. On the contrary.

Ongoing research projects

1) Participatory opera : We presented a first version of the opera to a conference audience on June 23rd in Basel, Switzerland. The current version of the opera runs about 25 minutes. The opera presents a full story arc, albeit in a compressed form, beginning with an introduction into the future world in which the action takes place as well as two of the three primary characters and carrying the action through to a climax which involves interactive elements. The story deals with overcoming resistance to expressions of difference, including transgender difference. A second version involving interaction enhancements is being prepared for the fall of 2017. We are working on a book to describe the project in its globality, and an online version of the opera is also under preparation.
Public Performances
- Pinnacle - An Interactive Opera. Empathies2017, Gala performance, 11th European Society for Literature, Science and the Arts Conference, Basel, Switzerland (2017).

2) Orienteering belt : We have been working on a belt to provide information concerning spatial orientation for a range of different populations (those with attention deficit issues, visual impairments, and cognitive impairments). The challenge is to determine an interaction interface which is readily understandable but still powerful enough to support a range of possible actions. We are drawing on cognitive load theory to limit the complexity of the interface.

3) Masturbation aids for people with upper arm impairments : Our work on masturbations aids is in its final stages. We have developed a series of handles to assist people with a range of upper arm impairments in manipulating erotic toys, as well as redesigning certain devices for stimulating genitalia. Three articles based on this work have been published, and a fourth is in preparation.
Publications
- E. Morales, V. Gauthier, G. Edwards and A. Guerette. (2017). Co-designing Sex Toys for Adults with Motor Disabilities. Sexuality and Disability Journal. 35(3): 1-10.
- Ernesto Morales, Véronique Gauthier, Geoffrey Edwards, Frédérique Courtois. (2016). Masturbation practices of men and women with upper limb motor disabilities. Sexuality and Disability. 34: 1-15.
- Ernesto Morales, Véronique Gauthier, Geoffrey Edwards, Frédérique Courtois. (2016). Women with Disabilities' Perceptions of Sexuality, Sexual Abuse and Masturbation. Sexuality and Disability. 34: 1-12.

4) Ecological framework for disability and mental health : Work with the author (P. Fougeyrollas) and collaborators of the Disability Creation Process model has led to several efforts to extend the model to integrate sustainable development issues as well as, most recently, ongoing efforts to accommodate the issue of mental health promotion and treatments. The ecological framework draws on a dual understanding of resiliency drawn from two distinct domains, the psycho-social domain and the biological domain. One article has been published in this area and a second one is under development.
Publications
- Geoffrey Edwards. (2016). Augmented Corporality - Key Technologies for Last Mile Interventions for People with Disabilities. First IEEE International Symposium on Last-Mile Smart Mobility, Paris, France (1-10)

5) Sensor net ecologies : In addition to providing a broader understanding of disability and mental health, ecological perspectives also offer ways to integrate the development of smart cities and the internet of things with more human-oriented goals, that of enhancing resiliency in human communities. The idea of resiliency applies not only to the development goals of sensor networks, however, but also to the process dynamics of their implementation. An article has been submitted in this area and a second article is in development.
Publications
- Geoffrey Edwards. (2016). Sensor Ecologies - Designing the Internet of Things, International Journal of Internet of Things, submitted.

6) Lithospheres : A collaborative project with a partner in private industry, seeking to develop an online exchange environment in which the body is more present, using smart garments and appropriate interfaces and apps. Under the leadership of Dr Jocelyne Kiss.

7) ProBE : Development of near body distance measurements, a collaborative project involving private industry, under the leadership of Dr. Brad McFadyen. My team is responsible for developing the user interface using cognitive load principles.

8) Pro(x)thèse : A first smart garment has been developed that provides an opportunity for people with spinal cord lesions and other conditions where sense of self and self image have been strongly impacted, to help them recover a sense of a sensual self.
Publications
- Geoffrey Edwards, Frédérique Courtois, Nancy Dubé, Ernesto Morales, Luis Velasco. (2015). Pro(x)thèse An Interactive Installation That Enables The Exploration Of Sexuality, Disability And Self Image. 4th ISCoS and ASIA Joint Scientific Meeting, Montreal, Canada

Ongoing pedagogical activities

1) Embodied Entanglements Seminar : Since January 2017, we have been holding a weekly seminar exploring issues of embodiment especially through contemporary philosophers such as Deleuze, Whitehead, Sloterdijk, Derrida, etc. The seminar is currently on a summer break but we expect to pick up where we left off in the autumn.

A Day in the Life...

This has been an amazing autumn. I am doing some of the most creative work I have ever done in my career, and at the same time it has been a highly productive period, generating six full peer-reviewed papers over the past year, with three-plus more in the works. So, a typical day :

1. Designing erotic accessories for people with disabilities : This is a two-year project funded by Quebec's Fonds de recherche québécois en société et culture (FQRSC), led by my collaborator Dr Ernesto Morales and involving, in addition to myself, our sexologist collaborator Dr Frédérique Courtois. We organized a series with people with a range of disabilities, both men and women, to discuss their masturbation practices and the difficulties and challenges they face. Based on these interviews, we have elaborated some preliminary designs. Most of these are of the "handle" type, that is, extensions that connect to existing sex toys that allow people with a range of disabilities to use these more effectively. In addition, some actual sex toys are also under development where there don't appear to be any commercial ones available. The work is inspiring in the sense that we are clearly serving a need that exists and for which little work has been done in the past. Our work in this area will probably provide a kind of basis for encouraging other projects in this area over the coming years. Furthermore, the designs we are producing can be either 3d printed directly, or one can 3d print molds that are used to construct the object from non 3d-printed materials such as silicone gels.

2. Understanding how children with and without disability move together : This is a three-year project funded by the Canadian Institutes of Health Research under the leadership of my collaborator Dr Coralee McLaren and involving, in addition to myself, Dr Tom Chau and Dr Barbara Gibson from Holland-Blooview Kids Rehab and Dr Cheryl Missiuna from the University of Waterloo. The project involves bringing a group of children, both with and without disabilities, together within a dance exercise that encompasses both structured and unstructured movement exercises. We will be monitoring the children's neurological responses via their own movements, but especially as they observe and respond to the movements of other children. Although we have not yet begin the full data analysis phase, we have used the EEG cap to study one child's responses to the movements of others, and the results, even for this one individual, are fascinating. Certain observed movements trigger "motor imagery" related to those movements, but not all movements have this effect. It seems that children "feel" certain movements of their peers more than others, and these "felt movements" trigger them to move in similar ways (a kind of mimicking). These observations are changing how we understand the way children play together. There will be much more to come, but even these preliminary results are intriguing.

3. Designing interactive and immersive installations for people with disabilities : Artists across the world are designing and implementing immersive and interactive installations that provide unusual experiences to participants. These installations are often not accessible to people with disabilities. In addition, the experience of disability can itself generate new possibilities for unusual experiences for those without disability, and unusual experiences of the body can lead to new insights for people with disabilities about their own interactions with the environment. A Ph.D. student, Ms. Afnen Arfaoui, has taken on the challenge of developing a design methodology for creating interactive and immersive installations that address issues of disability. She is drawing on Alfred North Whitehead's "process philosophy" in order to structure this design process. This is leading to a novel approach to design of these unusual installations, an approach which integrates both scientific preoccupations and artistic sensitivities.

4. Designing a participative, interactive opera : Given today's technology and the possibilities offered by social networking, it seems obvious that the traditional presentation formats of performance art - theatre, music, opera, dance - should evolve. Modifying the formats of public presentations of these art forms is not easy, however - these have settled into "ways of doing" that are normative and generally accepted by the public. We propose to open up the opera form to new forms of interaction with the audience. To do this, we are working with an unpublished manuscript (see the discussion of the opera project below), a science fiction story still under development. The manuscript is part of a "vast narrative" type project, that is to say, the story is told across 15 books in over 2500 pages, and parts of the story are finding their way into a variety of formats, including game environments and visual art (paintings). Furthermore, the story draws inspiration from the Greek myths and legends of gods and heroes, in particular the stories of Agamemnon Atreus and his family (the Oresteia), of Jason and Medea, of Odysseus and his compatriots and family, and of Orpheus and his family. The Greeks "invented" dramatic presentations, but in their day the public played an active role in the presentation of theatre. We propose to restore this participation. Right now, the issue we are struggling with is how to "segment" the story (in essence, the libretto) into short pieces which can be recombined in different ways through audience choices. The segments have to work not just as text, but also musically and choreographically. You can't just take an arbitrary piece of music and move it around, the result will be incoherent. Choreography also imposes constraints on the process. So as a team we are working on finding a kind of "basic unit" that incorporates the constraints on music, dance and text recombination.

5. Ongoing projects in other areas : Beyond these main challenges, which tend to be present every day in one form or another, several other projects are also ongoing. As part of the effort of developing smart garments and intelligent environments, I am drawing on ecoscience theory to develop a new understanding of complex sensor systems to assist the design process, and to recognize the need to address issues of personal vulnerability as these systems encroach on the highly personal spaces of the body. Another project under development focusses on designing techniques to test and enhance the combined effect of viewing and feeling the body, as a means to improve movement retraining following stroke, for example. In a third area we are looking at how to recruit adolescents with disabilities for a study of virtual reality as a tool for skill development for eventual employment. And this work excludes my ongoing writing initiatives and my work on fashion design...

Pinnacle - A One Act, Massively Participatory Opera

The participatory opera project is such an interesting effort it deserves a blog entry of its own. The convergence of several completely separate initiatives, three under my direct purview and one from another team, the project integrates these into one unifying initiative. Hence, over the past five years, in addition to my ongoing research at the intersection of the geomatics and rehabilitation sciences, on the one hand, and performance and media arts on the other, I have undertaken an ambitious writing effort as well as developed and brought to market two fashion collections based on my own designs.

The writing project consists of developing a "vast narrative" of some 2500 pages, involving hundreds of characters, planets, and habitats and more than 250 years of "future history) - about 65% of this project has been completed. The story is inspired by several of the Greek myths - the stories of Orestes and Elektra (immortalized in Euripedes' Orestia), of Orpheus and Eurydice, of Ulysses and Penelope, and of Jason, Medea and the Argonauts are the main narratives involved. The opera focusses on the first 100 pages of this story, essentially the youth of its central character, Oreph Sodenheim (based on both Orestes and Orpheus).

In addition to the scenario (from which the opera's libretto is derived), we propose to provide opportunities for large sectors of the public to participate both in the development of the opera and in its final delivery on stage, via an online web access we will create for the project. Opportunities to influence the scenario, the music, the choreography and parts of the staging will be provided. In addition, we are developing a smart garment that will incorporate movement sensors and which will serve as a specialized interface for the opera development - the garment will be provided to targeted audience members. The project involves several researcher-artists from Université Laval's Department of Music (Jocelyne Kiss, Serge Lacasse, Sophie Stévance) as well as collaborators from outside the university. An innovate project which will act as a showcase for innovation for related research at Laval University.

Research Nirvana?

Have I died and gone to researcher heaven? The set of projects on which I and my collaborators are currently working feels very much like that could be the case. Here is a brief overview :

1. The Winter Project : This project is the brain child of my colleague, Dr. Ernesto Morales. Essentially, we are working in collaboration with the city council for Quebec City and a range of organisations for people with disability, to redesign city policies, including snow removal practices, to make the city more "disability friendly" during winter conditions. Early results from the project include a redesign of pavement ramps to include a drainage system allowing snow to be melted and removed - pavement ramps are of key importance for people in wheelchairs and are often the site of an accumulation of snow and ice ; the development of a wheelchair-adapted snow-mobile device ; and discussions concerning changes to snow removal practices.

2. Pro(x)thèse : This project, under my oversight, seeks to create an interactive smart garment that is embedded within an active, immersive environment, to facilitate the exploration of self image in relation to sensuality and sexuality and disability. A prototype poncho has been developed which incorporates 12 pressure sensors, interface software has been completed, and photography of people with disability has been acquired. The project includes collaborators Dr. Frédérique Courtois, Dr. Ernesto Morales and Ms. Nancy Dubé.

3. Sex toys : Another collaborative project with Dr. Ernesto Morales, in this project we are designing aids that can be combined with existing sex toys, as well as developing new ones, that provide masturbation ability to people with disability who are often unable to use existing sex aids. The designs can be printed on a 3d printer, ensuring privacy and customizability.

4. ProBE : ProBE (Proximal Body Environments) seeks to develop a diagnostic tool for clinics to assess the presence of brain trauma, both mild and more severe, in patients. The project is predicated on the observation, tested across decades of research on obstacle avoidance strategies, that people who have even mild brain trauma move differently in space and in proximity to other objects (or people) than do healthy individuals. ProBE involves researchers from Quebec City (Drs Brad McFadyen, the leader of the project and Denis Laurendeau) and Toronto (Dr Karl Zabjek) as well as clinicians from both cities.

5. Participatory Opera : The crown of my ongoing research program, developing a massively participative one-act opera based on my own science fiction opus. The concept is to develop the opera itself in parallel with a range of tools that allow active participation by diverse publics in all stages of development as well as the final real-time performance of the opera - input concerning the music, the choreography and the story line itself. These tools include virtual and social environments and specially designed smart garments. The opera project, led by myself, involves musicians Jocelyn Kiss, Serge Lacasse and Sophie Stévance from the Department of Music at Laval University, Marie Louise Bourbeau, a lyrical singer in private practice, Dr Adel Elmaghraby, a computer scientist and dancer-researchers Erin Manning and Cora McLaren. Both myself and Dr. Manning are also fashion designers - we will also be developing the costumes for the opera.

On Designing Immersive Spaces for Rehabilitation Research

Over the course of the past ten years, my team and I have successfully designed and implemented (produced) more than a dozen immersive installations within a research focus. It is with the emergence of technologies for creating and working with immersive, interactive environments (virtual reality, augmented reality, sensor networks, wearable computing, smart environments, etc.), that the design of immersive spaces has become a viable process. Hence working with such spaces and installations is still very new. Artists have been creating interactive experiences using these technologies for a little more than a decade, while the use of these environments in research has been mostly confined to virtual reality and related technologies. The convergence of immersive technologies from disparate fields into a coherent and powerful set of tools for immersive design is no older than a few years, and, of course, just as the technologies are still evolving rapidly, research based on their use is only beginning to develop.

Research that embraces immersive design requires new methodologies and these, too, are still very experimental. Immersive spaces are different from conventional experimental designs. Immersive environments are increasingly multimodal - that is, visual and auditory and tactile or haptic. They are "ecological" in the sense of being global, holistic and systemic - they engage all of a person, not just targeted aspects. Furthermore, they often generate surprises - this is a consequence of their ecological nature.

Our experience has demonstrated that the creation of these environments demands a three phase process :

CONCEPTION/DESIGN

I

I

DEVELOPMENT/PRODUCTION

I

I

EXPERIMENTATION/EVALUATION

This might look like the classic life cycle of any project, but each of these phases is substantial - these are complex projects to organize. Let us examine just one of our projects to get a better sense of what is involved. I like to call this project "Virtuoso" - all of our installation projects have a distinct title. This project draws upon another key principle we have identified over the course of our development work - immersive installations that have a research (scientific) focus should serve a specific and well-identified need. This is distinct from artistic installations which may or may not serve such a need. "Virtuoso" is being developed to provide an engaging experience to adolescents with motor impairments, who experience both growing isolation and a tendency towards depression as they leave behind their childhood friends. By providing these adolescents with a virtual, online, and shared experience of architectural design within a virtual world environment, we hope not only to break the cycle of isolation and depression but potentially offer also an opportunity to develop an interest that might lead to employment.

The Design Phase of this project lasted over four years. Although this was longer than many, it is by no means atypical of the collection of installations we developed. The Design work actually consisted of two more intensive periods, each lasting from 4 to 6 months, separated by an interval during which the project was shelved. The reasons for the break were multiple, but experience shows that such breaks may be a useful part of the project development cycle (although they need not be as long as in this particular case!). Lack of resources, funding and difficulties developing a mature concept were among the reasons, and possibly also our lack of experience developing and financing complex projects. During the first intensive planning period, we organized a series of meetings with both scientists and clinicians, and agreed to develop a kind of video game experience that would include a social networking dimension as well as some form of cooperative manipulation. However, the exact nature of the video game itself never became clear.

Over the fallow period, the team pursued other projects, including several projects that harnessed the virtual world environment called "Second Life". During this work, the existence of several simulators inspired by the "Second Life" environment were identified and explored. One of these, a simulator called "OpenSim", seemed particularly interesting because it shares with "Second Life" the same simplicity of operation. The arrival of a new researcher led to renewed interest in the "Virtuoso" project, and this time the possibility of using OpenSim as a framing environment for the project gave a clear direction for development. The second period of intensive work on design was therefore able to finalize a design concept - we would lead the adolescents through the process of designing and constructing architectural projects using the virtual world environment. Furthermore, the design concept included not just the design of the immersive environment itself, but also details about the experimental protocols that would need to be followed in the third phase of the project. Indeed, we would evaluate the effect on users of the environment of the design process, compared to a control group that would play a video game.

The Production Phase involved the hiring of a summer student to do the development work. The OpenSim simulation was acquired and the necessary procedures for creating, storing and running a variety of virtual landscapes were studied and adopted. A thematic context for the project was created, pedagogical tools for guiding the young people through the process of virtual construction, and different ways for encouraging collaboration and sharing results were discussed and adopted. The summer student hired to develop the environment is an architectural student with an interest in virtual environments. The development phase is expected to last 3 to 4 months.

The Evaluation Phase is expected to take place over the course of another 4 to 5 months. This phase is, of course, completely different than the development phase - it requires very different kinds of expertise. Indeed, each of the three phases requires different mixes of expertise - this is one of the challenges posed by projects of this kind. In Phase Three, what is required are experts on experimental protocols and data analysis. Technical support for the environment itself must also be in place, and it may be necessary to make adjustments to the design of the immersive environment as a result of challenges in addressing the evaluation phase.

A brief analysis of the dozen or so projects that have been developed using this approach shows that the average duration of the Design Phase was 24 months, of the Production Phase was 10 months, and of the Testing Phase was 9 months. At least 5 of the projects were characterized by a two-step design phase with a fallow period between the two more intense design periods. From initial steps to completion took, on average, 4 years. Some of this duration is almost certainly due to working with limited monetary and human resources, but other factors included the fact that we had to invent research methodology as we progressed, that the projects require different mixes of expertise at different phases, and that creation, implementation and testing of these environments is necessarily complex and demanding work. Perhaps with the benefit of experience, it will be possible to limit the time span to less than 3 years. This is important, since most grants are awarded for three year periods - projects which extend significantly beyond three years are therefore extremely difficult to bring to term in an academic environment. Indeed the early projects in our slate of initiatives were actually taken through only to the end of Phase Two, a result of the need to provide some constraints before procedures and research methodologies became clearer. (Nine of the dozen projects completed or underway are shown in the table below. The projects which are excluded from this list are those which have not yet progressed beyond the Design Phase.)

#	Project	Phase	Duration (mo.)	Expertise
1	Ariadne Emerging	Design	24	Performance designer, choreographer, researcher
		Production	08	Singer, dancer/choreographer, video production team
		Documentation	04	Video production team, researcher, designer
-----
2	Incarnatus	Design	08	Performance designer, singer, theatre technician, programmer, researcher
		Production	08	Singer, theatre technician, programmer, researcher
-----
3	Virtualities in Dusseldorf	Design	24	Designer, researcher
		Production	06	Researcher, designers, programmer/technician, virtual content creators, museum staff, translator
-----
4	Augmented Reality for Bloorview Kids Rehab	Design	08	Researchers, designers, programmer/technician, clinicians
		Production	04	Researcher, designer, programmer/technician, hospital patients
-----
5	Ulysses : A Sound Geography	Design	24	Researchers, designer, composer
		Production	04	Researcher, designer, composer, programmer/technician
-----
6	EcoOracle	Design	24	Researchers, designer, programmer
		Production	06	Researcher, designer, programmer/technician
-----
7	EMIR Demos	Design	06	Researcher, designers/programmers
		Production	24	Researcher, programmers/technicians
-----
8	Pro(x)thèse	Design	36	Researchers, designer, composer
		Production	24	Researchers, sexologist, composer, programmer/technician, fashion engineer, photographers, artists, clinicians
		Experimentation	tbd	Researchers, programmer/technician, clinicians, sexologist
-----
9	Virtuoso	Design	48	Researchers, designers
		Production	04	Researchers, designers, architect, programmer/technician
		Experimentation	06	Researchers, designers, programmer/technician, data analyst
-----

It is worth noting that work of this nature may have been possible only within the context of extended funding such as within a Research Chair. The availability of significant funding levels every year over a seven year grant, obviating the need to reapply for funding every two to three years, made this effort viable. Now that procedures and methods are more well defined, such projects can be managed within shorter term funding arrangements, but the initial development work would have been very difficult to undertake within a standard academic grant environment.

EMIR Laboratory Now Functional

It has taken longer to get the lab completed and operational than expected, but this has finally been achieved. In conjunction with the efforts to complete the installation of the laboratory, we have developed five demos that showcase the potential of the laboratory to support diverse projects in rehabilitation and disability studies. These are as follows :

1. Fragment de vie (Fragmented Life) : Demo that provides different viewpoints of disability by offering different soundtracks for the same film delivered to wireless headphones (collaboration with CinéScène Inc.)
2. Vertiges (Vertigo) : Demo that provides an experience of vertigo by simulating walking across a narrow pathway suspended above Quebec City (collaboration with CinéScène Inc.)
3. Deuxième peau (Second Skin) : Demo that provides an observer a vicarious experience of disability. The movements of a person in a motion capture suit are transfered in real time to an avatar in a virtual kitchen, but attempts to interact with the kitchen and manipulate objects are restricted because the avatar experiences various types of motor impairment (collaboration with CinéScène Inc.)
4. Viscères (Visceres) : Demonstration of a body-based interface for virtual navigation of spaces (Google Street Map)
5. Meta-laboratoire (Meta-laboratory) : Demonstration of the use of the lab to support immersive experiments, in this case, a study of the effects of heminegligence on spatial orientation and judgement in the far field (collaboration with CinéScène Inc. and Dr. Julien Voisin)

In addition to the demos, a growing number of research projects are taking place that harness the possibilities that the lab offers. I have subdivided these projects into six categories : Bimodal Environments, Trimodal Environments, Movement-based Environments, Visceral Environments, Virtual Environments and Geographic Environments.

1. Bimodal Environments : Immersive environments that engage two major sense modalities

   Hemispheres (Hémisphères)

   Experimental study in planning stages of far-field effects of heminegligence (collaboration with Dr. Julien Voisin)

   Co-breather (Co-respirateur)

   Design and validation study underway to build and test four co-breathers for possible clinical applications. Co-breathers provide auditory-tactile immersion (collaboration with Ms. M.L. Bourbeau and C. Légaré)

2. Trimodal Environments : Immersive environments that engage three major sense modalities

   Living Wall (Mur vivant)

   Project in preparation, aimed at developing a playful immersive installation for waiting areas in clinics for children and adolescents that offers an engaging and absorbing environment that provides motor training opportunities (dexterity exercises) for individuals with fine motor impairments (collaboration with Dr. Ernesto Morales; projected Ph.D. thesis of Walid Baccari)

   Pro(x)thèse (Pro(x)thesis)

   Project underway in design phase, aimed at developing a clinical tool for allowing people with disability to explore sexual/sensual imagery and providing the means to track image choices over time. The tool involves the use of a touch-sensitive smart garment and an immersive visual environment, and we are commissioning photos by a professional photographer (collaboration with Dr. Ernesto Morales and Dr Frédérique Courtois).

   Auric Space (Espace aurique)

   Current in the planning stage, this project seeks to provide a training environment for people who have difficulties locating sounds in their immediate environment. We will use a bimodal environment (visual and auditory and haptic) to provide cues to and test for sound location (projected Ph.D. thesis of Afnen Arfaoui)

3. Movement-based Environments : Immersive environments that explore movement modalities

   Third Skin (Troisième peau)

   Project in planning stages that seeks to extend the work initiated in the project "Second Skin" to provide a variety of vicarious experiences of disability and ability

   Choreographic maps (Cartes chorégraphiques)

   Planned project that seeks to study how dance may contribute to emerging ideas about how children play (collaboration with Dr. Cora McLaren)

4. Visceral Environments : Immersive environments that explore actions rooted in the engagement of the body's visceral organs

   Visceres II (Viscères)

   Project in planning stages that aims to test the hypothesis that viscerally learned spaces are more fully understood and remembered than spaces learned by more traditional means

   OrienT (OrienT)

   Planned project that seeks to use a smart garment to help people who get easily disoriented to resituate themselves in their environments (collaboration with Dr. Claude Vincent)

5. Virtual Environments : Immersive virtual environments

   Virtuarch (Virtuarch)

   Project in design development stage that seeks to provide adolescents with disabilities who feel isolated and have a tendency towards depression, access to an environment and situation that engages them in the creative design of architectural spaces (collaboration with Dr. Ernesto Morales)

6. Geographic Environments : Immersive environments that encourage an appropriation of geographic space

   Multimodal Online Mapping Interface (Interface multimodal pour la cartographie en ligne)

   Project in planning stage that seeks to design and implement an on-line multimodal interface for a mapping application that draws on cognitive design principles (collaboration with Dr. Mir Mostafavi; projected Ph.D. thesis of Bilel Saadani)

These different projects seek to serve a variety of populations of people with impairments, including the deaf, the deafblind, the blind, those with low vision, people with either gross or fine motor impairments, people with attention deficits and people with intellectual impairments. Furthermore, different projects have different scientific goals and involve distinct methodologies. These include projects that are experimental or involve evaluation and assessment (Hemispheres, Visceres, etc.), projects that have more educational or pedagogical objectives (Second/Third Skin, etc.), projects that seek the development of assistive technologies or that are focused on design issues (OrienT, etc.), projects aimed at developing training environments (Auric Space, etc.), projects aimed at enhancing personal development among those struggling with issues of disability and impairment (Virtuarch, Pro(x)thesis, etc.), and projects that are far more exploratory in nature (Choreographic Maps, etc.).