ICCHP18 Poster

The TERRAIN Project

Independent urban mobility for pedestrians with blindness and low vision through audio-tactile navigation

A. Constantinescu, B. Behrendt, D. Kochanek, D. Koester, G. Jaworek, H. Kucharek, K. Müller, M. Awizus, M. Haurilet, M. Winkelmann, N. Weinberger, P. Frank, R. Stiefelhagen, S. Helfer, S. Kliesch, S. Ritterbusch, S. Siebert, V. Petrausch

Motiviation

In urban, unknown spaces it is often difficult for people with blindness or visual impairment to find their way around. The different environments such as city centres, parks or forest paths place diverse demands on orientation and mobility. A lack of local knowledge and orientation problems can lead to blind people not using some areas of the city, such as local recreation areas. This results in a limited range of movement and social isolation. Assistance systems – which help to identify obstacles and points of orientation when navigating in public space – can noticeably improve the quality of life.

Goals

The aim of TERRAIN is to develop a portable assistance system to support the mobility of blind and visually impaired people in urban areas. The system combines navigation based on digital map data with camera-based image processing methods. Paths, obstacles, traffic lights, road crossings as well as interesting landmarks, buildings and objects are detected. To this end, an accessible, acoustic and haptic user interface is being developed that can be adapted to the needs and preferences of users. A new type of mobile, wirelessly connected Braille display will also be integrated.

Project

With TERRAIN, decisive hurdles in mobility and navigation are overcome and confidence in the users‘ own movement and mobility abilities is strengthened. Everyday paths can be done independently; activity and social contacts ensure physical and mental well-being.

The project receives up to 1.7 M€ funding by the Federal Ministry of Education and Research of Germany from July 2016 to June 2019. Further information is available on the project website: https://www.terrain-projekt.de/

Topics

Scene Analysis by Computer Vision

A portable Computer Vision system aims at detecting landmarks, obstacles and free surface, as well as traffic lights, buttons and crossings in front of the user. The goal is to use this information to help crossing streets more safely.

Multi-Modal Human-Computer Interaction

The system provides information using acoustic and haptic devices, such as narration or sounds, as well as Braille, vibrating belts or armbands. Various interaction modes aim at offering a system that is adaptable to the users capabilities.

Roadside-aware Safe Routing

As finding suitable crossings is most important for blind and visually impaired users, the project introduced a roadside-aware safe routing that prefers safe crossings and paths to shorter alternatives and gives instructions accordingly.

Experts and Citizens Involvement

The use of new technology in an urban environment may lead to unexpected responses by citizens. Therefore citizens and experts of various fields are included in workshops and meetings, to improve the reception and results of the project.

Innovative Braille Integration

The development of a new Braille Interface aims at the specific needs in urban mobility in terms of weight, usability and improved concepts for information display using the well proven Braille representation.

System Evaluation and Mobility Training

Close collaboration with Mobility Trainers is an integral part in the development and evaluation phase. The feedback of test users with blindness and low vision has a major impact on the final result and the training material that is provided.

User Centered Smartphone Solution

A fully accessible smartphone app offers the user centered access to all supporting features of the project. The user decides what information is given, and how devices should present the information about the environment.

Consortium

Karlsruhe Institute for Technology (KIT)

Studienzentrum für Sehgeschädigte (SZS)

Computer Vision for Human-Computer Interaction (cv:hci)

Institute for Technology Assessment and Systems Analysis (ITAS)

F. H. Papenmeier GmbH & Co. KG

iXpoint Informationssysteme GmbH

Funding

The TERRAIN project is sponsored by the Federal Ministry of Education and Research, Germany.