exploring memories through sound

Interactive product design concept to explore past memories using sound layering.

About

The overall aim of the Industrial sound design course was to gain an increased understanding, awareness and experience of how sound can be utilized to enhance the design experience of the form language and user interface of a product.

Our group decided to explore how we could use sound in product design to help therapists in accompanying their dementia patients in exploring past memories through sound reminiscence therapy

Type of project

Case Study at Umeå Institute of design,
2 weeks project, 2021

main focus

UX design

Contribution

This work was done with my classmates from APD masters Sinan Altun, David Bertl, and Nathanael Boetl . 

My contributions centered mainly around conceptualization, experience prototyping, sound design, and UI.

The short version

challenges / opportunities

During the sound design course we explored how sound can be used in design. Through small experiments, we learned about sound’s ability to evoke emotional responses and trigger memories.

This inspired us to explore how sound could help people immerse themselves in feelings of reminiscence.
sound as a medium to access past memories
mockup of final concept in action

outcome

The outcome is a concept for an audio reminiscence therapy tool consisting of a connected device and app.

It uses sound stimulation to help individuals with dementia, together with their therapist or care professional, recall past events.

The tool enables easy, intuitive sound layering to support the exploration of memories.
To read more about it, just keep on scrolling

the long version

Process

After a week of sound design exploration, we began the 2.5-week design sprint with desktop research and an interview with a gerontopsychologist.

We then explored ideas through sketches and low-fidelity prototyping, refining our concept through multiple iterations to improve the product, app, and user flow.
Design process (own visualization)
a negative loop

Main research findings

Our research showed that dementia can lead to anxiety and depression, which worsen the condition in a harmful cycle. Treating these mental health issues is important, but traditional therapies often don't work because patients struggle to remember recent events.

To address this, care professionals use sensory therapies like sound reminiscence, where familiar sounds help patients recall memories, providing comfort and helping them express emotions.

design principles

Our research and group discussions allowed us to define clear values for our design. These values guided both the product design and the interaction patterns.

This helped make sure that the product would be enjoyable, easy to use, and create the right atmosphere for reminiscence therapy.
Show simplicity
The product should look simple and be easy to use to avoid overwhelming dementia patients
Ensure error-proofing
Design with error-proofing in mind to focus on exploration and prevent frustration.
Promote Playfulness
Use play as a way to connect and interact.
Allow for Creativity
Integrate creativity into the design, as it plays a key role in healing and supporting mental well-being.
quick prototyping for ideation

ideation

We quickly created low-fidelity prototypes using paper, Legos, and cardboard. We then tested interactions with a wizard-of-oz method, where two people moved the pebbles on the board while another controlled the sound on their computer.

This fast prototyping approach allowed us to rapidly iterate and helped us quickly define the interaction modalities.

concepting

We chose a product and app combination. The therapist first uses the app to select the sounds. During the session, different soundscapes are explored and discussed with the dementia patient. Afterward, the therapist can use the app to take notes on how the sounds impacted the patient.
product app combination, own illustration
rendering of the device, made by my classmates

the device

The device is a board on which connected pebbles can be moved to manipulate sound. It connects to speakers and has a space to store the pebbles when not in use. The surface of the board acts as the medium for adding sound—when a pebble is lifted, the sound is muffled, and as it moves closer to the center, the sound becomes louder and clearer, allowing users to create layered soundscapes.

the app

The app is used to load the pebbles with different sounds. It mainly functions as a sound library through which the therapist can select sounds that are likely to trigger reminiscence feelings.
selected screens of  app concept

reflections

collaborating with industrial designers

Working with sound was challenging at first, but it turned out to be really rewarding.

This project opened my eyes to the many ways sound can be used in design. Collaborating with three students from the Advanced Product Design master was a great experience and helped me understand how to work better with industrial designers. It also showed me how much shape and interaction influence each other.