Skip to content
Work About Publications Talks Contact
MNEMO — clip-on camera worn on a red hoodie

MNEMO · Master’s thesis

A camera that remembers what moves you.

A memory system that captures moments the way the brain forms them — triggered by emotion, not by conscious decision.

Role
Concept, interaction and product design
Timeframe
2014
Context
Master’s thesis, HfG Schwäbisch Gmünd · with Martha Miosga
Status
First place, Zukunftspreis Kommunikation 2014

01 / Starting point

Why do we forget the moments we photograph?

In 2014, the number of photos people took exploded — and at the same time their value fell. We photographed more and remembered less. Psychology describes the effect: when we take a photo, we outsource remembering to the device.

The brain works differently. It does not store what we want to keep, but what moves us. Emotional moments are consolidated into memories; neutral ones fade.

Martha Miosga and I developed MNEMO as our joint master’s thesis; I focused on the interface and the Hexagon Navigator. It started from one question: can a camera system remember the way a person does? Not recording everything (lifelogging), not triggering deliberately (photography) — but capturing exactly when emotion arises.

A hand holds the small dark MNEMO camera between two fingers; a white sensor wristband sits on the wrist
The two parts you wear: the clip-on camera and the sensor wristband, as 3D-printed models. · Original material

02 / Research

How do memories form — and what triggers them?

Before designing anything, we wanted to understand the phenomenon: cognitive science and the psychology of memory formation, dementia research, the photography market. Then we tested that knowledge against practice — six experts whose job is remembering, and a quantitative survey with 192 participants on memory cues and emotional triggers.

Online survey: what people capture and how they sort it192 people took part in an online survey. Of those who had a nice moment that day, 74 percent did not capture it, and 77 percent of them wish they had. Photos, videos and keepsakes matter: 4.37 out of 5. How they sort their photos (180 usable answers): by date 116, by event 66, no order 30, by place 19, by person 11, by life stage 3. How they would label drawers of memories (154 usable answers, up to three each): person 165, event 116, emotion 105, life stage by activity 83, life stage by age 64, other 50, place 22.192people answered, at the university and via social mediaOf those who had a nice moment that day74 % did not capture it77 % of them wish they had4.37 / 5 – how much photos and keepsakes matterHow they sort their photos180 usable answersDate116×Event66×No order at all30×Place19×Person11×Life stage3×How they would label drawers of memories154 usable answers · up to three eachPerson165×Event116×Emotion105×Life stage (activity)83×Life stage (age)64×Other50×Place22×
Online survey: 192 participants192 people took part in an online survey. Of those who had a nice moment that day, 74 percent did not capture it, and 77 percent of them wish they had. Photos, videos and keepsakes matter: 4.37 out of 5.192people answered, at the universityand via social mediaOf those who had a nice moment that day74 % did not capture it77 % of them wish they had4.37 / 5how much photos and keepsakes matter
How people sort photos and how they would file memoriesHow they sort their photos (180 usable answers): by date 116, by event 66, no order 30, by place 19, by person 11, by life stage 3. How they would label drawers of memories (154 usable answers, up to three each): person 165, event 116, emotion 105, life stage by activity 83, life stage by age 64, other 50, place 22.How they sort their photos180 usable answersDate116×Event66×No order at all30×Place19×Person11×Life stage3×How they would labeldrawers of memories154 usable answers · up to three eachPerson165×Event116×Emotion105×Life stage (activity)83×Life stage (age)64×Other50×Place22×
Photos get sorted by date; memories would be filed by people, events and feelings. Results of the online survey with 192 participants. · Illustration
Six expert interviews in black and white, each with the interviewee’s field
Six perspectives on memory: photography, gerontology, dementia counselling, the University of Tübingen, memory books and the Stuttgart city archive. · Original material
Affinity diagram — synthesis of the research findings
Synthesis: affinity mapping across literature, interviews and survey, 18 opportunity areas. · Original material
  1. A day on a strip

    We wore two lifelogging cameras until the end of the project. One day alone produced more than 1,600 pictures, which we printed on a strip.

  2. Sorted by hand

    By place and event: irrelevant shots out, emotional ones kept as stand-ins for the rest.

  3. About 15 % were enough

    Around 240 pictures were enough to relive the whole day.

The self-experiment as a schematic; the tiles repeat pictures from the project. · Illustration

Emotion decides what stays — not intention. A memory system therefore must not ask whether to record; it has to feel when. The synthesis produced three theses and sixteen design principles, among them recording without interrupting the moment, reliving instead of managing, and full control for wearers over their own data, the principle that later earned the project the Zukunftspreis.

03 / Concept

What does a camera look like that feels rather than asks?

The answer is a system in three parts: a sensor wristband measures the physiological patterns of emotions — pulse, heart rate, skin conductance, skin temperature. When it registers a change, a wirelessly connected clip-on camera automatically records a short video. The software links everything into a memory network you can explore.

First idea sketches Navigation concept sketches Sketches of dimensions: pictures arranged along time, size and person Sketches of a network: pictures linked across timeline, people and highlights
First sketches, from the idea of memory to the system concept, then the navigation: how do you explore a network of memories? · Original material
  1. Wear it

    The sensor wristband measures pulse, heart rate, skin conductance and skin temperature, continuously. The camera sits on a clip, a necklace or a counter-magnet.

    From our film, 2014. · Original material

  2. A moment moves you

    When the wristband detects a change in emotion, it signals the wirelessly connected camera.

    From our film, 2014. · Original material

  3. Three seconds

    The clip-on camera records three seconds of video. Afterwards it slows down, to one picture every 30 seconds in everyday life.

    The camera’s view, as staged in our film, 2014. · Original material

  4. Explore

    Docked, the camera transfers its recordings. The software links every moment by place, person, time and emotion into a network you can explore.

    From our film, 2014. · Original material

Three seconds of video — no more. The length matches the rhythm in which the brain processes information into units of memory; longer would be surveillance, shorter just a photo. It was also the most important privacy decision: MNEMO documents moments, not sequences of events. Anyone who wants to take a photo deliberately simply releases the camera from its magnetic mount; automation never replaces intent, it complements it.

04 / Product

A wearable you forget about — until the moment comes.

The hardware took shape through form iterations in Rhino 3D — magnetic mechanism, material studies, wearing comfort. Magnetic mounts — two clips, a necklace and a counter-magnet — let the technology adapt to everyday life, not the other way round. A device that remembers must not draw attention to itself.

MNEMO system components: sensor wristband, two cameras, two clips, a necklace mount and a counter-magnet
The MNEMO system: sensor wristband, magnetic clip-on camera and its mounts, two clips, a necklace and a counter-magnet. · Original material
MNEMO sensor wristband and camera with its mounts: two clips, a necklace and a counter-magnet
One camera, many ways to wear it: two clips, a necklace, a counter-magnet. · Original material
MNEMO worn as a necklace
In everyday life, the camera reads as jewellery, not a gadget. · Original material
Twelve people wearing the MNEMO camera on their clothes or on a necklace
A wearable for everyone: twelve people, the camera on clothes, pockets, straps or a necklace. · Original material

05 / Interface

How do you navigate feelings?

Folders and timelines organise files — but memories work by association. The software links every recording with place, time, people and emotion into a network. The question was: how do you make that network tangible without it turning into a database?

Wireframe — overview grid Wireframe — sidebar navigation Wireframe — filtered view
Wireframes: the overview as a grid, sidebar and detail, filtered search. · Original material
Interface iteration 1 — early hexagon exploration Interface iteration 2 — refinement Interface iteration 3 — final interface
Three generations of the interface, from an early hexagon exploration to the final one, each tested against the sixteen design principles. · Original material

The Hexagon Navigator: the interaction model grows out of the data model. Any memory can become the centre; place, person and time link every other one to it, and three emotion axes between them complete the hexagon. Instead of search forms and filter lists, users stretch the shape. Pull the emotion axes in and only the highlights remain, shown large: memories filtered by how much they moved you, not only by when they happened.

A separate view filters by individual emotions. The same network opens as a photo grid and on a map, on desktop, tablet and phone.

EMOTION PARAMETER PERSON EMOTION PARAMETER TIME EMOTION PARAMETER PLACE
Six axes: place, person and time link memories by context; the three emotion axes between them filter by feeling. Pulled in, only the most emotional moments remain; pushed out, more ordinary ones appear. The area shows how many memories pass. · Illustration
The navigator in our film, 2014: place, person and time as icons, the emotion handles in between. · Original material
Desktop interface: Hexagon Navigator with filtered memories Desktop interface: the navigator with a row of emotion icons above it Desktop interface: memory overview Desktop interface: map view of the memories
Filtered with the navigator, by emotion, as a photo grid and on a map. · Original material
Tablet view of the MNEMO interface Phone view of the MNEMO interface: the navigator over a grid of pictures
Multiplatform: the same network on tablet and phone. · Original material

The archive forgets.

Pictures nobody looks at lose their colour over the years, like memories do; looking at one brings its colour back. A real process of forgetting was one of the sixteen design principles.

Ten years in a few seconds: 21 pictures fade, three are looked at again and regain their colour. Drag the handle to move through the years. · Concept visualisation

06 / What remains

An early answer to a question I still work on.

First place in the Privacy category, Zukunftspreis Kommunikation 2014 · master’s thesis graded 1.0 · lab talk at Intuity, Stuttgart · regional and trade press, 2014/15.

Reflection

MNEMO asked in 2014 what is my core topic today: how much autonomy do we give systems that decide for us? What I would do differently: test early with working sensors on the body, not only in scenarios. Whether physiological signals detect emotions reliably enough remained open.

Team
Martha Miosga, Dominik Witzke
Supervision
Prof. Ralf Dringenberg, Prof. Jens Döring · HfG Schwäbisch Gmünd
References
Film, 2014 ↗

Next project

SERIKAT

A student project for a small-series platform, later explored as the SERIKAT venture.

View project →