Speaking with your hands

Speaking with your hands

How does our physical body interact with digital content ?
The students have explored creative ways in which typography and graphics can be manipulated in response to human movement.

Workshop (2024) with Vera van de Seyp

Assistants
Martial Grin
Students
Elena Biasi, Olivia Capol, Thomas Gaudin, Quentin Kohler, Mathias Liniger, Emilie Maier, Aryana Noorani, Livia Schmid, Alexine Sierro, Charlotte Waridel, Valère Zen-Ruffinen
Know-how
Augmented Reality (AR, XR), UX/UI, Creative coding

OVERDOSE

Advertising sells us dreams, it’s up to you to choose your reality. The user tries to chase away increasingly invasive ads.

 

By Mathias Liniger and Quentin Kohler


Client vs Designer

A conversation between a designer and their client represented in a fighting game.

 

By Alexine Sierro and Charlotte Waridel


SMOKE

By imitating the gesture of smoking a cigarette, the user creates virtual smoke that reveals a message.

 

By Valère Zen-Ruffinen and Baptiste Godart


FAceOFF

A photo booth steals your face and gives it to someone else. You must catch it to get it back.

 

By Elena Biasi and Emilie Maier


Locoland

A car ride in an imaginary world. Drive the vehicle using your arms.

 

By Thomas Gaudin and Olivia Capol


PUND

Above a pond, the user fishes for puns related to fish.

 

By Aryana Noorani and Livia Schmid

Projects related to Augmented Reality (AR, XR)

Yann Müller – Trame Noire

BA MEDIA & INTERACTION DESIGN

Yann Müller – Trame Noire

by Yann Müller

As cities light up, the night fades from our sight. Trame Noire is a night-exploration mobile app designed to raise public awareness about the impacts of light pollution on the wildlife and flora that come alive at dusk. Combining immersive experience and citizen science, the project offers a new way to observe and understand our coexistence with the living world. Guided by the seasons and natural cycles, the app invites users to explore the urban environment and capture, from one location to the next, the unique light footprint of each space. Through these explorations, Trame Noire maps a sensitive geography of the dark, bringing to light how artificial illumination alters the behavior of nocturnal life.

RE-STRUCTURE

MA DIGITAL EXPERIENCE DESIGN

RE-STRUCTURE

with RNDR STUDIO

During this one-week workshop, Master Digital Experience Design students used machine learning tools to decompose music videos into their constituent parts: segmented scenes, detected gestures, extracted colors, analyzed beats, separated audio stems, transforming linear audiovisual artifacts into structured datasets. These components were then reimagined as interactive, non-linear systems: explorable maps, generative timelines, rhythm-driven interfaces, and self-recomposing structures built with the OPENRNDR framework.

Teo Grajqevci – reform

BA MEDIA & INTERACTION DESIGN

Teo Grajqevci – reform

by Teo Grajqevci

reform responds to a context in which designers are gradually losing control over their tools: creative software is becoming more automated, closed and dependent on cloud-based services. Today, generative AI can produce 3D models with ease, but often at the cost of control, understanding and ownership of the creative process. reform offers another approach: making 3D modelling easier to access, in a field that is usually complex and difficult to learn. The project takes the form of free and open-source software, built around a simplified interface, intuitive interactions and guides that support the learning of these tools. Through demonstrations and didactic exercises, reform restores the designers' motivation and means to model 3D shapes themselves.

Beyond Clicks

MA DIGITAL EXPERIENCE DESIGN

Beyond Clicks

with Gaël Hugo, Paul Lëon

The Mind Reader Interface shifts computing from the reactive to the proactive: from a system that obeys commands to one that anticipates them. Where smart environments cast their users as pilots issuing constant instructions, this project removes the friction of instruction altogether. Intention is no longer declared through a screen or a button. It is inferred. Reading context, habit and the signals of presence, the interface acts before it is asked. It sheds the form of the device to become a Ghost in the Room that senses rather than obeys. The user no longer pilots the space; they inhabit it. The system does not read thoughts, only traces, and stages the distance between anticipation and understanding: what we gain, and what we quietly surrender, when a space begins to act on our behalf.

Enshittification - 2026

BA MEDIA & INTERACTION DESIGN

Enshittification - 2026

with Tibor Udvari

Many platforms degrade over time, shifting from useful tools into manipulative systems. In this workshop, we explore enshittification as a creative method by modifying existing websites or developing small web experiments that exaggerate friction, automation, overload, and disorientation in order to reveal the underlying logics.

Related courses