Speaking with your hands

Speaking with your hands

How does our physical body interact with digital content ?
The students have explored creative ways in which typography and graphics can be manipulated in response to human movement.

Workshop (2024) with Vera van de Seyp

Assistants
Martial Grin
Students
Elena Biasi, Olivia Capol, Thomas Gaudin, Quentin Kohler, Mathias Liniger, Emilie Maier, Aryana Noorani, Livia Schmid, Alexine Sierro, Charlotte Waridel, Valère Zen-Ruffinen
Know-how
Augmented Reality (AR, XR), UX/UI, Creative coding

OVERDOSE

Advertising sells us dreams, it’s up to you to choose your reality. The user tries to chase away increasingly invasive ads.

 

By Mathias Liniger and Quentin Kohler


Client vs Designer

A conversation between a designer and their client represented in a fighting game.

 

By Alexine Sierro and Charlotte Waridel


SMOKE

By imitating the gesture of smoking a cigarette, the user creates virtual smoke that reveals a message.

 

By Valère Zen-Ruffinen and Baptiste Godart


FAceOFF

A photo booth steals your face and gives it to someone else. You must catch it to get it back.

 

By Elena Biasi and Emilie Maier


Locoland

A car ride in an imaginary world. Drive the vehicle using your arms.

 

By Thomas Gaudin and Olivia Capol


PUND

Above a pond, the user fishes for puns related to fish.

 

By Aryana Noorani and Livia Schmid

Projects related to Creative coding

Screen Design – 2025

BA MEDIA & INTERACTION DESIGN

Screen Design – 2025

with Harry Bloch

Websites developed over the course of a semester based on books chosen by students, which they adapted into web experiences as part of Harry Bloch's Screen Design course, second year of the Bachelor's degree in Visual Communication.

COUNTDOWN – 2025

BA MEDIA & INTERACTION DESIGN

COUNTDOWN – 2025

with Mario Von Rickenbach

The students worked on an interactive countdown in a web environment. Each day, they were tasked with creating a new sketch, culminating in their own collection, which could also be combined with projects from the entire class.

RE-STRUCTURE

MA DIGITAL EXPERIENCE DESIGN

RE-STRUCTURE

with RNDR STUDIO

During this one-week workshop, Master Digital Experience Design students used machine learning tools to decompose music videos into their constituent parts: segmented scenes, detected gestures, extracted colors, analyzed beats, separated audio stems, transforming linear audiovisual artifacts into structured datasets. These components were then reimagined as interactive, non-linear systems: explorable maps, generative timelines, rhythm-driven interfaces, and self-recomposing structures built with the OPENRNDR framework.

Enshittification - 2026

BA MEDIA & INTERACTION DESIGN

Enshittification - 2026

with Tibor Udvari

Many platforms degrade over time, shifting from useful tools into manipulative systems. In this workshop, we explore enshittification as a creative method by modifying existing websites or developing small web experiments that exaggerate friction, automation, overload, and disorientation in order to reveal the underlying logics.

The Mind Reader Interface

MA DIGITAL EXPERIENCE DESIGN

The Mind Reader Interface

with Gaël Hugo, Paul Lëon

The Mind Reader Interface shifts computing from the reactive to the proactive: from a system that obeys commands to one that anticipates them. Where smart environments cast their users as pilots issuing constant instructions, this project removes the friction of instruction altogether. Intention is no longer declared through a screen or a button. It is inferred. Reading context, habit and the signals of presence, the interface acts before it is asked. It sheds the form of the device to become a Ghost in the Room that senses rather than obeys. The user no longer pilots the space; they inhabit it. The system does not read thoughts, only traces, and stages the distance between anticipation and understanding: what we gain, and what we quietly surrender, when a space begins to act on our behalf.

Related courses