Resonant spaces of perception: sonification of abstract art

How do we perceive abstract artworks, and how do they shape our understanding of reality? These questions are at the core of Frank Furto’s interdisciplinary project, which explores the intersection of visual perception and auditory experience. Through an innovative interface, the impact of abstract paintings is intensified by a real-time sonification system that translates viewers’ gaze data into sound. This auditory feedback transforms the space between the artwork and the observer into a dynamic, interactive experience.

Abstract art challenges perception and can evoke profound emotional and psychological effects. But how do these experiences emerge? Frank Furto investigates this question through biological, philosophical, and technological perspectives. By integrating eye-tracking technology with sound design, the project creates an immersive experience that stimulates not only visual but also auditory perception. The viewer transitions from a passive observer to an active participant in a perceptual dialogue with the artwork.

The developed technology enhances the aesthetic impact of abstract images by making their abstraction tangible and audible. At the same time, it reflects the very act of seeing, revealing subjective perception as an integral part of the artwork. The dialogical space between image and observer is not understood as an empty interval but as a living resonance space.

This project merges artistic practice with scientific methodology, inviting visitors to rediscover the relationship between artwork and perception. It demonstrates how abstract art is not just something to be observed but can become an interactive element of an expanded aesthetic reality. The paintings used in the project are selected from the artist Philipp Pusch.