bosch_busts_honey.jpg

eden

 
 

project: eden

concept: experience AI with all senses

year: 2019

 
 
 
 

research questions: How can we feel AI in new ways?

execution: A 3D simulation of paradise with neural network agent Adam&Eve is running in realtime. The agent's movements are tied to human heartbeats. If there are signs of human life, the AI can roam in its paradise and the audience floats in a sea of sounds. For my talk at Runway x Paperspace I created a special rave version of the project with the AI agent as DJ/VJ partner. I am just controlling the beats, the machine learning agent the rest. Eden was part of my ITP master thesis: Binaural Storytelling with AI - Sonification of ML-Agents through Spatial Audio.

tools: felt, AI (reinforcement learning), spatial sound design, 3D rendering, Unity, VR, WatchKit/HealthKit, ableton live

code-source: github-repo (unity mlagents, will link my fork soon)

 
 
live spatial-sound installation setup that enables user to listen to the movements of AI-agent in its 3D world

live spatial-sound installation setup that enables user to listen to the movements of AI-agent in its 3D world

 
 
real-time communication between AI-agent and user: human heart-rate and AI-observations

real-time communication between AI-agent and user: human heart-rate and AI-observations

3D render of agents head and torso

3D render of agents head and torso