A Story from Humid Land
Love Project
Digital Chinese Almanac 電子黃曆
Love Project
Digital Chinese Almanac 電子黃曆
A Story from Humid Land
Love Project
Digital Chinese Almanac 電子黃曆
Love Project
Digital Chinese Almanac 電子黃曆
- A Website of Tamagotchi
- StudySphere
Story from the Humid Land
Tools TouchDesigner, Ableton Live, Arduino, styleGAN
Year 2023
Story From the Humid Land is an audiovisual live performance.
The project is composed of three components: audio, visuals, and an Arduino MIDI controller. It is a series connection system using the Arduino circuit to control the distortion of the live audio in Ableton Live, then the live visual narrative in TouchDesigner directly reacts to the audio distortion. Together, they form a narrative that traces back to a childhood memory. In this work, I explore how the narrative unfolds across different media and how these elements intertwine to create new narrative traces. This narrative is rooted in a childhood memory stemming from those intimate moments and departing people, restlessness and fantasies, and the family space in my childhood.
Selected Frames
The visual creation begins with ten images I generated using StyleGAN. I collected a database of family rooms from videos in the Internet Archive and trained them into ten final images. I then converted the pixels of these images into text, selecting from short phrases I wrote for the narrative. This causes the image or video to distort along the outlines of the text, which documents the images. Using an AI voice generator, I translated the narrative into an audio segment, and the frequency of this audio controls the outline distortions of the images.
Then, I continue to the creation of audio. The audio is a four-minutes experimental sound piece telling the narrative. The piece is mainly composed with a series of daily noises I recorded in my living spaces, including typing sound, washing machine noise, and a recording of environmental sounds in my bedroom. The audio is made with Ableton Live 11. To connect the audio to visual, I used the TDAbleton package plug-in to link the audio to visual. When specific audio effects change in the Ableton track, the visual generates new layers of effects automatically.
The visual creation begins with ten images I generated using StyleGAN. I collected a database of family rooms from videos in the Internet Archive and trained them into ten final images. I then converted the pixels of these images into text, selecting from short phrases I wrote for the narrative. This causes the image or video to distort along the outlines of the text, which documents the images. Using an AI voice generator, I translated the narrative into an audio segment, and the frequency of this audio controls the outline distortions of the images.
Then, I continue to the creation of audio. The audio is a four-minutes experimental sound piece telling the narrative. The piece is mainly composed with a series of daily noises I recorded in my living spaces, including typing sound, washing machine noise, and a recording of environmental sounds in my bedroom. The audio is made with Ableton Live 11. To connect the audio to visual, I used the TDAbleton package plug-in to link the audio to visual. When specific audio effects change in the Ableton track, the visual generates new layers of effects automatically.
Audio WIP
Visual WIP
Then, I made a MIDI controller using Arduino Nano 33 to control the audio distortion using buttons, Ultrasonic Distance sensor and three Potentiometers as knobs.