Lyrics, music and visuals: Eric Schuurman
Tenor sax and harmonica: Vince Salerno
This has never been done before.
I am a fan of Lofi, DIY, and found objects. I also think that describing the process of creating the art adds an additional dimension if you can tell it compellingly and accessibly. This is my song ‘Hallucination’.
After writing and recording the song, I decided on a process to generate visuals and motion for it. I wanted to combine generative AI animation with morphing 3D, creative coding using the Processing programming language, and motion 3D fractals with a Z-buffer.
The Kaiber AI prompt used 5 scenes and was rendered using the Flipbook format. The artifacts in the rendering are delightfully grotesque on occasion. The blue-ish generative AI was then embedded in a bronze-ish 3D fractal using its Z-buffer depth information.
I had ChatGPT 4o scramble the words from the song to create 8 random sentences which I animated using the Processing programming language. I’m not a programmer, so I told ChatGPT to generate the code according to my design requests. They drift in and out of view softly.
The morphing 3D lattices were rendered in Blender and layered with the other compositional elements in Blender’s compositor. Blender was the central application for combining everything.