After much experimentation and research about the techniques that could be used, it was time to actually do something. Myself and Klara travelled from the South West of England to the South East and shot a series of landscapes. Above is an early experiment using a shot of Ubley Warren in North Somerset, mirrored to create the effect of a living, breathing landscape.

Here is the full video with the sound recorded on location (The sound will be changed by creating mini soundtracks using field recordings and samples all mixed in protools, kind of like noise music as seen in the movie 'Frank').

The initial Idea was to map the unique curves of the mirrored landscape and interpret them as sound data and create a unique soundtrack formed by the shape of the landscape. However, after experimenting with different picture to sound programs and attempting to code the images manually, we felt that by mirroring them, the landscapes were given new life, as if they were living and breathing.

This was done by importing into Premiere, duplicating the clip and putting one on top of the other, cropping them fifty fifty and rotating one by 180 degrees. It does in a way resemble a waveform and it kind of sucks that we can't figure it out just yet. Perhaps this is something to develop.

So we have the  After numerous hours of research into trying to visualise things in various coding softwares, such as processing and puredata, we reached out to a visual artist friend of Klara's who recommended the program Resolume Arena. Resolume is a VJ (video jockey software) and allows manipulation and projection mapping of audio visuals so that they react to one another. Using this tutorial to get me familiar with the basics of the program, I was able to experiment with looping audio and syncing it with effects applied within the program. As it turns out this program is incredibly easy to pick up, and I can't wait to experiment further. What you see below is actually a single .jpg file manipulated to give the essence of movement. there is a video (which is linked) that has the looping sound. This is just one potential visualisation of the landscapes, but was not used with a fully realised soundtrack. Once the soundtrack is complete I will continue experimenting and create different visualisations of the landscapes using the sound.

Ubley Warren

Furthermore, the sound artist we contacted about the program is linking us his own software he developed that visualises sound, so I will post about that once it's done.


RESEARCH:

Music Visualisation in Pure Data: https://puredata.info/dev/summer-of-code/PdDataViz
More Music Visualisation: https://zf213.wordpress.com/2009/05/05/visual-musicpure-data/
Tutorials I am going through about using vvvv: http://vvvv.org/documentation/video-tutorials#vvvv-tutorial-1-installing-vvvv
Reactive audio visuals that I need to work on: http://www.airtightinteractive.com/2013/10/making-audio-reactive-visuals/