making BLUE MOON

My video poem BLUE MOON, has generated quite some interest in how it was made.

The underlying sequence of buildings panning along to a beachscape is actually a single still image that I built in Photoshop. It is constructed from about 100 images of buildings around the Adelaide CBD, North Haven, and Brighton. They were photographed on days with bright sunshine and clear blue skies so that the lighting was comparable across the shots. Even so, I needed to adjust colour, brightness, saturation, scale, perspective and so on to get the visual mix right. The blue skies also allowed for easier compositing later on. In the final mix, the background sky was processed to be the same in all assemblies and was derived from the average sky colour in the images. The final Photoshop file is huge: 62,000 x 1800 pixels and about 500 MB. It was assembled from 5 smaller montages, each of which was from a specific location, and each of which contained dozens of layers.

I then took the final composite image into Final Cut Pro X and animated the pan from one end to the other. To save memory, I rendered it, and used the resulting video clip in the final composite. The sky with moving clouds is composited from three sets of vids I took all on the same day, but in slightly different parts of the sky so that the cloud movements were not quite the same. They are sped up and looped to varying degrees. The various flying objects are from a commercial image library that I animated. The final moonrise sequence is taken from the recent lunar eclipse we had (click here to see that). It is composited via an animated mask and a couple of other image processing tweaks. The whole lot was composited using colour keys, background colour gradients, key framed text and opacity animations.

The soundtrack is tin can, a performance I did as part of a Paroxysm Press tribute to David Bowie. The text is inspired by Bowie’s Space Oddity, Arthur C Clarke & Stanley Kubrick’s 2001: A Space Odyssey and NASA’s Pioneer 10 / 11 space probes to the moons of Jupiter and Saturn, with all due reference to Homer’s Odyssey. The music is derived from the chord pattern of Space Oddity. You might find a few other references as well…

 

Dial Tone awarded 3rd place in Health Poetry Prize

My poem Dial Tone came third in the University of Canberra 2017 Health Poetry Prize! Congrats to winner Joe Dolce and runner-up, Vanessa Procter.

“The University of Canberra Health Poetry Prize aims to inspire others through poetry to consider the journey to live life well. The poem may be focussed on mental or physical health, and can investigate what ‘living life well’ means. This may include barriers to living a well life, promoting a life lived well, or describe the experience of, or transition to, living life well.

The prize-winning and short-listed poems will be published by the University. Meanwhile, here is an excerpt from Dial Tone:

Redial 1

The message mentioned belongings. I comply, search afterglow
for jasmine, rose, orange blossom, hands fallow at my sides,
on tabletop, in rarely hostile earth. “Good to have you back.”
But I cannot be sure. Our arrival is delayed by asymptote, slowed
by imperfection. Bloodshot meanders skirt lawns to be mown,
drains to clear, vermin to evict. Amid cartons and packing crates,
window shades jealous our skin, discontent curtains our perspective.
We substitute bluff with categoric denial, switch to silent mode.

Click here to see more about the Prize.

Body of Evidence

[metaslider id=1064]

Body of Evidence was a multi-medium exhibition inspired by the impact of Art on Health held at the Adelaide Convention Centre 30 May – 1 July, 2016 featuring John Blines, Gina Czarnecki & The Australian Dance Theatre, Meg Cowell, Ian Gibbins, Naomi Hunter, Cheryl Hutchens, Hans Kreiner, Kerryn Levy, Deborah Prior, Damien Shen, Angela Valamanesh & Thomas Yeend. Curated by Carollyn Kavanagh.

I contributed an installation piece called Syntaxin: Kiss and Run, and two videos called Situs Inversus, one for an internal LED screen (which you can see here, with audio), and one, a special projection project (watch it here), on a huge window of the SW corner of the Convention Centre, along with one by Meg Cowell. 

[metaslider id=1062]

Body of Evidence

BOE Exhibition Card FINAL 1

 

Body of Evidence is a multi-medium exhibition inspired by the impact of Art on Health held at the Adelaide Convention Centre 30 May – 1 July, 2016 featuring John Blines, Gina Czarnecki & The Australian Dance Theatre, Meg Cowell, Ian Gibbins, Naomi Hunter, Cheryl Hutchens, Hans Kreiner, Kerryn Levy, Deborah Prior, Damien Shen, Angela Valamanesh & Thomas Yeend. Curated by Carollyn Kavanagh.

I contributed an installation piece and two videos, one for an internal LED screen running through the exhibition, and one, a special projection project, on a huge window of the SW corner of the Convention Centre, along with one by Meg Cowell, during the nights of 22-25 June 2016.


Syntaxin: Kiss and Run

2016. Timber, steel, brass, glass, digital prints, magnetic-optical disks, magnetic tape, plate glass, found objects. Dimensions: 182cm W x 41cm D x 165cm H (approx).

‘Syntaxin’ is a protein with a vital role in the molecular mechanism, called ‘Kiss and Run’, that controls the release of chemical messengers from the ends of nerve cells (synapses). The relevant structures can only be seen by specialised microscopes. This work uses Ian’s own electron microscope images of synapses, obsolete data storage devices containing those images, and found objects to illustrate the mystery of ‘Kiss and Run’. The texts come from recent scientific publications on the matter.  Click here to read them.

Postcards including images of synapses with text taken from papers about syntaxin:

lsg003 syntaxin 1b ppt small
syntaxin text 1 badge 1
poets_cottage_3 synapse 1w
penang 2 synapse 1w small
OLYMPUS DIGITAL CAMERA
OLYMPUS DIGITAL CAMERA
OLYMPUS DIGITAL CAMERA
EM scans001 syntaxin 1 small
CG013 syntaxin 1 small
lsg007 syntaxin 1 small

Here are some images of the installation itself:

skr right 1
skr front 1
skr front left 1
skr kiss cosmetics 1
skr kiss glass 1
skr run heels 1
skr run joggers 1
skr MO disks 1
skr filmboxes exposed 1

Situs Inversus

2016. Digital HD video window projection. 6200 x 1080 pixels, approx. 3 minutes duration.

‘Situs Inversus’ is rare birth abnormality in which the positions of the internal organs are reversed. Sometimes, the internal organs are duplicated in mirror image, which is fatal. This video takes those ideas to generate images which are mirror symmetrical and can be read equally from both sides of the window. The underlying images are derived from Ian’s videos of living cells, his body, and the Adelaide Convention Centre, including the projection window itself.
Here is the projection video:

and here is a pic of the projection itself on opening night, viewed from North Terrace:

IMG_3805_ps1 small

 


Situs Inversus Viscerum Totalis

2016. Digital HD video LED display. 1920 x 1080 pixels, approx. 6 minutes duration.

This version of video used the same underlying images as those in the projection piece, but sequences them in new ways with different text.

Here is a version of the video with audio. The backing track is made from sounds recorded at the Convention Centre itself.

A conversation with Garry Stewart

The following is an extensive email conversation, which happened over a period of time between Garry Stewart and Ian Gibbins during the preparation of ‘Proximity‘. It will give you an idea of the depth of research that Garry delves into for his work on any particular subject. It really shows that contemporary dance can be the thinking person’s art form as well as satisfying the draw of physical expression and virtuosity. 

Q. I’m wondering if you could say that ‘when we see we do it with our entire body, not just our eyes and brain’.

A. I think the purists would not like to say “see” but certainly “perceive” would be well accepted. There is no doubt that how we visually perceive the world around us is influenced by our prior knowledge and / or expectations of the things we see. In terms of the “entire body”, something that is so intrinsic to us it is generally taken for granted, is that we perceive the world and its objects necessarily adjusted for our body scale: how big we are compared to everything else. This determines how we interact with things at various distances from us, how we judge the weight of objects, how feasible it would be to manipulate them (their “heft” to use a nice poetic term…), etc.

When you “not just our eyes and brain”, I think you need to be careful there… no problem with “not just our eyes…”, but all perception, experience, knowledge etc necessarily comes to our awareness via our brain: everything we know about our body we experience with our brain, even if it seems so intrinsic that it doesn’t feel like conscious experience… This is totally incontrovertible for neuroscientists / cognitive scientists, but some philosophers still don’t like it and try to argue otherwise. As far as I’m concerned they can’t win that one… there is a growing group of “cognitive philosophers” who explicitly accept this position.

Q. Do you think this is true from the point of view that our brain creates a sense of our entire bodies position in space and relationship/point of view to the objects within our visual field?

A. Yes… a big chunk of our brain is doing just this job (the parietal cortex, which sits between the visual cortex and the sensory-motor areas)

Q. Does my body take on a sort of global ‘attitude’ in the act of seeing and perceiving?

A. Yes… but it’s even more interesting than that. The “attitude” can be interpreted in different ways, all of which can operate at the same time. In terms of spatial maps, we can orient to the world using body-based coordinates (“egocentric”): ie everything is referred to our own body, as in left and right, for example. However we also map in external, world-based coordinated (“allocentric”): eg objects referred to absolute directions such as north, south, east, west, etc…  there are subsets of both of these coordinate systems that relate to the distances involved (near, eg within reach; far, known only by integrating a virtual map… and several intermediate levels) and to the landmarks we use to navigate these spaces.

The other way you could interpret “attitude” is that overlain on all the spatial processing is what we choose to attend to. Attention is driven from several areas of the brain, but mostly form the prefrontal cortex. We cannot perceive everything that is going on in the outside world or in our bodies, let alone both, equally well at the same time. So brain selects what we will attend to = what we  focus upon = what we are consciously aware of at any point in time… This process seriously impacts on what we perceive. There are all the famous (notorious?) examples of people missing really “obvious” events because they attend to something else (most well known is the example where you are asked to watch a video of two teams playing basketball and you are to keep track of the number of passes each team makes; while you are doing this a bloke in a gorilla suit runs into the frame, waves his hands, and runs out… most people report not seeing him at all until he is pointed out… and then they cannot believe they missed it!!!).

Q. Through this, it seems our bodies are sort of in a state of readiness. Readiness to act, or not act. We seem to move from one state to another depending on how we are feeling and what is going on externally and internally.

A. Yes. An increasingly common concept is that the brain is basically working as a prediction machine. In one sense, we are always ready to do something… exactly what that is depends on what ever else is going on modulated by what out focus of attention is and our current plans, whatever they may be. If we are doing something actively, what our readiness is actually directed to usually depends on what has just happened, ie it is modified by past experience.

Q. So are we perceiving our situation in space and 3 dimensions corporeally? With our whole bodies? It seems like when we see our entire body goes into the state of this seeing and hence adopting an ‘attitude’ toward what we are seeing.

A. I think so. In this sense, I would again replace “see” with “perceive”. The sense of “our whole body” comes from different types of sensory nerves in the muscles, tendons, ligaments, bones, skin, etc that record all kinds of things like muscle tension, muscle length, touch, texture, temperature, and so on. The amazing thing is that our conscious perception of all this feels like a continuous integrated sensation (most of the time). One of the things that has driven more conventional philosophers nuts is that you simply cannot unravel all this by introspection. Our “body sense” is such a derived construction, it’s impossible to identify all its components without doing some pretty sophisticated experiments.

Q. Perhaps I’m encroaching on philosophy here?

A. See above: depends how you define philosophy!!

Q. My understanding of how we see is that it is a form of trained blindness. We are born with an over supply of neural connections for seeing but these hypertrophise as we learn how to see. So the number of neural connections for seeing diminishes throughout early childhood as we become more and more specific in how we perceive through seeing. Is this correct? We ‘sculpt’ an oversupply of nerve connections in our visual cortext to shape a more specific network of the connection.

Is it also correct to say that when we see as adults, we draw on our history of cognitively conditioned seeing (that is culturally prescribed) so that our ability to see is not just a mechanical function of the eyes/brain but also a composite of this along with our learnt cognition for seeing?

i.e. we have already learnt about depth, colour, shading, perspective etc so our conditioned version of this informs how we see as adults.

A. don’t think that idea of ‘trained blindness’ is really correct, though I can easily see where why you would conclude that!

It is true that we are born with more connections than we need, not just for the visual system, but for most other parts of the brain too. The issue here is that these connections are sort of a default pre-wiring that ensure all the different brain regions are connected up to each other at all.

After birth, sensory experience fine tunes these connections to make sense of the sensory-motor world within in which we find ourselves. The best example of this is language processing: by the time we are about 6 months old, the language we have been hearing up until that time strongly biases the way we perceive the language sounds we hear.

The visual system rapidly becomes “trained” to recognise all the elements of a visual field – edges, textures, colours, shading, etc – and synthesise them into recognisable objects. People who are born with damaged eyes but an intact brain (eg congenital cataracts) usually are unable to see if the eye problem is fixed later in life. This ‘training’ is a combination of fine tuning overall wiring between different regions of visual cortex, as well as regulation of synaptic density between specific sets of neurons in those pathways. So in this sense, your idea of ‘sculpting’ is correct.

All of the low level processing of information in the visual system takes place below consciousness. Some of it actually occurs in the eye itself (in the retina) before the information is sent to visual cortex. So the retina can process relative contrast, detect edges of different orientation, for example.

Visual illusions are usually set up to muck around with these low level processes, either in the retina or in the visual cortex. By introspection, we cannot tell the difference. Also even knowing that the image is an illusion, we cannot consciously over-ride it. As our visual system develops, we also develop an incredibly rich underpinning of memory that allows us to recognise, name, manipulate the things we see. This corresponds to your ‘learnt cognition of seeing’: this refers to understanding what we see, but not the act of seeing itself…

[people with strokes or other forms of selective brain injury have shown how fragile these processes are and how they can be broken down and dissociated. So someone may have cortical blindness, in which they actually can see, but they don’t know that they can… ]

It really isn’t clear how much vision is culturally prescribed. However, it’s nothing like language, for example. I think most vision scientists would say that everyone with normal vision processes a visual scene in pretty much the same way in terms of generating the image itself. But then it’s how you interpret it. For example, if I gave you one of our microscopic images, it’s unlikely you’d know  what it represents, what scale it is, what the colours mean etc, without me telling you. Conversely, when you watch a dance piece, you’d be picking up on all sorts of visual cues that I would miss.

The other thing that feeds into a cultural modification of the perception of vision is attention. We cannot focus on the whole visual scene at once. In fact we can only attend to a very small part of it. Exactly what we attend to is a mix of our own motivation, our training or cultural background, and the circumstances of the moment. For example, if we are out in the bush with an Aboriginal bloke who’s grown up there. all sorts of things would attract his visual attention which may entirely escape our notice, even though we’d experienced more or less the same raw visual inputs.

Q. Do the saccadic movements of the eye take ‘pictures’ that are then sutured together to create a whole image? Is that an acceptable way of describing it. 

If you had to describe saccades and how they form a total image in just one or two pithy sentences what would you say? 

A. That’s pretty much right Garry.

The saccades are rapid movements of the eyes that scan the scene before us. Each saccade takes about 1/20th of a second. The movements are controlled by several areas in the brain: one small part of the cortex generates the movement itself, another relates each movement to the spatial coordinates extracted from visual cues. Other areas control the speed and magnitude of the eye movements. Yet other areas (in the frontal cortex) direct the saccades to the locations that we wish to attend to.

During the saccades, the brain is effectively blind, ie. there is no visual processing taking place during the saccade (this is the little demo I did with the clock at your studio…). Inhibition of visual processing during the saccade is essential for the smooth stitching together of the visual scene.

Once we have fixed out attention on something in the world, our eyes still jitter around a bit. This means that the same photoreceptors in the retina are not exposed continuously to the same stimulus. If they are, the receptors desensitise and we become effectively blind…

Hmmm… more than a sentence or two there… how about this:

Saccades are rapid movement of the eyes that take a snapshot of the visual world. The visual cortex assembles the conscious experience of viewing a continuous scene from a series of saccades. This requires the activity of many areas of the brain, as well as a kind of visual memory that keeps track of what has been captured visually in each saccade.

Q. How do our eyes and brain creates depth and perspective in seeing. How do we know that something is close to us or further away. How do we situate ourselves in relation to our field of perception.

A. As it turns out, this area is actually one of the best known in just about all of neuroscience (even if there are still lots of unanswered questions). Here’s a quick run through:

The brain uses several sources of visual information to create a sensation of depth.

The main way we judge depth is via stereoscopic binocular vision. Each eye sees the world from a slightly different angle. The information from each eye is sent to the visual cortex which then compares the views from each eye. Objects that are closer look more different when seen from each eye than do more distant objects. This binocular disparity is then used by the visual cortex to encode distance of objects from the viewer.

[ 3D movies / TV etc work by showing two views of the scene that correspond to the view seen by each eye. The technological trick here is to make sure that the left-eye’s view is seen only by the left eye and similarly for the right eye… ]

We also judge depth by focus. We cannot focus on near and far objects at the same time. The visual cortex uses information from the eye-focus muscles to help us interpret distance. Usually when we look at something up close, we not only have to focus, but we also have to converge our eyes onto the object [ ie go a little cross-eyed ]. Again information from the muscles that move the eyes is sent to the visual cortex.

The visual cortex also extracts depth information from the relative locations of objects in space, especially as we move through visual space or the objects move or both.  Two effects contribute to this information. Closer objects block or occlude the view of object further away. And when we move, closer objects seem to move through our visual space more quickly than more distant ones.

Finally visual information on the spatial locations of object and their relationships to the viewer can be reinforced by other senses, especially proprioception, which can tell us if an object is within reach or not. We also know distances of objects by having physically navigated the space within which they and we co-exist [ eg by walking past the objects.]

Sounds of moving objects can tell us if they are nearby or distant. The Doppler effect can tell us if an object is moving towards us or away from us [ this is when a siren or jet engine seems to increase in pitch as it moves towards us and decreases pitch at it moves away. ]

This multi-sensory integration takes place in the inferior parietal cortex, the same general area that builds up our own body sense. This high-level processing is essential to centre visual perception of space and depth of the external world on our body-centred frame of reference.

Q. How does the brain construct a sense of unified self, or how does the conscious mind filter the enormous incoming stream of data to construct an idea of the world and self that has a contained, cohesive meaning. Does this question make sense? Can we describe the phenomenon of unified selfhood from a neurophysiological viewpoint?

A. The brain constructs your sense of self from the memories of your past, your experience of now, and your imagined future.

Your brain sets your self as the reference point for the predicted outcomes for all your actions, real or imagined, physical or mental, rational or emotional.

Your sense of self is the reference point for your feeling of space and time and scale and relationships with the world, the objects within it and the people who inhabit it.

A complete sense of self requires interactions between multiple regions of the brain, regions that process sensory inputs, motor outputs, concepts of space and time, emotional state and social context.

The parietal cortex integrates sensory inputs from the outside world with your sensations from your own body. If it is damaged, you may feel that parts of your body are not part of your self, they are not yours.

Your conscious experience of the self as a complete autonomous entity in the here and now takes about one-third of a second to synthesise: our conscious sense of self inhabiting a physical world is always running a fraction of a second behind real time..!

Your self is the conscious manifestation of your total cerebral activity. However, much of your self-awareness, your feeling of who you are, is a consequence of the subconscious activities of your brain. This subconscious brain processes sensory inputs, makes decisions, moves your body, keeps your balance and emotional state in check, controls the activity of your internal organs. If any of this goes wrong, you “do not feel your self”…

Your sense of self necessarily must be a product of your genes, your upbringing, and your environment.

Pure introspection cannot identify the cerebral functions that generate our conscious sense of self.

No-one really knows how we experience our conscious sense of self… Although we can identify the types of brain activity that are required for a complete sense of self, we can have direct experience only of our own consciousness…

 

Australian Dance Theatre

bys-2
bys-950×577
Prox1
Ian has been fortunate to have collaborated with Garry Stewart and Australian Dance Theatre on two of their productions: Be Your Self (2010) and Proximity (2012), each of which premiered at the corresponding Adelaide Festival and then toured extensively overseas.

Garry Stewart’s Be Your Self reveals the precarious stability of the concept of self as the work steps through the conventions we use to construct a singular and consistent notion of ‘I’. In an analysis of selfhood, Stewart situates the body at the centre of his inquiry. In Be Your Self the Australian Dance Theatre dancers are transformed into erupting, powerful, creative entities projecting a plethora of physical images and impressions set to an unpredictable, cartoonish, electronic score.

In Proximity Garry Stewart and Paris-based video engineer Thomas Pachoud (with the support of didascalie.net) worked in collaboration to create a dialogue for dance and real-time video manipulation. The work is primarily an investigation into the body’s interactive participation in the act seeing the world with reference to neurological body maps and the French philosopher Merleau Ponty’s phenomenology of perception.

In each case, Ian provided text that was used in the production. In addition, he ran workshops for the dancers that explored the anatomy and neuroscience of body sense. During the development of Proximity, Ian and Garry had extensive email conversations about these areas of research which formed the basis of text used in the production. You can read the correspondence here.