Visual experiments straddling art and science

Filmmaker Markos Kay.

Filmmaker Markos Kay.{credit}courtesy of Eliza McNitt{/credit}

Digital artist and director Markos Kay pioneers at visualising the unvisualisable.

“Art and science are drivers of cultures,” says Kay, who visited the Middle East for the first time last month to exhibit a new film called ‘Quantum Fluctuations: Experiments in Flux’ at the Imagine Science Film Festival in Abu Dhabi. “I want to challenge our ideas of how our knowledge of reality is formed.”

He is perhaps best known for a generative short called The Flow (2011), which was featured in an episode of the TV hit series Breaking Bad.

The Flow takes its audience inside a proton, with the aid of simulation software and algorithms, to see a dramatically-visualised interplay of quarks and electrons, resulting in nuclei and atoms. “I was really frustrated that nobody is trying to visualise all this in a more accurate way, so I tried to make my own film. I wanted to show people how complex this stuff is,” he says.

Kay’s work explores and abstracts the complex worlds of molecular biology and particle physics, be it through presenting a different way of observing cells or using the visual language of a microscope to give life to an organic process. “The desire of an artist to find ways to interpret and observe the world is similar to a scientist’s,” he says of his own experiments.

A still from Quantum Fluctuations.

A still from Quantum Fluctuations.{credit}Markos Kay{/credit}

His films are usually filled with detail and movement, and often feature scores of orchestral sounds or a generative, organic soundscape created by algorithm-based software.

His new film, ‘Quantum Fluctuations’, for instance, meditates on the transient nature of the quantum world which, he says, is impossible to observe directly. The film re-imagines the complex interactions of elementary particles as they collide inside the Large Hadron Collider at CERN –– and it’s all presented against a musical backdrop that is designed by Kay himself. Through striking computer-generated imagery, we can see interactions that occur in the background of a collision; for example, particle showers that erupt from proton beams colliding, giving birth to composite particles that eventually decay.

“Since the time of Heisenberg, it’s been almost impossible to visualise these events and simulations. It felt like a challenge,” Kay says. The film was produced by experimental design studio Epoche.io and will be part of an art and science documentary called “Sense of beauty” that focuses on CERN’s particle physics and that will be released later this year.

His latest project Humans After all, in collaboration with photographer Jan Kriwol depicts people in the context of everyday life through their circulatory systems. The project that showcases its subjects – humans stripped down to blood vessels and neural circuits – in an urban setting is meant to highlight the fragility and vitality of the human body.

“Through my work, I try to create immersive environments so that people can feel they’re entering a distant world.”

Humans Afterall.

Humans Afterall.{credit}Markos Kay / Jan Kriwol{/credit}

The Finnish trio navigating the natural world through 3D art

A still from the Secret World of Moths.

A still from the Secret World of Moths.{credit}POHJANKONNA OY{/credit}

In one film, “The Death of an Insect”, three animators, filmmakers, and game creators turned science communicators have given a group of dead insects one last dance.

Against a backdrop of stunning imagery – some monochrome or solidly black or white – the insects hovered, floated, and swam though air as if held by invisible strings in a stunning feat of 3D modeling and stop motion photography that is as equally meditative as it is poetic – and perhaps only slightly macabre. The insects that waltzed and flew through urban landscapes – dead but not lifeless – were collected from attics and sheds, and their choreography delicately animated in the studios of Pohjankonna Oy, the production company behind this experimental picture.

In their other film “The Secret World of Moths” showing at the 3rd edition of Imagine Science Film Festival in Abu Dhabi this weekend, the collaborative crew of three, Hannes Vartiainen, Pekka Veikkolainen and Janne Pulkkinen, who are also lifelong friends, provides a glimpse into nature’s macroscopic expanses through moths.

The dreamy images of vibrantly coloured, almost translucent and luminous insects were constructed using 3D X-ray tomography. This brainchild of Pohjankonna Oy was done in collaboration with the Finnish science centre Heureka. Dozens of insect scans provided by the University of Helsinki, Finland, helped make the film’s animated sequences possible.

A light technology crossover.

A light technology crossover.

In other projects, in collaboration with researchers from various institutions, such as Ghent University, they used computer generated imagery from numerous scans to create samples that they can virtually ‘move’ inside. The Centre for X-ray Tomography in Ghent has opened up some data archives for Vartiainen, Veikkolainen and Pulkkinen to explore, experiment with and develop their tools.

The final product is always a paragon of film-making excellence at the intersection of science, animation and art. But none of it is interpretative.

“We take something from the real world and try to visualise it as accurately as possible,” says Veikkolainen. His colleague Vartiainen adds, “It’s never 3D models that are based on the interpretation of the data, but always the real data.”

It’s their third Imagine Science Film experience – previously their work won the 7th Imagine Science Film Festival Visual Science Award in the festival’s New York edition and the Scientific Merit Award in Abu Dhabi back in 2015. Their accolade this year, however, was the reactions of awe and wonder that their virtual reality (VR) engine – part of an installation at the festival’s Spectrum art showcase – has garnered from the audience.

This Nature Middle East editor couldn’t resist a dive (or two) into the immersive virtual world that Vartiainen, Veikkolainen and Pulkkinen have created: a journey into the gut of a 2mm fish, scaled up and visualised with impeccable detail. You can shine a light into this virtual model, carve out or slice through it, swap scales with the hit of a button to be able to move around it and observe it from the outside or walk through it on the inside, as you would in a dimly lit cave.

Since the model is based on real-world data, even the smallest details are true to form; there are no imaginatively constructed visuals.

The VR installation drew a large audience at Imagine Science festival, Abu Dhabi,

The VR installation drew a large audience at Imagine Science festival, Abu Dhabi.{credit}Nate Dorr / Imagine Science{/credit}

The synergy between art and technology in this VR prototype is seamless; giving life to an organic sample that both scientists and the public can go deeper into, while keeping it real.

Their method of visual construction is inspired, in part, by diagnostic tools already in use in the medical industry, but that lack the technology to control and manipulate the data, or make it come to life. “Medical visualization tools typically lack the sophisticated lighting and camera controls necessary for cinematic work,” explains Pulkkinen.

But the trio’s unique tools give them precise studio-like control over lighting tomography data – the render engine makes use of video footage to cast ‘animated light’, for instance, adding layers of natural light, such as a timelapse of a moonlit night, to an otherwise static creature.

The light helps bring out the shape of said creatures and samples, giving an extra layer of reality to these digital visualisations – so in the end, nothing is oversimplified.