In this multimedia venture, I delve into the realms of Naiads, Dryads, and Nereids from Greek and Roman mythology, employing augmented reality, 3D modeling, and neural networks to breathe new life into these classical creatures of nature. The fusion of highly advanced technology with the organic essence of these mythological beings sparks a conversation about our disconnect from the natural world and how technology can be a tool for reconnection.
This project challenges the dichotomy between the technological and the natural, encouraging a discourse on how we can harmonize the two. Throughout art history, mythological creatures have been a staple for painters and sculptors with a classical inclination. In this modern context, anthropomorphizing environmental concerns aids in fostering empathy toward nature and its needs.
Through the integration of machine learning and augmented reality via a mobile application interface, my aim is to offer viewers a unique insight into a computer’s empathic response to our environment. This not only transforms the mythical into the contemporary but also serves as a bridge between our technological advancements and our innate connection with nature.
Technology used
I produced these works using 3D modeling, blender’s physics engine and machine learning techniques such as texture synthesis, semantic photographic style transfer and iterative style transfer. I used Unity for the augmented reality application.
The culmination of this artistic journey is showcased through an innovative augmented reality experience. This app serves as a portal, allowing viewers to engage with augmented reality sculptures and animations that seamlessly integrate into their surroundings. This not only invites contemplation on our relationship with the environment but also provides a firsthand encounter with the reaction of a computer to our natural and mythological world.
Artworks
Using neural texture synthesis in Tensorflow, I created these abstract works, employing machine learning to abstract patterns from source photographs. The neural network sampled and replicated these intricate patterns into a repeating tile, forming visually compelling compositions. Engaging Augmented Reality enhances the viewer’s experience, allowing them to witness an animated narrative. The animation, produced through 3D rendering, undergoes an active, iterative style transfer in reverse, unraveling the abstract image and dynamically revealing a emerging figure. This dynamic approach invites viewers to actively explore the evolving visual story within the intersection of neural synthesis, 3D rendering, and Augmented Reality.
I created the grayscale pieces in Daz Studio and applied colorization and texture using a segmented semantic photographic style transfer in Tensorflow. This involved actively guiding a neural network to discern specific elements within the images and enabling it to fill in the blanks using photographic data. My methods were not the intended purpose of the neural network, however it did become an effective use of the system.
Research questions for this work included: How will the neural network react? What will it think and why? What happens with the base un rendered model and what happens with the figure?
The Augmented Sculptural works come to life on light boxes, providing a dynamic visual experience. Within the app, a 3D figure dynamically transforms based on the viewer’s proximity and interactions while navigating around the artwork. The sculptures, brought to life through Blender’s physics engine, depict figures made of water collapsing into waves or a dancer made of leaves breaking apart. This interactive fusion of technology and art not only engages viewers visually but also invites them to actively participate in shaping the narrative as they move and interact with the augmented sculptures.
Selected Augmented Reality Animations
Installation Photographs
This exhibition was shown at West End Art Space in 2018.
