YEAR 4

Semester 2 – Mindfulness & Machines

Part 3 – Machine Learning Model Training – Runway ML

Machine Learning Model Trained on Images of Me Practicing Yoga using Runway ML. I was curious to find out how a machine may interpret images of me while I practice yoga and mindfulness and I wanted to explore the generated visual outcomes.

Part 4 – Balance Light – Wii Balance Board & Arduino

Balance Light is a work which allows for the physical movement of the body to have a direct impact on a sculpture. Practicing yoga and/or mediation on a balance board, which I use to track the values of weight distribution, has a direct effect on the tissue flower light sculpture which I build.

Part 5 – Audio Development – Sound and Physical Movement

Exploring sound with relation to mediation and yoga practice. Allowing organic physical movement to trigger audio playback through recognition of poses and key points of the body using PoseNet as well as a wii balance board where weight distribution data controls sound output.

Part 6 – Shape & Paper – Machine Learning Generated Images + Object Detection

Using machine learning object detection model to find shapes in generated images from the yoga model I trained. Inspired by Henri Mattise I used these shapes to create cut-outs and collage. This work allowed me to experiment with bright colours and bold compositions creating a final large scale wall collage and a compositional ‘scrap-book’.

Part 7 – Moving Paintings

Paintings based on Machine Learning generated images. Intrigued by the idea of merging mindfulness and computers I wanted to delve into machine learning and how a machine could potentially envision yoga practice.

Part 8 – Slitscan – Transforming Yoga Practice Videos

I wanted to transfigure the visuals of practicing yoga stepping away from realistic images of me holding poses and moving into creating abstract forms and illusions of how a machine might visualise my movement. Slit-scans created using processing.org, original videos are of me practicing yoga.

Part 9 – Morphing Figures

Generated Latent Space Walk videos from Machine Learning Model based on images of me practicing yoga. These videos show the morphing of one generated ‘pose’ to another resembling transitions within yoga as well as the subtle trembling of the body when holding a pose or breathing.

Part 10 – Immersive Projections – Wii Balance Board & Processing

In this work I create an immersive experience allowing physical movement to directly change and impact a persons immediate surroundings. By practicing mediation or yoga on a balance board the values of weight distribution have an influence on the position, scale and rotation of projected shapes. I created the shapes dataset by using my machine learning generated model and scanning it through object detection which is where the machine looks for things it recognises in an image and highlights the shape with a label and confidence percentage. Created using Processing.org, Runway ML and OSCulator.

Book – Documentation

A Photobook with documentation and highlights of my work from this year exploring mindfulness and machines.

Semester 1

Week 1 & 2

14th September – 27th September 2020 Working on the Proposal Abstract/Summary In my 4th year I would like to work towards creating an … More

Week 3 & 4

28th September 2020 – 11th October 2020 Expectations for next point of contact point: Review your Studio Proposal Formulate it into the … More

Week 5 & 6

12 October – 25 October 2020 Change of Direction I felt as though I wouldn’t get very far with the idea of … More

Week 7 & 8

26 October 2020 – 8 November 2020 Working on a digitally drawn animation experiment The inspiration for this animation came from my … More

Week 9 & 10

9th November – 22 November 2020 Experiments in processing I started with Dan Shiffman’s ‘Loop Mouse’ example, the shaded area follows the … More

Week 11, 12 & 13

23 November 2020 – 13th December 2020 Coming back to working on studio The deadline for the essay draft was Friday and … More