Design Process
The design process began with ideation, focusing on determining the graphics to be created and sketching rough drafts of these elements. Simultaneously, the flow of the treatment was mapped out, identifying the types and quantities of assets required for each specific exploration. The project encompasses three distinct explorations, each characterized by different triggers and the corresponding objects they affect. The first two explorations are based on tap triggers, with the first being relatively straightforward and the second involving a more complex interaction and the third one based on proximity triggers. The assets incorporated into the platform are primarily 2D, including JPEG, PNG, and GIF files. The overall process for each exploration is summarized in the flow diagram below, which provides a quick overview of the steps followed.
The project focuses on an exploration of Augmented Reality (AR) graphics, aiming to amplify user agency in the customization and manipulation of illustrations and graphics within AR environments. As AR technology gains traction through platforms like Meta's Spark AR & Snapchat AR, its adoption by artists and creative communities has surged. However, the current landscape of AR is largely confined to basic image tracking and overlay animations, revealing a significant gap in user interaction.
This initiative seeks to bridge that gap by empowering users with enhanced control over AR graphics, encouraging them to move beyond mere passive consumption of pre-designed visuals. Conducted using the Adobe Aero platform, this project leverages the capabilities of AR to foster a more interactive and engaging experience, inviting users to actively shape their visual narratives in real-time.
It used to be — Urban Mural in AR by Samuele Rovituso
Vancouver Mural Festival
Artists are increasingly harnessing Augmented Reality (AR) to enrich their traditional artworks with a technological layer, enhancing exhibitions and murals through digital overlays that create a unique viewing experience. However, many of these applications remain confined to basic functionalities, such as image tracking and animation overlays. The driving force behind this project is to expand the horizons of AR in the artistic realm by introducing a new level of interactivity with the artwork.
By enabling audiences to engage directly with the art—manipulating elements within the AR environment—the project aims to transform passive observation into an active, participatory experience.
Motivation
Lagniappe Augmented Reality Mural by James Brindley
The initial phase of the project involved a review of research papers, articles, and blogs focusing on the application of Augmented Reality across various domains. This literature review aimed to identify and categorize the diverse fields in which AR technology is being utilized, providing a broad understanding of its applications.
The categorization process, while remaining at a surface level, served as a foundational step in refining the project's focus. It highlighted the potential of AR in numerous sectors, from education to healthcare and retail, where it enhances interactivity and user engagement. Ultimately, this exploration helped narrow down the study to the artistic domain, aligning seamlessly with the project's objectives of pushing the boundaries of AR in art and fostering deeper audience interaction.
Background Study
Exploration 01
The initial venture into Exploration 01 serves as a introduction to the world of Adobe Aero. This exploration primarily centers around experimenting with the tap trigger functionality, allowing for an engaging transformation of uploaded assets within the augmented reality (AR) landscape.
Tap based triggers for graphic manipulation
Exploration 02
Exploration 02 builds upon the insights gained from Exploration 01, introducing a level of complexity.
However, this exploration involves creating a more intricate setup. A UI panel is designed, featuring manipulation buttons controlling various elements within the graphic. These buttons serve as tap triggers that change the behaviors of designated elements in the AR scene.
This exploration is a step towards implementing multiple manipulations within a single scene, providing a trial for understanding how these interactions function together.
Stars
Spin
Slow
Medium
Fast
Lines
Animation Speed
Disperse
Slow
Medium
Fast
Disperse
Character
Animation Speed
Position
Slow
Medium
Fast
Rotate
Position
Can
+ 150
- 150
Rotate
Position
Cassette
+ 150
- 150
Smoke
Animation Speed
Slow
Medium
Fast
Tap based triggers for graphic manipulation
Exploration 03
Exploration 03 marks a shift in interaction techniques by introducing proximity sensing as the primary trigger mechanism. This exploration focuses on experimenting with this alternative trigger to understand its implications and effectiveness.
Exploration 03
Concluding, this Design Exploration Project aimed to investigate the potential of augmented reality (AR) to empower user creativity in manipulating graphics within AR environments. Through the explorations carried out on the Adobe Aero platform, experimented with interaction triggers, such as tap and proximity, while introducing manipulations in terms of animation. The project demonstrated how AR could offer more interactive and engaging experiences, particularly in the artistic domain, by giving users greater control over the visual elements of a virtual scene.
Thanks!
Acknowledgement
Prof. Ravi Pooviah
Exploring User Control to empower
creativity for graphics in AR
A Design Exploration Seminar Project
Field
Augmented Reality
Duration
3 weeks
