Prototyping AR

Week 11 & 12 : July 9th - July 22nd

Prototyping AR


Image Prototyping

To explore the moments of interaction across the use cases, I began creating quick visual representations of some of the impossible interactions that can be made possible through AR.

Following a Recipe / Information Retreival

Viewing Media

Dublin Bus App & World Content




Video Prototyping

After establishing how the content would look and feel within these contexts, I moved onto animating actual interactions with the content. These video prototypes were intended to be used to aid in user testing by bringing the user into this futuristic world of AR. I planned to gather opinions and suggestions based on the images and videos.

Following a Recipe / Information Retreival

Viewing Media

Dublin Bus App

World Content




Unity Prototyping

As part of prototyping, I've used Unity to create an interactive demo of the frames and handles paradigm. Using the Leap Motion and Unity, I made a very basic demo of the pinch to shrink interaction visible in the "viewing media" prototype which allows users to grab a shape and move it with their hands.

A recent Leap Motion update has also provided me with a single handed gestural interface which I plan to use alongside the video prototypes to gather user feedback on that form of interaction.




User Feedback

To gather people's opinions on the kinds of interactions and moments that I was trying to achieve with AR, I combined the images, video and unity prototypes into extended feedback sessions. I mounted images from each use case on a whiteboard and played the videos related to the use case to each participant. I then asked for their opinions and feedback regarding the concepts and use cases to understand how they would imagine these interactions in their own lives.

Each participant used post-its to record their thoughts and ideas throughout the discussions of each use case. AR is a difficult technology to prototype with users prior to development, but I found the use of concept videos to be a very effective means of representing ideas and giving form to concepts. Below is a timelapse video of some of the user feedback sessions.

What did I learn?

    • The frames and handles paradigm was liked universally (AR content lives within a frame, and each frame is moved and controlled through a handle which houses any user interfaces). The participants found this an easy to understand concept and believed that it could work as the core functionality of the system. Frames and Handles eliminate HUDs (heads up displays) and aim to avoid obstructing the vision of the user.


    • Creating handles currently requires a specific gesture so that it would be difficult to do it by accident. Some users preferred the idea of looser more expressive gestures to control the AR content, or perhaps giving users control over gestures of their choice. Metaphorical gestures were also proposed such as putting a handle in your pocket to save it for later. I plan to explore the interactions behind content creation and control more deeply to determine what is best for the use cases and the users. For this project I will be defining the methods of creation and will not explore personal user defined interaction as it would require extensive time to establish those parameters.


    • Mobile phone integration was a topic which arose regularly. As participants are already comfortable with mobile devices, they imagined the media use case in particular to be an extension of their phone; using the AR frames as screens which they cast content to from their mobile. There is definitely situations in this project which mobiles could and should be used alongside AR content. Phones are efficient at finding content, while AR is efficient at displaying content. I intend to determine when and how phones should work with this AR platform.


    • World content caused some slight confusion when combined with the bus app use case, but participants really saw the potential in it's usefulness. I will split the third use case into two separate cases: 3. Apps (Dublin Bus) & 4. World Content.


  • The social aspects of this platform were of huge interest to the participants. They wanted to know if the AR content could be shared with others, or if they could leave notes for specific people in specific locations. This is something that I've been exploring to date and I want to have distinctive social aspects of the platform ready for my next user testing session.




Use Cases

1. Media Content (viewing, selecting, controlling, sharing media)

2. Following a recipe (searching, viewing, controlling, unexpected extras, assisting)

3. AR Apps - Dublin Bus (placing, controlling, updating)

4. World Content (interacting, viewing, limitations, sharing/social)


Prototyping AR 2 >