Project Overview

Glow 3D is a computer vision technology built for Amazon Glow that creates the illusion of 3D to the naked eye. Glow 3D uses players head position to distort the image on Glow’s projected display, giving players a sense of depth and perspective as they look around.

This case study examines how Glow 3D technology was used to build a differentiated activity for Amazon Glow, called Memory Stones.

Problem

Glow 3D was a technology developed by Amazon Glow’s computer vision team. Leadership saw an opportunity to leverage the tech to create a differentiated experience for the Glow device.

However, Glow 3D only existed as a tech demo, and had not yet been used in a full-fledged Amazon Glow activity.

Build A Glow 3D Activity

Our leadership team wanted us to create an activity that featured Glow 3D technology. So, we set out to design and build an activity that was both fun, and showcased the capabilities of the tech.

Validate Glow 3D Technology.

Glow 3D was a nascent technology with a lot of potential. First we needed to “work out the kinks” through prototyping and user testing.

Ideation

I first engaged with the computer vision team to better understand the limitations of Glow 3D tech. I then facilitated several brainstorming sessions with other designers to generate a broad set of game concepts.

I prioritized concepts that promoted player head movement, as that was the best way to sell the Glow 3D effect. I took the strongest ideas and worked with the art team to create concept storyboards.

Concept Animatics

For some concepts, I created animatic pre-visualizations to better demonstrate user interactions. This helped communicate concept vision to leadership and other stakeholders.

Solution

In order to reduce project scope, I indexed higher on concepts that had simple game mechanics. After presenting the strongest concepts to the leadership team, we aligned on a symbol matching game we called “Memory Stones”. 

This concept forces players to look around stone blocks to see different symbols, so players needed to move their head to play.

From here I began defining the end-to-end experience, creating wireframes that detailed the user interactions and game flow.

I worked with a Design Technologist to build a functional prototype for user testing. We first focused on the basic symbol matching mechanic to see how it felt with head movement.

We refined the prototype and added the shattering mechanic. We also used off-the-shelf 3D assets to iterate more quickly. Once we felt the prototype was robust enough, we prepared it for user testing.

User Testing

Once we had a functional prototype, we set out to get signal on the experience. I created test protocols and conducted user testing sessions.

• Tested prototype with 10 children (ages 6-9).

• Prototype generated customer delight, receiving positive feedback both explicitly and observationally.

• The stone shattering mechanic received the most positive feedback.

• Testing also surfaced several usability issues that detracted from the user experience. 

Learnings

• It wasn’t obvious that you needed to move your head to play.

• Some children didn’t know where they should be tapping at first.

• Once children got their first match, they were off to the races (and had fun).

Improvements

The biggest insight from user testing was that we needed better user guidance on how to play. I focused on improving this in 3 areas.

Pre-game Tutorial

• Added an animated pre-game tutorial that demonstrated how to play.

In-Game Hints

• Designed a contextual in-game hint system to help players when they get stuck.

• Hints show where to tap, and nudged players to move their head to see the sides of the stones.

• Created animatics to better demonstrate hint behavior.

Tuning CV Algorithm

• Worked with Computer Vision team to tune the parameters of the Glow 3D algorithm to make the perspective shifting more pronounced.

Delivery

• Finalized wireframes detailing overall user flow, UI behavior, and gameplay interactions.

• Partnered with Visual Design team to define the visual style for the UI.

• Authored Game Design Document and handed off to software team.

• Worked with software team on implementing designs.

Outcome

We successfully validated Glow 3D as a viable technology, and built a game that generated genuine customer delight. Memory Stones was positioned as a flagship activity for Amazon Glow, and paved the way for other potential Glow 3D experiences. Additionally, I was credited as an inventor on a successful patent application filing.