Contextual Augmented Reality (Sensor-Based Storytelling) - AWE2014 Presentation
•Download as PPTX, PDF•
12 likes•8,306 views
Slides from my talk at AWE2014. Youtube video is available here - http://youtu.be/OxKC1AyZ26U I took 15 minutes to cover a few fun topics.. contextually aware apps, embedded sensors, wearables, the internet of things, quantified self movement, feedback loops, privacy vs transparency, AR UI/UX, HMD's, smart homes, pervasive gaming, and ambient intelligence.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Contextual Augmented Reality (Sensor-Based Storytelling) - AWE2014 Presentation
Similar to Contextual Augmented Reality (Sensor-Based Storytelling) - AWE2014 Presentation (20)
Recently uploaded
Recently uploaded (9)
Contextual Augmented Reality (Sensor-Based Storytelling) - AWE2014 Presentation
- 1. CONTEXTUAL AUGMENTED REALITY Brian Selzer VP Business and Product Development DAQRI.com Sensor-Based Storytelling
- 3. Our mobile devices are designed to know us at a deep level
- 4. Mobile is transforming… Sensor-based wearable's are coming to everyBODY.
- 5. Things once silent now have a voice
- 6. Connected to the world
- 7. Low powered, low cost transmitters provide services based on environmental awareness
- 8. The time to lament the loss of privacy is over. It’s now about transparency.
- 9. Privacy is an exchange which needs to be negotiated between people and businesses
- 11. Augmented Reality (AR) as a canned experience is very limiting, and has no repeat value.
- 12. Augmented Reality (AR) which requires holding phone up in front of face is limiting (arm fatigue).
- 13. AR will help to visualize the Internet of Everything
- 14. UI TO THE WORLD AR has the potential to be the User-Interface to the world itself… conveying data about everything around us, and even that within us.
- 15. Which is more effective at getting drivers to slow down? Instant feedback Speeding ticket in the mail two weeks later OR
- 17. Real-time feedback loops (visualized via AR) will change how we live, work and play
- 18. • Firefighters • Soldiers • Pilots • Surgeons • Manufacturers • Etc. AR-enhanced HMD’s will become a need for professionals
- 19. Video game-like HUD design for real world applications.
- 21. What story will the kitchen of the future tell?
- 22. The predictive story needs to be intelligent and precise. Did Minority Report get it right?
- 23. The AI assistant of the future may be digitally designed to show us, as well as tell us.
- 24. Pervasive Gaming Pervasive Gaming - Always on; all around us; ready when we are…
- 25. Some final thoughts… • We are on a path to integrating ourselves with the internet of everything. • AR will serve as a UI/UX to this world • Context in real time will change the way we interact with the world around us. • Contextual Awareness is setting the stage for a world of true Ambient Intelligence.
- 26. Ambient Intelligence Embedded, context aware, highly personal, reactive, adaptive, anticipatory, constantly evolving…
- 27. Email: Brian.Selzer@Daqri.com Twitter: BrianSe7en Web: Daqri.com / BrianSelzer.com
Editor's Notes
- SLIDE – Privacy is an exchange which needs to be negotiated between people and businesses. It’s now about getting control over your privacy stream, and understanding who is collecting and how they are using. Set your Privacy to ON or OFF… based on the context you are in. Pattern Privacy is the next layer. Consumers will want to know how they are being analyzed. Today, companies today bind us into long, unenforceable, one-sided contracts. This is the next battle ground. Companies which try to predict the intentions of consumers will face the most scrutiny. (This is where many companies are focused now).
- SLIDE – Todays Augmented Reality is typically a canned experience, and is very limiting, with no repeat value. Canned AR is the equivalent of a digital Pop Up Book. A one-trick-pony. This remains the typical experience. To date, to much of the focus has been on “wow-factor” of the mixed reality experience itself. There is some context here though - Visual Recognition of the Image. VISION is key to the AR medium (identification, correlations, knowledge transfer…) Still this image recognition is just part of the foundation of AR, and it is time to evolve.
- SLIDE – AR which requires holding your pone up in front of your face is limiting (arm fatigue) Early AR browser Apps (Layar, Wikitude etc.) started by focusing here on location and mapping. The smartphone form-factor is not ideal though for this type of navigational viewing. LOCATION is one of the most important and useful parts of contextually aware applications Eyewear will eventually solve this problem. Google Glass is an early entrant into the smartglasses market.
- SLIDE –AR will help to visualize the internet of everything. We are talking about “Knowledge Transfer” – visualizing data relevant to the physical world in real time.
- SLIDE – AR has the potential to be the User-Interface to the world itself… conveying data about everything around us, and even that within us. VISION and LOCATION are key to contextual AR, but we are just scratching the surface We are just learning how to apply and deliver this sensor-based data properly To get more answers, let’s take a simple pop-quiz…
- SLIDE – Which is more effective at getting drivers to slow down? (instant feedback, or ticket in mail two weeks later?)
- ( The feedback loop. Your action has an effect, and the feedback from that effect influences your next action.) Real time feedback to optimal for many actions we take on a daily basis.
- SLIDE – Real-time feedback loops (visualized via AR) will change how we live, work and play Example: Ghost Runner Concept by OnTheGo Platforms (Ryan Fink and team) The ghost runner represents previous run on same course. If you ran faster that day, you would see a ghostly image of yourself running in front of you. This UX was first seen in video racing games like “Mario Cart” … and serve as a motivating factor to race against yourself for a better time. So, which is more effective for optimizing ourselves? Looking at stats afterwards, or adjusting in real time based on contextual data? The Quantified Self movement will only really take off when we can get this type of instant feedback loop, and Augmented Reality is the ideal visual UX for this. The SmartWatch will play a big role in the transition to wearable eyeware. Why? It gets us closer to this instant feedback we seek. Contextually relevant content.
- Head Mounted Displays (HMD’s)… will be key to any professions where contextual data provided in real time is critical. How critical will feedback loops be in these professions? Do they need knowledge transfer in real time?
- For thoughtful HMD designs one can simply look to Video Games. The video game industry, and entertainment industry (iron man movie) have done a great job creating our HMD UX’s of the future. As AR-enabled eyewear becomes more commonly used, these type of displays will play a key role in how information and contextual content is translated and delivered. Even the early Google glass concept video missed the mark on UX, putting too much information in the center of the screen, etc.
- SLIDE – What story will the kitchen of the future tell? Will it teach us how to cook in real time? (based on ingredients it knows I have in the refrigerator and spice racks). The smart home is coming. Appliances all connected. Refrigerator telling you when the milk has gone bad, or when you are out of soda. Ovens telling you when they need to be cleaned.
- SLIDE – The predictive story needs to be intelligent and precise. Did Minority Report get it right? Minority Report showed us the future of contextually relevant advertising being thrown in our face when we enter a mall (understanding our presence). But Minority Report only got it half right. . Tom Cruise was running for his life through that mall in that scene, and had no time to shop. The sensors in our future will understand this (detecting things like heart rate, speed of movement, stress level, perspiration, etc..). Contextual advertisements in this type of situation are more likely to be pushing our favorite deodorant, or discoutnts to our favorite getaway vacation spot. This type of predictive “proximity mobile marketing” has already begun. Brands you have “liked” on Facebook push you ads. Items you have bought before offer you a special coupons to buy again. The predictive story needs to be intelligent and concise though, or we will turn it off! The story that is unfolded in front of us, to get us to buy something, needs to touch on our impulses and desires in an intuitive and non intrusive way. (tricky).
- SLIDE – The AI assistant of the future may be digitally designed to show us, as well as tell us. Apple’s Siri, Microsof’s Cortana (reference to Halo AI character), Google Now No longer will our digital assistants be just a voice, or information on a flat screen… Digital characters that walk among us in the real world.. And serve as Coaches, Teachers, Docents… AR will allow us to interact with these digital beings as if they were real in many ways. They will walk and talk…teach us, demonstrate for us, and more.
- SLIDE – Pervasive gaming – always on, all around us, ready when we are… (image of Clandestine Anomaly) A new type of gaming is coming, thanks to technologies like LBS, AR and sensor-based technologies. The opportunity is to turn the world into the game itself, and be contextually relevant to your personal story. The game is everywhere, and played at anytime; relevant to your environment.. Who your are with, where you are, what you are doing, etc. Ogmento launched Paranormal Activity as the first LBS/AR game Now we see efforts like Ingress which are getting closer to showing the potential. 4 I’s of Storytelling when it comes to Pervasive Gaming… Immersion – Go deeper into the story-world, by learning more about it or by heightening the sensory experience of it? Interactivity – Change or influence elements of the story (where you are (Location data), who are you with (Social data)). Integration - Is a cohesive story being told across platforms? Can it interface with the real world in any way? Impact - Does the story inspire me to take action in my own life, such as making a purchase or supporting a good cause? (photo courtesy of ZenFri – Clandestine Anomaly. Corey King)
- SLIDE – the potential is to understand all that is connected in real time. Technology recedes into the background and is everywhere. Ambient Intelligence - Embedded (invisible tech), context aware, highly personalized, reactive, adaptive, anticipatory, constantly evolving…