Proactive Displays, UW DUB group, 16 July 2008

Slide 1: Proactive Displays: Bridging the Gaps between Online Social Networks and Shared Physical Spaces Joe McCarthy Principal Instigator Strands Labs, Seattle

Slide 2: Outline • A few shameless plugs • Overview: A brief history of Proactive Displays • An example: the Context, Content & Community Collage • Related work: commercial & academic • Future plans (Slides available online at ht t p:/ / www.slidesha re.net / gumpt ion)

Slide 3: Strands: social recommendation & discovery ht t p:/ / www.s t ra nds .com/ corp ht t p:/ / blog.st ra nds .com

Slide 4: Strands: social recommendation & discovery

Slide 5: Strands: social recommendation & discovery “What you play counts!”

Slide 6: Recommender System Startup Contest ACM RecSys 2 0 0 8 2 3 - 2 5 Oct ober La us a nne, S wit z erla nd Deadline: 1 5 September 2 0 0 8

Slide 7: Strands Labs Seattle Mission: “To design, develop and deploy technologies that weave together the various strands of our activities, interests and passions to bridge the gaps between the digital and physical worlds and help people relate to the other people, places and things around them in ways that offer value to all participants.” [http://gumption.typepad.com/blog/2008/03/innovating-at-m.html] Location:

Slide 8: Proactive Displays: Definition (ˌ)prō-ˈak-tiv adjective acting in anticipation of future problems, needs, or changes di-ˈsplā noun a setting or presentation of something in open view

Slide 9: Proactive Displays Large visual or aural displays that can sense & respond to the people and activities taking place in their vicinity + + = Better Online Physical Large Real-world Profiles Tokens Displays Interactions Bridging the gaps between people by bridging the gaps between the online and offline worlds

Slide 10: 1st Generation Proactive Displays MusicFX a fitness center environment that knows who is working out, what they like to listen to, and dynamically adjusts the music to best suit the group of exercisers at any given time. MusicFX: An Arbiter of Group Preferences for Computer-Supported Cooperative Workouts Joseph F. McCarthy and Theodore Anagnost 1998 ACM Conference on Computer-Supported Cooperative Work (CSCW ‘98) A Multi-Agent System for Meting Out Influence in an Intelligent Environment M. V. Nagendra Prasad and Joseph F. McCarthy Eleventh Innovative Applications in Artificial Intelligence Conference (IAAI ‘99) http://www.youtube.com/watch?v=WLgXLl4uGYk

Slide 11: 2nd Generation Proactive Displays Visual Awareness Location Tools (ActiveMap & EventManager) a suite of tools for creating greater awareness of the location and activities of colleagues within a workgroup, with an aim to provide more opportunities for informal communication ActiveMap: A Visualization Tool for Location Awareness to Support Informal Interactions Joseph F. McCarthy and Eric S. Meidel First International Symposium on Handheld and Ubiquitous Computing (HUC '99) EventManager: Support for the Peripheral Awareness of Events Joseph F. McCarthy and Theodore D. Anagnost. Second International Symposium on Handheld and Ubiquitous Computing (HUC 2000)

Slide 12: 3rd Generation Proactive Displays UniCas t, OutCas t, Gro upCas t: Ubiquito us Pe riphe ral Dis plays UniCast, OutCast & GroupCast: Three Steps Toward Ubiquitous Peripheral Displays Joseph F. McCarthy, Tony J. Costa and Edy S. Liongosari Third International Conference on Ubiquitous Computing (UbiComp 2001) Promoting Awareness of Work Activities through Peripheral Displays Elaine M. Huang, Joe Tullio, Tony J. Costa and Joseph F. McCarthy 2002 ACM Conference on Human Factors in Computer Systems (CHI 2002)

Slide 13: 4th Generation Proactive Displays AutoSpeakerID Ticket2Talk Neighborhood Window Augmenting the Social Space of an Academic Conference Joseph F. McCarthy, David W. McDonald, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM 2004 Conference on Computer Supported Cooperative Work (CSCW 2004) Proactive Displays: Supporting Awareness in Fluid Social Environments David W. McDonald, Joseph F. McCarthy, Suzanne Soroczak, David H. Nguyen and Al M. Rashid ACM Transactions on Computer-Human Interactions (TOCHI), Vol. 14, No. 4, January 2008

Slide 14: 4th Generation Proactive Displays (v 2)

Slide 15: 5th Generation Proactive Displays The Context, Content & Community Collage @ Nokia Research Center Palo Alto The Context, Content & Community Collage: Sharing Personal Digital Media in the Physical Workplace Joseph F. McCarthy, Ben Congleton, F. Maxwell Harper To appear: ACM 2008 Conference on Computer Supported Cooperative Work (CSCW 2008)

Slide 16: A New Generation of Proactive Displays • Shortcomings of previous efforts • Goals of present / future efforts • Special-purpose sensors • Multi-purpose sensors (IR badges, RFID tags) (BT mobiles … NFC) • Special-purpose profiles • Multi-purpose profiles • Special-purpose installations • Multi-purpose installations

Slide 17: The Problem • Employees feel un[der]appreciated • #1 reason people leave jobs (US Labor Dept) • 2/3 of workers receive no recognition (Gallup) • Active disengagement costs US$300B / year • Employees feel disconnected • Lack of community in workplace • Us vs. them • Managers have less time, broader responsibilities • Difficult to manage frequent, sustained “personal touch”

Slide 18: Friendships at Work 30% of employees have a best friend at work (BF@W) 20% of employees dedicate time to building relationships at work Employees with a BF@W are 50% more satisfied with their company Employees with a BF@W are 7 times more likely to be engaged in their work

Slide 19: Maintaining Friendships through Social Media • ambient intimacy • “being able to keep in touch with people with a level of regularity and intimacy that you wouldn’t usually have access to” • Leisa Reichert • http://www.disambiguity.com/ambient-intimacy/ • http://www.slideshare.net/leisa/ambient-intimacy • continuous partial friendship • David Weinberger • http://www.hyperorg.com/backissues/joho-may04-07.html

Slide 20: Friendships through Social Media @ Work? @

Slide 21: The Context, Content & Community Collage: A proactive display application Opening physical windows into online content in workplace contexts to foster a greater sense of community

Slide 22: A New Generation of Proactive Displays • Goal: increase the sense of community in the workplace • Method: open windows in shared physical spaces into the social media co-workers are creating • Situated Social Software (SiSoSo) [vs. Mobile Social Software (MoSoSo)] • Hypotheses • Adding a physical dimension of audience will promote greater social media usage • Social media sharing in the workplace will enhance personal relationships • Enhanced personal relationships will lead to more productive professional relationships • Challenges • Privacy / benefit tradeoff (usability vs. security) • Sustainable engagement (after novelty factor has worn off) • How to measure the impact? (measuring community, relationships)

Slide 23: A User-Generated Video on Proactive Displays ht t p:/ / www.y out ube.com/ wa t ch? v=m5 rU9 cAiYs Y

Slide 24: Signup / Login

Slide 25: Select / Configure Module

Slide 26: Select Bluetooth Device(s)

Slide 27: Location, Location, Location

Slide 28: Locations (mock-up)

Slide 29: Hardware & Software

Slide 30: Interactions with / through the displays

Slide 31: Interactions with displays

Slide 32: The Highest Rated Content (5 up votes)

Slide 33: Edge detection http://www.snopes.com/horrors/robbery/kidney.asp

Slide 34: Everything in moderation

Slide 35: Moderation: NSFW [Not Safe For Work]

Slide 36: Moderation: SFW

Slide 37: Action Type Times Done Times/Day Image Clicked 11727 902.1 Image Moved 7210 554.6 Image Closed 611 47.0 Filter Button Clicked 189 47.3 Filter Confirmation 27 6.8 Rate Up Clicked 574 191.3 Rate Down Clicked 269 89.7

Slide 38: Number of Actions by Day of Week 7000 6000 5000 4000 3000 2000 1000 0 Sun Mon Tue Wed Thurs Fri Sat

Slide 39: Number of Actions by Hour of Day 3000 2500 2000 1500 1000 500 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Slide 41: Evaluation: interactions through displays • Context • 8 displays, deployed July 19, evaluated after 4 weeks • 75 full-time / part-time residents • 44 proactive display accounts (34 non-empty) • Perpetual alpha (location sensing, new modules, new features) • Hypotheses • Adding a physical dimension of audience will promote greater social media usage • Social media sharing in the workplace will enhance personal relationships • Enhanced personal relationships will lead to more productive professional relationships • Web-based Survey • Mix of multiple choice and open text questions • 32 responses

Slide 42: Positive / Negative Impact (Personal / Professional)

Slide 43: A few choice comments • I was surprised by some of the photos taken by [a colleague]. I had no idea of his very diversified and, in some cases, adventurous interests, and his photos showed me a side of him I would have never realized. The photos also give you an appreciation of other people's interests and unique travels. I find the photos absolutely fascinating and a very strong method of bringing all of us closer. • I[t] was nice to see people putting up "themes". One person had a Star Wars theme, actually happening just by tags, but appeared to me as if a themed series of photos. • Somewhat negative: I was surprised to see a photo of my family (my husband and my two kids) with another female friend. They were all sprawled on the grass. It reminded me of a picnic we all had together. But it also made me self-conscious: what would other people think of seeing this scene. Who is the "mystery lady"? Positive: walking into the kitchen and spotting my daughter's happy face on the screen. It was a nice greeting! Positive: I am delighted to see other peoples pics of exotic places they visited. Negative: seeing a picture of a guy in his underwear. The face was not in the pics so I couldn't tell who it is. Somebody esle in the room "killed" the photo. Positive: seeing people cluster around displays. I like that!

Slide 44: Impact of Displays on Social Media Flickr Usage by Different User Groups 6.00 5.00 4.00 Before May 1 3.00 May 1 - July 19 After July 19 2.00 1.00 Average Uploads Per Day 0.00 veteran users recent users new users User Group

Slide 45: Influence of Rank & Role Members # Participants % Participants Mgmt 6 1 0.17 Lead 6 2 0.33 Principal 11 2 0.18 Member 18 7 0.39 Admin 9 3 0.33 Intern 22 12 0.55 Total 72 27 0.38

Slide 46: Influence of Team Membership Members # Participants % Participants VCUI 17 9 0.53 C3 14 9 0.64 WGCS 9 3 0.33 IR 5 0 0.00 MoBS 5 1 0.20 MISS 5 1 0.20 NRCPA 9 2 0.22 NRC 4 1 0.25 SRC 4 1 0.25 Total 72 27 0.38

Slide 47: Influence of competition Of f - s it e Tea m- Building Event s Wii Tourna ment s

Slide 48: Future Work: Algorithms • Location / Proximity detection • Near / far • Proxemics • Incorporating meta-data • Folksonomy, Semiotics • Priority queue management • People, streams • Recommender System • Module management • Space, time, displays

Slide 49: Future Work: Modules • Other sources of content • Other interaction modalities • Other dimensions of experience

Slide 50: Future Work: Interfaces & Interactivity • Interfaces • Signup page • Display interface • Administrator interface • Interactivity • Authentication • Phones • Touchscreens • Other?

Slide 51: Future Work: Replicability and Sustainability • Deployments • Nokia: NY, Dallas, Helsinki, LA … • Academia: UMich, UMN, Stanford, … • ?: Yahoo!, Flickr, … • Mobiquitous Marketing (Mobile + Ubiquitous) • Holistic approach to engagement marketing • Co-promotional opportunities • Contextual advertising in physical world

Slide 52: Future Work @ Strands Labs Seattle New Online Sources New Phy s ica l Spa ces (ht t p:/ / bet a .s t ra nds.com) (“t hird pla ces”)

Slide 53: Related Work: Commercial Awareness / Interactions Digital Signage at Events Ca pt iva t e TV Clea rCha nnel, et al. RippleTV

Slide 54: Related Work: OneKeyAway / MatchlinC • OneKeyAway • Singles mixers in LA / SF Bay area; since May 2004 • Questionnaire: • 64 true-false questions about sex, religion, drug use, how you spend your spare time, etc • “I just want to get people together and talk about relationships … to discuss the questions, talk about their habits and personality traits. I think the device facilitates that.” – Edwin Duterte • MatchlinC: personality compatibility device • a mini “relationship advisor” • Infrared “zapping” • Three color codes (stoplight): red, amber, green) • Reminiscent of Lock & Key, Lovegety, Meme Tags

Slide 55: Related Work: partyStrands (1) New Yea r’s Eve Times Squa re, NYC Pa ul Va n Dy k Cry s t a l Ba llroom, Port la nd ht t p:/ / www.pa rt y s t ra nds.com Buda del M a r Ba r ht t p:/ / blog.my s t ra nds.com/ ca t egory / pa rt y st ra nds M a drid

Slide 56: Related Work: partyStrands (2)

Slide 57: Related Work: Research (1) • Meme Tags (MIT) • Interpersonal display: display for other people • RF + LEDs + programming • Notification Collage (Calgary) • Submit content to personal or shared display • Support remote awareness and collaboration • CityWall (Helsinki IIT) • Multi-touch display in city center • Flickr photos tagged with “helsinki” • Interactions with display vs. through display • Twitterspaces (Indiana U) • Large display in campus lounge • Dynamic visualization of group “tweets” (Twitter)

Slide 58: Related Work: Research (2) • PlasmaPoster (FXPAL) • Interactive community bulletin board • Content submitted via web, interaction via touchscreen • Version 1: corporate campus context • CHIPlace / CSCWPlace (FXPAL) • Plasma Poster in conference context • CHI 2002, CSCW 2002 • Connected to online profile tools • eyeCanvas (FXPAL) • Plasma Poster in café context • Canvas Gallery Café, San Francisco • Café-oriented content + “finger scribbling”

Slide 59: Related Work: Research (3) • BlueBoard (IBM Almaden) • Badge swipe for identification • Focused collaboration in work context • Opinionizer (Sussex) • Shared display at social events • Interaction through typed input • Dynamo (Sussex) • High school setting • Interaction via USB disk • AgentSalon (ATR) • Interaction via PalmGuides (PDAs) • Conversations mediated by animated agents Public and Situated Displays O’Hara, Perry, Churchill, Russell

Slide 60: Thanks! • For more information: • mccarthy@strands.com • http://interrelativity.com/joe • http://gumption.typepad.com • http://www.slideshare.net/gumption • C4 made possible by • Ben Congleton (U. Mich), Max Harper (U. Minn) • Nokia Context, Content & Community (C3) team • All my former colleagues at Nokia • Future work being made possible by Strands [Labs [Seattle]] Yogi Patel Shelly Farnham Sameer Ahuja Richie Hazlewood Josh Lind

Slide 61: Backup

Slide 62: Related Work: Alone Together Two Hours of Joint Solitude http://www.coffeegeek.com/opinions/cafestage/10-19-2005 Alone Together http://blogs.parc.com/playon/

Slide 63: Related Work: Addictive Games • Amy Jo Kim, Social Architect, Shufflebrain • “Putting the Fun in Functional: Applying Game Mechanics to Functional Software” • Incentives for games, communities • Collecting • Points • Feedback • Exchanges • Customization http://www.shufflebrain.com/etech2007.html

Slide 64: Early proactive displays Dangling String (PARC) Bus Mobile (UC Berkeley)

Slide 65: Proactive Displays in the large Sunset @ 200MHz (PARC) Love Board (Hachiko Crossing)

Slide 66: Proactive Displays on the road Alaris E-boards (www.alaris.net)

Slide 67: Proactive displays, circa 2054

Slide 68: Details • Location / proximity detection • Bluetooth sampling (MAC addresses, BT names) • Location server (separate component) • Priority queue management • New / old, near / far, 70/30 • Display management • Firefox + Javascript • Flickr module • Ruby API • Remote administration • Process, power • Modular, flexible framework • Front-end (time / space sharing) • Back-end

Slide 70: Flickr API