We present Geollery, an interactive mixed reality social media platform for creating, sharing, and exploring geotagged information. Geollery introduces a real-time pipeline to progressively render an interactive mirrored world with three-dimensional (3D) buildings, internal user-generated content, and external geotagged social media. This mirrored world allows users to see, chat, and collaborate with remote participants with the same spatial context in an immersive virtual environment. We describe the system architecture of Geollery, its key interactive capabilities, and our design decisions. Finally, we conduct a user study with 20 participants to qualitatively compare Geollery with another social media system, Social Street View. Based on the participants' responses, we discuss the benefits and drawbacks of each system and derive key insights for designing an interactive mirrored world with geotagged social media. User feedback from our study reveals several use cases for Geollery including travel planning, virtual meetings, and family gathering.

1. Geollery: A Mixed Reality Social Media Platform
Ruofei Du, David Li, and Amitabh Varshney

2. image courtesy: plannedparenthood.org
Introduction
2

3. image courtesy: huffingtonpost.com
Introduction
3

4. Motivation
4

5. image courtesy:
instagram.com,
facebook.com,
twitter.com
Motivation
5

6. Motivation
image courtesy:
pinterest.com
6

7. Motivation
image courtesy:
viralized.com
7

8. Motivation
8

9. Motivation
9

10. Related Work
10

11. Related Work
11

12. Related Work
12

13. Related Work
13

14. Related Work
14

15. Related Work
15

16. Related Work
16

17. Related Work
17

18. Related Work
18

19. Related Work
19

20. Related Work
20

21. What's Next?
What may a social media
platform look like in mixed reality?
21

22. What's Next?
What if we could allow social media
sharing in a live mirrored world?
22

23. What's Next?
What use cases can we benefit
from social media platform in XR?
23

24. Geollery.com
24

25. Geollery.com
25

26. Conception, architecting & implementation
Geollery
A mixed reality system that can depict geotagged social
media and online avatars with 3D textured buildings.
26

27. Extending the design space of
3D Social Media Platform
Progressive streaming, aggregation approaches,
virtual representation of social media, co-presence
with virtual avatars, and collaboration modes.
27

28. Conducting a user study of
Geollery vs. Social Street View
by discussing their benefits, limitations, and potential
impacts to future 3D social media platforms.
28

29. System Overview
29

30. System Overview
30

31. System Overview
31

32. System Overview
32

33. System Overview
33

34. System Overview
34

35. System Overview
35

36. System Overview
36

37. System Overview
37

38. System Overview
38

39. System Overview
39

40. System Overview
40

41. System Overview
41

42. System Overview
42

43. System Overview
43

44. Design Space
44

45. User Study
45
20 participants (10 females; age range: 21 - 30, with an average of 25.75 and standard
deviation of 3.02) via campus email lists and flyers

46. User Study
46

47. User Study
47
A background interview
An exploration of Geollery and Social Street View
A quantitative evaluation
A discussion session about the future of 3D social media platforms

48. User Study
48

49. User Study
49

50. User Study
50

51. User Study
51

52. User Study
52

53. User Study
53

54. I post news about sports and
games every day.
54

55. I majorly use Instagram, I post
from my own portfolio.
55

56. User Study
56

57. User Study
57

58. User Study
58
University Campus New York City Washington D.C.

59. User Study
59

60. What's Next?
What's your first impression?
60

61. First Impression
61

62. I think it’s a very good start, it’s
very good experience to walk
around.
62

63. I believe I am in a museum.
63

64. I like that the buildings are
forming while I am walking.
64

65. It's cool to see posts by people
in real time, along with the
establishment they're in.
65

66. It’s like you don’t have to be
there.
66

67. User Study
67

68. User Study
68

69. User Study
69

70. Post Interview
Suppose that we have a polished 3D social media
platform like Geollery or Social Street View, would you
like to use it? If so, how much time would you like to
spend on it?
70

71. Post Interview
71

72. I would like to use it every day
when I go to work, or travel
during weekends.
72

73. If it’s not distracting like
Facebook and Instagram, I
would use it every day on a
couple of things.
73

74. I am a follower on most social
media sites. I would only join a
3D social media platform once
my friends are there.
74

75. If my friends are all on this, I
can see myself spend a couple
of hours every week.
75

76. I don’t think I will use this. I
prefer to use Yelp to see
comments [of nearby
restaurants]
76

77. Post Interview
Can you imagine your use cases for Geollery and Social
Street View? What would you like to use 3D social media
platforms for?
77

78. I would like to use it for the food in
different restaurants. I am always
hesitating of different restaurants. It
will be very easy to see all restaurants
with street views. In Yelp, I can only see
one restaurant at a time.
78

79. [I will use it for] exploring new places. If
I am going on vacation somewhere, I
could immerse myself into the location.
If there are avatars around that area, I
could ask questions.
79

80. I think it (Geollery) will be useful for
families. I just taught my grandpa how
to use Facetime last week and it would
great if I could teleport to their house
and meet with them, then we could
chat and share photos with our
avatars.
80

81. … for communicating with my families,
maybe, and distant friends, [so] they
can see New York. And, getting to
know more people, connecting with
people based on similar interests.
81

82. Post Interview
If you were a designer or product manager for Geollery
or Social Street View, what features would you like to
add to the systems?
82

83. A mapping of the texture,
high-resolution texture, will be
great.
83

84. if there is a way to unify the
interaction between them,
there will be more realistic
buildings [and] you could have
more roof structures. Terrains
will be interesting to add on.
84

85. I would like to see kitties and
puppies running around, and
birds flying in the air
85

86. I could also add a bike, add a
vehicle, a motorcycle in
Geollery, this will add some
fun.
86

87. Insights
87
High-quality content and seed users play key roles

88. Insights
88
Interactivity and panoramic textures matter.

89. Insights
89
Customization of avatars, diversity, and accessibility are crucial.
image courtesy:
Facebook
Messenger

90. Discussion
90
...

91. Discussion
91
...

92. Discussion
92

93. Discussion
93

94. Challenge
94

95. Research Goal
95

96. Future Directions
96

97. Future Directions
97

98. Future Directions
98

99. Future Directions
99

100. Future Directions
100

101. Future Directions
101

102. Acknowledgement
102

103. Acknowledgement
103

104. Thank you!
Ruofei Du, David Li, and Amitabh Varshney

105. Geollery: A Mixed Reality Social Media Platform
Ruofei Du, David Li, and Amitabh Varshney