The document is a slide presentation given by Jim Spohrer of IBM on October 12, 2017 about artificial intelligence (AI) and intelligence augmentation (IA). Some key points from the presentation include:
- AI has made progress in areas like pattern recognition, learning from large labeled datasets, and games/translation but still faces challenges in video understanding, episodic memory, commonsense reasoning and more.
- IA pairs people with AI/cognitive systems to enhance human capabilities. As AI capabilities progress over time, cognitive systems may become collaborative partners, coaches, and mediators to help people.
- Future benefits of AI include access to expertise to boost productivity and better choices through collaboration, while near term risks include job loss
1. Jim Spohrer (IBM)
San Jose, CA & San Francisco, CA USA
Thursday October 12, 2017
http://www.slideshare.net/spohrer/ibm-welcome-and-cognitive-20171012-v11
10/12/2017 1
Welcome to IBM – Denmark ATV
5. You say you want a
revolution?
October 8, 2017
https://www.slideshare.net/spohrer/revolution-
20171008-v23
10/12/2017 (c) IBM 2017, Cognitive Opentech Group
5
6. TED Arai Todai Robot
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 6
… when will
your smartphone
be smart enough to
pass a university
entrance exam?
7. “AI will change the world?
Who will change AI?”
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 7
8. “These amazing technologies must be
able to help people like myself…”
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 8
9. Questions
• What is the timeline for solving AI and IA?
• Who are the leaders driving AI progress?
• What will the biggest benefits from AI be?
• What are the biggest risks associated with AI, and
are they real?
• What other technologies may have a bigger
impact than AI?
• What are the implications for stakeholders?
• How should we prepare to get the benefits and
avoid the risks?
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 9
10. Every 20 years, compute costs are down
by 1000x
• Cost of Digital Workers
– Moore’s Law can be thought of as
lowering costs by a factor of a…
• Thousand times lower
in 20 years
• Million times lower
in 40 years
• Billion times lower
in 60 years
• Smarter Tools (Terascale)
– Terascale (2017) = $3K
– Terascale (2020) = ~$1K
• Narrow Worker (Petascale)
– Recognition (Fast)
– Petascale (2040) = ~$1K
• Broad Worker (Exascale)
– Reasoning (Slow)
– Exascale (2060) = ~$1K
1010/12/2017 (c) IBM 2017, Cognitive Opentech Group
2080204020001960
$1K
$1M
$1B
$1T
206020201980
+/- 10 years
$1
Person Average
Annual Salary
(Living Income)
Super Computer
Cost
Mainframe Cost
Smartphone Cost
T
P
E
T P E
AI Progress on Open Leaderboards
Benchmark Roadmap to solve AI/IA
11. GPD/Employee
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 11
(Source)
Lower compute costs translate into increasing productivity and GDP/employees for nations
Increasing productivity and GDP/employees should translate into wealthier citizens
AI Progress on Open Leaderboards
Benchmark Roadmap to solve AI/IA
12. Leaderboards Framework
AI Progress on Open Leaderboards - Benchmark Roadmap
2015 2018 2021 2024 2027 2030 2033 2036
Perceive World Develop Cognition Build Relationships Fill Roles
Pattern
recognition
Video
understanding
Memory Reasoning Social
interactions
Fluent
conversation
Assistant &
Collaborator
Coach &
Mediator
Speech Actions Declarative Deduction Scripts Speech Acts Tasks Institutions
Chime Thumos SQuAD SAT ROC Story ConvAI
Images Context Episodic Induction Plans Intentions Summarizatio
n
Values
ImageNet VQA DSTC RALI General-AI
Translation Narration Dynamic Abductive Goals Cultures Debate Negotiation
WMT DeepVideo Alexa Prize ICCMA AT
Learning from Labeled Training Data and Searching (Optimization)
Learning by Watching and Reading (Education)
Learning by Doing and being Responsible (Exploration)
2015 2018 2021 2024 2027 2030 2033 2036
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 12
Which experts would be really surprised if it takes less time… and which experts really surprised if it takes longer?
13. Icons of AI
Progress
• 1956: Dartmouth Conference
organized by:
– John McCarthy (Dartmouth, later
Stanford)
– Marvin Minsky (MIT)
– and two senior scientists:
• Claude Shannon (Bell Labs)
• Nathan Rochester (IBM)
• 1997: Deep Blue (IBM) - Chess
• 2011: Watson Jeopardy! (IBM)
• 2016: AlphaGo (Google DeepMinds)
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 13
15. AI Leaders
• Who is winning?
– Regions China vs USA vs EU vs ROW
– Companies Microsoft vs Google vs IBM
• Leaderboards
– SQuAD – Question Answering
– EFF Measuring AI Progress
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 15
16. AI to IA Timeline: Hard unsolved AI
problems
• 2012-2017 AI Pattern Recognition and
Learning from Massive Labeled Data
– Speech, image, translation, driverless, games
– Chatbots as digital assistants
• 2018 Video Understanding
• 2021 Episodic Memory
• 2022 Learning from Watching
• 2024 Commonsense Reasoning
• 2026 Learning from Reading
• 2028 Learning from Doing
• 2030 Fluent Conversation
• 2031-2039 Cognitive Collaborator and
Mediator; Intelligence Augmentation (IA)
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 16
17. AI Benefits
• Access to expertise
– “Insanely great” labor productivity for trusted
service providers
– Digital workers for healthcare, education, finance,
etc.
• Better choices
– ”Insanely great” collaborations with others on
what matters most
– AI for IA = Augmented Intelligence and higher
value co-creation interactions
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 17
18. AI Risks
• Job Loss
– Shorter term
bigger risk
= de-skilling
• Super-intelligence
– Shorter term
bigger risk
= bad actors
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 18
19. Other Technologies: Bigger impact?
Yes.
• Augmented Reality (AR)/
Virtual Reality (VR)
– Game worlds
grow-up
• Blockchain/
Security Systems
– Trust and security
immutable
• Advanced Materials/
Energy Systems
– Manufacturing as cheap,
local recycling service
(utility fog, artificial leaf, etc.)
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 19
20. Stakeholders
• Individuals
• Families
• Businesses and
other Organizations
• Industry Groups
• Regional
Governments:
– Cities
– States
– Nations
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 20
21. Be Prepared
• Understand open AI code + data +
models + stacks + communities
– Leaderboards
– Ethical conduct
• Learn 3 R’s of IBM’s Cognitive
Opentech Group (COG)
– Read arXiv
– Redo with Github
– Report with Jupyter notebooks on
DSX and/or leaderboards
• Improve your team’s skills of rapidly
rebuilding from scratch
– Build your open code eminence
– Understand open innovation
– Communities + Leaderboards
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 21
1972 used
Punch cards
2016 used
IBM Watson
Open APIs to win…
22. Cupertino Teens
• IBM Watson on Bluemix
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 22
AI for NLP
entity identification
23. Courses
• 2015
– “How to build a cognitive system for Q&A task.”
– 9 months to 40% question answering accuracy
– 1-2 years for 90% accuracy, which questions to reject
• 2025
– “How to use a cognitive system to be a better professional X.”
– Tools to build a student level Q&A from textbook in 1 week
• 2035
– “How to use your cognitive mediator to build a startup.”
– Tools to build faculty level Q&A for textbook in one day
– Cognitive mediator knows a person better than they know themselves
• 2055
– “How to manage your workforce of digital workers.”
– Most people have 100 digital workers.
10/12/2017 23
Take free online cognitive classes today at cognitiveclass.ai
24. Headlines
• 2017 Popular
– “AI vs People”
– “X-Y team up to invest big in AI”
• 2025 Commonplace
– “People using AI to become better at their
professions, serving others.”
– “Teenagers using AI to solve challenges,
and improve their communities.”
• 2085 Resilience
– “Teams competing to rapidly rebuild
socio-economic-technical systems (wise
service systems) from scratch”
– “U.N. Pluto-base makes major discovery
about nature of universe. U.F.P.
established.”
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 24
IEEE 2017
25. IBM-MIT $240M over 10 year AI
mission
10/12/2017 (c) IBM 2017, Cognitive Opentech Group 25
33. 10/12/2017 33
1955 1975 1995 2015 2035 2055
Can better service help us be wiser?
Cognitive Mediator (2035): Tool, Assistant, Collaborator, Coach
34. Courses
2015
– “How to build a cognitive system for Q&A task.”
– 9 months to 40% question answering accuracy
– 1-2 years for 90% accuracy, which questions to reject
2025
– “How to use a cognitive system to be a better professional X.”
– Tools to build a student level Q&A from textbook in 1 week
2035
– “How to use your cognitive mediator to build a startup.”
– Tools to build faculty level Q&A for textbook in one day
– Cognitive mediator knows a person better than they know themselves
2055
– “How to manage your workforce of digital workers.”
– Most people have 100 digital workers.
10/12/2017 34
41. “The best way to predict the future is to inspire the
next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
48. By 2035, T-Shaped Makers with great
Building Blocks and Cognitive Mediators
10/12/2017 48
Empathy & Teamwork
sector
region/culture
discipline
Depth
Breadth
STEM
Liberal Arts
70. What types of digital cognitive systems?
• Cognitive Build: Outthink Challenge (250K people)
• Imagine a digital cognitive system to help you do something
important in your personal or professional lives
• Team to design it and advocate for it, and then everyone
votes
• Winners: reduce waste and human suffering, screen for
health issues and safety threats, learn life skills and make
better choices, find what you are looking for, move around
more effectively, provide emotional support, provide IT
support, learn about important public policy goals and make
better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
10/12/2017 Understanding Cognitive Systems 70
95. Tomorrow: Servitization
• Start with any traditional product that is sold to customers
• Make the product part of a smart/wise service system
– Instrument it (sensors) – Internet of Things/Everything
– Set-up an intelligent operation center to monitor all products’
performance across their life-cycles
– Use big data analytics to determine how to improve product
performance, efficiency, maintenance, etc.
– Offer customer the “product-performance-as-a-service” with
financing/Internet of Service
– Customer benefits from cost-savings, predictability
– Provider benefits margin-improvements, predictability
• Every product becomes a platform technology (a vehicle for
service innovation) for innovative university startups
96. Vision: MMaaRRSS
• Modular Manufacturing as a Regional
Recirculation Service System
– “I am the stuff that will be made into product X for
customer Y.”
– Stuff = Material, Energy, and Information Flows
– Minimize transport costs (for products and waste)
• The Vision: Circular Economy (~4 minutes)
102. Some paths to becoming 64x smarter:
Improving learning and performance
• 2x from Learning sciences (methods)
– Better models of concepts
– Better models of learners
• 2x from Learning technology (tools)
– Guided learning paths
– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)
– More you know, faster you go
– Advanced organizers
• 2x from Lifelong learning (time)
– Longer lives and longer careers
– Keeps “learning-mode” activated
• 2x from Early learning (time)
– Start earlier: Challenged-based approach
– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)
– Technology & Infrastructure Interactions
– Organizations & Others Interactions
103. Next Generation:
Future-Ready T-Shaped Adaptive Innovators
Many disciplines
Many sectors
Many regions/cultures
(understanding & communications)
Deepinonesector
Deepinoneregion/culture
Deepinonediscipline
111. Assisting individuals and organizations
to close their service innovation skills gap
and co-create wiser service systems
empowering employees, customers, citizens
with cognitive mediators
in the collaborative service economy
115. “The best way to predict the future is to inspire the
next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
118. Today’s Talk: Cyber-Social-Learning-
Systems• What is the impact of Artificial Intelligence (AI) on CSLS?
– Augmented Intelligence (IA) via digital cognitive systems
– White House OSTP Response(s)
• Other topics to think about:
– What are more of the implications of digital cognitive systems?
• Tool > Assistant > Collaborator > Coach > Mediator
• Transformation > Experience > Data > Software > Hardware
– What does social intelligence require? Episodic Memory?
– What is the impact of augmented reality on CSLS?
– What are possible connections to service systems science
(SSME+DAPP)?
– What type of adaptive innovator with growth mindset needed
(T-shapes)?
10/12/2017 Understanding Cognitive Systems 118
119. Augmented Intelligence
• Tool
• Assistant
•
Collaborat
or
• Coach
• Mediator
10/12/2017 Understanding Cognitive Systems 119
120. White House OSTP Response(s)
• AI for public good
• Social & economic implications
• Education to harness AI
• Research questions and gaps
• Data sets and model sets
• Multidisciplinary research
• Role of incentives and prizes
• Safety and control protocols
• Legal and governance issues
10/12/2017 Understanding Cognitive Systems 120
123. Understanding
Cognitive Systems
Jim Spohrer (IBM), August 25, 2016
CSIG (Cognitive Systems Institute Group) Speaker
Series
http://www.slideshare.net/spohrer/understanding_20
160825_v3
10/12/2017 Understanding Cognitive Systems
123
124. Today’s Talk: Understanding Cognitive
Systems• What is a cognitive system (entity)?
– biological
– technological
– types of digital cognitive systems
• How to…
– build them?
– understand them?
– work with them?
• Steps toward a next generation cognitive
curriculum…
10/12/2017 Understanding Cognitive Systems 124
125. But first…. Cognitive Science, a young
field
• Society
– cognitivesciencesociety.org
• People
– Founders: Roger Schank, Donald Norman,
Allan Collins
– Others: David Rumelhart, Herbert Simon,
Allen Newell
– Today: Patrick Langley, Wayne Gray,
Kenneth Forbus, Ashok Goel, Paul Maglio,
etc.
• Systems Conference
– cogsys.org
– (JCS wishes this was part of HICSS)
10/12/2017 Understanding Cognitive Systems 125
126. Advances in Cognitive Systems -
cogsys.org
10/12/2017 Understanding Cognitive Systems 126
128. Today’s Talk: Understanding Cognitive
Systems• What is a cognitive system (entity)?
– biological
– technological
– types of digital cognitive systems
• How to…
– build them?
– understand them?
– work with them?
• Steps toward a next generation cognitive
curriculum…
10/12/2017 Understanding Cognitive Systems 128
129. What is a cognitive system (entity)?
10/12/2017 Understanding Cognitive Systems 129
130. What is a digital cognitive system
(entity)?
10/12/2017 Understanding Cognitive Systems 130
131. What types of digital cognitive
systems?
• Cognitive Build: Outthink Challenge (250K people)
– Imagine a digital cognitive system to help you do
something important in your personal or professional
lives
– Team to design it and advocate for it, and then
everyone votes
– Winners: reduce waste and human suffering, screen
for health issues and safety threats, learn life skills and
make better choices, find what you are looking for,
move around more effectively, provide emotional
support, provide IT support, learn about important
public policy goals and make better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
10/12/2017 Understanding Cognitive Systems 131
140. Backup slides
• Service systems - http://service-
science.info/archives/3368
10/12/2017 Understanding Cognitive Systems 140
141. What is service science?
• IBM initiated effort to establish a
multidisciplinary field to study
service systems … with a focus on
people-centered, IT-enabled service
innovations for business and society
– based on service-dominant logic
– service = value co-creation
– IT-enabled service architectures
– service systems (socio-technical
systems for win-win value co-creation)
• IBM helped establish
– computer science (1945-present)
– service science (2005-present)
10/12/2017 Understanding Cognitive Systems 141
Service systems are dynamic configurations of
resources (people, technology, organizations,
and information) interconnected by
value propositions, internally and externally.
Examples:
- macro: cities, states, nations
- meso: hospitals, universities, businesses
- micro: households, families, individuals
Reference:
Spohrer J, Maglio P, Bailey J, Gruhl D (2007)
Steps toward a science of service systems.
IEEE Computer Society. 40(3):71-77(January).
142. What is service science?
• Now over 500 universities globally teach a more
multidisciplinary approach to service innovation,
including:
– Service management and marketing
– Service engineering and operations
– Service design and arts
– Service public policy and economics
– Service computing and informatics
• SSME + DAPP =
Service Science Management Engineering +
Design Arts Public Policy
– People, technology, organizations, information
interconnected by value propositions.
10/12/2017 Understanding Cognitive Systems 142
Reference:
IfM & IBM (2008). Succeeding through service
innovation: A service perspective for education,
research, business and government.
University of Cambridge Institute for Manufacturing,
Cambridge, UK. 2008.
143. How to get involved?
• Weekly speaker series
– Service innovation
– Service education & research
– Smart service/cognitive systems
• Discovery summits & book series
• Opportunities
– Institutional memberships
– Leadership & ambassadors
– Volunteer opportunities
– Awards & sponsored
conferences
10/12/2017 Understanding Cognitive Systems 143
ISSIP.org is a non-profit society
International Society of Service Innovation Professionals
Membership:
Over 1000 professionals and students from 40+ countries,
50+ companies and 50+ universities.
144. How to get involved?
• Journals (INFORMS,
etc.)
• Conferences (HICSS,
etc.)
• Courses (MIT, etc.)
• Funding (NSF, etc.)
• Society (ISSIP, etc.)
10/12/2017 Understanding Cognitive Systems 144
145. What are the hot topics?
• Smart Service Systems: Intelligence Augmentation
– AI + AR UX (Artificial Intelligence + Augmented Reality User
Experience)
– Smartphones (mobile, social, secure, etc.)
• Collaborative Economy: Servitization
– From assets to co-creation (e.g., Uber, AirBnB, etc.)
– From product to capability/outcome-as-a-service
– Manufacturing as a local recycling service
• Digital Transformation: Trust and Identity
– Blockchain: Don Tapscott’s TED Talk & book
– Big Data: Service Analytics & HAT (Hub of All Things)
10/12/2017 Understanding Cognitive Systems 145
147. Some paths to becoming 64x smarter:
Improving learning and performance
• 2x from Learning sciences (methods)
– Better models of concepts
– Better models of learners
• 2x from Learning technology (tools)
– Guided learning paths
– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)
– More you know, faster you go
– Advanced organizers
• 2x from Lifelong learning (time)
– Longer lives and longer careers
– Keeps “learning-mode” activated
• 2x from Early learning (time)
– Start earlier: Challenged-based approach
– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)
– Technology & Infrastructure Interactions
– Organizations & Others Interactions
148. Next Generation:
Future-Ready T-Shaped Adaptive Innovators
Many disciplines
Many sectors
Many regions/cultures
(understanding & communications)
Deepinonesector
Deepinoneregion/culture
Deepinonediscipline