SlideShare a Scribd company logo
1 of 29
Download to read offline
#rtanalytics	





    real-time analytics	

    the future of big data in the agency	


                  Dhruv Bansal!
                  Chief Science Officer and Co-founder!
                  Infochimps, Inc.!
#rtanalytics	





     big data infrastructure made simple	


     some of our customers	

   our partners
#rtanalytics	





         agenda	

            •     agency goals	

            •     why big data	

            •     hadoop vs. real-time analytics	

            •     demo of the infochimps platform	

            •     conclusion
#rtanalytics	





                  poll
#rtanalytics	


              more data than ever before	

      CRM	

      POS	

      ERP	

      BI & data warehouse	

      system & network logs	

      web logs	

                                   many terabytes of data,	

      google analytics	

        sometimes many petabytes	



                                                                ?!
      facebook	

      twitter	

      tumblr	

      foursquare	

      klout	

      mobile devices	

      product reviews	

      google search results	

      + more
#rtanalytics	



         enhance the agency product line	

    •    CRM/customer insights	

    •    ad/content optimization and targeting	

    •    social media analytics	

    •    sentiment/influencers	

    •    topics/memes	

    •    web traffic analysis	

    •    mobile/cross-channel reporting	

    •    data-driven ad campaigns
#rtanalytics	





                  It’s all big data!
1!

volume	

   	

velocity	

   	

variety
#rtanalytics	




                  2!

           staff	

             	

         expertise	

             	

           time
#rtanalytics	





                  hadoop!
#rtanalytics	





                  POLL
#rtanalytics	





                  hadoop!
#rtanalytics
#rtanalytics	





            what about real-time?
#rtanalytics
#rtanalytics	




          real-time analytics is the future	

     •     high volume and high velocity	

     •     customer demand	

     •     competitive differentiation	

     •     cost & speed benefit
#rtanalytics	





           why isn’t everyone	

           and their mother	

              doing this?
#rtanalytics	





                     big data expertise	

                               	

                  scalability and flexibility	

                               	

                    agnostic integration
#rtanalytics	




                                       platform	

  data input	

                                                insights	





        data delivery	

 database	

    elastic	

   analytics	

         service™	

 management	

     hadoop	

      tools
#rtanalytics	





                  poll
#rtanalytics
#rtanalytics
#rtanalytics	



                         Agency X	

                       real-time analytics	





                  data delivery	

    database	

     front-end	

                   service™	

       management	

   apps/reports
#rtanalytics	





                  live demo!
#rtanalytics	



                     real-time analytics	

                  powered by the data delivery service™
#rtanalytics	



         enhance the agency product line	

    •    CRM/customer insights	

    •    ad/content optimization and targeting	

    •    social media analytics
    •    sentiment/influencers	

    •    topics/memes	

    •    web traffic analysis	

    •    mobile/cross-channel reporting	

    •    data-driven ad campaigns
#rtanalytics	



                  the new winning reality	


    •  your clients are asking questions that
       require big data to answer	


    •  your agency has the opportunity for a
       bigger seat at the CMO's table
#rtanalytics	



                   benefits we provide	


    •  generate insights clients need while:	

         •  saving valuable resources	

         •  delivering solutions extremely quickly	

         •  responding to unique client needs	

         	

    •  we are:	

         •  a flexible big data foundation to build upon	

         •  your outsourced big data partner
#rtanalytics	





           Let’s discuss your big data projects and ideas.	

            infochimps.com/free-big-data-consultation	




                           info@infochimps.com	

                          follow us: @infochimps

More Related Content

What's hot

Getting Started with Big Data for Business Managers
Getting Started with Big Data for Business ManagersGetting Started with Big Data for Business Managers
Getting Started with Big Data for Business ManagersDatameer
 
Using a Graph Database for Next-Gen MDM
Using a Graph Database for Next-Gen MDMUsing a Graph Database for Next-Gen MDM
Using a Graph Database for Next-Gen MDMNeo4j
 
How AI-Powered Search Drives Employee Experience
How AI-Powered Search Drives Employee ExperienceHow AI-Powered Search Drives Employee Experience
How AI-Powered Search Drives Employee ExperienceLucidworks
 
Bmc joe goldberg
Bmc joe goldbergBmc joe goldberg
Bmc joe goldbergBigDataExpo
 
Big data solutions explained for marketeers & business executives
Big data solutions explained for marketeers & business executivesBig data solutions explained for marketeers & business executives
Big data solutions explained for marketeers & business executivesAgile Delivery
 
Optimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsOptimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsCloudera, Inc.
 
Datameer6 for prospects - june 2016_v2
Datameer6 for prospects - june 2016_v2Datameer6 for prospects - june 2016_v2
Datameer6 for prospects - june 2016_v2Datameer
 
Balancing Business Value and Business Values with Big Data
Balancing Business Value and Business Values with Big DataBalancing Business Value and Business Values with Big Data
Balancing Business Value and Business Values with Big DataSAP Analytics
 
IT Simplification with the SAP HANA Platform
IT Simplification with the SAP HANA PlatformIT Simplification with the SAP HANA Platform
IT Simplification with the SAP HANA PlatformSAP Asia Pacific
 
Customer Event Hub - the modern Customer 360° view
Customer Event Hub - the modern Customer 360° viewCustomer Event Hub - the modern Customer 360° view
Customer Event Hub - the modern Customer 360° viewGuido Schmutz
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with DataSeth Familian
 
Gartner Magic Quadrant for Operational Database Management Systems
Gartner Magic Quadrant for Operational Database Management SystemsGartner Magic Quadrant for Operational Database Management Systems
Gartner Magic Quadrant for Operational Database Management SystemsRobert Bira
 
Analytics & Data Strategy 101 by Deko Dimeski
Analytics & Data Strategy 101 by Deko DimeskiAnalytics & Data Strategy 101 by Deko Dimeski
Analytics & Data Strategy 101 by Deko DimeskiDeko Dimeski
 
Ureason jules oudmans
Ureason jules oudmansUreason jules oudmans
Ureason jules oudmansBigDataExpo
 
Back to Square One: Building a Data Science Team from Scratch
Back to Square One: Building a Data Science Team from ScratchBack to Square One: Building a Data Science Team from Scratch
Back to Square One: Building a Data Science Team from ScratchKlaas Bosteels
 
The Rise of the Citizen Data Scientist
The Rise of the Citizen Data ScientistThe Rise of the Citizen Data Scientist
The Rise of the Citizen Data ScientistPlatfora
 
Activate 2019 Opening Keynote, Will Hayes, CEO, Lucidworks
Activate 2019 Opening Keynote, Will Hayes, CEO, LucidworksActivate 2019 Opening Keynote, Will Hayes, CEO, Lucidworks
Activate 2019 Opening Keynote, Will Hayes, CEO, LucidworksLucidworks
 
[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...
[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...
[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...Kaan Onuk
 

What's hot (20)

Getting Started with Big Data for Business Managers
Getting Started with Big Data for Business ManagersGetting Started with Big Data for Business Managers
Getting Started with Big Data for Business Managers
 
Using a Graph Database for Next-Gen MDM
Using a Graph Database for Next-Gen MDMUsing a Graph Database for Next-Gen MDM
Using a Graph Database for Next-Gen MDM
 
How AI-Powered Search Drives Employee Experience
How AI-Powered Search Drives Employee ExperienceHow AI-Powered Search Drives Employee Experience
How AI-Powered Search Drives Employee Experience
 
Bmc joe goldberg
Bmc joe goldbergBmc joe goldberg
Bmc joe goldberg
 
Big data solutions explained for marketeers & business executives
Big data solutions explained for marketeers & business executivesBig data solutions explained for marketeers & business executives
Big data solutions explained for marketeers & business executives
 
Why mTAB?
Why mTAB?Why mTAB?
Why mTAB?
 
Optimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsOptimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analytics
 
Unlock Your Data
Unlock Your DataUnlock Your Data
Unlock Your Data
 
Datameer6 for prospects - june 2016_v2
Datameer6 for prospects - june 2016_v2Datameer6 for prospects - june 2016_v2
Datameer6 for prospects - june 2016_v2
 
Balancing Business Value and Business Values with Big Data
Balancing Business Value and Business Values with Big DataBalancing Business Value and Business Values with Big Data
Balancing Business Value and Business Values with Big Data
 
IT Simplification with the SAP HANA Platform
IT Simplification with the SAP HANA PlatformIT Simplification with the SAP HANA Platform
IT Simplification with the SAP HANA Platform
 
Customer Event Hub - the modern Customer 360° view
Customer Event Hub - the modern Customer 360° viewCustomer Event Hub - the modern Customer 360° view
Customer Event Hub - the modern Customer 360° view
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with Data
 
Gartner Magic Quadrant for Operational Database Management Systems
Gartner Magic Quadrant for Operational Database Management SystemsGartner Magic Quadrant for Operational Database Management Systems
Gartner Magic Quadrant for Operational Database Management Systems
 
Analytics & Data Strategy 101 by Deko Dimeski
Analytics & Data Strategy 101 by Deko DimeskiAnalytics & Data Strategy 101 by Deko Dimeski
Analytics & Data Strategy 101 by Deko Dimeski
 
Ureason jules oudmans
Ureason jules oudmansUreason jules oudmans
Ureason jules oudmans
 
Back to Square One: Building a Data Science Team from Scratch
Back to Square One: Building a Data Science Team from ScratchBack to Square One: Building a Data Science Team from Scratch
Back to Square One: Building a Data Science Team from Scratch
 
The Rise of the Citizen Data Scientist
The Rise of the Citizen Data ScientistThe Rise of the Citizen Data Scientist
The Rise of the Citizen Data Scientist
 
Activate 2019 Opening Keynote, Will Hayes, CEO, Lucidworks
Activate 2019 Opening Keynote, Will Hayes, CEO, LucidworksActivate 2019 Opening Keynote, Will Hayes, CEO, Lucidworks
Activate 2019 Opening Keynote, Will Hayes, CEO, Lucidworks
 
[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...
[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...
[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...
 

Viewers also liked

Real time data services
Real time data servicesReal time data services
Real time data servicesRelevate
 
Real Time Big Data
Real Time Big DataReal Time Big Data
Real Time Big DataInfoFarm
 
Big Data Ecosystem
Big Data EcosystemBig Data Ecosystem
Big Data EcosystemIvo Vachkov
 
Towards Neuro–Information Science
Towards Neuro–Information ScienceTowards Neuro–Information Science
Towards Neuro–Information Sciencejacekg
 
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY- SCOPE,THEORIES AND...
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY-  SCOPE,THEORIES AND...KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY-  SCOPE,THEORIES AND...
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY- SCOPE,THEORIES AND...Dr. Raju M. Mathew
 
Big Data and Hadoop - key drivers, ecosystem and use cases
Big Data and Hadoop - key drivers, ecosystem and use casesBig Data and Hadoop - key drivers, ecosystem and use cases
Big Data and Hadoop - key drivers, ecosystem and use casesJeff Kelly
 
Big data + data science startup focus points
Big data + data science startup focus pointsBig data + data science startup focus points
Big data + data science startup focus pointsTom Zorde
 
Sharing & Sustaining Ecosystem Data
Sharing & Sustaining Ecosystem DataSharing & Sustaining Ecosystem Data
Sharing & Sustaining Ecosystem DataTERN Australia
 
Semiotics and Information Science
Semiotics and Information ScienceSemiotics and Information Science
Semiotics and Information ScienceFlorence Paisey
 
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...Perficient, Inc.
 
Big data ecosystem
Big data ecosystemBig data ecosystem
Big data ecosystemSlideCentral
 
Data science fin_tech_2016
Data science fin_tech_2016Data science fin_tech_2016
Data science fin_tech_2016iECARUS
 
Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...
Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...
Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...Paolo Nesi
 
Share Information, Change the World: Big Data, Small Apps, Smart Dashboards &...
Share Information, Change the World: Big Data, Small Apps, Smart Dashboards &...Share Information, Change the World: Big Data, Small Apps, Smart Dashboards &...
Share Information, Change the World: Big Data, Small Apps, Smart Dashboards &...Kristin Wolff
 
Valtech - Big Data for marketing (EN)
Valtech - Big Data for marketing (EN)Valtech - Big Data for marketing (EN)
Valtech - Big Data for marketing (EN)Valtech
 
Marketing Automation & CRM: Terrible Twosome or Dynamic Duo?
Marketing Automation & CRM: Terrible Twosome or Dynamic Duo?Marketing Automation & CRM: Terrible Twosome or Dynamic Duo?
Marketing Automation & CRM: Terrible Twosome or Dynamic Duo?Pardot
 
Social CRM - #Datamarketing @DM2013Toronto
Social CRM - #Datamarketing @DM2013Toronto  Social CRM - #Datamarketing @DM2013Toronto
Social CRM - #Datamarketing @DM2013Toronto ArCompany
 
Big Data: Unveiling opportunities in Email Marketing
Big Data: Unveiling opportunities in Email MarketingBig Data: Unveiling opportunities in Email Marketing
Big Data: Unveiling opportunities in Email MarketingEmail Monks
 
Anderson SAA 2014 Using CRM Data for "Big Picture" Research
Anderson SAA 2014 Using CRM Data for "Big Picture" ResearchAnderson SAA 2014 Using CRM Data for "Big Picture" Research
Anderson SAA 2014 Using CRM Data for "Big Picture" Researchdinaa_proj
 

Viewers also liked (20)

Real time data services
Real time data servicesReal time data services
Real time data services
 
Real Time Big Data
Real Time Big DataReal Time Big Data
Real Time Big Data
 
Big Data Ecosystem
Big Data EcosystemBig Data Ecosystem
Big Data Ecosystem
 
Towards Neuro–Information Science
Towards Neuro–Information ScienceTowards Neuro–Information Science
Towards Neuro–Information Science
 
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY- SCOPE,THEORIES AND...
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY-  SCOPE,THEORIES AND...KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY-  SCOPE,THEORIES AND...
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY- SCOPE,THEORIES AND...
 
Big Data and Hadoop - key drivers, ecosystem and use cases
Big Data and Hadoop - key drivers, ecosystem and use casesBig Data and Hadoop - key drivers, ecosystem and use cases
Big Data and Hadoop - key drivers, ecosystem and use cases
 
Big data + data science startup focus points
Big data + data science startup focus pointsBig data + data science startup focus points
Big data + data science startup focus points
 
Sharing & Sustaining Ecosystem Data
Sharing & Sustaining Ecosystem DataSharing & Sustaining Ecosystem Data
Sharing & Sustaining Ecosystem Data
 
Semiotics and Information Science
Semiotics and Information ScienceSemiotics and Information Science
Semiotics and Information Science
 
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
 
Big data ecosystem
Big data ecosystemBig data ecosystem
Big data ecosystem
 
Data science fin_tech_2016
Data science fin_tech_2016Data science fin_tech_2016
Data science fin_tech_2016
 
Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...
Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...
Smart City Ecosystem, fram data to value for the citizens, Km4City solution, ...
 
Share Information, Change the World: Big Data, Small Apps, Smart Dashboards &...
Share Information, Change the World: Big Data, Small Apps, Smart Dashboards &...Share Information, Change the World: Big Data, Small Apps, Smart Dashboards &...
Share Information, Change the World: Big Data, Small Apps, Smart Dashboards &...
 
Big Data + Social Graph
Big Data + Social GraphBig Data + Social Graph
Big Data + Social Graph
 
Valtech - Big Data for marketing (EN)
Valtech - Big Data for marketing (EN)Valtech - Big Data for marketing (EN)
Valtech - Big Data for marketing (EN)
 
Marketing Automation & CRM: Terrible Twosome or Dynamic Duo?
Marketing Automation & CRM: Terrible Twosome or Dynamic Duo?Marketing Automation & CRM: Terrible Twosome or Dynamic Duo?
Marketing Automation & CRM: Terrible Twosome or Dynamic Duo?
 
Social CRM - #Datamarketing @DM2013Toronto
Social CRM - #Datamarketing @DM2013Toronto  Social CRM - #Datamarketing @DM2013Toronto
Social CRM - #Datamarketing @DM2013Toronto
 
Big Data: Unveiling opportunities in Email Marketing
Big Data: Unveiling opportunities in Email MarketingBig Data: Unveiling opportunities in Email Marketing
Big Data: Unveiling opportunities in Email Marketing
 
Anderson SAA 2014 Using CRM Data for "Big Picture" Research
Anderson SAA 2014 Using CRM Data for "Big Picture" ResearchAnderson SAA 2014 Using CRM Data for "Big Picture" Research
Anderson SAA 2014 Using CRM Data for "Big Picture" Research
 

Similar to Real-Time Analytics: The Future of Big Data in the Agency

Open-BDA Hadoop Summit 2014 - Mr. Krish Krishnan (Driving Business Value – Bi...
Open-BDA Hadoop Summit 2014 - Mr. Krish Krishnan (Driving Business Value – Bi...Open-BDA Hadoop Summit 2014 - Mr. Krish Krishnan (Driving Business Value – Bi...
Open-BDA Hadoop Summit 2014 - Mr. Krish Krishnan (Driving Business Value – Bi...Innovative Management Services
 
In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017SingleStore
 
Moving Targets: Harnessing Real-time Value from Data in Motion
Moving Targets: Harnessing Real-time Value from Data in Motion Moving Targets: Harnessing Real-time Value from Data in Motion
Moving Targets: Harnessing Real-time Value from Data in Motion Inside Analysis
 
Align Business Data & Analytics for Digital Transformation
Align Business Data & Analytics for Digital TransformationAlign Business Data & Analytics for Digital Transformation
Align Business Data & Analytics for Digital TransformationPerficient, Inc.
 
ANTS Programmatic Omnichannel 2017 - Part 1
ANTS Programmatic Omnichannel 2017 - Part 1ANTS Programmatic Omnichannel 2017 - Part 1
ANTS Programmatic Omnichannel 2017 - Part 1ANTS
 
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...Vishrut Shukla
 
Hadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHortonworks
 
Mobility and the Real-Time Enterprise
Mobility and the Real-Time EnterpriseMobility and the Real-Time Enterprise
Mobility and the Real-Time EnterpriseAnyPresence
 
Powering the "As it Happens" Business
Powering the "As it Happens" BusinessPowering the "As it Happens" Business
Powering the "As it Happens" BusinessMapR Technologies
 
Connecting the Dots with Data Mashups
Connecting the Dots with Data MashupsConnecting the Dots with Data Mashups
Connecting the Dots with Data MashupsInside Analysis
 
BIBoss: The Data Science Behind Personalisation & AI
BIBoss: The Data Science Behind Personalisation & AIBIBoss: The Data Science Behind Personalisation & AI
BIBoss: The Data Science Behind Personalisation & AICorecom Consulting
 
A Winning Strategy for the Digital Economy
A Winning Strategy for the Digital EconomyA Winning Strategy for the Digital Economy
A Winning Strategy for the Digital EconomyEric Kavanagh
 
Key Considerations for Putting Hadoop in Production SlideShare
Key Considerations for Putting Hadoop in Production SlideShareKey Considerations for Putting Hadoop in Production SlideShare
Key Considerations for Putting Hadoop in Production SlideShareMapR Technologies
 
Knowledge Graphs Webinar- 11/7/2017
Knowledge Graphs Webinar- 11/7/2017Knowledge Graphs Webinar- 11/7/2017
Knowledge Graphs Webinar- 11/7/2017Neo4j
 
Keyrus US Information
Keyrus US InformationKeyrus US Information
Keyrus US InformationJulian Tong
 
WEBINAR – DAM 2020 Report & Analysis along side the user perspective
WEBINAR – DAM 2020 Report & Analysis along side the user perspectiveWEBINAR – DAM 2020 Report & Analysis along side the user perspective
WEBINAR – DAM 2020 Report & Analysis along side the user perspectiveActivo Consulting
 

Similar to Real-Time Analytics: The Future of Big Data in the Agency (20)

[Webinar] High Speed Retail Analytics
[Webinar] High Speed Retail Analytics[Webinar] High Speed Retail Analytics
[Webinar] High Speed Retail Analytics
 
Open-BDA Hadoop Summit 2014 - Mr. Krish Krishnan (Driving Business Value – Bi...
Open-BDA Hadoop Summit 2014 - Mr. Krish Krishnan (Driving Business Value – Bi...Open-BDA Hadoop Summit 2014 - Mr. Krish Krishnan (Driving Business Value – Bi...
Open-BDA Hadoop Summit 2014 - Mr. Krish Krishnan (Driving Business Value – Bi...
 
In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017
 
Moving Targets: Harnessing Real-time Value from Data in Motion
Moving Targets: Harnessing Real-time Value from Data in Motion Moving Targets: Harnessing Real-time Value from Data in Motion
Moving Targets: Harnessing Real-time Value from Data in Motion
 
Align Business Data & Analytics for Digital Transformation
Align Business Data & Analytics for Digital TransformationAlign Business Data & Analytics for Digital Transformation
Align Business Data & Analytics for Digital Transformation
 
ANTS Programmatic Omnichannel 2017 - Part 1
ANTS Programmatic Omnichannel 2017 - Part 1ANTS Programmatic Omnichannel 2017 - Part 1
ANTS Programmatic Omnichannel 2017 - Part 1
 
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
Getting Started with Product Analytics - A 101 Implementation Guide for Begin...
 
Hadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data Processing
 
Big data Introduction by Mohan
Big data Introduction by MohanBig data Introduction by Mohan
Big data Introduction by Mohan
 
Mobility and the Real-Time Enterprise
Mobility and the Real-Time EnterpriseMobility and the Real-Time Enterprise
Mobility and the Real-Time Enterprise
 
Powering the "As it Happens" Business
Powering the "As it Happens" BusinessPowering the "As it Happens" Business
Powering the "As it Happens" Business
 
Connecting the Dots with Data Mashups
Connecting the Dots with Data MashupsConnecting the Dots with Data Mashups
Connecting the Dots with Data Mashups
 
5 Big Data Use Cases for 2013
5 Big Data Use Cases for 20135 Big Data Use Cases for 2013
5 Big Data Use Cases for 2013
 
BIBoss: The Data Science Behind Personalisation & AI
BIBoss: The Data Science Behind Personalisation & AIBIBoss: The Data Science Behind Personalisation & AI
BIBoss: The Data Science Behind Personalisation & AI
 
A Winning Strategy for the Digital Economy
A Winning Strategy for the Digital EconomyA Winning Strategy for the Digital Economy
A Winning Strategy for the Digital Economy
 
Key Considerations for Putting Hadoop in Production SlideShare
Key Considerations for Putting Hadoop in Production SlideShareKey Considerations for Putting Hadoop in Production SlideShare
Key Considerations for Putting Hadoop in Production SlideShare
 
Knowledge Graphs Webinar- 11/7/2017
Knowledge Graphs Webinar- 11/7/2017Knowledge Graphs Webinar- 11/7/2017
Knowledge Graphs Webinar- 11/7/2017
 
Keyrus US Information
Keyrus US InformationKeyrus US Information
Keyrus US Information
 
Keyrus US Information
Keyrus US InformationKeyrus US Information
Keyrus US Information
 
WEBINAR – DAM 2020 Report & Analysis along side the user perspective
WEBINAR – DAM 2020 Report & Analysis along side the user perspectiveWEBINAR – DAM 2020 Report & Analysis along side the user perspective
WEBINAR – DAM 2020 Report & Analysis along side the user perspective
 

More from Infochimps, a CSC Big Data Business

[Webinar] Getting to Insights Faster: A Framework for Agile Big Data
[Webinar] Getting to Insights Faster: A Framework for Agile Big Data[Webinar] Getting to Insights Faster: A Framework for Agile Big Data
[Webinar] Getting to Insights Faster: A Framework for Agile Big DataInfochimps, a CSC Big Data Business
 
[Webinar] Measure Twice, Build Once: Real-Time Predictive Analytics
[Webinar] Measure Twice, Build Once: Real-Time Predictive Analytics[Webinar] Measure Twice, Build Once: Real-Time Predictive Analytics
[Webinar] Measure Twice, Build Once: Real-Time Predictive AnalyticsInfochimps, a CSC Big Data Business
 
Case Study: Digital Agency Turbocharges Social Listening and Insights with t...
Case Study: Digital  Agency Turbocharges Social Listening and Insights with t...Case Study: Digital  Agency Turbocharges Social Listening and Insights with t...
Case Study: Digital Agency Turbocharges Social Listening and Insights with t...Infochimps, a CSC Big Data Business
 

More from Infochimps, a CSC Big Data Business (14)

Vayacondios: Divine into Complex Systems
Vayacondios: Divine into Complex SystemsVayacondios: Divine into Complex Systems
Vayacondios: Divine into Complex Systems
 
[Webinar] Getting to Insights Faster: A Framework for Agile Big Data
[Webinar] Getting to Insights Faster: A Framework for Agile Big Data[Webinar] Getting to Insights Faster: A Framework for Agile Big Data
[Webinar] Getting to Insights Faster: A Framework for Agile Big Data
 
[Webinar] Measure Twice, Build Once: Real-Time Predictive Analytics
[Webinar] Measure Twice, Build Once: Real-Time Predictive Analytics[Webinar] Measure Twice, Build Once: Real-Time Predictive Analytics
[Webinar] Measure Twice, Build Once: Real-Time Predictive Analytics
 
AHUG Presentation: Fun with Hadoop File Systems
AHUG Presentation: Fun with Hadoop File SystemsAHUG Presentation: Fun with Hadoop File Systems
AHUG Presentation: Fun with Hadoop File Systems
 
Report: CIOs & Big Data
Report: CIOs & Big DataReport: CIOs & Big Data
Report: CIOs & Big Data
 
451 Research Impact Report
451 Research Impact Report451 Research Impact Report
451 Research Impact Report
 
[Webinar] Top Strategies for Successful Big Data Projects
[Webinar] Top Strategies for Successful Big Data Projects[Webinar] Top Strategies for Successful Big Data Projects
[Webinar] Top Strategies for Successful Big Data Projects
 
Infochimps + CloudCon: Infinite Monkey Theorem
Infochimps + CloudCon: Infinite Monkey TheoremInfochimps + CloudCon: Infinite Monkey Theorem
Infochimps + CloudCon: Infinite Monkey Theorem
 
Taming the Big Data Tsunami using Intel Architecture
Taming the Big Data Tsunami using Intel ArchitectureTaming the Big Data Tsunami using Intel Architecture
Taming the Big Data Tsunami using Intel Architecture
 
The Other Way of Doing Big Data
The Other Way of Doing Big DataThe Other Way of Doing Big Data
The Other Way of Doing Big Data
 
Ironfan: Your Foundation for Flexible Big Data Infrastructure
Ironfan: Your Foundation for Flexible Big Data InfrastructureIronfan: Your Foundation for Flexible Big Data Infrastructure
Ironfan: Your Foundation for Flexible Big Data Infrastructure
 
The Power of Elasticsearch
The Power of ElasticsearchThe Power of Elasticsearch
The Power of Elasticsearch
 
Case Study: Digital Agency Turbocharges Social Listening and Insights with t...
Case Study: Digital  Agency Turbocharges Social Listening and Insights with t...Case Study: Digital  Agency Turbocharges Social Listening and Insights with t...
Case Study: Digital Agency Turbocharges Social Listening and Insights with t...
 
Meet the Infochimps Platform
Meet the Infochimps PlatformMeet the Infochimps Platform
Meet the Infochimps Platform
 

Recently uploaded

UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 

Recently uploaded (20)

UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 

Real-Time Analytics: The Future of Big Data in the Agency

  • 1. #rtanalytics real-time analytics the future of big data in the agency Dhruv Bansal! Chief Science Officer and Co-founder! Infochimps, Inc.!
  • 2. #rtanalytics big data infrastructure made simple some of our customers our partners
  • 3. #rtanalytics agenda •  agency goals •  why big data •  hadoop vs. real-time analytics •  demo of the infochimps platform •  conclusion
  • 5. #rtanalytics more data than ever before CRM POS ERP BI & data warehouse system & network logs web logs many terabytes of data, google analytics sometimes many petabytes ?! facebook twitter tumblr foursquare klout mobile devices product reviews google search results + more
  • 6. #rtanalytics enhance the agency product line •  CRM/customer insights •  ad/content optimization and targeting •  social media analytics •  sentiment/influencers •  topics/memes •  web traffic analysis •  mobile/cross-channel reporting •  data-driven ad campaigns
  • 7. #rtanalytics It’s all big data!
  • 8. 1! volume velocity variety
  • 9. #rtanalytics 2! staff expertise time
  • 10. #rtanalytics hadoop!
  • 11. #rtanalytics POLL
  • 12. #rtanalytics hadoop!
  • 14. #rtanalytics what about real-time?
  • 16. #rtanalytics real-time analytics is the future •  high volume and high velocity •  customer demand •  competitive differentiation •  cost & speed benefit
  • 17. #rtanalytics why isn’t everyone and their mother doing this?
  • 18. #rtanalytics big data expertise scalability and flexibility agnostic integration
  • 19. #rtanalytics platform data input insights data delivery database elastic analytics service™ management hadoop tools
  • 20. #rtanalytics poll
  • 23. #rtanalytics Agency X real-time analytics data delivery database front-end service™ management apps/reports
  • 24. #rtanalytics live demo!
  • 25. #rtanalytics real-time analytics powered by the data delivery service™
  • 26. #rtanalytics enhance the agency product line •  CRM/customer insights •  ad/content optimization and targeting •  social media analytics •  sentiment/influencers •  topics/memes •  web traffic analysis •  mobile/cross-channel reporting •  data-driven ad campaigns
  • 27. #rtanalytics the new winning reality •  your clients are asking questions that require big data to answer •  your agency has the opportunity for a bigger seat at the CMO's table
  • 28. #rtanalytics benefits we provide •  generate insights clients need while: •  saving valuable resources •  delivering solutions extremely quickly •  responding to unique client needs •  we are: •  a flexible big data foundation to build upon •  your outsourced big data partner
  • 29. #rtanalytics Let’s discuss your big data projects and ideas. infochimps.com/free-big-data-consultation info@infochimps.com follow us: @infochimps

Editor's Notes

  1. Amanda introduces Dhruv, Infochimps, and sets the context for the webinar.
  2. Hi, everyone, my name is Dhruv Bansal and I’m one of the founders and the CSO at Infochimps. We make big data infrastructure simple. We’re proud to knit together solutions for our customers from best of breed big data technologies that we research and become experts at using and deploying – so our customers don’t have to.
  3. Before we get started I’d like to set an agenda for what we’ll be talking about today. I’m going to start by telling you some stories about big opportunities in big data that we’re hearing from our customers in the agency space. I hope you’ll all agree that you see these same opportunities and challenges in front of you.Next I’m going to talk about why these challenges and opportunities all ultimately stem from or depend upon big data technology. I’ll next talk about Hadoop, a tool I’m sure many of you have heard of, and talk about some other big data tools that you might be less familiar with.That’ll leave us in a good position to show you a real, live demo that highlights some of what I’ve been saying and gives you a taste for how the Infochimps platform works and how it can help you overcome some of the challenges you’ll face with big data and capitalize on some of the opportunities.Finally, we’ll wrap up, and I’ll take some questions.
  4. But first – a poll! Just to get a sense of where you all are, let me ask a quick, almost diagnostic question:How much data do you have under management? 0-200 GB 201 GB – 1 TB 1-10 TB Over 10 TB Absolutely no idea how to measure this
  5. So let’s dig into it. Big data is a pretty easy idea to explain: we produce data, all the time, constantly, and we produce a lot of it. Data centers now take up 1.3% of global energy usage – as much as the entire continent of Australia. So we have some similarly big challenges and even bigger opportunities.On the left on this slide I’ve listed just a few of the kinds of data sources that might be available to an agency, should they choose to ingest them. Everything from their own clients’ customer databases, to streams of tweets from Twitter, to Google search results and even forum posts, can be ingested in the pursuit of building something that generates insights for their clients.
  6. But what do clients actually want? Anything. Everything! Some want to take advantage of listening platforms to report on everything that happens with their brand in social media. Your client is an airline and an upset customer’s tweets complaining about bad service go viral #faii – imagine being able to spot this trend within seconds because you detected an anomalous number of tweets with negative sentiment about the airline localized within a city. Reactive PR at the speed of light can help nullify a crisis or amplify positive stories.Others clients will want their customer databases connected to what those same customers are talking about online to better segment them and increase sales and revenues. Fire off an email campaign with a diaper discount to Twitter users who exclaim that they’ve just had a baby!Some brands know that there exist prominent users of social networks, influencers who can organically and honestly spread the gospel about their brand to the rest of the Web – if only they can be identified and reached.Our customers don’t lack for ideas about what *could* be done. The opportunities here are endless, and the ground so poorly trod, that it’s easy to think of ways of combining social data feeds with customer data to make wonderful things happen.But there’s one big challenge.
  7. You guessed it! Ingesting all the data sources available these days, combining them in smart ways to produce insight, and delivering that insight to your customers in the way they want it, in real-time so they can act on it hard. It’s big data hard.
  8. GARTNERBig data means chiefly means three things: large (big) data volume, large throughput of data per second or minute, and a large variety of different types of data to handle.Variety – the prior slide has just a small subset of the data sources our clients are excited aboutWhat do you need in order to be able to solve these problems?
  9. Our clients tell us that they don’t have the expertise or support staff to solve these problems right now. And they don’t want to spend the time or resources required to hire these very rare persons. It’s just not their core competency and they don’t want it to be.
  10. Well, that’s not strictly fair. Some of our clients have already started to work with something called Hadoop. Hadoop is a wonderful open source tool designed to process big data at tremendous scale, reliably, and without using top-of-the line hardware.
  11. But first – a poll! To help me understand the level of technical detail I can assume from you all, I’d like to know what you know about big data. Have you evaluated Hadoop? Yes No
  12. Despite how well-known Hadoop is, even in the agency ecosystem, there’s still often confusion about what it actually does and what problems it solves. Let me show you an illustrative – if a little silly – example that might help you to understand exactly when and why you would use Hadoop.
  13. Welcome to the Batch Sub Shop! We make sandwiches, lots of sandwiches. If we get a big order for 1,000 subs, we execute that order all at once. Hadoop has two phases in each calculation or job that executes, the map phase and the reduce phase. In the map phase, input data is modified, transformed, parsed, or otherwise altered or prepared. In our Batch Sub Shop, the map phase is when we slice our bread and our veggies and prepare our meat.In the reduce phase, transformed data from the map phase is assembled into the final output we want. In our Batch Sub Shop, the reduce phase is when we assemble all the sandwich orders from the sliced bread, veggies, and meats we prepared in the map phase. In a few hours, we’ll deliver a huge batch of sandwiches, fresh and delicious.For those of you who have started to evaluate Hadoop, I hope you’re getting the joke here. Hadoop is great in the same way that a caterer is great: if you have a big order and you don’t need it right away, it’s the perfect choice. Similarly, if you have a large amount of data that you need analyzed and you don’t need the result right away you should use Hadoop. This is one of the reasons that Hadoop so popular for analyzing historical data in a batch processing paradigm.
  14. But say you were really hungry, and you just really want to eat your sandwich now. Our batch sub shop will make you wait 3 hours! Sure, you’ll get 1000 sandwiches at the 3-hour mark, but that’s not very helpful if you just wanted one right away.Similarly, Hadoop is not the right big data tool to use when you want results right away, in real-time, because not only do you have to assemble all your data in one place, as we assembled all our ingredients in one place in the batch sub shop, but you also have to wait for the full computation to finish before you get any results. This can often take hours. This makes Hadoop appropriate for batch or offline calculations that can run, say, overnight, and whose results we won’t need to see till morning.But what if we need results right away?
  15. Enter the Streaming Sub Shop. This sub shop works like a conveyor belt. Ingredients enter on the left and as they move through the shop, we slice ‘em, dice ‘em, assemble those sandwiches, and get them toasted and served. The first sandwich will come out in just a few minutes and sandwiches will continuously be produced afterwards as they’re continuously fed in.Similarly, there are technologies complementary to Hadoop which enable this kind of stream processing of big data.
  16. While batch-processing is better known and still useful, Real-time analytics, like the streaming sub shop, is actually the right tool for a lot of the data feeds that are relevant to the agency. Social media is not only high volume data, but high velocity as well: it’s continuously being produced.
  17. But now let’s return to the central challenge of big data: why aren’t you doing it right now? Why aren’t your competitors? It’s because it’s hard, you lack the expertise, and you haven’t or can’t hire the necessary resources – all of whom are rare and expensive.
  18. Infochimps are experts in the full-stack of big data technologies. We want to inform you of several factors you should be evaluating as you start moving into the big data space.You need the expertise to evaluate and choose the right tools and architecture to solve your big data problems. These choices need to provide a scalable infrastructure that can handle volume, velocity, and variety of big data while remaining flexible and adaptable as your needs change. You’ll likely also want to integrate with whatever technologies you’re already running, whether they are traditional resources like SQL servers or Tableau or your first forays into big data.
  19. When we approach these problems, we think about four major tools that need to work together. We’ve designed and built these tools to work together in what we call the Infochimps Platform. It consists of four main pieces:The data delivery service. This is our streaming sub shop. We can ingest data at the terabyte scale in real time, transport it to wherever else in the infrastructure it needs to go, and transform it on the flyNext is our database management service. The world of big data has a lot of choices for database technologies, everything from Cassandra, to Hbase, to Mongodb to Elasticsearch, to even traditional SQL services. Each of these databases has strengths and weaknesses. Don’t lock yourself into only being able to use a single database and don’t work with vendors who push this choice onto you. You want to be able to grow your stack as your needs change; a federated database management system is the right approach.Of course there’s also Hadoop. Our approach to Hadoop is a little bit different than the usual. Instead of having a Hadoop cluster around at all times, possibly being underutilized and therefore wasting resources, we allow you to spin up Hadoop clusters on demand, run your jobs, and spin them back down. You can always leave one of them up forever, if that’s your use case, but if it isn’t, you can unlock the power of Hadoop while also seeing tremendous cost savings due to our dynamic approachfinally, you’ll need an analytics and monitoring layer. Whether its seeing what your servers are up to, watching data stream by, writing simple scripts that can be automatically turned into Hadoop jobs, you need analytics tools make it easy for even non-big data experts to be productive in this new world. For those of you that want to reach into the lower layers of these systems, you’ll want to have direct access to the Hadoop Java APIs and tools like Pig or Hive.The advantage of working with the Infochimps Platform is that we’ve already identified these needs because of our long experience in this space and we’ve built a framework with compatible tools that fit together nicely into a solution.
  20. Before we get into talking about how the Infochimps platform can help you, we’d like to know a little bit more about your plans to get into big data.How many of you have hired big data talent? Team of 1-3 Team of 4+ people Not hired yet Not planning on hiringI ask because investing in people to manage a big data infrastructure isn’t always the best strategy for an agency.
  21. Different parts of a modern digital agency scale differently and have different cost structures and requirements. People are the most expensive and least scalable part of the operation but they also provide the most value – your people are your core competency, your creatives that differentiate your agency, what your clients pay you for.But these people are increasingly supported by reports and visualizations, the kinds of resources required by analysts to provide quantitative insight into the scope or effectiveness of campaigns. These reports themselves are supported by listening and content technologies that drive their value upward through the stack.It’s a mistake to pull people from the top of this pyramid, where they produce the most value, to the lower tiers which really should be supported entirely by technology.
  22. And that’s exactly what Infochimps does. The tools that comprise our platform provide a grammar for building solutions that power your creative teams without bogging down your organization with the responsibility of having to manage these new systems.
  23. To help you understand how our platform could be useful to you, I want to tell you a simple story about a made up Agency, Agency X.Agency X is excited about making their first inroads into leveraging big data to create insights for their clients and to create repeatable new revenue streams for themselves.This system represents a fully-automated big data platform that provides a foundation for a repeatable service Agency X can sell to client after client.
  24. Just a quick overview of what we just saw. We collected data, moved it through a transformation, and lodged it into a database where it could be queried in both an ad hoc way, behind the scenes, or through a custom frontend application.
  25. I’d also like to take a moment to bring it back to the use cases we outlined at the beginning of the webinar. The Agency X example and the demo I gave illustrate just one of these possible agency products: a social media listening service.Because the Infochimps Platform is a set of tools designed to work together to solve a big data problem, it can be used to for any of these use cases.
  26. Solutions like these are becoming more important because the world has changed. Big data is here and your clients want to know about what their customers are doing. We can help you help *your* clients gain those insights, giving your agency a bigger seat at the CMOs table.Agencies have been dabbling in big data 1.0 for a while. Black box services that provide limited abilities to do cross-channel marketing, meager (but passable) sentiment analyses, are common throughout the industry.The next wave is about mixing and matching different data sources, public and private, and connecting them to provide a *context* for your customers. This context turns pretty dashboards into useful tools.
  27. Our platform helps you build this context in an entirely new way.We aren't just a data supplier or an infrastructure hosting provider or a software company - we're a strategic resource. The agencies who will win are making big data analysis one of their new and essential superpowers. And we’re helping get them there.
  28. This concludes our webinar and I thank you all for coming and please come visit our website and schedule a free big data consultation. I’d love to hear about the use cases that you’re engaged with and help you understand the most effective way to realize success.