SlideShare a Scribd company logo
1 of 33
Download to read offline
© 2013 Forrester Research, Inc. Reproduction Prohibited 1
the world of e-Commerce
testing and personalization
is changing
Zee Aganovic, Ph.D.
Founder & CEO, HiConversion
2000 2014
Site
Analytics
PersonalizationA/B Split and
Multivariate
Testing
Sustainablevalue
EVOLUTION OF e-COMMERCE OPTIMIZATION
2006 2009
e-Commerce
Revenue
Performance
Management
eRPM is a disruptive
technology framework
for sustainable online
revenue growth
!
!
eRPM!
EVERYTHING!
INTERACTS!
WITH!
EVERYTHING
multi-
everything
E-COMMERCE!
TECHNOLOGY IS!
VERY COMPLEX !
virtualization
(no IT needed)
CUSTOMER!
PREFERENCES!
ARE ALWAYS!
CHANGING
real-time
e-commerce technology is very complex
OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
traditional optimization
requires IT resources
1.  Custom tagging of pages
2.  Custom scripting of
optimization variables
3.  Implementing your
optimization results
solution. virtualization
US PATENTS: 7779161 and 8499237
<HEAD>
HICONVERSION
HEAD TAG
</HEAD>
<BODY>
HICONVERSION
BODY TAG
</BODY>
US PATENTS 7779161 and 8499237
solution. virtualization
STEP 1: Select an element to add to the campaign.
solution. virtualization
US PATENTS 7779161 and 8499237
STEP 2: Click on ‘move’ to relocate the element.
solution. virtualization
STEP 3: View the new variable you just created.
everything interacts with everything else
OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
optimization requirements are escalating;
finding what works is getting more difficult
MULTI-DEVICE
MULTI-PAGE
MULTI-VARIATE
MULTI-SEGMENT
combining A/B test results doesn’t work.
full-funnel, multi-segment, multi-variate, multi-targeting, and more
solution. multi-everything optimization
$$$
SINGLE CAMPAIGN. END-TO-END RESULTS.
customer preferences are constantly changing
OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
case study. free shipping experiment
week one. strong performance with $50 min.
week two. can significant results change?
e-Commerce surprise: the magnitude of
visitor time varying behavior
figure 1. REVENUE PER VISITOR (RPV) OVER TIME – ONE PAGE
visitors reactions to the same experience
can fluctuate significantly over time.
POINT 1 RPV = $1.82 POINT 2 RPV = $4.09
solution. real time optimization
VERSION A VERSION B
15%88%
figure 2. CAMPAIGN VS. BASELINE RPV PERFORMANCE
85%12%
$95.00$95.00
US PATENT 8321359
benefit. sustainable revenue growth
ready, set, launch
operating in a world of
Kristopher Jean
e-Commerce Content Manager, L’Orèal USA
multi-everything
MULTIPLE!
STAKEHOLDERS
MULTIPLE!
PHASES
MULTIPLE!
PAGES
MULTIPLE!
TECH RESOURCES
MULTIPLE!
VARIABLES
MULTIPLE!
SEGMENTS
MULTIPLE!
DEVICES
MULTIPLE!
TARGETS
we live in the age of multi-everything e-Commerce
each of these tenets can fit together
under the umbrella of one
multi-everything optimization strategy
… but how are these moving parts
orchestrated to work seamlessly?
GETTING STARTED WITH ERPM
build your very own
optimization roadmap.
four key aspects of any roadmap:
1.  Brainstorming ideas
2.  Setting expectations
3.  Aligning tactical resources
4.  Managing expectations
part 1. brainstorming ideas
Get the scoop on anti-aging and find the routine right for your skin concern Learn More
PERSONALIZATION A: ANTI-AGING
part 1. brainstorming ideas
Get the scoop on anti-aging and find the routine right for your skin concern Learn MoreThe Ultimate Man 3-step routine: Cleanse, Shave, and Moisturize! Learn More
PERSONALIZATION B: MALE
part 2. setting expectations
what do we want to accomplish and how does this campaign look?
A
PERSONALIZATION PERSONALIZATION
B
SEGMENT: SEO SEGMENT: PES SEGMENT: SEO SEGMENT: PES
•  ANTI-AGING
KEYWORDS
•  5-PAGE
FUNNEL
•  5 BANNERS
•  6 POSSIBLE
PES SCORES
•  5-PAGE
FUNNEL
•  5 BANNERS
•  3 POSSIBLE
PES SCORES
•  5-PAGE
FUNNEL
•  2 BANNERS
•  MALE
KEYWORDS
•  5-PAGE
FUNNEL
•  2 BANNERS
ANTI-AGING MALE
part 2. setting expectations
what do we want to accomplish and how does this campaign look?
part 3. aligning resources
what tactical resources are necessary to get this strategy off the ground?
DEVELOPMENT RESOURCES
part 4. managing expectations
PRELIMINARY NET RESULTS – CAMPAIGN-WIDE
+59.76% RPV, +127% CONVERSION RATE
The Ultimate Man 3-step routine: Cleanse, Shave, and Moisturize! Learn More
MALE
RPV CONVERSION RATE AOV
+3.86% +2.08% +1.74%
TOP
PERFORMER
+230.77% RPV, +148% CONVERSION RATE
ANTI
AGE
TOP
PERFORMER
Repair and replenish skin overnight with the Midnight Recovery Concentrate collection Learn More
The ABC’s
of eRPM
Just e-mail Maeve at:
info@hiconversion.com
FREE ECOMMERCE GUIDE

More Related Content

Similar to e-Commerce Testing: The Coming of Age

Business of Mobile Apps
Business of Mobile AppsBusiness of Mobile Apps
Business of Mobile AppsGBG Mumbai
 
Adam Sharp - Funnel 16-9-2013
Adam Sharp - Funnel 16-9-2013Adam Sharp - Funnel 16-9-2013
Adam Sharp - Funnel 16-9-2013CleverTouch
 
Make Experience Your Business
Make Experience Your BusinessMake Experience Your Business
Make Experience Your BusinessMediaPost
 
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...Uberflip
 
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...Matt Davis
 
Being a Product Manager for Enterprise Products by Snapchat PM
Being a Product Manager for Enterprise Products by Snapchat PMBeing a Product Manager for Enterprise Products by Snapchat PM
Being a Product Manager for Enterprise Products by Snapchat PMProduct School
 
The Role of Technology in the Creative Agency
The Role of Technology in the Creative AgencyThe Role of Technology in the Creative Agency
The Role of Technology in the Creative AgencyMarTech Conference
 
Aligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Aligning Business Goals & ROI - Sagittarius Travel Marketing MasterclassAligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Aligning Business Goals & ROI - Sagittarius Travel Marketing MasterclassSagittarius
 
The power of Programmatic marketing!
The power of Programmatic marketing! The power of Programmatic marketing!
The power of Programmatic marketing! snvrtt
 
Pitstop brochure slideshare-1
Pitstop brochure slideshare-1Pitstop brochure slideshare-1
Pitstop brochure slideshare-1Lizelle Nel
 
Marketing de Buscadores
Marketing de BuscadoresMarketing de Buscadores
Marketing de Buscadoresguest40e6566
 
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...Uberflip
 
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To MakeHow To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To MakeMarketo
 
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. SolomonMastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. SolomonStartup Product Academy, LLC
 
Get social: How to create a social content strategy to change perceptions
Get social: How to create a social content strategy to change perceptionsGet social: How to create a social content strategy to change perceptions
Get social: How to create a social content strategy to change perceptionsLinkedIn Talent Solutions
 
Turn Your Business Vision into Reality with “Jewel – ERP"
Turn Your Business Vision into Reality with “Jewel – ERP"Turn Your Business Vision into Reality with “Jewel – ERP"
Turn Your Business Vision into Reality with “Jewel – ERP"Faruk Shah
 
Succesful Product Strategy | Moe Ali | ProductTank Toronto
Succesful Product Strategy | Moe Ali | ProductTank TorontoSuccesful Product Strategy | Moe Ali | ProductTank Toronto
Succesful Product Strategy | Moe Ali | ProductTank TorontoProduct Tank Toronto
 
DIGIT Leader Summit 2017
DIGIT Leader Summit 2017DIGIT Leader Summit 2017
DIGIT Leader Summit 2017Ray Bugg
 

Similar to e-Commerce Testing: The Coming of Age (20)

Business of Mobile Apps
Business of Mobile AppsBusiness of Mobile Apps
Business of Mobile Apps
 
Content Marketing for High Tech
Content Marketing for High TechContent Marketing for High Tech
Content Marketing for High Tech
 
Adam Sharp - Funnel 16-9-2013
Adam Sharp - Funnel 16-9-2013Adam Sharp - Funnel 16-9-2013
Adam Sharp - Funnel 16-9-2013
 
Mango Marketing Tools
Mango Marketing ToolsMango Marketing Tools
Mango Marketing Tools
 
Make Experience Your Business
Make Experience Your BusinessMake Experience Your Business
Make Experience Your Business
 
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
 
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
 
Being a Product Manager for Enterprise Products by Snapchat PM
Being a Product Manager for Enterprise Products by Snapchat PMBeing a Product Manager for Enterprise Products by Snapchat PM
Being a Product Manager for Enterprise Products by Snapchat PM
 
The Role of Technology in the Creative Agency
The Role of Technology in the Creative AgencyThe Role of Technology in the Creative Agency
The Role of Technology in the Creative Agency
 
Aligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Aligning Business Goals & ROI - Sagittarius Travel Marketing MasterclassAligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Aligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
 
The power of Programmatic marketing!
The power of Programmatic marketing! The power of Programmatic marketing!
The power of Programmatic marketing!
 
Pitstop brochure slideshare-1
Pitstop brochure slideshare-1Pitstop brochure slideshare-1
Pitstop brochure slideshare-1
 
Marketing de Buscadores
Marketing de BuscadoresMarketing de Buscadores
Marketing de Buscadores
 
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
 
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To MakeHow To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
 
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. SolomonMastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
 
Get social: How to create a social content strategy to change perceptions
Get social: How to create a social content strategy to change perceptionsGet social: How to create a social content strategy to change perceptions
Get social: How to create a social content strategy to change perceptions
 
Turn Your Business Vision into Reality with “Jewel – ERP"
Turn Your Business Vision into Reality with “Jewel – ERP"Turn Your Business Vision into Reality with “Jewel – ERP"
Turn Your Business Vision into Reality with “Jewel – ERP"
 
Succesful Product Strategy | Moe Ali | ProductTank Toronto
Succesful Product Strategy | Moe Ali | ProductTank TorontoSuccesful Product Strategy | Moe Ali | ProductTank Toronto
Succesful Product Strategy | Moe Ali | ProductTank Toronto
 
DIGIT Leader Summit 2017
DIGIT Leader Summit 2017DIGIT Leader Summit 2017
DIGIT Leader Summit 2017
 

Recently uploaded

DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Visualising and forecasting stocks using Dash
Visualising and forecasting stocks using DashVisualising and forecasting stocks using Dash
Visualising and forecasting stocks using Dashnarutouzumaki53779
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 

Recently uploaded (20)

DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Visualising and forecasting stocks using Dash
Visualising and forecasting stocks using DashVisualising and forecasting stocks using Dash
Visualising and forecasting stocks using Dash
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 

e-Commerce Testing: The Coming of Age

  • 1. © 2013 Forrester Research, Inc. Reproduction Prohibited 1
  • 2. the world of e-Commerce testing and personalization is changing Zee Aganovic, Ph.D. Founder & CEO, HiConversion
  • 3. 2000 2014 Site Analytics PersonalizationA/B Split and Multivariate Testing Sustainablevalue EVOLUTION OF e-COMMERCE OPTIMIZATION 2006 2009 e-Commerce Revenue Performance Management
  • 4. eRPM is a disruptive technology framework for sustainable online revenue growth ! ! eRPM! EVERYTHING! INTERACTS! WITH! EVERYTHING multi- everything E-COMMERCE! TECHNOLOGY IS! VERY COMPLEX ! virtualization (no IT needed) CUSTOMER! PREFERENCES! ARE ALWAYS! CHANGING real-time
  • 5. e-commerce technology is very complex OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
  • 6. traditional optimization requires IT resources 1.  Custom tagging of pages 2.  Custom scripting of optimization variables 3.  Implementing your optimization results
  • 7. solution. virtualization US PATENTS: 7779161 and 8499237 <HEAD> HICONVERSION HEAD TAG </HEAD> <BODY> HICONVERSION BODY TAG </BODY>
  • 8. US PATENTS 7779161 and 8499237 solution. virtualization STEP 1: Select an element to add to the campaign.
  • 9. solution. virtualization US PATENTS 7779161 and 8499237 STEP 2: Click on ‘move’ to relocate the element.
  • 10. solution. virtualization STEP 3: View the new variable you just created.
  • 11. everything interacts with everything else OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
  • 12. optimization requirements are escalating; finding what works is getting more difficult MULTI-DEVICE MULTI-PAGE MULTI-VARIATE MULTI-SEGMENT
  • 13. combining A/B test results doesn’t work.
  • 14. full-funnel, multi-segment, multi-variate, multi-targeting, and more solution. multi-everything optimization $$$ SINGLE CAMPAIGN. END-TO-END RESULTS.
  • 15. customer preferences are constantly changing OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
  • 16. case study. free shipping experiment
  • 17. week one. strong performance with $50 min.
  • 18. week two. can significant results change?
  • 19. e-Commerce surprise: the magnitude of visitor time varying behavior
  • 20. figure 1. REVENUE PER VISITOR (RPV) OVER TIME – ONE PAGE visitors reactions to the same experience can fluctuate significantly over time. POINT 1 RPV = $1.82 POINT 2 RPV = $4.09
  • 21. solution. real time optimization VERSION A VERSION B 15%88% figure 2. CAMPAIGN VS. BASELINE RPV PERFORMANCE 85%12% $95.00$95.00 US PATENT 8321359
  • 23. ready, set, launch operating in a world of Kristopher Jean e-Commerce Content Manager, L’Orèal USA multi-everything
  • 25. each of these tenets can fit together under the umbrella of one multi-everything optimization strategy … but how are these moving parts orchestrated to work seamlessly?
  • 26. GETTING STARTED WITH ERPM build your very own optimization roadmap. four key aspects of any roadmap: 1.  Brainstorming ideas 2.  Setting expectations 3.  Aligning tactical resources 4.  Managing expectations
  • 27. part 1. brainstorming ideas Get the scoop on anti-aging and find the routine right for your skin concern Learn More PERSONALIZATION A: ANTI-AGING
  • 28. part 1. brainstorming ideas Get the scoop on anti-aging and find the routine right for your skin concern Learn MoreThe Ultimate Man 3-step routine: Cleanse, Shave, and Moisturize! Learn More PERSONALIZATION B: MALE
  • 29. part 2. setting expectations what do we want to accomplish and how does this campaign look? A PERSONALIZATION PERSONALIZATION B SEGMENT: SEO SEGMENT: PES SEGMENT: SEO SEGMENT: PES •  ANTI-AGING KEYWORDS •  5-PAGE FUNNEL •  5 BANNERS •  6 POSSIBLE PES SCORES •  5-PAGE FUNNEL •  5 BANNERS •  3 POSSIBLE PES SCORES •  5-PAGE FUNNEL •  2 BANNERS •  MALE KEYWORDS •  5-PAGE FUNNEL •  2 BANNERS ANTI-AGING MALE
  • 30. part 2. setting expectations what do we want to accomplish and how does this campaign look?
  • 31. part 3. aligning resources what tactical resources are necessary to get this strategy off the ground? DEVELOPMENT RESOURCES
  • 32. part 4. managing expectations PRELIMINARY NET RESULTS – CAMPAIGN-WIDE +59.76% RPV, +127% CONVERSION RATE The Ultimate Man 3-step routine: Cleanse, Shave, and Moisturize! Learn More MALE RPV CONVERSION RATE AOV +3.86% +2.08% +1.74% TOP PERFORMER +230.77% RPV, +148% CONVERSION RATE ANTI AGE TOP PERFORMER Repair and replenish skin overnight with the Midnight Recovery Concentrate collection Learn More
  • 33. The ABC’s of eRPM Just e-mail Maeve at: info@hiconversion.com FREE ECOMMERCE GUIDE