SlideShare a Scribd company logo
1 of 33
by RevelOps
Logs as Data:
Using Logs to track Web Application Performance
May 2014
by RevelOps
A Heritage in Advanced Research
• Founders hold PhDs in Distributed Systems
• Former Scientists at the IBM Center for Advanced Studies
• Built Log Management Solution for IBM (RTCE)
Global SaaS Log Management Service
• More than 1,000 customers in over 100 countries, processing over 10B
events daily
• Locations in Boston, Dublin, Prague
• Raised more than $11M in venture funding
Trevor Parsons
Formerly a scientist at IBM's Center for advanced studies with a
PhD in Computer Science.
Andrew Burton
Proven software executive, with over 16 years of experience in
start-ups & enterprise companies.
Brendan Dillon
Experienced software engineering & security executive,
formerly CTO at Adaptive Mobile.
Viliam Holub
Over a decade developing enterprise software, with a PhD in
Computer Science.
Leadership Team
Leigh Merrigan
SaaS marketing, communications and branding executive,
formerly with AppNeta.
President & CEO
Co-founder, Chief Scientist
VP, Engineering
Co-founder, CTO
VP, Marketing
About Logentries
by RevelOps
Developers, IT Operations and Business Analysts from…
Some of Our Customers
by RevelOpsOver 25k Users across 100 Countries
by RevelOpsWhat We Do?
by RevelOpsThe Humble Log
by RevelOpsMaking Log Data Accessible
by RevelOps
Logs As Data
by RevelOpsTop 10 Customer Use Cases
Production Monitoring
Production Troubleshooting
Debugging During Development
Web Application Analytics
Support
Real User Monitoring
Security
Quality Assurance & Testing
Business Analytics
Mobile Application Analytics
All Other Responses
71%
66%
41%
34%
32%
28%
22%
21%
10%
6%
5%
© 2014 Logentries. All Rights Reserved. Confidential.
by RevelOpsBenefits of Logs for Performance Monitoring
MACHINE
GENERATED
LOG DATA
#1: You can’t always instrument the cloud
by RevelOpsBenefits of Logs for Performance Monitoring
#2 Logs Maintain the Evidence
by RevelOpsBenefits of Logs for Performance Monitoring
#2 Logs Maintain the Evidence
by RevelOpsBenefits of Logs for Performance Monitoring
#2 Logs Maintain the Evidence
• Even with ephemeral servers
by RevelOpsBenefits of Logs for Performance Monitoring
#2 Logs Maintain the Evidence
• When you have performance issues on ephemeral servers
by RevelOpsBenefits of Logs for Performance Monitoring
#3 Logs can contain symptoms of failures
by RevelOpsBenefits of Logs for Performance Monitoring
#4 Events, App Performance, Resource Usage
by RevelOpsBenefits of Logs for Performance Monitoring
#5 Top to Bottom and End to End
by RevelOpsA Study across 25k users: Some Common Issues
Community Insights - Strength in Numbers
• Categories:
• Generic patterns across all web logs
• Tomcat specific patterns
• IIS logs i.e. running a ASPX/ASP web app
• Logentries Community Insights: logentries.com/doc/community-insights
by RevelOpsInvestigating Performance Issues w/ Logs
#1 Set Up Real Time Alerts: e.g. Response Time>500ms
by RevelOpsInvestigating Performance Issues w/ Logs
#2 Understand what single user behavior caused the issue
by RevelOpsInvestigating Performance Issues w/ Logs
#2 Understand if group user behavior caused the issue
by RevelOpsInvestigating Performance Issues w/ Logs
#3 What did resource usage look like?
by RevelOpsInvestigating Performance Issues w/ Logs
#4 Was performance effected?
by RevelOpsInvestigating Performance Issues w/ Logs
#4 Was performance effected? (Real User Monitoring)
by RevelOpsInvestigating Performance Issues w/ Logs
#5 What part of the application code caused the issue?
by RevelOpsInvestigating Performance Issues w/ Logs
#5 What part of the application code caused the issue?
(Tracing Transactions)
by RevelOpsWhat part of the app code caused the issue?
• Step 1: Collate your logs
by RevelOpsWhat part of the app code caused the issue?
• Step 2: Refine the log entries
by RevelOps
• Step 3: Narrow the time range
What part of the app code caused the issue?
by RevelOpsWhat part of the app code caused the issue?
• Step 4: View the Transaction
by RevelOpsSummary
Benefits of Logs for Production Monitoring
1. You can’t always instrument the cloud
2. Logs Maintain the Evidence
3. Logs can contain of symptoms of more serious issues
4. Logs combine event data, resource usage, performance metrics
5. Top to Bottom and End to End
Investigating Performance issues w/ Logs
1. Setup Real Time Alerts
2. Understand user behaviour
3. Inspect Resource Usage
4. Was Performance Effected
5. What Code caused the issue
by RevelOpsGive it a Try for Free
• Get started in minutes with the free Logentries service!
• Lots of examples of using Logs to Monitor Application
Performance on our blog: http://blog.logentries.com
• Contact us directly!
• Trevor.parsons@logentries.com
• Support@logentries.com
by RevelOps
May 2014

More Related Content

What's hot

Algosec 5 more_things_you_can_do_with_a_security_policy_management_solution
Algosec 5 more_things_you_can_do_with_a_security_policy_management_solutionAlgosec 5 more_things_you_can_do_with_a_security_policy_management_solution
Algosec 5 more_things_you_can_do_with_a_security_policy_management_solutionMaytal Levi
 
Automating the cip compliance test lab
Automating the cip compliance test labAutomating the cip compliance test lab
Automating the cip compliance test labChuck Reynolds
 
Rockwell Automation TechED 2017 - AP14 - MRWPCA
Rockwell Automation TechED 2017 - AP14 - MRWPCARockwell Automation TechED 2017 - AP14 - MRWPCA
Rockwell Automation TechED 2017 - AP14 - MRWPCARockwell Automation
 
Engineering Operations
Engineering OperationsEngineering Operations
Engineering OperationsCybera Inc.
 
Putting the Sec into DevOps
Putting the Sec into DevOpsPutting the Sec into DevOps
Putting the Sec into DevOpsMaytal Levi
 
Code-to-Cloud Visibility: An Essential Framework for DevOps Success
Code-to-Cloud Visibility: An Essential Framework for DevOps SuccessCode-to-Cloud Visibility: An Essential Framework for DevOps Success
Code-to-Cloud Visibility: An Essential Framework for DevOps SuccessJadeCampbell13
 
2018 07-24 network security at the speed of dev ops - webinar
2018 07-24 network security at the speed of dev ops - webinar2018 07-24 network security at the speed of dev ops - webinar
2018 07-24 network security at the speed of dev ops - webinarAlgoSec
 
Enforce compliance policy with model-driven automation
Enforce compliance policy with model-driven automationEnforce compliance policy with model-driven automation
Enforce compliance policy with model-driven automationPuppet
 
Spirent: The Internet of Things: The Expanded Security Perimeter
Spirent: The Internet of Things:  The Expanded Security Perimeter Spirent: The Internet of Things:  The Expanded Security Perimeter
Spirent: The Internet of Things: The Expanded Security Perimeter Sailaja Tennati
 
Spirent Accelerating SDN and NFV Deployments
Spirent Accelerating SDN and NFV DeploymentsSpirent Accelerating SDN and NFV Deployments
Spirent Accelerating SDN and NFV DeploymentsSailaja Tennati
 
Pushing the DevOps envelope into the network with microservices
Pushing the DevOps envelope into the network with microservicesPushing the DevOps envelope into the network with microservices
Pushing the DevOps envelope into the network with microservicesLori MacVittie
 
Chris Northwood Camp Digital 21015 - Continuous delivery
Chris Northwood Camp Digital 21015 - Continuous deliveryChris Northwood Camp Digital 21015 - Continuous delivery
Chris Northwood Camp Digital 21015 - Continuous deliveryNexer Digital
 
Operationalize all the network things
Operationalize all the network thingsOperationalize all the network things
Operationalize all the network thingsLori MacVittie
 
Flight East 2018 Presentation–Continuous Integration––An Overview
Flight East 2018 Presentation–Continuous Integration––An OverviewFlight East 2018 Presentation–Continuous Integration––An Overview
Flight East 2018 Presentation–Continuous Integration––An OverviewSynopsys Software Integrity Group
 
NI Week 2019 Overview
NI Week 2019 OverviewNI Week 2019 Overview
NI Week 2019 OverviewDMC, Inc.
 
FLIGHT WEST 2018 Presentation - Integrating Security into Your Development an...
FLIGHT WEST 2018 Presentation - Integrating Security into Your Development an...FLIGHT WEST 2018 Presentation - Integrating Security into Your Development an...
FLIGHT WEST 2018 Presentation - Integrating Security into Your Development an...Black Duck by Synopsys
 
Get Your Head In the Clouds: The Use of Cloud Computing in the Practice of Law
Get Your Head In the Clouds: The Use of Cloud Computing in the Practice of Law Get Your Head In the Clouds: The Use of Cloud Computing in the Practice of Law
Get Your Head In the Clouds: The Use of Cloud Computing in the Practice of Law SkyLaw Professional Corporation
 
Fact2009 How To Operationalize Your Strategies
Fact2009 How To Operationalize Your StrategiesFact2009 How To Operationalize Your Strategies
Fact2009 How To Operationalize Your Strategiessyosko
 

What's hot (20)

Algosec 5 more_things_you_can_do_with_a_security_policy_management_solution
Algosec 5 more_things_you_can_do_with_a_security_policy_management_solutionAlgosec 5 more_things_you_can_do_with_a_security_policy_management_solution
Algosec 5 more_things_you_can_do_with_a_security_policy_management_solution
 
Automating the cip compliance test lab
Automating the cip compliance test labAutomating the cip compliance test lab
Automating the cip compliance test lab
 
Rockwell Automation TechED 2017 - AP14 - MRWPCA
Rockwell Automation TechED 2017 - AP14 - MRWPCARockwell Automation TechED 2017 - AP14 - MRWPCA
Rockwell Automation TechED 2017 - AP14 - MRWPCA
 
Engineering Operations
Engineering OperationsEngineering Operations
Engineering Operations
 
Putting the Sec into DevOps
Putting the Sec into DevOpsPutting the Sec into DevOps
Putting the Sec into DevOps
 
Code-to-Cloud Visibility: An Essential Framework for DevOps Success
Code-to-Cloud Visibility: An Essential Framework for DevOps SuccessCode-to-Cloud Visibility: An Essential Framework for DevOps Success
Code-to-Cloud Visibility: An Essential Framework for DevOps Success
 
2018 07-24 network security at the speed of dev ops - webinar
2018 07-24 network security at the speed of dev ops - webinar2018 07-24 network security at the speed of dev ops - webinar
2018 07-24 network security at the speed of dev ops - webinar
 
Enforce compliance policy with model-driven automation
Enforce compliance policy with model-driven automationEnforce compliance policy with model-driven automation
Enforce compliance policy with model-driven automation
 
Spirent: The Internet of Things: The Expanded Security Perimeter
Spirent: The Internet of Things:  The Expanded Security Perimeter Spirent: The Internet of Things:  The Expanded Security Perimeter
Spirent: The Internet of Things: The Expanded Security Perimeter
 
Spirent Accelerating SDN and NFV Deployments
Spirent Accelerating SDN and NFV DeploymentsSpirent Accelerating SDN and NFV Deployments
Spirent Accelerating SDN and NFV Deployments
 
Pushing the DevOps envelope into the network with microservices
Pushing the DevOps envelope into the network with microservicesPushing the DevOps envelope into the network with microservices
Pushing the DevOps envelope into the network with microservices
 
Chris Northwood Camp Digital 21015 - Continuous delivery
Chris Northwood Camp Digital 21015 - Continuous deliveryChris Northwood Camp Digital 21015 - Continuous delivery
Chris Northwood Camp Digital 21015 - Continuous delivery
 
Operationalize all the network things
Operationalize all the network thingsOperationalize all the network things
Operationalize all the network things
 
Flight East 2018 Presentation–Continuous Integration––An Overview
Flight East 2018 Presentation–Continuous Integration––An OverviewFlight East 2018 Presentation–Continuous Integration––An Overview
Flight East 2018 Presentation–Continuous Integration––An Overview
 
NI Week 2019 Overview
NI Week 2019 OverviewNI Week 2019 Overview
NI Week 2019 Overview
 
FLIGHT WEST 2018 Presentation - Integrating Security into Your Development an...
FLIGHT WEST 2018 Presentation - Integrating Security into Your Development an...FLIGHT WEST 2018 Presentation - Integrating Security into Your Development an...
FLIGHT WEST 2018 Presentation - Integrating Security into Your Development an...
 
Welding monitoring adriano engineering
Welding monitoring adriano engineeringWelding monitoring adriano engineering
Welding monitoring adriano engineering
 
Real time Welding monitoring
Real time Welding monitoringReal time Welding monitoring
Real time Welding monitoring
 
Get Your Head In the Clouds: The Use of Cloud Computing in the Practice of Law
Get Your Head In the Clouds: The Use of Cloud Computing in the Practice of Law Get Your Head In the Clouds: The Use of Cloud Computing in the Practice of Law
Get Your Head In the Clouds: The Use of Cloud Computing in the Practice of Law
 
Fact2009 How To Operationalize Your Strategies
Fact2009 How To Operationalize Your StrategiesFact2009 How To Operationalize Your Strategies
Fact2009 How To Operationalize Your Strategies
 

Similar to Logs as Data: Using Logs to track Web Application Performance

Correlate Log Data with Business Metrics Like a Jedi
Correlate Log Data with Business Metrics Like a JediCorrelate Log Data with Business Metrics Like a Jedi
Correlate Log Data with Business Metrics Like a JediTrevor Parsons
 
Continuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile DevelopmentContinuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile DevelopmentDynatrace
 
Five Ways to Fix Your SQL Server Dev-Test Problems
Five Ways to Fix Your SQL Server Dev-Test Problems Five Ways to Fix Your SQL Server Dev-Test Problems
Five Ways to Fix Your SQL Server Dev-Test Problems Catalogic Software
 
Why Monitoring and Logging are Important in DevOps.pdf
Why Monitoring and Logging are Important in DevOps.pdfWhy Monitoring and Logging are Important in DevOps.pdf
Why Monitoring and Logging are Important in DevOps.pdfDatacademy.ai
 
How to Migrate Applications Off a Mainframe
How to Migrate Applications Off a MainframeHow to Migrate Applications Off a Mainframe
How to Migrate Applications Off a MainframeVMware Tanzu
 
Accelerate User Driven Innovation [Webinar]
Accelerate User Driven Innovation [Webinar]Accelerate User Driven Innovation [Webinar]
Accelerate User Driven Innovation [Webinar]Dynatrace
 
DevOps Engineering.pptx
DevOps Engineering.pptxDevOps Engineering.pptx
DevOps Engineering.pptxAbalBoot
 
How to Ensure High-Performing Microsoft .NET Applications
How to Ensure High-Performing Microsoft .NET ApplicationsHow to Ensure High-Performing Microsoft .NET Applications
How to Ensure High-Performing Microsoft .NET ApplicationseG Innovations
 
It's What's Inside that Counts!
It's What's Inside that Counts!It's What's Inside that Counts!
It's What's Inside that Counts!New Relic
 
DCEU 18: 5 Patterns for Success in Application Transformation
DCEU 18: 5 Patterns for Success in Application TransformationDCEU 18: 5 Patterns for Success in Application Transformation
DCEU 18: 5 Patterns for Success in Application TransformationDocker, Inc.
 
ReflectInsight - Let your application speak volume
ReflectInsight - Let your application speak volumeReflectInsight - Let your application speak volume
ReflectInsight - Let your application speak volumeCallon Campbell
 
Do DevOps Right with New Relic
Do DevOps Right with New RelicDo DevOps Right with New Relic
Do DevOps Right with New RelicNew Relic
 
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things BetterTaking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things BetterMatt Tesauro
 
Taking AppSec to 11 - BSides Austin 2016
Taking AppSec to 11 - BSides Austin 2016Taking AppSec to 11 - BSides Austin 2016
Taking AppSec to 11 - BSides Austin 2016Matt Tesauro
 
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Compuware DevOps presentation
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Compuware DevOps presentationNRB - LUXEMBOURG MAINFRAME DAY 2017 - Compuware DevOps presentation
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Compuware DevOps presentationNRB
 
NRB - BE MAINFRAME DAY 2017 - Compuware Dev Ops
NRB - BE MAINFRAME DAY 2017 - Compuware Dev OpsNRB - BE MAINFRAME DAY 2017 - Compuware Dev Ops
NRB - BE MAINFRAME DAY 2017 - Compuware Dev OpsNRB
 
Delivering Better Software Faster (Without Breaking Everything)
Delivering Better Software Faster (Without Breaking Everything)Delivering Better Software Faster (Without Breaking Everything)
Delivering Better Software Faster (Without Breaking Everything)XebiaLabs
 
Innovate Better Through Machine data Analytics
Innovate Better Through Machine data AnalyticsInnovate Better Through Machine data Analytics
Innovate Better Through Machine data AnalyticsHal Rottenberg
 

Similar to Logs as Data: Using Logs to track Web Application Performance (20)

Correlate Log Data with Business Metrics Like a Jedi
Correlate Log Data with Business Metrics Like a JediCorrelate Log Data with Business Metrics Like a Jedi
Correlate Log Data with Business Metrics Like a Jedi
 
Continuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile DevelopmentContinuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile Development
 
Nandini-CV
Nandini-CVNandini-CV
Nandini-CV
 
Five Ways to Fix Your SQL Server Dev-Test Problems
Five Ways to Fix Your SQL Server Dev-Test Problems Five Ways to Fix Your SQL Server Dev-Test Problems
Five Ways to Fix Your SQL Server Dev-Test Problems
 
Why Monitoring and Logging are Important in DevOps.pdf
Why Monitoring and Logging are Important in DevOps.pdfWhy Monitoring and Logging are Important in DevOps.pdf
Why Monitoring and Logging are Important in DevOps.pdf
 
How to Migrate Applications Off a Mainframe
How to Migrate Applications Off a MainframeHow to Migrate Applications Off a Mainframe
How to Migrate Applications Off a Mainframe
 
Accelerate User Driven Innovation [Webinar]
Accelerate User Driven Innovation [Webinar]Accelerate User Driven Innovation [Webinar]
Accelerate User Driven Innovation [Webinar]
 
DevOps Engineering.pptx
DevOps Engineering.pptxDevOps Engineering.pptx
DevOps Engineering.pptx
 
Musharraf_Syed_Resume
Musharraf_Syed_ResumeMusharraf_Syed_Resume
Musharraf_Syed_Resume
 
How to Ensure High-Performing Microsoft .NET Applications
How to Ensure High-Performing Microsoft .NET ApplicationsHow to Ensure High-Performing Microsoft .NET Applications
How to Ensure High-Performing Microsoft .NET Applications
 
It's What's Inside that Counts!
It's What's Inside that Counts!It's What's Inside that Counts!
It's What's Inside that Counts!
 
DCEU 18: 5 Patterns for Success in Application Transformation
DCEU 18: 5 Patterns for Success in Application TransformationDCEU 18: 5 Patterns for Success in Application Transformation
DCEU 18: 5 Patterns for Success in Application Transformation
 
ReflectInsight - Let your application speak volume
ReflectInsight - Let your application speak volumeReflectInsight - Let your application speak volume
ReflectInsight - Let your application speak volume
 
Do DevOps Right with New Relic
Do DevOps Right with New RelicDo DevOps Right with New Relic
Do DevOps Right with New Relic
 
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things BetterTaking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
 
Taking AppSec to 11 - BSides Austin 2016
Taking AppSec to 11 - BSides Austin 2016Taking AppSec to 11 - BSides Austin 2016
Taking AppSec to 11 - BSides Austin 2016
 
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Compuware DevOps presentation
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Compuware DevOps presentationNRB - LUXEMBOURG MAINFRAME DAY 2017 - Compuware DevOps presentation
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Compuware DevOps presentation
 
NRB - BE MAINFRAME DAY 2017 - Compuware Dev Ops
NRB - BE MAINFRAME DAY 2017 - Compuware Dev OpsNRB - BE MAINFRAME DAY 2017 - Compuware Dev Ops
NRB - BE MAINFRAME DAY 2017 - Compuware Dev Ops
 
Delivering Better Software Faster (Without Breaking Everything)
Delivering Better Software Faster (Without Breaking Everything)Delivering Better Software Faster (Without Breaking Everything)
Delivering Better Software Faster (Without Breaking Everything)
 
Innovate Better Through Machine data Analytics
Innovate Better Through Machine data AnalyticsInnovate Better Through Machine data Analytics
Innovate Better Through Machine data Analytics
 

Recently uploaded

Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 

Logs as Data: Using Logs to track Web Application Performance

  • 1. by RevelOps Logs as Data: Using Logs to track Web Application Performance May 2014
  • 2. by RevelOps A Heritage in Advanced Research • Founders hold PhDs in Distributed Systems • Former Scientists at the IBM Center for Advanced Studies • Built Log Management Solution for IBM (RTCE) Global SaaS Log Management Service • More than 1,000 customers in over 100 countries, processing over 10B events daily • Locations in Boston, Dublin, Prague • Raised more than $11M in venture funding Trevor Parsons Formerly a scientist at IBM's Center for advanced studies with a PhD in Computer Science. Andrew Burton Proven software executive, with over 16 years of experience in start-ups & enterprise companies. Brendan Dillon Experienced software engineering & security executive, formerly CTO at Adaptive Mobile. Viliam Holub Over a decade developing enterprise software, with a PhD in Computer Science. Leadership Team Leigh Merrigan SaaS marketing, communications and branding executive, formerly with AppNeta. President & CEO Co-founder, Chief Scientist VP, Engineering Co-founder, CTO VP, Marketing About Logentries
  • 3. by RevelOps Developers, IT Operations and Business Analysts from… Some of Our Customers
  • 4. by RevelOpsOver 25k Users across 100 Countries
  • 7. by RevelOpsMaking Log Data Accessible
  • 9. by RevelOpsTop 10 Customer Use Cases Production Monitoring Production Troubleshooting Debugging During Development Web Application Analytics Support Real User Monitoring Security Quality Assurance & Testing Business Analytics Mobile Application Analytics All Other Responses 71% 66% 41% 34% 32% 28% 22% 21% 10% 6% 5% © 2014 Logentries. All Rights Reserved. Confidential.
  • 10. by RevelOpsBenefits of Logs for Performance Monitoring MACHINE GENERATED LOG DATA #1: You can’t always instrument the cloud
  • 11. by RevelOpsBenefits of Logs for Performance Monitoring #2 Logs Maintain the Evidence
  • 12. by RevelOpsBenefits of Logs for Performance Monitoring #2 Logs Maintain the Evidence
  • 13. by RevelOpsBenefits of Logs for Performance Monitoring #2 Logs Maintain the Evidence • Even with ephemeral servers
  • 14. by RevelOpsBenefits of Logs for Performance Monitoring #2 Logs Maintain the Evidence • When you have performance issues on ephemeral servers
  • 15. by RevelOpsBenefits of Logs for Performance Monitoring #3 Logs can contain symptoms of failures
  • 16. by RevelOpsBenefits of Logs for Performance Monitoring #4 Events, App Performance, Resource Usage
  • 17. by RevelOpsBenefits of Logs for Performance Monitoring #5 Top to Bottom and End to End
  • 18. by RevelOpsA Study across 25k users: Some Common Issues Community Insights - Strength in Numbers • Categories: • Generic patterns across all web logs • Tomcat specific patterns • IIS logs i.e. running a ASPX/ASP web app • Logentries Community Insights: logentries.com/doc/community-insights
  • 19. by RevelOpsInvestigating Performance Issues w/ Logs #1 Set Up Real Time Alerts: e.g. Response Time>500ms
  • 20. by RevelOpsInvestigating Performance Issues w/ Logs #2 Understand what single user behavior caused the issue
  • 21. by RevelOpsInvestigating Performance Issues w/ Logs #2 Understand if group user behavior caused the issue
  • 22. by RevelOpsInvestigating Performance Issues w/ Logs #3 What did resource usage look like?
  • 23. by RevelOpsInvestigating Performance Issues w/ Logs #4 Was performance effected?
  • 24. by RevelOpsInvestigating Performance Issues w/ Logs #4 Was performance effected? (Real User Monitoring)
  • 25. by RevelOpsInvestigating Performance Issues w/ Logs #5 What part of the application code caused the issue?
  • 26. by RevelOpsInvestigating Performance Issues w/ Logs #5 What part of the application code caused the issue? (Tracing Transactions)
  • 27. by RevelOpsWhat part of the app code caused the issue? • Step 1: Collate your logs
  • 28. by RevelOpsWhat part of the app code caused the issue? • Step 2: Refine the log entries
  • 29. by RevelOps • Step 3: Narrow the time range What part of the app code caused the issue?
  • 30. by RevelOpsWhat part of the app code caused the issue? • Step 4: View the Transaction
  • 31. by RevelOpsSummary Benefits of Logs for Production Monitoring 1. You can’t always instrument the cloud 2. Logs Maintain the Evidence 3. Logs can contain of symptoms of more serious issues 4. Logs combine event data, resource usage, performance metrics 5. Top to Bottom and End to End Investigating Performance issues w/ Logs 1. Setup Real Time Alerts 2. Understand user behaviour 3. Inspect Resource Usage 4. Was Performance Effected 5. What Code caused the issue
  • 32. by RevelOpsGive it a Try for Free • Get started in minutes with the free Logentries service! • Lots of examples of using Logs to Monitor Application Performance on our blog: http://blog.logentries.com • Contact us directly! • Trevor.parsons@logentries.com • Support@logentries.com