Impetus webcast ‘Performance Testing of Large-scale Systems’ available at http://lf1.me/UL/

1. Impetus Technologies Inc.
1 © 2014 Impetus Technologies
Performance Testing of
Large-scale Systems
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

2. Outline
• Large-scale Systems - Key Drivers
• Performance Testing of Large Systems
• Major challenges & their solutions
• Real-world examples
• Best practices
2 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

3. Large-scale Systems
3 © 2014 Impetus Technologies

4. Key Drivers
• Internet
• Social Media
• Smartphones & Tablets
• Data explosion and analytics
• Information availability
• Big Data
• Cloud computing
4 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

5. Characteristics
• High concurrency
• High transactional
• Geographically distributed
• High availability
• Large data analytics
5 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

6. Performance Testing of Large-scale
6 © 2014 Impetus Technologies
Systems

7. Key Challenges Large Investment
• Test environment - Hardware cost, infrastructure,
maintenance
• License costs - Tools and utilities
• Dedicated teams
7 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

8. How to Save Large Investment
Effective Test Environment setup
• Use Production/ Staging/ Scaled-down environments
• Leveraging Cloud-based setup
• Opting for open source tools
• Automation
8 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

9. Key Challenge Penetrating the System
Complexity
• Nodes behind load balancers
• Look-up servers
• Database clusters
• Internode connectivity
• Testing for high availability
9 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

10. How to Penetrate the System Complexity
• Greater insights - System & business
• Understanding load balancer, queues, CDN
• Identifying failover
• Third party interactions
• Perform Black Dye test
10 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

11. Key Challenge Simulate Realistic Workload
• Identifying usage patterns - End-user, components
• Creating workload models
• Simulating third party interactions
11 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

12. How to Simulate Realistic Workload
• Identifying usage patterns
• Components - Black Dye Test
• Automated/Manual log analysis
• End User - Market study, Historic data
• Workload designing
• Stubs for third party components
12 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

13. Key Challenge Test Data Creation
• Populating realistic data
• Volume
• Nature
13 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

14. How to Create Test Data
• Using masked Production DB
• Altering DB volumes
• Leveraging automatic data loaders
• Using historic data
14 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

15. Key Challenge Configuration Consistency
• Tracking multiple systems
• Maintaining uniformity
15 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

16. How to Ensure consistent Configuration
• Automate
• Functional Sanity
• Configuration validation
16 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

17. Key Challenge Tool Section
• Load generation
• Monitoring
• Diagnostics
17 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

18. How to Select the Right Tools
• Cloud-based tools for larger volume
• Automated diagnostic tools – Layer-wise breakdown,
profiling
• Infrastructure monitoring - Integrated resource monitoring,
vendor reports
18 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

19. Key Challenge Result Collation & Analysis
• Multiple Sources
• Interprétation
• Automation
• Stratégie
19 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

20. How to Collect & Analyze Results
• Dashboards
• Automated
• Results Collection
• Results Collation
• Analytical tools
20 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

21. Real World Example
21 © 2014 Impetus Technologies

22. Case Study Digital Mail Processing
• The Client
Market-leader in digital mail box services
• Key Challenges
Automated test environment creation
Benchmark application with 25k users
Continuous performance management
22 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

23. Case Study Digital Mail Processing
• “Open Source” solution
Puppet APIs to instantiate Test Environment
Cassandra to populate Test DB
JMeter to test web services
Load generated via Cloud
Integrated servers monitoring
Continuous integration with Maven
23 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

24. Case Study Digital Mail Processing
• Benefits
Automatic environment creation
Significant cost saving
Automatic resource monitoring
24 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

25. Case Study Credit Rating & Portfolio
Management
• The Client
Leading credit rating company
• Key Challenges
Test Environment
Automatic set-up - Test data, generate distributed load, monitoring
scripts
25 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

26. Case Study…Credit Rating & Portfolio
Management
Our Solution
• Usage of Staging Environment
• Masked copy of production data
• Leveraging Cloud-based tool
• Create custom utilities
• Use vendor reports
26 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

27. Case Study…Credit Rating & Portfolio
Management
Benefits
• Extensive automation
• Enhanced quality of end product
• Faster time to market
27 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

28. Our Recommendations
28 © 2014 Impetus Technologies

29. Best Practices
• Integrated on-premise and cloud based approach
• Start early in the development cycle
• Continuous Performance Management
• Simulate end-user experience
• Automation
29 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

30. SandStorm Our Enterprise Performance
Testing Tool
• Supports web, mobile and cloud applications
• Reduces performance testing costs by up to 60%
30 © 2014 Impetus Technologies
Download Evaluation Version
sandstorm.impetus.com
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

31. 31 © 2014 Impetus Technologies
About Impetus

32. • Strategic partners for software product engineering and
R&D
• Thought leaders in cutting-edge technologies
• Mature processes and practices that are methodical, yet
flexible
• Diverse domain expertise
32 © 2014 Impetus Technologies
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62

33. 33 © 2014 Impetus Technologies
Q & A

34. 34 © 2014 Impetus Technologies
Thank You
Write to us at inquiry@impetus.com
Follow us on Twitter @impetustech
Recorded version available at
http://www.impetus.com/webinar_registration?event=archived&eid=62