New Siebel features and our enhancements: - Invoking SQL - Passing parameters between test scripts - Simplified editing of recorded scripts - Test automation analytics

1. Siebel Test Automation
Enhancements
by Areon Consulting

2. Agenda
• About Areon Consulting
• About Siebel Test Automation
• Why we enhanced Siebel Test Automation
• Enhancements done:
– Executing SQL Commands from Siebel Test Scripts
– Passing parameters between Siebel Test Scripts
– Simplified editing of recorded Test Scripts
– Test Automation Business Analytics Developed

3. • Founded in 2009 in Kyiv, Ukraine
• Oracle Siebel CRM, Oracle BI, Call
Centers, Dedicated Teams
• Acting globally
• Siebel specialists headcount 150+
• 80+ successful projects
www.areon.ua
www.areondev.com
About Areon Consulting

4. About Siebel Test Automation
• Built-in Siebel Automation Framework
– Record and playback UI flows
– No automation scripting required
– Schedule Automation Batch Runs
• Test Execution Framework
– Simplified set up of automation clients
– Jenkins plug-in to manage distributed and
parallel automation batch runs
• Consolidated Test Results in Siebel
– End to end Test Management
– Manage Test Cases and Test Cycles
– Quality Measurement and Traceability
Organize
Tests
Plan Cycles
Run Tests
Analyze
Results
Capture
Tests
Advantages:
• Built on Siebel, supplied with Siebel with no additional license fees
• Easy to adopt by Siebel People
• Visual tool, no sophisticated Java code

5. Why did we enhance Siebel Test
Automation
• We use it heavily in our Projects for our Customers
• We collected tremendous experience on it
• We had ideas how to improve it to achieve better usability
and performance

6. Executing SQL from Siebel Test Scripts
Problem: Siebel Test Automation itself doesn’t allow to execute SQL procedures at DB Level
Example: Clean-up records after test scripts execution, change statuses etc.
Solution: InvokePerl method
Advantages:
• Now we can execute DB operations from the test scripts;
• Flexible, reusable, can invoke any required SQL code
• Can be extended to execute any scripts (powershell, perl, …)
1. Include line with “InvokePerl” into test script, add perl file name and parameters (dosar Id etc)
2. Perl program that executes SQL from the file and
returns results
3. Text file with SQL Code. Can take parameters passed from the test scripts

7. Passing parameters between Siebel Test Scripts
Problem: Long End-to-end scripts contain too many steps, it’s very hard to edit and manage.
Example: Long business processes that guide users through multiple modules and features (e.g. Loan Origination Flow).
Solution: Split large tests into a number of smaller tests. Pass parameters from script to script using perl (developed, not supported
OOTB)
1.Creating dozar with unique name 3.Get name
2.Save name
4.Result
Advantages:
• Now we can execute long end-to-end chains
of smaller tests.
• It is easier to create, debug, monitor and
check the problems
• Small test scripts are reusable, can me
included into different big test chains and test
suites

8. Simplified editing of recorded Test Scripts
Problem: It’s very difficult to change order of step in recorded test script
Example: I need to insert new step in the middle of recorded test script (for instance, perl command). In
order it start to work properly I have to manually set Test Step Sequence for inserted step and all the next
steps
Solution: Implemented “+1” and “-1” buttons that changes Sequence of current step. Sequences of all
the next stems are changed (recalculated) automatically.

9. Test Automation Analytics: Problem
Problem: Out-of-the box Siebel Test Automation Reporting has very limited capabilities
• Execution Reports are
stored in the file system
as archived attachments
with CSV+XML+ HTML
files inside
• No graphical
Representation
• Able to see results 1-by-1
only, no aggregated
results
• Not possible to analyze
historical data to track
progress and
performance

10. Test Automated Analytics: Solution
Solution:
• Created automated process for extracting information from archives and populating tables in Siebel DB
• Created Siebel Testing Analytical Dashboards
• Created Email Agents for daily reporting delivery
Siebel DB
Advantages:
• Complete Test Automation Analytical Reporting
• Ability to track Historical Data, Progress and Performance
Archives
XML Files
Tables in Siebel DB
Business Intelligence Dashboards and Agents

11. Test Automation Daily Monitoring Dashboard
• Last Run
- Passed/Failed Pie Chart
- Passed/Failed per Functionality
Diagram
- Passed/Failed Scripts Table
• Failed for last 3 Days
- Top 5 failed scripts diagram
- Failed scripts table
• Failed for last 30 Days
- Top 5 failed scripts diagram
- Failed scripts table
• History of bugs appeared
and fixed
• Drill-Down capabilities
For detailed information on
selected record

12. Test Automation Dynamic Analytics
• Passed/Failed scripts daily Diagram
• Passed/Failed scripts daily table
• Last Running script statuses daily table
• Allows to see test scripts that were failed but
fixed on the same day
• Drill-down for test script execution history
• History of bugs appeared and fixed

13. Daily email agents for testers
• Passed/Failed scripts daily
table
• History of bugs appeared
and fixed

14. Daily email agents for managers
• Passed/Failed scripts for last 3 Days
• Common Pie Chart
• Breakdown Pie Charts per Subject Areas
• Detailed Table – Passed/Failed scripts grouped by
subject areas