If you like this presentation – show it...
THE WHAT, WHY & HOW OF WEB ANALYTICS TESTING Anand Bagmar Test Practice Lead, Software Quality Evangelist
ABOUT ME @BagmarAnand about.me/anand.bagmar
Why do we do Testing?
HOW DO WE VALIDATE?
WHAT IS WEB ANALYTICS?
WHY DO WE NEED WEB ANALYTICS?
WEB ANALYTICS SOLUTIONS AWStats SiteCatalyst Google Analytics WebTrends ….
Testing Web Analytics
TESTING AT THE REPORT LEVEL Pros ¨ Ensure report is setup correctly Cons ¨ Licensing ¨ Reports not yet setup ¨ Validate all requests are sent / captured
Biggest Problem It is TOO LATE!
Web Analytics Testing Challenges
REPEATING OVER-AND-OVER AGAIN
WAAT - Web Analytics Automation Testing
WHAT DOES WAAT DO FOR ME? q Plugs into existing test framework q With minimal changes q Web Analytic tool independent q UI Driver framework independent q Browser independent
WAAT-JAVA q Original ﬂavor q Supports 3 plugins q Omniture Debugger q HttpSniﬀer q JsSniﬀer q Available on github
WAAT-RUBY q Ruby gem implemented over WAAT-Java q Uses RJB – Ruby-Java-Bridge q Supports 2 plugins q HttpSniﬀer q JsSniﬀer q Available on github and rubygems.org
OMNITURE DEBUGGER Pros q OS independent q Run using the regular test-user Cons q Browser dependent – need to implement ScriptRunner for the UI-driver in use q Web-Analytic solution dependent – Adobe Marketing Cloud / Omniture SiteCatalyst
HTTPSNIFFER Pros q Web-analytic solution independent q Browser independent q UI-driver independent Cons rd q 3 party libraries are OS Dependent q HTTPs not supported out-of-the-box q Run tests as ‘root’
Is that all to Web Analytics?
The new “kids” in town IoT & Big Data
Some popular use cases
IOT – INTERNET OF THINGS Opportunity to ¨ Create new value propositions ¨ Be Innovative ¨ Be Creative
IOT – HOW TO DELIVERING VALUE? ¨ Automate the manual processes ¨ Need to optimize and integrate data capabilities ¨ Collect – integrate from various sources ¨ Repeat collection – automate the collection ¨ Analyze – manual & machine learning ¨ Optimize / Pivot ¨ Repeat
IOT – CHALLENGES ¨ Federated devices, ¨ Diﬀerent types of networks ¨ Diﬀerent communication channels ¨ Physical (hardware) & Virtual (software)
IOT – BIGGER CHALLENGES ¨ Too many devices ¨ Lots of data
BIG DATA …. IS GETTING BIGGER ¨ Volumes of data generated ¨ A jet engine generates 1TB of data per ﬂight. ¨ A large reﬁnery generates 1TB of raw data per day. ¨ As cars get smarter, the number of sensors is projected to reach as many as 200 per car. ¨ Sensors of all types will generate immense amounts of data. In fact, analysts estimate that by 2020, 40 percent of all data will come from sensors. ¨ IoT leads to massive volumes of data http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper
IoT is about Data!
TO GET VALUE FROM IOT … ¨ Collect ¨ Analyze ¨ Predict ¨ Plan
What does this mean for Testing?
TESTING OPPORTUNITIES We need to build capabilities to validate – ¨ Data collection is working well ¨ From all sources ¨ Analyzing data, capturing patterns and trends ¨ Optimize business value ¨ Create new opportunities and value propositions
THANK YOU firstname.lastname@example.org Anand.Bagmar@thoughtworks.com @BagmarAnand about.me/anand.bagmar
RESOURCES ¨ https://github.com/anandbagmar/waat ¨ https://github.com/anandbagmar/waat-ruby ¨ http://essenceoftesting.blogspot.in/search/label/waat ¨ http://www.cisco.com/web/solutions/trends/iot/docs/ iot-data-analytics-white-paper ¨ http://www.dezyre.com/article/how-big-data-analysishelped-increase-walmart-s-sales-turnover/109 4