The What, Why and How of Web Analytics Testing (Web, IoT, Big Data)

If you like this presentation – show it...

Slide 0

THE WHAT, WHY & HOW OF WEB ANALYTICS TESTING Anand Bagmar Test Practice Lead, Software Quality Evangelist

Slide 1

ABOUT ME @BagmarAnand about.me/anand.bagmar

Slide 2

Why do we do Testing?

Slide 3

Slide 4


Slide 5

Web Analytics

Slide 6


Slide 7

Slide 8


Slide 9

WEB ANALYTICS SOLUTIONS AWStats SiteCatalyst Google Analytics WebTrends ….

Slide 10

Testing Web Analytics

Slide 11

Slide 12

Slide 13

Slide 14

TESTING AT THE REPORT LEVEL Pros ¨  Ensure report is setup correctly Cons ¨ Licensing ¨ Reports not yet setup ¨ Validate all requests are sent / captured

Slide 15

Biggest Problem It is TOO LATE!

Slide 16

The Solution

Slide 17

Slide 18

Slide 19

Slide 20

Web Analytics Testing Challenges

Slide 21


Slide 22


Slide 23

Slide 24

WAAT - Web Analytics Automation Testing

Slide 25

WHAT DOES WAAT DO FOR ME? q  Plugs into existing test framework q  With minimal changes q  Web Analytic tool independent q  UI Driver framework independent q  Browser independent

Slide 26


Slide 27


Slide 28

WAAT-JAVA q  Original flavor q  Supports 3 plugins q  Omniture Debugger q  HttpSniffer q  JsSniffer q  Available on github

Slide 29

WAAT-RUBY q  Ruby gem implemented over WAAT-Java q  Uses RJB – Ruby-Java-Bridge q  Supports 2 plugins q  HttpSniffer q  JsSniffer q  Available on github and rubygems.org

Slide 30


Slide 31

OMNITURE DEBUGGER Pros q  OS independent q  Run using the regular test-user Cons q  Browser dependent – need to implement ScriptRunner for the UI-driver in use q  Web-Analytic solution dependent – Adobe Marketing Cloud / Omniture SiteCatalyst

Slide 32

HTTPSNIFFER Pros q  Web-analytic solution independent q  Browser independent q  UI-driver independent Cons rd q  3 party libraries are OS Dependent q  HTTPs not supported out-of-the-box q  Run tests as ‘root’

Slide 33

JSSNIFFER Pros q  Web-analytic solution independent q  Browser independent q  HTTPs supported out-of-the-box rd q  No dependency on any 3 party library Cons q  Need to write JavaScript to get the URL from the browser q  UI-driver dependent

Slide 34

Is that all to Web Analytics?

Slide 35

The new “kids” in town IoT & Big Data

Slide 36

Some popular use cases

Slide 37

IOT – INTERNET OF THINGS Opportunity to ¨  Create new value propositions ¨  Be Innovative ¨  Be Creative

Slide 38

IOT – HOW TO DELIVERING VALUE? ¨  Automate the manual processes ¨  Need to optimize and integrate data capabilities ¨  Collect – integrate from various sources ¨  Repeat collection – automate the collection ¨  Analyze – manual & machine learning ¨  Optimize / Pivot ¨  Repeat

Slide 39

IOT – CHALLENGES ¨  Federated devices, ¨  Different types of networks ¨  Different communication channels ¨  Physical (hardware) & Virtual (software)

Slide 40

IOT – BIGGER CHALLENGES ¨  Too many devices ¨  Lots of data

Slide 41

BIG DATA …. IS GETTING BIGGER ¨  Volumes of data generated ¨  A jet engine generates 1TB of data per flight. ¨  A large refinery generates 1TB of raw data per day. ¨  As cars get smarter, the number of sensors is projected to reach as many as 200 per car. ¨  Sensors of all types will generate immense amounts of data. In fact, analysts estimate that by 2020, 40 percent of all data will come from sensors. ¨  IoT leads to massive volumes of data http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper

Slide 42

IoT is about Data!

Slide 43

TO GET VALUE FROM IOT … ¨  Collect ¨  Analyze ¨  Predict ¨  Plan

Slide 44

What does this mean for Testing?

Slide 45

TESTING OPPORTUNITIES We need to build capabilities to validate – ¨  Data collection is working well ¨  From all sources ¨  Analyzing data, capturing patterns and trends ¨  Optimize business value ¨  Create new opportunities and value propositions

Slide 46

THANK YOU abagmar@gmail.com Anand.Bagmar@thoughtworks.com @BagmarAnand about.me/anand.bagmar

Slide 47

RESOURCES ¨  https://github.com/anandbagmar/waat ¨  https://github.com/anandbagmar/waat-ruby ¨  http://essenceoftesting.blogspot.in/search/label/waat ¨  http://www.cisco.com/web/solutions/trends/iot/docs/ iot-data-analytics-white-paper ¨  http://www.dezyre.com/article/how-big-data-analysishelped-increase-walmart-s-sales-turnover/109 4

Slide 48