'

What Does it Mean to be a Test Engineer?

Понравилась презентация – покажи это...





Слайд 0

WHAT DOES IT MEAN TO BE A TEST ENGINEER? Andrii Dzynia http://bit.ly/1GYquoR


Слайд 1

MY BACKGROUND • 8 years in software engineering • started as a test engineer in a team of 20 testers • currently working on improving product quality and development productivity at Spotify @adzynia https://www.linkedin.com/in/andriidzynia


Слайд 2

SATURDAY EVENING https://twitter.com/mfloryan/status/655433887015948288


Слайд 3

LET ME SHOW YOU THE PROCESS video: https://www.dropbox.com/s/un7m49kdgeuzsbz/test-sessionandrii.mov?dl=0


Слайд 4

FOUND BUGS


Слайд 5

MY COLLEAGUE, FRONT-END DEVELOPER.


Слайд 6

WHAT DID I LEARN? • Software always has bugs. If you have not found any, does not disprove their existence • Developers do not spend much time looking for edge cases, testers do


Слайд 7

WHAT I WANTED YOU TO LEARN? Testing is not a set of artefacts.


Слайд 8

TESTING IS A PROCESS. @adzynia


Слайд 9

TESTING PROCESS


Слайд 10

GUESS WHAT BUG MARCIN WAS REFERRING TO?


Слайд 11

MORE LESSONS LEARNED • People are different. It is hard to predict every single combination when user can get stuck • Think slower, sometimes


Слайд 12

WHAT MAKES YOU A TEST ENGINEER? Critical thinking Fault models Patterns recognition @adzynia


Слайд 13

CRITICAL THINKING https://www.criticalthinking.org/ctmodel/logic-model1.htm


Слайд 14

FAULT MODELS “From the model, the designer or user can predict the consequences of a particular fault.” - Wikipedia video: https://www.youtube.com/watch?v=rEumMkAhwzA


Слайд 15

PATTERNS RECOGNITION https://www.nasa.gov


Слайд 16

BASED ON EXPERIENCE BRAIN RECOGNISES SEQUENCES WHICH LEADS TO UNDESIRED OUTCOME. NOTE: BE CAREFUL WITH FAULTY ASSUMPTIONS. FACE ON THE MOON SURFACE IS PAREIDOLIA. “Pareidolia is a psychological phenomenon when the mind perceives a familiar pattern of something where none actually exists.” - Wikipedia


Слайд 17

LOOK FOR PATTERNS WITH HIGH FAILURE RISK. video: https://www.youtube.com/watch?v=qoQssWPRNR0


Слайд 18

BRINGING VIDEO TO SPOTIFY USERS http://techcrunch.com/2015/05/20/spotify-introduces-video-clipspodcasts-and-activity-based-playlists/


Слайд 19

TEAM SETUP


Слайд 20

COMMUNICATION CAN BE A PROBLEM http://dilbert.com/strip/1989-05-31


Слайд 21

SOLUTION WAS Create a #slack channel Start asking video integration questions Rise bugs early and facilitate conversations


Слайд 22

DID WE PREDICTED ALL DEFECTS BEFORE TESTING? SURELY, NOT. Data collected by Stefan Rungardt


Слайд 23

BUT HOW DID THAT HELP? Integration ended up to be much easier Testing started earlier # of production issues was low


Слайд 24

WAS THAT EASY? Not really. You have to ask questions people do not want to hear http://media2.giphy.com/media/wrTHBbla7suPu/giphy.gif


Слайд 25

Tester: Shall video be playing when I lock a screen? Programmer: I do not know. Tester: who can know? Programmer: Product manager? Product manager: I do not know. Tester: who can know? Product manager: let’s take a look how Youtube does it. After a while we figured why video has to be paused when you lock a screen. Licensing constraints.


Слайд 26

DEFECT PREVENTION VS DEFECT DETECTION “Bugs are so 90s”


Слайд 27

LEAN MANUFACTURING https://en.wikipedia.org/wiki/Lean_manufacturing


Слайд 28

KEEP YOU WORK ENVIRONMENT IN A GOOD SHAPE • engineering quality • product quality • strive for improvements


Слайд 29

ENGINEERING QUALITY • Start testing as early as possible • Build safety nets • Fix bugs as fast as they occur • Conduct root-cause analysis and take actions http://www.slideshare.net/AndrewDzynia/quality-built-in


Слайд 30

PRODUCT QUALITY • Product success metrics Time to first video frame Number of users streaming video content Average viewing time, etc. • Number of production defects


Слайд 31

SPOTIFY TEST CERTIFIED MODEL Inspired by Google https://mike-bland.com/2011/10/18/test-certified.html


Слайд 32

TAKE AWAYS • Testing is a process, not a set of artefacts • Cost of defect can be lowered. Think about that • Find ways to influence quality on organization level. It is hard, but possible, even for a test engineer


Слайд 33

THANK YOU! @adzynia andrii@adzynia.com


Слайд 34


×

HTML:





Ссылка: