July 2, 2018

Stop Compromising Quality: Setting Automation Up for Success - Angie Jones, Ministry of Testing - Boston

Missed last Wednesday's Ministry of Testing - Boston Meetup, hosted and sponsored by SmartBear? Where Angie Jones, SDET at Twitter, provides metrics that help her decide what to automated at Twitter?

Have no fear! SmartBear live-streamed the conference. It starts at the 52 minute mark.

Stop Compromising Quality: Setting Automation Up for Success https://youtu.be/WAu1gWmKp5w


Thank you so much Brianne Cordima and Bria Grangard of SmartBear for setting up this event as the Ministry of Testing - Boston's event organizers!


Slides:Which Tests Should We Automate? - Angie Jones




Setup


Let's say you were presented at Twitter with ten features that may need automated tests written. How do you decide what to automate?


  • Add a Tweet
  • View Tweets
  • Pin a Tweet
  • Follow a User
  • Set a Handle / Username
  • Set Location
  • Update Handle
  • Block a User
  • View Analytics of a Tweet
  • Balloons Appear When It's Someone's Birthday

At the Meetup, Angie had us all pick a partner to analyze these features together.

Step One: What is Your Gut Reaction?


Check off which features, in column "G", before you start analyzing the features, which ones may need automated tests written.


Step Two: Measure the Risk


There are two metrics to consider. On a scale of 1 to 5, what value should each metric be?

  • Impact: If broken, what's the impact to customers?
  • Probability: Frequency of use by customers.

Multiply the two values you came up with. Write the value in column "R".


Step Three: Measure the Value

On a scale of 1 to 5, what values would each feature have?

  • Induction to Action: How quickly would this failure be fixed?
  • Distinctness: Does this test provide new info?

Multiply the two values you came up with. Write the value in column "V".


Step Four: Cost Efficiency


On a scale of 1 to 5, what values would each feature have?

  • Simplicity: How easy will it be to script this?
  • Time: How quickly can this be scripted?

Multiply the two values you came up with. Write the value in column "C".



Step Five: History


Let's say the following areas have these many bugs:

  • Setting location: 51
  • Updating handle: 27
  • Pinning Tweet: 2
  • Viewing Tweets: 10
... Wow! Geolocation has so many bugs associated with it!


On a scale of 1 to 5, what values would each feature have?

  • Frequency of Breaks: Volume of historical failures for this test. Geolocation services would definately get a "5" for that. Balloons? It would get a "0" since there are not any bugs associated with it. 
  • Similarity to Weak Areas: Volume of Historical Failures in related areas.

Multiply the two values you came up with. Write the value in column "H". 


Step Six: Tally Up The Scores





Thank you so much, Angie Jones, for running this workshop.

Happy Testing!

-T.J. Maher
Sr. QA Engineer, Software Engineer in Test
Meetup Organizer, Ministry of Testing - Boston

Twitter | YouTubeLinkedIn | Articles

6 comments:

UnknownGuest said...

Whether attending an event or going about daily life, a professionally made thobe allows the wearer to exude quiet sophistication, confidence, and individuality that distinguishes their sense of style from the ordinary.

UnknownGuest said...

The end result is a roof that looks exceptional, performs effectively, and stands strong for decades. They roof replacement checklist canada handle every step, from material selection to clean-up, with precision and care.

UnknownGuest said...

Instead of juggling multiple responsibilities yourself, you benefit from a seamless management experience that property management companies keeps both tenants and owners satisfied. Having a dedicated property management agency gives you the advantage of professionalism and peace of mind.

UnknownGuest said...

Removing a mobile home can be a time-consuming and risky process if attempted without professional assistance. Expert old mobile home tear down removal teams have the necessary equipment, vehicles, and safety gear to carry out the job efficiently.

UnknownGuest said...

The radiant glow of gold and gemstones reflects sophistication, while the cultural essence connects you jewellery brands uae to centuries of craftsmanship. Arabic jewelry’s versatility allows it to be worn casually or for formal occasions, seamlessly enhancing one’s poise and charm.

UnknownGuest said...

A professional agency understands how to blend creativity with technology to enhance brand recognition. Which is better web design or web development? they focus on building a strong digital foundation through tailored campaigns, keyword optimization, and engaging content strategies.