February 1, 2015

Shifts in Software Testing

You might not have recognized this if you have worked at the same job for the past couple of years, but the software testing industry has shifted. There is less demand for traditional QA Engineers. You may know the entire software development process, both Waterfall and Agile. You may be very skilled at working with business analysts examining the business requirements to make sure they are clear and concise. You may be quite good at coming up with great testing scenarios. But there are many new standards, practices and technologies that future employers are going to need from you, most which were unheard of just two or three years ago.

Let me tell you, I've been finding all of this out the hard way! I started casually examining the state of the software testing industry six months ago. This casual research became a mad scramble when I found myself on the wrong side of a layoff at the company I had been at for over four years. With the countless numbers of phone screenings and two or three face-to-face interviews a week I have had since early December, it is like I have enrolled in a crash course about the state of the software industry.

I have observed that there are three things that have converged in the past few years to completely change software testing as we know it:

Sources of Change in the Software Testing Industry: 

1) Agile has officially become the new standard 

The good news is that with the Agile Software Methodology the Software Quality Assurance team is now fully integrated into the entire software development process. [Read more about it here]

The bad news is that the DEV and QA team only has two weeks at a time to build, unit test, do code reviews, and create and execute test scripts.

The worse news is that because of the short time frame, all the regression testing you need to do just before the release of the software product to make sure that the old functionality still works while you were building in new features into the software product ... well, the time also has been rapidly condensed. The only way to keep up with the pace is to automate all the regression tests. Which means that as a QA Engineer, you are now expected to code. Fluently.

2) Automated testing tools are now cheap or free 

Companies in the past that wished to introduce  automated testing into their quality assurance department had to purchase expensive software packages such as Rational Rose, the Mercury Toolset or Segue Software's Silk Test. This would involve enrolling the entire QA team in expensive courses and training to get them up to speed. Now, with the introduction of free tools such as Selenium, companies can focus on either getting their old QA team up to speed or hiring a new QA team with the desired skillsets.

Selenium went from the Selenium IDE, a cute little Firefox plugin offered for free in 2006, to Selenium WebDriver, a heavy duty code library backed by Google in 2011. Selenium WebDriver can work with Java, Python, Ruby, or C# to interact directly with any web application through the Firefox, Chrome, or Internet Explorer browser and it is all offered for free. With libraries such as the Appium or Selendroid libraries, you can even write Selenium automated tests on the iPhone, iPad, or Android mobile devices.

3) Companies match Google's standards    

Google has set the bar high, and other software companies have followed. Starting with the book, "How Google Tests Software" [Read more about it here], Google has introduced the concept of filling up the ranks of the Software Quality Assurance team with software developers, either creating test automation frameworks or writing the automated tests themselves. Whether it is writing code in Selenium with Java, Python, Ruby or C#, or working with Continuous Integration tools such as Jenkins, companies which follow Google's high standards, coding skill has been the new focus in software testing, so you better make sure to get prepared.

Continuous integration is the process of automatically merging the developer's working copies of code into the main body of code several times a day.

Changes to the Hiring Process of a QA Engineer

With QA departments now looking to add programming knowledge to its ranks, there are new methods of screening potential candidates, new job requirements, and new interview techniques.

New Methods of Screening Candidates    

Before the initial phone interview with the hiring manager is even scheduled, you may need to submit a programming assignment to the company if it involves any automated testing. It is past the time when companies are willing to train a new hire on the job. Right now, they are hard at work getting their current employees up to speed. With any new position, they need proof that the minimum coding requirements are met. If you cannot figure out how to solve their programming assignment, they can't start the interview process with you.

Here are a few coding assignments I have been given:

  • "Write an efficient, well documented program in the language of your choice that will return the first n prime numbers" [My solution, in both Java and Python]
  • "Write a program where a user can choose an input file that contains a table, the program reads the table, sorts it by the column name the user chooses, and places the new sorted table in an output file". [My solution, in Python]

New Job Requirements

When you are looking for your next job, even if the job requirements do not mention automation testing, you may find that they are going to ask you:
  • Do you have experience in automated testing? Do you know Selenium? 
  • How much programming experience do you have? How much recent on-the-job experience do you have? Do you know both a programming language like Java and a scripting language like Python? 
Even if it what you think will be a manual testing position, you are going to be asked about:

  • If you know Selenium WebDriver with either Java or Python
  • If you have tested using any APIs, and if you are familiar with XML feeds and JSON notation.
  • If you have any experience in Javascript, Angular.js, and Node.js. If you say that you know Javascript, remember, they will quiz you on it. 
  • If you know about Continuous Integration with tools such as Jenkins.

New interview techniques

If you have not had a position where coding is part of your day-to-day activity, it is going to be very tough for you... and it is going to get tougher. If you are going for an automated testing position you will have to demonstrate programming examples on the whiteboard during a technical interview.

If you do not have experience coding, or your coding skills are quite rusty, like mine have been, you are going to have a lot of work to do. I may have earned a Masters of Software Engineering, but it has been six years since I coded on a regular basis...

... Which is why exactly I started this blog! :)

Hopefully, we can all catch up to the new standard together.

Here's to the new standards in software testing!

-T.J. Maher
 Sr. QA Engineer
 Quincy, MA

1 comment:

Anonymous said...

Benefits of Shift-Right Testing
Shift-right testing and shift-left testing are two approaches that aim to enhance the software testing process. While shift-right testing focuses on involving testers earlier and more frequently in the SDLC, shift-left testing emphasizes early involvement of testers in the requirements and design phases. Here are some benefits of shift-right testing compared to shift-left testing:
1. Early user feedback: Shift-right testing allows for early user feedback by involving testers throughout the development process. Testers can provide valuable insights and suggestions based on their understanding of user needs and expectations. This helps in refining the software requirements and design, leading to a product that better meets user requirements.
2. Agility and adaptability: Shift-right testing aligns with agile and iterative development methodologies. By involving testers throughout the SDLC, it enables quick iterations, adjustments, and enhancements based on feedback. This agility and adaptability are particularly beneficial in dynamic development environments where requirements evolve rapidly.
3. Comprehensive test coverage: Shift-right testing complements shift-left testing by providing additional test coverage. While shift-left testing focuses on early validation of requirements and design, shift-right testing expands the testing scope to cover functional, non-functional, and user-centric aspects of the software. This results in more comprehensive testing and a higher level of quality assurance.
4. Improved defect detection: By involving testers earlier in the development process, shift-right testing enhances defect detection. Testers can identify bugs and issues that may have been missed during the design or coding stages. This early detection allows for timely resolution and prevents the accumulation of critical defects.
5. Collaborative approach: Shift-right testing fosters collaboration between testers, developers, and other stakeholders. By working closely together throughout the SDLC, teams can address issues, share knowledge, and align their efforts toward delivering high-quality software. This collaborative approach promotes better communication and teamwork.
6. Test automation leverage: Shift-right testing encourages the use of test automation tools and frameworks. Testers can automate repetitive and time-consuming test cases, enabling faster execution and freeing up time for more exploratory and user-centric testing. This automation leverage improves efficiency and productivity in the testing process.
Both shift-left and shift-right testing approaches have their own unique benefits, and their effectiveness may vary depending on the specific project and context. Employing a combination of these approaches, commonly referred to as "shift-left-right testing," can provide the advantages of both methodologies and help achieve comprehensive testing and quality assurance.
Q-Pros is a leading test services provider, we offer software testing as one of our main services, as we understand its importance in today’s competitive market. If you would like to know more about us and our services, check out our list of offers.