- November 5, 2020
- Posted by: InApp
- Category: Testing
In all industries, whenever a new product is developed, before being launched among end-users, it has to be tested for all its features to check whether the product meets all the predefined criteria. It’s more so in the IT industry where applications are tested for their features and functions so that they won’t give some unexpected results.
In simple terms, we define software testing a process involving many evaluations and verifications to ensure that the developed software is of the best quality and delivers in all applications and functions as intended. With the software testing, we remove bugs, lower costs and enhance performance and provide the greater user experience. The process encompasses both static and dynamic life cycle activities to assess whether they satisfy all the requirements.
The software testing is an integral part of a well-delivered application, and its importance cannot be overstated to the overall development. Some issues in software such as security vulnerabilities, scalability, invalid functions, poor design decisions or architectural flaws can bring to the surface some unseen or unexpected problems while applications are used in real-world use by customers. The surfacing up of defects during the use by end-users can not only tarnish a company’s reputation but also lead to dissatisfaction and loss of customers – in extreme cases, depending on the use area can cause malfunctions and even human loss.
Its economic significance is not overemphasised by the fact that in 2017 alone, software problems cost businesses and organisations $1.7 trillion in assets. Now think of the 2016 case of Nissan. The company had to call back its 1 million cars when a software defect was found in its airbag sensors detector. Wherever software is used, there is a potential of its malfunction and appearance of bugs. A software bug in a military satellite was responsible for the loss of $1.2 billion. Apple once paid two hundred thousand dollars for detecting a firmware security bug.
The just mentioned numbers encourage companies around the world to focus on the right QA processes for the early detection and uncovering of problems before the software reaches the market. In this regard, companies have to upgrade the testing capabilities keeping in mind the advancements in developments. In the software development companies, the development teams are supposed to be receptive to feedback on the functioning of their applications and address them. A software product delivered flawless and performing as per a client’s expectations helps in enhancing market share and more sales for all the companies.
Methodologies of Testing
Black Box Testing
Conducted at all levels of testing such as unit, integration, system and acceptance, in Black Box Testing, testers focus just on the functionalities of the software without going into the internal details and codes. It means the software is checked just for what it is designed to do. Internal programming is not covered in the Black Box Testing. The tester feeds in all kinds of values such as valid values, invalid values, and boundary values and on the basis of the expected output declares it passed or failed.
White Box Testing
Opposite of Black Box Testing, in White Box Testing, we conduct in-depth tests to the level of internal programs examining logics, their implementation and working. It’s carried out at the unit, integration and system levels and often detects internal designs errors. The following components of codes are covered for testing: statements, condition, decisions, decisions with conditions and multiple conditions.
In the statement coverage, all the statements of the code are executed at least once to ensure it works as expected. In the decision coverage, all the true and false conditions of the code are tested including if statements, for and while loop, and case statements. Condition coverage includes checking all Boolean expressions which return True or False. These are important in the final output and every one of them are checked.
Grey Box Testing
In Grey Box Testing, Black Testing and White BoxTesting are combined to look into the logical and functional part of the software. For carrying out this test, a tester is supposed to know the internal structure and architecture of the code as they may need to write the test cases for testing. In big projects, for Grey Box Testing, sometimes automated testing is incorporated.
One of the approaches of Integration Testing, it tests all the modules individually in the unit testing phase, and afterwards, the tested modules are integrated gradually and testing is further built upon gradual integration. Incremental Testing ensures smooth interface and interaction among all modules.
Incremental testing consists of three categories:
Top-down Integration – As the name suggests, it involves the integration of modules from top to bottom, with the modules not available replaced by stubs.
Bottom-up Integration– Modules are integrated from bottom to top, with the unavailable modules replaced by drivers.
Functional Incremental– In this, testing is done as per the predefined functional specifications.
The incremental testing helps in finding out the defects in the very early stage; however, the development of drivers and stubs can be time-consuming sometimes.
We define a thread as the smallest unit of work that a system can do. The idea for this testing is to know if the system can carry out the required functions as per the requirements in the early stages of integration.
Levels of Testing
The testing is generally conducted at the following four levels:
a) Unit testing
b) Integration testing
c) Acceptance testing
d) System testing
It is necessary that unit testing be carried out before the beginning of the integration testing. A unit is the smallest testable and independent part of the code for the software. The first step in the software testing, the unit testing is carried out by developers themselves and rarely done by testers separately. Once the developers are confident that the units in the code are working fine, then only they can send them to the testers for integration testing. If the unit testing is done and code has been checked for any bugs, a lot of time and costs are saved and the overall development and delivery process picks up pace.
From the integration testing starts the work of a testing engineer who checks how the units interact with each other to produce the output in different scenarios. At this level are detected defects of requirement, function and performance areas. Three approaches are broadly used for integration testing: Top Down, Big Bang, and Bottom-Up. In bang, the complete system formed by combining all the modules is tested for bugs. As the name suggests, in the top-down approach, the testing starts with the top-level modules and moves down with the insertion of sub-modules for testing.
After the completion of the integration testing for checking the necessary working and integration of the components, the software is tested by the highly skilled test engineers for performance and adherence to necessary quality requirements, technical specifications and function as required by the customers. It is purely black-box testing. The system is tested as per the point of view of the users for the behaviour and design of the software, validating software architecture and business requirements of the clients.
It is the final level of testing carried out to see if the system meets the business requirements of the client and if it’s ready for deployment. It has a wide range of scope including finding checking language, cosmetic errors, bugs etc. The test engineers use a variety of ways including pre-written scenarios, to test the system and see how the software will perform when the users will use it.
Acceptance testing is further categorized in the following ways:
User Acceptance Testing
Carried out by the actual users before the system is accepted, it can be conducted at the developers’ site or the user’s site.
Operation Acceptance Testing
It is conducted to make sure that all the necessary processes are working right and the software can be used and maintained easily.
Contract and Regulation Acceptance Testing
It makes sure that the system meets all the legal and safety standards and regulations.
Performed when the software development is nearing the end, it tests the system as a whole and if done successfully paves the way for Beta Testing. It makes sure that the system is of good quality and all the engineering aspects are doing as required. It is carried out from the point of users.
Done before some days or weeks before the release of the product, this test further improves the quality of the product by checking all the customer requirements. The users carry it out in the real world.
We can further categorize testing on the basis of who does the test, how to do, what and when to do:
How do you do testing?
It means how the testing strategy is implemented, which can be grouped further into two sections: Manual testing and Automated testing
In this, the testers conduct the tests without using any automation tools and by playing end-users they find bugs in the system, which are sent to developers for fixing them.
Manual testing has the following categories:
The testers are allowed to have some freedom to interact with the software and take action as they deem fit. Depending on their experience and understanding, they do the required instead of following any predefined procedure. Nevertheless, the testers are given some parameters and follow them with a plan. Thus, it is a planned activity though not scripted one.
Manual Regression Testing
Performed manually, it is carried out using already executed test cases to verify that a recent bug fix or any other modification in the code has not unexpectedly affected the features of the software.
Test Case Execution
The testers execute assigned test cases and if there are any bugs, they are compiled into a report and sent to developers for fixing. The process helps to understand whether the software is working as expected.
In the automated testing, by using an automation tool pre-scripted test cases are executed to increase efficiency in the testing. Automated testing is employed in cases such as when testing requires a lot of time or there are repetitive tasks requiring login or registrations. Undoubtedly faster, it increases productivity and reduces testing times. While being a little costlier, it saves time in the long term. However, it is not suited for conditions like documentation, user interface, compatibility etc.
Automation testing has the following categories:
Explained in levels of testing.
In API testing we check Application Programming Interfaces (APIs) directly to see if they meet the requirements of functionality, reliability, performance, and security.
Automated Regression Testing
It is just like manual regression testing except that it is done using an automated method.
Who does the testing?
Making a decision on who is going to do the testing is an important part of the testing. It can be In- house Testing, Outsourced Testing or Crowdsourced Testing.
It is carried out by the internal testers of the company that developed the software. It has the good advantages that the testers are well trained and for any issues can be in communication with the developers.
Here the testing is done by an organization outside the company which creates the software. The testing companies have a large pool of well-trained testers who can do testing quicker and more efficiently. However, sometimes there can be a problem in communicating between developers and testers, as they belong to different organizations, leading to some unexpected delays.
There are crowdsourced testing firms which provide professional testing facilities with testers located at different places with access to multiple devices. With more number of people working on finding bugs and problems in the software, testing is done faster and more efficiently.
When to do the Testing?
It is performed to check whether the software can be used by disabled people as well. There are established guidelines to make sure that the software meets the requirements for being used by differently-abled people. The testers check the system for hearing impairments, literacy problems, visual impairments, poor motor skills etc. The accessibility testing is not advanced at present and in future, more improvements are expected.
The application is tested for checking whether it runs on different environments such as operating systems, network, hardware etc.
Before the release of the application, it is essential that its performance is tested for specific actions or functions of the code or features of the work to be done. This testing is carried out under the conditions close to user experiences and with the same operating systems, hardware etc. to be used by the real users.
Graphical User Interface (GUI) testing ensures the correct functioning of GUI such as input field, the size of the button, readability etc. Through GUI testing it is easier to find regressing errors resulting from application updates. It’s easy to carry out though repetitive and time-consuming.
An important part of testing, and performed generally with automated tools simulating real-world use, the load testing checks the behaviour of the application under the actual demands of the users. With load testing, the issues preventing the software from performing under heavy demands are unearthed.
Sometimes a translation of the language of the application does not convey the intended meaning. Many applications are to be released at locations with different cultures and languages. Localization testing checks the quality and acceptability of the application in different cultures and languages.
Non Functional Testing
It’s not related to any specific function or action but checks the breaking point, at which non-functional parts result in unstable execution. It covers load times, not covered in functional testing, and makes the application more secure and better.
This is the testing for checking the security of the application and its environment when subjected to cyberattacks through malicious programs. Penetration tests use the same methods used by real hackers to uncover the vulnerabilities of the application.
The problems related to the software qualities are not the same for all the industries, varying from one industry to another. The severity of consequences also varies. However, software problems can make a big dent on a company’s brand and reputation. There are varieties of tests and selected by the testers depending on the application and requirements. There’s no test fitting all the requirements and applications.