Automated tests and test pyramids in Magento 2 – check which can be useful

Software testing is a long and complex process. In the contemporary world, maintaining a high-quality product using only a manual approach to testing is difficult. Frequent changes that can affect large parts of the system require automation of certain areas. An agile approach to software development involves testing from the earliest possible stage of the project. This allows you to identify incompatibilities, defects or glitches, the fixing of which is often faster, easier and cheaper as a result. Automated testing should take place at every stage of software development.


What is a test pyramid?

The use of the test pyramid fits very well into the approach described above. This solution relies on the assumption that the product should be tested automatically using different testing levels.

Individual tests form a kind of a pyramid. The base of the pyramid starts from unit tests, through integration tests, APIs all the way to E2E tests (UI layer). Manual tests are above the pyramid and complement it.

The pyramid includes the biggest number of unit tests (tests performed by developers during code development). They are fast, performed in isolation, and enable to detect bugs at an early stage, which results in a lower cost of fixing them.

At the very top of the pyramid are E2E tests. These tests are much slower, they test specific business cases, are more expensive and time-consuming to maintain. They use the UI layer (reflect the user’s interactions with the application). A single test can include a specific business path, which can result in a long test run time. E2E testing should not be excessive.

Magento 2.x Automated Tests

Magento 2.x provides a suite of tests to automatically control your application quality. They are a good complement to the testing process. The suite includes the following automated tests:

  • static – static code analysis for compliance with Magento 2 coding standards and best practices;
  • unit – tests verifying the correctness of the code (are created in the course of development), performed in isolation;
  • JavaScript unit tests – they test the frontend code of the application using Jasmine framework;
  • Integration tests – they test the code in varying degrees of isolation. They tend to be a lot more low-level than functional tests. Because they do not use a browser, they can run faster;
  • Web API functional – allows you to test Magento Web API from the client application’s point of view;
  • functional – black box tests, performed from a user perspective.

The above tests apply to the core part of Magento. It is definitely worthwhile to learn more about them and to consider using at least some of them in your project. They can offer many benefits because:

they test Magento’s core, so they can be helpful in creating new modules (they allow you to verify whether the newly developed modules have not adversely affected the core part of the application);

they are educational materials – you can use them to learn about Magento’s approach to testing.

On the other hand, when deciding to try the above tests, you need to be patient and allocate more time, especially at the beginning. Finding your bearings with such a big number of tests is time-consuming.

When analyzing the above automated tests, you may also encounter difficulties such as:

– the need to adapt the tests to your application. Some elements may not be available, so not all tests will be right for you;

– the need to verify the settings – the tests are prepared for a specific frontend template and use a specific language (e.g. in assertions based on the content of pop-up messages). Applications with settings may experience problems.

The tests in Magento 2 constitute an interesting element for development as part of the test pyramid. The test levels shown above are only a basis for building such a pyramid.

Summary:

Applying different levels of testing in the software testing process is important and helpful. It’s a good idea to start testing your project as early as possible. Maintaining product quality should be the goal of the entire team, as not all areas are within the control of the tester himself. It is definitely worth trying the solutions available on the market which can support the testing process or provide knowledge on how to do it better.

Our Experts
/ Knowledge Shared

16.02.2021

Why Should You Develop Mobile Applications with AWS?

Mobile Solutions

Today’s mobile apps have a lot of requirements, increasingly in the areas of performance, scalability and, of course, cost-efficiency. In these areas, we need a sophisticated infrastructure to support the app.   After all, the frontend of the app is already based on the user’s hardware, but the backend is where we have the most control....

02.02.2021

The 7 Deadly Signs of Digital Debt

Industries

Previously, we spoke about the rising awareness of Digital Debt thanks to recent events. This time, we want to help point out the most common signs of Digital Debt in your own company or operations.  After all, there’s a good chance the issues that produce such debt have gradually become part of day-to-day business. So much so, in fact,...

26.01.2021

Digital Debt / The Business Killer That’s Spreading

Industries

Some businesses were happy with being offline… until they were not. Recent events have pushed the issue of digital debt into the cold light of day.  The hard truth is simple: companies and other entities have suddenly found themselves in a reality where offline operations are no longer the backbone to rely on. This shift was significantly...

Expert Knowledge
For Your Business

As you can see, we've gained a lot of knowledge over the years - and we love to share! Let's talk about how we can help you.

Contact us

<dialogue.opened>