Match Level
The match level determines the way Autonomous compares the checkpoint image with the baseline image. There are the following match levels:
Strict
This is the default and in most situations the recommend match level. This match level verifies that the screen content matches the baseline image closely enough that the human eye would not see any difference. With this level, Autonomous detects changes in text, font, color, graphics, and position of elements. It detects differences that are visible to the human eye while ignoring differences in pixel values that are platform dependent due to the rendering software and hardware.
Layout
This level is useful for validating that the screen layout is consistent. With this match level, Autonomous identifies the various screen elements in the checkpoint and baseline images, such as text, images, buttons, and columns, and verifies that the relative positions of these elements are consistent. This match level can detect elements that have appeared, disappeared, or moved. With this match level, the Autonomous matching engine ignores differences in the actual content text and graphics, color, and other style changes. This match level is useful for screens with dynamic content, such as banner ads or content which changes every time the screen is refreshed.
Ignore colors
This match level is similar to the strict match level but ignores changes in colors. It is effective when your content is static but the color varies, for example if there are buttons or screen elements that can appear in a variety of colors.
Regions only
This match level treats all checkpoints as Passed by default and performs no visual assertions. It is intended for cases where you only want to validate specific elements or areas of a page.
If no regions are defined, the test still passes but a red dot indicator appears in the results and next to the relevant checkpoints in the Screens view. This indicates that although the test passed, no visual assertions were applied.
When you open the test, the Test summary tab displays a banner indicating that no regions have been set yet.
To view all checkpoints using Regions Only where regions have not yet been set, do one of the following:
- Click See more details from the banner or tooltip.
- Filter by Status = Passed and Requires Attention = Yes.
After the run, you can Define Regions in the Test Analyzer to enable visual assertions. These regions will apply to future test runs; the current run is not re-evaluated.
You can modify the match level for each image in a test. In the Test Analyzer window you can define a match level for regions within a screen.
To Set the Match Level in a Custom Flow Test
Click on a Visually check this screen step and select the match level.
