Test suites are mandatory to make sure that our packages build and are running well.

Packages with test suites

If a testsuite is available, it must be executed.

To activate a testsuite you have to add a full "test" section to your build instructions.

build
      test
           "instructions to run the testsuite"
      end
end

Broken testsuites

Sometimes packages have a test suite that is broken. This can either be that it is not well maintained upstream or fails to execute in the build environment. In the latter case we should work together with upstream to get this fixed or disable certain tests.

However, it must be noted that the test suite fails to execute and it should be tried to re-enable it with the next update.