diff options
| author | Emma Anholt <emma@anholt.net> | 2022-01-12 09:54:44 -0800 |
|---|---|---|
| committer | Marge Bot <emma+marge@anholt.net> | 2022-01-27 04:37:16 +0000 |
| commit | d041630a3791cf3dbafba833cb9344c533207c21 (patch) | |
| tree | f1cbce719f3017e6ee7f1e77cd872dda92577239 /.gitlab-ci.yml | |
| parent | 87c3651674fd91c6d73e8758da78bb432ce18bde (diff) | |
ci/llvmpipe,softpipe: Switch piglit testing to piglit-runner.
The new runner reduces the runtime by about 1/3 thanks to using rust
instead of python, and includes automatic flake handling so you don't just
have to skip flaky tests. The wrapper script also includes IRC flake
reporting (so one can track and update the flakes list to improve CI
reliability), always uploading results to CI for review (so you can
diagnose flakes and look at timings), has a prettier regressions report
and a helpful timing report, and is the same as what's used by all the HW
runners as well.
The downside is that by dropping the massive list of skips, you no longer
get flagged if Mesa refactors end up accidentally disabling extensions and
thus making tests skip. For that, I've started on
https://gitlab.freedesktop.org/anholt/deqp-runner/-/merge_requests/33 so
that hardware drivers get extension checking coverage too.
Thanks to the perf improvement, we get to drop one of the jobs for
llvmpipe.
xfail lists were mostly sed-jobs from the prior expectations lists. The
exceptions to that you'll find in the form of whitespace around the
affected test group (usually changes of capitalization or
special-characters), or an explanation for the more interesting changes
(which thankfully we can now record in the xfails lists!).
Reviewed-by: Cristian Ciocaltea <cristian.ciocaltea@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/14604>
Diffstat (limited to '.gitlab-ci.yml')
| -rw-r--r-- | .gitlab-ci.yml | 16 |
1 files changed, 11 insertions, 5 deletions
diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index 746aed0a216..cb54524a4f3 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -1260,16 +1260,16 @@ debian-mingw32-x86_64: .piglit-test: artifacts: - when: on_failure name: "mesa_${CI_JOB_NAME}" paths: - - results/summary/ - - results/*.txt + - results + reports: + junit: results/junit.xml variables: PIGLIT_NO_WINDOW: 1 - CI_JOB_JWT_FILE: /minio_jwt # JWT file on piglit jobs should be available on / partition + HWCI_TEST_SCRIPT: "/install/piglit/piglit-runner.sh" script: - - install/piglit/run.sh + - install/piglit/piglit-runner.sh .piglit-traces-test: extends: @@ -1283,12 +1283,18 @@ debian-mingw32-x86_64: name: "mesa_${CI_JOB_NAME}" reports: junit: results/junit.xml + paths: + - results/summary/ + - results/*.txt variables: CI_JOB_JWT_FILE: /minio_jwt # JWT file on piglit jobs should be available on / partition PIGLIT_PROFILES: replay PIGLIT_REPLAY_UPLOAD_TO_MINIO: 1 PIGLIT_REPLAY_EXTRA_ARGS: --keep-image --db-path ${CI_PROJECT_DIR}/replayer-db/ --minio_host=minio-packet.freedesktop.org --minio_bucket=mesa-tracie-public --role-session-name=${CI_PROJECT_PATH}:${CI_JOB_ID} --jwt-file=${CI_JOB_JWT_FILE} PIGLIT_JUNIT_RESULTS: 1 + CI_JOB_JWT_FILE: /minio_jwt # JWT file on piglit jobs should be available on / partition + script: + - install/piglit/run.sh .deqp-test: script: |