I am still poking at https://openqa.gnome.org/ as and when my limited time permits, here’s a quick status update and some areas you can help if you’d like to learn more about testing and/or see the initiative progress further.
As of today, the latest test run is: openQA: gnomeos-master-iso-x86_64-gnomeos@qemu_x86_64 test results
- The installation process succeeds, and the journal is now written to the serial port and logged during installation to help debug future installer issues.
- Baobab and Nautilus tests fail because the icons are completely black - a regression somewhere. The first step is to ask around to see if anyone’s already seen this issue, and what might be the cause.
- Connections tests fail as the window has changed colour - the needle needs to be updated.
- Connections then doesn’t exist, possibly causing the next test to fail - it would be nice to avoid that.
- Weather test fails due to major UI changes (GTK4 port?) - needle needs to be updated.
- Settings test fails due to a minor UI change - needle needs to be updated.
You will also notice a couple of infra issues:
- Test screenshots aren’t shown in the test overview (except they sometimes are), this regressed when I updated to latest web UI. Images not shown in openQA web UI (#15) · Issues · GNOME / OpenQA Tests · GitLab
- “Ghost” tests appear for every real test that runs. Ghost tests appear at https://openqa.gnome.org/tests (#6) · Issues · GNOME / OpenQA Tests · GitLab
Some of these issues are great “getting started” issues, particularly updating needles which can be done straight from the web UI once you have permissions. I would love to see more people getting involved, so if that sounds interesting please get in touch here or in #gnome-os. (There are instructions for updating needles here).