[Planned maintenance] OCP Cluster - 25th of July 2024, 8 AM - 12 PM (UTC)

Infrastructure
1

Hello,

We’ll be processing an OCP major release cluster upgrade (4.12 to 4.14) due to OCP 4.12 being EOL (OpenShift Container Platform Life Cycle - Red Hat Customer Portal ). The following services will experience a downtime while the upgrade will be applied:

  1. wiki.gnome.org

I’ll keep this thread up-to-date as the upgrade moves forward, thanks!

2

4.13 upgrade has been completed, I’ll process OCP Virt and Ceph updates next and progress to 4.14 in the afternoon.

3

Hi,
you mentioned only wiki will be affected, but there are currently
problems with git, and GitLab and several other services. Is it related
to these changes or it’s just a coincidence that “half of the services”
are down or unreliable?
Thanks and bye,
Milan

4

The VM where we host git repositories failed to migrate so yes, GitLab was also impacted. As soon as the upgrade was performed we started noticing failures in mounting CephFS volume due to mislabeled volumes at the SELinux level. It should be all fixed by now. We are going to postpone the upgrade to OCP 4.14 to next week, I’ll make sure to send another announcement with details around the upgrade timeline early next week.

1 Like
5

Damned Lies is still giving [Errno 13] Permission denied: '/var/www/djamnedlies/data/media/upload/Graphs-v1.8.x-po-fr-1000850.po' when trying to upload files. Is it related?

6

Definitely related, should be fixed by now, please confirm.

7

Yes, it works now. Thanks!

8

Hi,
please do not do that, not the next week.

While the window for the upgrade was set to 4 hours, it took a day to
settle (despite status.gnome.org laying with “No incidents reported”,
there had been outages from roughly Wednesday evening until Thursday
evening (UTC+2), which did not even match the proposed time). It was
painful, to say the least.

It would be even more painful the next week, because it’s a release
time for the whole GNOME. See the GNOME Release Calendar - GNOME Release Notes .
It would be good to schedule any such infrastructure changes in time
which does not collide with major dates related to the GNOME
contributors. Thank you for understanding.

Bye,
Milan