Operations/Minutes/2025-04-17

From OpenStreetMap Foundation

OpenStreetMap Foundation, Operations Meeting - Draft minutes

These minutes do not go through a formal acceptance process.
This is not strictly an Operations Working Group (OWG) meeting.

Thursday 17 April 2025, 19:00 London time
Location: Video room at https://osmvideo.cloud68.co

Participants

Minutes by Dorothea Kazazi.

Absent


New action items from this meeting

  • Minh Nguyễn to post about the OSM wiki downtime planned for Saturday 26 April 2025 at 10am (9am UTC). [Topic: Wiki upgrades next steps]
  • Grant Slater to do a quick compatibility check for the Prometheus server upgrade. [Topic: Next Debian Upgrades?]

Reportage

Grant will catch-up with the action items tomorrow, as he was away.


Wiki upgrades: Next steps

Related ticket: https://github.com/openstreetmap/operations/issues/1210]

  • Aim: replace the operating system and upgrade to the newest long-term supported version of MediaWiki.
    • Tom has done the staging version, and resolved some bugs.
  • Steps: Read-only, dump sql, upgrade OS (in-place), return-data (from in-place), wiki upgrade.
  • Server: konqi.
  • Date and time: Saturday 26 April 2025 at 10am (9am UTC).
  • Duration estimate to be included in the announcement: 8 hours.

Minh offered to help.

Suggestion: Keep the test instance and test some modules that people have asked for.

Action item: Minh to post about the OSM wiki downtime planned for 10am (9am UTC) Saturday 26 April 2025.


Upgrade primary database server

Current setup: primary DB server running PostgreSQL 15, while the tile servers are running 16.

PostgreSQL 16:

  • introduces the new custom dump compressor, which could improve backup performance.
  • uses pg_dump to restore to SQL.

On upgrade

  • We need to fix planet dump first.
  • If we switch to zStandard and we tweak the compression level slightly we could theoretically gain double the performance while keeping the same compressed size

Other point mentioned during discussion

  • zStandard is a lot faster than gzip, depending on the compression level.

Any other business

Grant's tech talk

  • Grant plans to do an OSM chef - how to contribute - talk, open to anyone, in the next couple of months.
  • The Chef repo contains a contribution guide, which shows how to run the test.

OSM core software development facilitator

Minh is the new OSM core software development facilitator.


Open Ops Tickets

Review open, what needs policy and what needs someone to help with...


Next meeting

  • On 2025-05-01.

Action items reviewed at the beginning of the meeting

  • 2025-03-20 Grant to upgrade (inplace) muirdis to Debian and then Tom will set up a staging instance of the wiki upgrade. [Topic: Upgrading the OSM wiki] Done
  • 2025-03-20 Grant to investigate whether Karm's latency spike on 10 Jan 2025 is due to IO or network. Most likely IO. Karm may need upgrading to handle sync. [Topic: Database Server Upgrades]
  • 2025-03-20 Grant to set the sys request variable to be more dynamic, as we tune the number of threads that MDRAID enables, and it is likely not more than four. [On 10 Jan 2025 peak] [Topic: Database Server Upgrades]
  • 2025-03-20 Grant to negotiate with HE.net if we can get better cost from them as a fallback link (which he had proposed), to allow budget spend elsewhere. [Topic: HE.net]
  • 2025-03-20 Grant to follow-up with the South African contact about the potential hardware donation from a mobile network. [Topic: New offers of servers in Australia and South Africa]
  • 2025-03-20 Grant to run an SQL query to identify more email providers used by spammers. [Topic: Spam]
  • 2025-03-20 Grant to check the metrics for any significant impact of recent spam blocking. [Topic: Spam]
  • 2025-03-06 Grant to present a draft budget at the next meeting.
  • 2025-01-23 Grant to check whether Paul wants to pick up responding to Meta [Topic: Rapid editor] - In board hands with Mikel / Paul.
  • 2024-09-19 Grant to create an IP blocklist script. [Topic: Cloudflare keep enabled?][2024-09-19 Reportage] - Discussion during 2024-07-25 OPS to make a reasonable evaluation whether to go with Cloudflare, Fastly or none. - Grant to create now
  • 2024-09-19 Grant to confirm that the AArnet servers will be removed and to ask the Australian community whether there is interest in hosting/providing a render server in Australia or Asia/Pacific [2024-09-19 topic: AArnet Servers going away] - We in conversation with Australian National University for new hardware.

Action items that have been stricken-through are completed, removed, or have been moved to GitHub tickets.