Operations/Minutes/2023-03-23

From OpenStreetMap Foundation

OpenStreetMap Foundation, Operations Meeting - Draft minutes

These minutes do not go through a formal acceptance process.
This is not strictly an Operations Working Group (OWG) meeting.

Thursday 23 March 2023, 19:00 London time
Location: Video room at https://osmvideo.cloud68.co

Participants

Minutes by Dorothea Kazazi.

Absent

New action item from this meeting

  • Grant Slater to create a GitHub issue for discussion regarding dockerising MediaWiki [Topic: Dockerising MediaWiki (Yuri)]

Reportage

GitHub tickets

Grant created/added GitHub tickets to action items

Chef testing

https://github.com/openstreetmap/operations/issues/863

Tests pass 100%. Tom worked on this. Suggestion: adding new flavours .kitchen .yaml

GitHub actions define which tests run on GitHub.

Network updates

Guillaume has emailed Gary to ask about two 1G links each in Amsterdam and in Dublin. Bonded interfaces, so 2GB total.

  • At the moment we barely go above 1G on the links that we have.
  • 10G costs three times the price of 1G.
  • We could save money by going down to two 1G links, each with max 1G commit per flow. AM6 has to be linked to AM7 using cross-connects. Would leave us with one good link which we could upgrade if we want. Reduces the complexity of talking to Clement and linking to his ISP.

Suggestions

  • Downgrading Dublin from two 10G links to two 1G links and adding an 1G link in AMS and swapping the link away from Cogent.
  • We have enough ports on our switches, we may have to juggle some modules, as a 10G module usually can't be 1G.
  • Check if the modules we have can run at different speeds.

Decision: Discuss via email or ticket.

Enable and require 2FA login for all WordPress sites

https://github.com/openstreetmap/operations/issues/856

Grant has been emailing people. 50% of people would like to keep their accounts.

Debian testing

Tom has been doing great work.

Hardware decommissioning

UCL

  • Deprecating ~10 servers, keeping two. If we need to move the two, we will move them to Dublin.

API usage and automatically submitting forms

https://github.com/openstreetmap/owg-website/pull/102 - Prohibit automatically submitting website forms #102

  • We had an editor that was creating OSM accounts via an automated process and allowing their users to map.
  • The board has been discussing this issue.
  • Wider discussion might be needed.

Suggestions

  • Wait for the board.
  • Discuss at the next OPS meeting.

Decision: Parked for the moment while the board handles it. Will discuss it at the next meeting.

Dockerising MediaWiki (Yuri)

Yuri's suggestion: Dockerising MediaWiki.

  • It will greatly simplify the upgrade process and deployment.
  • Ability to easily roll forward and back.
    • For the database, it is extremely hard to do, as we would lose any changes that have been made.

The Wikibase team has been maintaining a number of Docker images already.

Usual upgrade process

  • copy DB, update DB copy separately in a temporary space, try with the new docker
  • if everything passes you discard the DB, take the original DB and mark it as "read only" and upgrade.
  • if it works, you unmark it as "Read only"

Issues

  • Separation of the MediaWiki container and the data volume.
    • Production environment: we wouldn't run the database within the container.
    • Developer: a docker compose file would set up the database.
  • Getting all steps automated is really hard.
  • Testing is complicated and would need to involve a human.
  • Database snapshots cannot be shared, and if shared, they would have to be anonymised.
    • We would not have to share the data. We could have the same script run to initialise new data.

Other points mentioned during discussion

  • More complicated than dockerising the wiki.
  • Would allow us to have the same setup, both server side and DEV side.
  • Having some wrapper scripts which could do snapshotting and testing would be interesting.

Action item

Grant Slater to create a GitHub issue for discussion.

Action items

  • 2023-03-09 Paul Norman to reply to KDE that we're ok with their current tile usage but this might change in the future. [Topic: KDE usage]
  • 2023-03-09 Paul Norman to check the IPs associated with scraping OSM tiles using a MapProxy user-agent. Will block, if it is one IP and possible. [Topic: KDE usage]
  • 2023-03-09 Guillaume to try to provide options for 1G connectivity for AM6 by the next OPS meeting. [Topic: Network Upgrades]
  • 2023-03-09 Paul Norman to draft a deprecation notice and encourage people to move to OAuth2.0 [Topic: OAuth 1.0a support]
  • 2023-02-23 [Bureaucracy] Grant Slater to migrate OWG action items to GitHub tickets. (https://github.com/openstreetmap/operations/issues/823)
  • 2023-01-12 Grant Slater to experiment with Netbox. [Topic: Asset management]
  • 2022-12-15 Grant Slater to produce a pull request and finish the OSQA one. [Topic: Containerisation of small services https://github.com/openstreetmap/operations/issues/807] # 2022-12-29 In progress.
  • 2022-11-03 [Network upgrades AM6] Guillaume Rischard to talk with Clement / Open Source ISP about reliability and get insurances that the virtualised Layer2 links to Paris will be reliable. # 2022-11-17 Pending # 2022-12-29 Changed from "OPS" to "Guillaume".
  • 2022-09-22 [Network upgrades @ AM6] Grant Slater and Guillaume Rischard to talk to Clement about the options for network upgrades. # 2022-10-06 Guillaume talked with Clement.
  • 2022-09-22 [Network upgrades @ AM6] Guillaume Rischard to provide a schema at next meeting.
  • 2022-09-22 [Network upgrades @ AM6] Grant Slater and Guillaume Rischard to work out all the costs involved for option 1.
  • 2022-09-08 Grant Slater to document Chef testing. [Topic: How to get more people involved] # 2022-09-22 Chef kitchen tests running locally. # 2022-11-03 pending. #2022-11-17 Pending # 2022-12-29 In progress. # 2023-01-12 In progress - one of the rests fails randomly.
  • 2022-07-14 Guillaume Rischard to ask Brian Sperlongano about OpenMapTiles and YAML, to do a test run. [Topic: Vector tile status]. # 2022-09-22: Suspended for a while. Brian is back at school and has no time to work on this. Guillaume will try to move vector tiles forward with someone else. # 2022-12-29 Still suspended.
  • 2020-12-02 [AWS] Grant Slater to develop some thoughts on what is next for us using AWS. [Topic: AWS] # 2021-05-19 & 2021-06-02 & 2021-06-16 postponed for a few weeks. # 2022-12-29 In progress.
  • 2020-07-29 [AWS] Grant Slater to enable background sync to AWS S3. [Topic: Ironbelly] #2020-08-12&26 & 2021-06-02 Manually run, automated scripting to be added. # 2021-05-19 Grant to run the script again. # 2022-04-09 Still manually run. # 2022-09-22 wants to make sure there are absolutely minimum permissions. # 2022-12-29 In progress. # 2023-01-12 Still manually run. Grant to look at the policies together with Paul.
  • 2020-07-01 Paul Norman to create a ticket about solutions to reduce incoming communications. [Topic:Revision of acceptable use policy to reduce incoming communications] # 2021-05-19 decision to leave the action item open. # 2021-06-02 discussion about priority for account deletion. # 2022-04-09 Grant can show Paul how to do that with autoresponder which Tom built. Might be better to work on an online form (action item below).
  • 2020-07-01 Grant Slater to work out some of the questions for an online form as a solution to reduce incoming communications. [Topic: Revision of acceptable use policy to reduce incoming communications] 2020-08-12 need to think about the reply # 2021-05-19 decision to leave the action item open. # 2022-04-09 Grant is thinking about examples. Suggestion to add what is considered large for tile usage.
  • 2020-04-10 Grant Slater to work out a table of different data bits, work out how they are backed up and what can be potentially improved. [Topic: High Availability / redundancy of OpenStreetMap.org (and primary services)] # 2021-05-19 decision to leave the action item open. # 2021-06-02 pending.

Next meeting

Thursday 6 April 2023, 19:00 London time, unless rescheduled.

Operations meetings are currently being held every two Thursdays, at 19:00 London time.
Online calendar showing the OPS meetings.

Retrieved from "https://osmfoundation.org/w/index.php?title=Operations/Minutes/2023-03-23&oldid=10995"