fedora-coreos-meeting
LOGS
<@dustymabe:matrix.org>
16:29:14
!startmeeting fedora_coreos_meeting
<@meetbot:fedora.im>
16:29:17
Meeting started at 2023-12-13 16:29:14 UTC
<@meetbot:fedora.im>
16:29:17
The Meeting name is 'fedora_coreos_meeting'
<@dustymabe:matrix.org>
16:29:31
!topic roll call
<@dustymabe:matrix.org>
16:29:43
!hi dustymabe
<@zodbot:fedora.im>
16:29:45
Dusty Mabe (dustymabe) - he / him / his
<@apiaseck:matrix.org>
16:30:06
!hello c4rt0
<@zodbot:fedora.im>
16:30:08
Adam Piasecki (c4rt0) - he / him / his
<@apiaseck:matrix.org>
16:30:27
Hi all!
<@jlebon:fedora.im>
16:30:36
!hi jlebon
<@zodbot:fedora.im>
16:30:37
None (jlebon)
<@gurssing:matrix.org>
16:32:04
!hi gursewak
<@zodbot:fedora.im>
16:32:07
Gursewak Singh (gursewak)
<@fifofonix:matrix.org>
16:32:12
!hi fifofonix
<@zodbot:fedora.im>
16:32:14
Fifo Phonics (fifofonix)
<@dustymabe:matrix.org>
16:33:16
welcome apiaseck Jonathan Lebon gursewak fifofonix
<@jdoss:beeper.com>
16:34:03
!hi jdoss
<@zodbot:fedora.im>
16:34:05
Joe Doss (jdoss)
<@aaradhak:matrix.org>
16:34:21
!hi aaradhak
<@zodbot:fedora.im>
16:34:23
Aashish Radhakrishnan (aaradhak)
<@jdoss:beeper.com>
16:34:28
I am still figuring out this Matrix stuff.
<@dustymabe:matrix.org>
16:34:31
welcome ash jdoss
<@dustymabe:matrix.org>
16:34:39
we all are
<@dustymabe:matrix.org>
16:35:32
!topic Action items from last meeting
<@dustymabe:matrix.org>
16:35:46
!info there are no action items from the last meeting
<@dustymabe:matrix.org>
16:36:02
!topic tracker: Fedora 40 changes considerations
<@dustymabe:matrix.org>
16:36:12
<@dustymabe:matrix.org>
16:36:38
welcome Brad Smith 🙂
<@dustymabe:matrix.org>
16:37:06
ok so @jlebon and I went over the existing accepted changes for F40 yesterday
<@dustymabe:matrix.org>
16:37:36
A decent number of them were items that we had already discussed previously but had been deferred from F39
<@jdoss:beeper.com>
16:38:09
Lots of exciting changes in F40
<@dustymabe:matrix.org>
16:38:16
All the ones with the ✔️ are items we think won't require any work from us
<@dustymabe:matrix.org>
16:38:53
I'll go through real quick the ones that we didn't come to any conclusion on
<@dustymabe:matrix.org>
16:39:13
subtopic 105. Ostree Native Container (Phase 2, stable)
<@dustymabe:matrix.org>
16:39:31
<@dustymabe:matrix.org>
16:39:48
this one is from Colin and it was deferred from F39
<@jdoss:beeper.com>
16:40:27
So no more Zincatti upgrades in FCOS? Am I reading this right?
<@dustymabe:matrix.org>
16:40:30
he's been working on bootc related stuff and also possibly pushing that up into Fedora more properly. I think they will probably write a new change proposal and this one will get replaced
<@dustymabe:matrix.org>
16:40:56
jdoss: I don't think that has been decided anywhere
<@jdoss:beeper.com>
16:41:15
>Rework Fedora editions and spins (CoreOS, IoT, Silverblue, Kinoite, etc) that use ostree to instead deliver via Docker/OCI container images Is why I asked.
<@dustymabe:matrix.org>
16:42:00
yeah, even if we deliver via a container registry (which we do plan to do), that doesn't mean zincati (or similar functionality) goes away
<@jdoss:beeper.com>
16:42:15
Gotcha, sounds good.
<@fifofonix:matrix.org>
16:42:31
great to see this will be progressing. do we see any improved ux with this turn of the wheel or is it generally behind-the-scenes stuff?
<@jlebon:fedora.im>
16:42:46
Zincati (and the update graph) at its core is not very ostree-backend specific
<@dustymabe:matrix.org>
16:42:49
Jonathan Lebon: anything you want to add?
<@dustymabe:matrix.org>
16:43:05
~~Jonathan Lebon: anything you want to add?~~
<@jlebon:fedora.im>
16:43:17
dustymabe: no, i think that's good :)
<@dustymabe:matrix.org>
16:44:09
fifofonix: a lot of behind the scenes stuff for the most part. but something we would really like to do is enable automatic updates even if you have derived and rebased to your own container layer - it's not an easy problem to solve, though :(
<@jlebon:fedora.im>
16:44:15
fifofonix: i think we're still figuring out how this will get phased at a higher level than FCOS
<@jlebon:fedora.im>
16:44:20
phased in*
<@dustymabe:matrix.org>
16:45:31
moving this forward.. what do we do with this particular Changes entry for now? mark it as "likely to be replaced with updated Fedora 40 strategy" and move on?
<@jdoss:beeper.com>
16:46:14
I would really like to see some Ignition sugar added to bundle layer images into ISOs and manage that whole lifecycle.
<@jlebon:fedora.im>
16:46:15
yeah, i don't think we need to focus on it as part of the change proposal process since it has its own dedicated focus
<@jdoss:beeper.com>
16:46:41
but this is fantastic that it is considered stable. I have been using it for over a year and I have had very little issues.
<@dustymabe:matrix.org>
16:46:43
Jonathan Lebon: what should we put under the `Notes:` entry for it?
<@jlebon:fedora.im>
16:48:21
dustymabe: i think Colin had created a tracker issue for it in the past. we can point to that for now and say more info to come in the future.
<@jlebon:fedora.im>
16:48:24
let me try to find it
<@fifofonix:matrix.org>
16:48:34
@jdoss great to have your feedback on stability. i demoed the feature to my team this week as i think we're going to finally make this pivot in my world. researching the topic i was happy to see it referenced in OKD documentation at this point too.
<@dustymabe:matrix.org>
16:49:00
ok I'll move on and let jlebon send me the notes to add to this entry
<@fifofonix:matrix.org>
16:49:30
jdoss: great to have your feedback on stability. i demoed the feature to my team this week as i think we're going to finally make this pivot in my world. researching the topic i was happy to see it referenced in OKD documentation at this point too.
<@dustymabe:matrix.org>
16:49:37
subtopic 112. Switch pam_userdb from BerkeleyDB to GDBM
<@dustymabe:matrix.org>
16:49:44
<@dustymabe:matrix.org>
16:50:07
Jonathan Lebon's notes were: `NOTES: jlebon: NEEDS INVESTIGATION. looks like they expect users to run a conversion tool`
<@dustymabe:matrix.org>
16:50:32
so maybe we add an individual tracker issue for this and get a volunteer to look at it?
<@jlebon:fedora.im>
16:51:02
yeah, sounds good +1
<@dustymabe:matrix.org>
16:51:24
subtopic 118. Removing SSSD ‘files provider’
<@dustymabe:matrix.org>
16:51:31
<@dustymabe:matrix.org>
16:51:44
Jonathan Lebon's notes were `NOTES: jlebon: should be transparent to us, but this touches nsswitch.conf, which is sensitive`
<@dustymabe:matrix.org>
16:52:14
another tracker issue?
<@jlebon:fedora.im>
16:52:37
i think this is just "make sure that the nsswitch.conf change looks sane"
<@jlebon:fedora.im>
16:53:24
in case of a bad change, the most likely case is that it'd break CI (by breaking altfiles), but would be good to be sure
<@jlebon:fedora.im>
16:53:26
yeah, SGTM
<@dustymabe:matrix.org>
16:54:11
ok - any other of these topics in the list that we should discuss? maybe there is one where we missed some detail and we do need to investigate?
<@dustymabe:matrix.org>
16:55:49
ok I'll move on to another topic
<@dustymabe:matrix.org>
16:56:00
!topic Podman v5 breaking changes
<@dustymabe:matrix.org>
16:56:06
<@dustymabe:matrix.org>
16:56:37
so there is a change for this already but I don't think it's been accepted yet
<@dustymabe:matrix.org>
16:56:40
<@jlebon:fedora.im>
16:57:37
i think basically there's not much we can do there other than make users aware
<@dustymabe:matrix.org>
16:57:42
basically it looks like podman v5 is going to be really hard to upgrade to
<@jlebon:fedora.im>
16:58:13
i think as soon as it's accepted, we should send something out. they can use the new defaults today to ensure no breakage at rebase time
<@dustymabe:matrix.org>
16:58:49
Jonathan Lebon: but that most likely means removing/recreating all containers?
<@jlebon:fedora.im>
16:58:58
yes
<@jlebon:fedora.im>
16:59:18
or just reprovisioning, with newer bootimages, or tweaked ignition config
<@dustymabe:matrix.org>
17:00:03
fifofonix: jdoss ^^
<@jdoss:beeper.com>
17:00:17
catching up
<@jdoss:beeper.com>
17:00:46
oh man, this is a doozy
<@jlebon:fedora.im>
17:01:30
i think if you've provisioned in the last couple of releases, you should already be good
<@jdoss:beeper.com>
17:01:36
All good changes tho
<@fifofonix:matrix.org>
17:01:45
personally this doesn't seem to be a major issue for me. my podman containers can be redeployed entirely without issue.
<@dustymabe:matrix.org>
17:01:48
maybe we should do some analysis to see what versions are affected
<@jdoss:beeper.com>
17:02:04
I think I am fine, I basically keep on stable and we redeploy the container images on layer update from tarballs.
<@dustymabe:matrix.org>
17:02:11
but yeah, you're probably right jlebon about if your systems are new enough it might just be OK
<@jlebon:fedora.im>
17:02:23
i don't recall when we switched over to cgroups v2 by default, but basically the max of (f36, $cgroups_v2_release)
<@dustymabe:matrix.org>
17:02:56
when was boltdb switched out?
<@jlebon:fedora.im>
17:03:57
hmm, i don't *think* boltdb is getting cut out yet, just deprecated IIUC
<@dustymabe:matrix.org>
17:04:09
CNI was default in f35 and older
<@dustymabe:matrix.org>
17:04:28
ahh ok
<@jlebon:fedora.im>
17:04:35
(to be verified)
<@dustymabe:matrix.org>
17:04:36
so CNI and boltdb are just deprecated
<@jlebon:fedora.im>
17:04:42
no
<@jlebon:fedora.im>
17:04:49
CNI support is getting removed
<@dustymabe:matrix.org>
17:05:01
oh, the change proposal doesn't say that
<@dustymabe:matrix.org>
17:05:09
No longer support cgroups v1 Deprecate CNI plugins Deprecate Boltdb Have passt as the default rootless network service instead of slirp4netns Support stable --format Go template structs Isolate podman bindings leading to improved usability Allow better handling of containers.conf
<@jlebon:fedora.im>
17:05:25
https://fedoraproject.org/wiki/Changes/Podman5#Upgrade/compatibility_impact
<@jlebon:fedora.im>
17:05:52
yeah, i think "Deprecate CNI plugins" in that section probably should be "Remove support for CNI plugins" ?
<@dustymabe:matrix.org>
17:05:56
ok then the bullet points probably need to be updated mboddu ^^
<@mohanboddu:matrix.org>
17:06:28
Ack
<@mohanboddu:matrix.org>
17:06:31
I will update it
<@dustymabe:matrix.org>
17:06:40
so cgroupsv2 and CNI are getting removed - boltdb still around but deprecated
<@mohanboddu:matrix.org>
17:06:50
But yes, CNI support is getting removed
<@dustymabe:matrix.org>
17:07:04
ok good to know
<@dustymabe:matrix.org>
17:07:48
so yeah, I guess we can start today with CLM helpers and instructions for people (I guess as soon as the change gets accepted).
<@dustymabe:matrix.org>
17:07:56
so yeah, I guess we can start today with CLHM helpers and instructions for people (I guess as soon as the change gets accepted).
<@dustymabe:matrix.org>
17:08:39
at least the CLHM helpers will still be there when their nodes get moved to Fedora 40 and they log in to find out why they aren't working
<@dustymabe:matrix.org>
17:09:29
!info as soon as the podman v5 change gets accepted for Fedora 40 we should add CLHM helpers to notifiy people of the incoming changes and also a coreos-status post with the details
<@dustymabe:matrix.org>
17:10:21
I wish there was a migration that could be done, but I don't want to put our team on the hook for that. mboddu do you know of any tooling that will move a system over without having to delete containers and re-create them?
<@dustymabe:matrix.org>
17:10:51
I can't imagine for RHEL that we'd make people delete their containers on upgrade, but maybe if it's a major upgrade
<@mohanboddu:matrix.org>
17:11:30
I am not aware of anything like that, if there is then we could change the "Deprecate boltdb" to "Remove boltdb" :)
<@jlebon:fedora.im>
17:11:57
mboddu: is the second bullet in https://github.com/coreos/fedora-coreos-tracker/issues/1629#issuecomment-1854387360 accurate?
<@mohanboddu:matrix.org>
17:13:18
Jonathan Lebon: I am not sure on the fedora releases, but the info is accurate
<@jlebon:fedora.im>
17:13:44
mboddu: thanks!
<@dustymabe:matrix.org>
17:14:01
ok I need to step away soon. I'll move to open floor
<@dustymabe:matrix.org>
17:14:09
!topic Open Floor
<@dustymabe:matrix.org>
17:14:22
anyone with anything for open floor?
<@dustymabe:matrix.org>
17:14:55
I guess we should bring up the meeting schedule for the next few weeks
<@dustymabe:matrix.org>
17:15:17
I'll be on holiday until the new year so won't be able to attend any meetings until jan 3rd
<@jdoss:beeper.com>
17:15:33
Have a great holiday Dusty (and everyone else too!)
<@dustymabe:matrix.org>
17:15:36
should we cancel the remaining meetings for the year, or does someone want to carry the torch?
<@jdoss:beeper.com>
17:15:47
+1 to cancel
<@fifofonix:matrix.org>
17:15:54
+1 to cancel
<@jlebon:fedora.im>
17:15:59
yeah agreed
<@apiaseck:matrix.org>
17:16:02
+1 to cancel too
<@dustymabe:matrix.org>
17:16:49
We do need to find a candidate to run the releases next week :) - apiaseck - looks like you are assigned to them. Are you going to be around?
<@apiaseck:matrix.org>
17:17:10
Oh yes, I'm around
<@apiaseck:matrix.org>
17:17:33
I'll do it gladly (hopefully with no issues)
<@dustymabe:matrix.org>
17:17:47
ok that's all I had
<@dustymabe:matrix.org>
17:17:55
will close out the meeting in 60s unless new topics arise
<@jdoss:beeper.com>
17:18:16
Toodles everyone 🙂
<@dustymabe:matrix.org>
17:18:37
!endmeeting