fedora-cloud-meeting
LOGS
<@davdunc:fedora.im>
15:00:35
!startmeeting fedora_cloud_meeting
<@meetbot:fedora.im>
15:00:36
Meeting started at 2024-03-28 15:00:35 UTC
<@meetbot:fedora.im>
15:00:36
The Meeting name is 'fedora_cloud_meeting'
<@nhanlon:beeper.com>
15:00:43
!hi
<@davdunc:fedora.im>
15:00:44
!topic roll call
<@zodbot:fedora.im>
15:00:45
Neil Hanlon (neil) - he / him / his
<@jcline:fedora.im>
15:00:51
!hi
<@zodbot:fedora.im>
15:00:53
Jeremy Cline (jcline) - he / him / his
<@davdunc:fedora.im>
15:00:56
though I don't think we really have to roll call any more. :)
<@mhayden:fedora.im>
15:01:57
!hi
<@zodbot:fedora.im>
15:01:58
Major Hayden (mhayden) - he / him / his
<@dustymabe:matrix.org>
15:02:18
!hi
<@zodbot:fedora.im>
15:02:21
Dusty Mabe (dustymabe) - he / him / his
<@dustymabe:matrix.org>
15:02:23
I’m double booked
<@humaton:fedora.im>
15:02:42
!hi
<@zodbot:fedora.im>
15:02:44
Tomáš Hrčka (humaton) - he / him / his
<@davdunc:fedora.im>
15:03:01
dustymabe: we established that long pauses are okay.
<@davdunc:fedora.im>
15:03:03
:)
<@davdunc:fedora.im>
15:03:38
!topic Action items from last week
<@davdunc:fedora.im>
15:03:44
* @davdunc and Jeremy Cline to work on #399 Upload Images to Azure Marketplace * Neil Hanlon to provide details for building the test plan for images. * davdunc to add ELN definition and upload for the ELN team. * davdunc to build kiwi definition for kubevirt image * davdunc to build kiwi definition for Oracle image * davdunc to write the ansible uploader for the oracle images and register. * work with the kiwi community to include a definition for kubevirt.
<@conan_kudo:matrix.org>
15:03:52
!hi
<@zodbot:fedora.im>
15:03:54
Neal Gompa (ngompa) - he / him / his
<@davdunc:fedora.im>
15:04:17
so glad to see that.
<@davdunc:fedora.im>
15:05:13
okay so Jeremy has been handling the first action item pretty much solo . . . gratitude!
<@davdunc:fedora.im>
15:05:30
Matt Micene 👋
<@davdunc:fedora.im>
15:05:48
awesome to see you!
<@dustymabe:matrix.org>
15:06:04
Jeremy Cline: i'd be interested in syncing with you on azure image uploading
<@mmicene:fedora.im>
15:06:11
👋 it took an embarassingly long time to realize the IRC bridge was dead :)
<@davdunc:fedora.im>
15:06:42
Jeremy Cline: would you like to repeat your update from the #cloud:fedoraproject.org chat this morning?
<@dustymabe:matrix.org>
15:06:43
when I started to get around to it for us (for community galleries) it was a bit more complicated because of the way aarch64 images are required to be uploaded
<@dustymabe:matrix.org>
15:06:52
maybe I was just confusing mysefl
<@jcline:fedora.im>
15:06:52
dustymabe: sure, can do. Still needs a little tweaking for versioning and EOL stuff, but it's pretty close
<@dustymabe:matrix.org>
15:06:56
maybe I was just confusing myself
<@dustymabe:matrix.org>
15:07:08
us == FCOS
<@davdunc:fedora.im>
15:07:28
Jeremy Cline: just getting them there and registered is a good MVP.
<@jcline:fedora.im>
15:07:35
Yeah, so I have https://pagure.io/cloud-image-uploader which listens to Koji build messages and runs an ansible playbook when it sees Azure images completed
<@davdunc:fedora.im>
15:07:38
:) the EOL we can handle later.
<@davdunc:fedora.im>
15:08:10
MVP = minimum viable product.
<@davdunc:fedora.im>
15:09:17
so it sounds like we need help integrating what you have into infra.
<@jcline:fedora.im>
15:09:18
It still needs some documentation and I've not wired it up to listen to live messages, but replaying messages results in images being uploaded
<@davdunc:fedora.im>
15:09:32
awesome.
<@humaton:fedora.im>
15:09:40
oh is this goint to replace fedimg?
<@conan_kudo:matrix.org>
15:09:47
how difficult would it be to extend to AWS and GCP images?
<@davdunc:fedora.im>
15:09:52
jednorozec: that's the plan.
<@conan_kudo:matrix.org>
15:09:59
especially given some of the wonkiness our AWS image uploads have right now
<@dustymabe:matrix.org>
15:10:05
davdunc: we have several coreos apps that listen to messages and act.. but TBH Jeremy probably mentored me on those, so I think he probably knows how to implement it
<@davdunc:fedora.im>
15:10:26
Conan Kudo: it shouldn't be difficult at all.
<@davdunc:fedora.im>
15:10:37
hah. So glad he is working on it!
<@jcline:fedora.im>
15:10:45
I don't know how much massaging needs to happen for those images, but it should be another if statement, a playbook to run, and whatever python needs to happen to setup things for the playbook
<@mhayden:fedora.im>
15:11:13
Matt Micene: welcome! 👏
<@davdunc:fedora.im>
15:11:20
exactly.
<@davdunc:fedora.im>
15:11:55
And then we need to plumb the ELN images in for Stephen Gallagher so users can have those too.
<@davdunc:fedora.im>
15:12:58
okay... this is awesome.
<@davdunc:fedora.im>
15:14:22
so then the action here is to complete the work with infra to get the Azure images published.
<@davdunc:fedora.im>
15:15:07
let me end that sentence with a question mark?
<@nhanlon:beeper.com>
15:15:26
I don't think I will let you :)
<@davdunc:fedora.im>
15:15:40
:) you better!
<@davdunc:fedora.im>
15:15:55
if you know what's good for me. :)
<@nhanlon:beeper.com>
15:16:00
I think I linked it before but just in case... for aws uploads this is what I hacked together: https://git.resf.org/sig_core/toolkit/src/branch/devel/sync/import-snapshot-publish-aws.sh
<@jcline:fedora.im>
15:16:33
I think that is accurate. There's an infra meeting in an hour so maybe I can inquire during the open floor what I need to do to get it deployed.
<@nhanlon:beeper.com>
15:16:41
(but i'd love to turn it into a playbook ;) )
<@davdunc:fedora.im>
15:16:49
let's do it!
<@davdunc:fedora.im>
15:17:34
if you need any assistance, I am sure that we can get someone in the #aws:ansible.com group to help us work out any kinks.
<@davdunc:fedora.im>
15:18:08
it's a workflow that I am sure that they want to support.
<@davdunc:fedora.im>
15:18:59
So Jeremy Cline is going to work with infra on getting the uploader into place.
<@davdunc:fedora.im>
15:19:36
we have work to be done together to support the EOL process in the context of Jeremy Cline's work.
<@davdunc:fedora.im>
15:19:51
we'll call that "deprecation"
<@davdunc:fedora.im>
15:20:03
then image retirement.
<@conan_kudo:matrix.org>
15:20:07
down the road (after all this work is done), we should start making a fedora cloud collection: https://pagure.io/fedora-cloud/fedoraproject.cloud-ansiblecollection
<@conan_kudo:matrix.org>
15:20:20
so that people can do things on their own without fedora infra stuff
<@davdunc:fedora.im>
15:20:25
yes! that's definitely the goal.
<@davdunc:fedora.im>
15:20:43
then we can have import and registration targets.
<@davdunc:fedora.im>
15:21:33
and some other use-cases, like configuring private repository mirrors and such.
<@davdunc:fedora.im>
15:22:03
and supporting Fedora Quality
<@davdunc:fedora.im>
15:23:05
this could be the collection that makes it possible
<@conan_kudo:matrix.org>
15:23:14
hmm, Dalton M and I did something ansible based around private repository mirrors before
<@conan_kudo:matrix.org>
15:23:34
probably worth talking to him about it and seeing whether we can do something interesting for the fedora cloud collection
<@davdunc:fedora.im>
15:23:41
make it public if you can/haven't already.
<@conan_kudo:matrix.org>
15:24:13
<@davdunc:fedora.im>
15:24:21
thanks.
<@conan_kudo:matrix.org>
15:24:54
it needs love to handle multiple arches and versions, but it's a good starting point
<@davdunc:fedora.im>
15:24:55
we can read them and figure out how to add that to the collection. :)
<@conan_kudo:matrix.org>
15:25:22
it even handles debuginfod :)
<@davdunc:fedora.im>
15:25:23
sounds like everything we have.
<@conan_kudo:matrix.org>
15:25:28
because I'm awesome like that :P
<@nhanlon:beeper.com>
15:25:34
hehe
<@davdunc:fedora.im>
15:25:35
haha.
<@davdunc:fedora.im>
15:25:56
okay.
<@davdunc:fedora.im>
15:26:21
!topic Fedora cloud test day
<@conan_kudo:matrix.org>
15:26:26
I also wrote roles for my personal stuff about deploying image build software
<@davdunc:fedora.im>
15:26:31
<@conan_kudo:matrix.org>
15:26:43
so we can bring that over to the collection eventually
<@davdunc:fedora.im>
15:26:55
thanks Conan Kudo !
<@davdunc:fedora.im>
15:27:20
what would be a good date for this?
<@conan_kudo:matrix.org>
15:27:52
if there are people around, we should schedule it within the next week
<@davdunc:fedora.im>
15:28:06
!info @sumantrom expects we need new test cases?
<@davdunc:fedora.im>
15:28:34
Neil Hanlon: yes.
<@nhanlon:beeper.com>
15:28:34
nah but next week is good lol
<@davdunc:fedora.im>
15:28:57
okay... maybe thursday the 4th?
<@davdunc:fedora.im>
15:29:08
would that work for folks?
<@jcline:fedora.im>
15:29:30
Works for me
<@nhanlon:beeper.com>
15:29:44
I can make it work :)
<@conan_kudo:matrix.org>
15:29:55
I'm mostly bowing out as I'm busy with things, but I think we really only need a couple of folks to work with this
<@davdunc:fedora.im>
15:30:02
okay. same. I can make it wor.
<@conan_kudo:matrix.org>
15:30:08
the big new thing is the aarch64-for-all-the-things
<@davdunc:fedora.im>
15:30:09
Conan Kudo: you have done enough.
<@davdunc:fedora.im>
15:30:25
Thanks for making all of these new test case requirements necessary!
<@davdunc:fedora.im>
15:30:48
the fact that the plumbing for this even works is because you didn't sleep. :)
<@nhanlon:beeper.com>
15:30:57
<3
<@davdunc:fedora.im>
15:31:07
okay.
<@davdunc:fedora.im>
15:31:55
Proposed: Cloud Test Day on April 4th?
<@davdunc:fedora.im>
15:32:18
are we agreed?
<@davdunc:fedora.im>
15:32:50
Anybody (besides Conan Kudo ) opposed?
<@davdunc:fedora.im>
15:33:11
mhayden Matt Micene any objections?
<@mhayden:fedora.im>
15:33:18
sounds good!
<@davdunc:fedora.im>
15:33:24
Awesome.
<@mmicene:fedora.im>
15:33:53
wait .. did i just oppose? i'm good with it!
<@davdunc:fedora.im>
15:34:00
!agreed Cloud Test Day will be April 4th
<@nhanlon:beeper.com>
15:34:14
(late ack)
<@davdunc:fedora.im>
15:34:41
hah.
<@davdunc:fedora.im>
15:34:57
Neil Hanlon: anything you think we can add to the test day, just dig in there.
<@conan_kudo:matrix.org>
15:35:06
I'm not opposed
<@conan_kudo:matrix.org>
15:35:12
I just am too tired.
<@davdunc:fedora.im>
15:35:25
understood Conan Kudo you are off the hook.
<@davdunc:fedora.im>
15:36:12
we will work on doing the testing and adding more testing to the testing because you made more images and more opportunity for users.
<@nhanlon:beeper.com>
15:36:34
that. Genuinely: thank you.
<@davdunc:fedora.im>
15:37:36
okay. ticket updated.
<@davdunc:fedora.im>
15:38:11
If you find time Conan Kudo et. al. can you add what you think we should include in the test operations generally?
<@conan_kudo:matrix.org>
15:38:24
sure
<@conan_kudo:matrix.org>
15:38:34
which ticket?
<@davdunc:fedora.im>
15:38:41
I added the meeting flag to the ticket so we revisit it next week.
<@conan_kudo:matrix.org>
15:38:43
the test day one?
<@davdunc:fedora.im>
15:38:47
next meeting, I mean.
<@davdunc:fedora.im>
15:38:50
yea.
<@davdunc:fedora.im>
15:38:56
yes.
<@conan_kudo:matrix.org>
15:39:06
okay will do
<@davdunc:fedora.im>
15:39:23
🙏
<@davdunc:fedora.im>
15:40:32
we should add some cloud-init validations to the image testing.
<@mhayden:fedora.im>
15:40:56
speaking of cloud-init, i was trying to get the dhcpcd change into F40 but it turned out to be a more complex issue than i planned 🙃
<@davdunc:fedora.im>
15:41:04
:(
<@davdunc:fedora.im>
15:41:12
I hear you on that one.
<@mhayden:fedora.im>
15:41:28
only blocker is an SELinux denial, but that is going to be fixed in the next selinux-policy pkg
<@davdunc:fedora.im>
15:41:38
nice!
<@davdunc:fedora.im>
15:42:48
!topic Additional testing for Fedora Cloud images
<@davdunc:fedora.im>
15:43:53
!info we have a lot of new images and aarch64 images specifically that we need to validate.
<@davdunc:fedora.im>
15:44:33
we also need to include the container images we just included in the kiwi definitions.
<@davdunc:fedora.im>
15:45:08
and I think that the dhcp option that mhayden is working on is a pretty important test case too.
<@mhayden:fedora.im>
15:46:00
indeedy
<@mhayden:fedora.im>
15:46:06
will need some help there for sure
<@davdunc:fedora.im>
15:46:22
also old issues, like nspawn support and the like.
<@jcline:fedora.im>
15:46:25
I guess this is a bit of a separate topic, but it would be nice to have some automated testing for all the images that runs after each build
<@jcline:fedora.im>
15:46:40
(or maybe that exists in some capacity somewhere?)
<@davdunc:fedora.im>
15:46:56
Jeremy Cline: Conan Kudo has been working on CI for the kiwi definitions.
<@davdunc:fedora.im>
15:47:22
we should include additional testing in the definitions for the images that he is producing and verifying.
<@conan_kudo:matrix.org>
15:47:52
every supported image is built in CI
<@davdunc:fedora.im>
15:47:56
Jeremy Cline: I think it's good to discuss here/now.
<@conan_kudo:matrix.org>
15:48:00
we just don't have any way to boot and test them in CI
<@conan_kudo:matrix.org>
15:48:19
err release-blocking image
<@conan_kudo:matrix.org>
15:48:32
the definitions support way more than what is release blocking
<@davdunc:fedora.im>
15:48:40
but we could add that as another [p,t]oddler with an outcome.
<@jcline:fedora.im>
15:48:58
Yeah, that would be good. I was also thinking say, post uploading the image to a cloud, something goes and boots it and does stuff
<@conan_kudo:matrix.org>
15:49:15
yes, that is probably what we want
<@conan_kudo:matrix.org>
15:49:34
that's what the img-proof tool from SUSE does, and we should have a similar workflow
<@jcline:fedora.im>
15:49:54
Is that something openqa could do? I assume so, but I've never fiddled with it
<@davdunc:fedora.im>
15:49:59
yea. if we can't adopt it (I don't think we can) we can learn from it.
<@davdunc:fedora.im>
15:50:27
it's like mash, it requires a bunch of stuff we don't package.
<@nhanlon:beeper.com>
15:50:31
I don't believe so, Jeremy Cline
<@davdunc:fedora.im>
15:50:49
openqa _could_ do some of the work.
<@jcline:fedora.im>
15:51:15
Are we okay building it as a container though? IIRC Fedora infra was more okay with running stuff that wasn't necessarily packaged with RPMs
<@nhanlon:beeper.com>
15:51:28
aiui it can't schedule a job on a cloud--it can do remote agents but it expects to launch them in qemu. but yeah, it could do other tests for sure
<@davdunc:fedora.im>
15:51:35
but It would be better to validate in the environments that we are building the images to run in.
<@davdunc:fedora.im>
15:51:57
Neil Hanlon: that's in the works on openqa next, but it's not completed.
<@jcline:fedora.im>
15:52:05
Are we okay building img-proof as a container though? IIRC Fedora infra was more okay with running stuff that wasn't necessarily packaged with RPMs
<@nhanlon:beeper.com>
15:52:10
oh, nice! I didn't realize that :D
<@davdunc:fedora.im>
15:52:21
there is a lot of work going on to make it "cloud-enabled"
<@conan_kudo:matrix.org>
15:52:29
img-proof requires being hooked into obs's uploader system
<@conan_kudo:matrix.org>
15:52:31
which we don't have
<@jcline:fedora.im>
15:52:40
Ah
<@conan_kudo:matrix.org>
15:53:13
I looked into potentially making it optional, but after how davdunc's discussion with the mash folks went, I didn't bother
<@davdunc:fedora.im>
15:53:13
that kinda makes it a learning platform for now.
<@nhanlon:beeper.com>
15:53:44
Zuul could be a good option here, I think.. with the ability to gate releases on tests, e.g.
<@jcline:fedora.im>
15:53:45
Well, if openqa is getting worked on to support cloudy things I imagine that's the direction we'd want to go
<@davdunc:fedora.im>
15:53:48
yea. mash would be better for us if it had a plugin architecture, but it doesn't.
<@davdunc:fedora.im>
15:54:03
Neil Hanlon can you explore.
<@davdunc:fedora.im>
15:54:05
?
<@nhanlon:beeper.com>
15:54:44
yeah, i have some experience with it from the opendev projects. i can add it to the list
<@davdunc:fedora.im>
15:54:52
awesome!
<@davdunc:fedora.im>
15:55:05
!action Neil Hanlon to explore testing options with Zuul.
<@davdunc:fedora.im>
15:55:13
okay.
<@davdunc:fedora.im>
15:55:27
let's leave this for now and go to open topic.
<@davdunc:fedora.im>
15:55:35
!topic open floor
<@davdunc:fedora.im>
15:55:58
Thanks mhayden for all the work on the cloud-init dhcp action.
<@mhayden:fedora.im>
15:56:13
no problemooo
<@jcline:fedora.im>
15:56:20
I noticed the Azure images are missing from the https://fedoraproject.org/cloud/download beta listings, anyone familiar with how that works? Otherwise I'll poke around https://gitlab.com/fedora/websites-apps/fedora-websites/cms/fedoraproject.org/ until I figure it out
<@davdunc:fedora.im>
15:56:34
Jeremy Cline: it's in the website code.
<@davdunc:fedora.im>
15:56:58
ask darknao to help you locate the fedora-messaging script and we can add them in.
<@davdunc:fedora.im>
15:57:13
i expect that the arm64 images for the new listings are also not showing up.
<@davdunc:fedora.im>
15:57:45
!action update the website code to include the new images and containers
<@davdunc:fedora.im>
15:58:29
Need to add that as a requirement for new images.
<@davdunc:fedora.im>
15:59:15
it's an update to listener.
<@davdunc:fedora.im>
15:59:27
we need that in the tickets too.
<@davdunc:fedora.im>
15:59:33
I'll add a ticket for it.
<@davdunc:fedora.im>
15:59:49
!action davdunc to add a ticket for the required website changes.
<@davdunc:fedora.im>
16:00:04
that should be part of our test day activities too.
<@davdunc:fedora.im>
16:00:10
okay.
<@davdunc:fedora.im>
16:00:16
anything else? We are out of time.
<@davdunc:fedora.im>
16:00:36
I am going to call it here then. Thanks everyone for attending.
<@nhanlon:beeper.com>
16:00:37
not from I.
<@davdunc:fedora.im>
16:00:48
!endmeeting