<@tflink:fedora.im>
16:31:20
!startmeeting fedora ai-ml
<@meetbot:fedora.im>
16:31:21
Meeting started at 2024-08-29 16:31:20 UTC
<@meetbot:fedora.im>
16:31:21
The Meeting name is 'fedora ai-ml'
<@jsteffan:fedora.im>
16:31:38
!hi
<@zodbot:fedora.im>
16:31:39
Jonathan Steffan (jsteffan)
<@tflink:fedora.im>
16:31:47
!hi
<@zodbot:fedora.im>
16:31:47
Tim Flink (tflink)
<@mystro256:fedora.im>
16:32:20
!hi
<@zodbot:fedora.im>
16:32:22
None (mystro256)
<@mystro256:fedora.im>
16:32:44
I am still "None (mystro256)" :)
<@trix:fedora.im>
16:34:02
hey all
<@tflink:fedora.im>
16:34:12
Jeremy Newton: you don't appear to have your name listed in FAS
<@tflink:fedora.im>
16:34:40
anyhow, lets get this party started
<@tflink:fedora.im>
16:34:56
!topic F41 Update
<@trix:fedora.im>
16:35:04
F41 status..
<@trix:fedora.im>
16:35:29
rocm 6.2 bits built now ..
<@trix:fedora.im>
16:35:47
pytorch build is pending.
<@trix:fedora.im>
16:35:55
testing of pytorch is pending
<@trix:fedora.im>
16:36:07
llvm18 is pending
<@trix:fedora.im>
16:36:29
or maybe llvm18 landed today and we need to rebuild the world again.
<@mystro256:fedora.im>
16:36:56
I make an update to pull rccl into f41
<@mystro256:fedora.im>
16:37:02
but it's frozen now
<@mystro256:fedora.im>
16:37:35
I was going to rebuild the rocm-compiler into the sidetag with clang18 and ping the owners
<@trix:fedora.im>
16:37:37
thanks to Jeremy Newton and tflink for filling in while i was on vacation last week.
<@tflink:fedora.im>
16:38:59
which llvm18 package is still missing?
<@trix:fedora.im>
16:39:37
maybe ALL of them.. maybe it landed yesterday ?
<@tflink:fedora.im>
16:39:45
https://koji.fedoraproject.org/koji/buildinfo?buildID=2517176
<@tflink:fedora.im>
16:39:58
that landed over a month ago
<@trix:fedora.im>
16:40:11
and when did clang18 land ?
<@trix:fedora.im>
16:40:21
etc.
<@tflink:fedora.im>
16:40:24
a day later
<@trix:fedora.im>
16:41:35
ok, maybe i am confused, i talked to tom s. about this and afaik it was still pending as of last week
<@tflink:fedora.im>
16:42:00
llvm19 hasn't landed yet, maybe that's what he thought you were asking about?
<@trix:fedora.im>
16:42:41
llvm -> 19 means old llvm-> llvm18
<@tflink:fedora.im>
16:43:08
in the past, yes but we complained about it and they made the compat packages early
<@tflink:fedora.im>
16:43:20
for the moment, llvm and llvm18 will give you the same version of llvm
<@tflink:fedora.im>
16:44:07
for f41 and rawhide, anyways
<@mystro256:fedora.im>
16:44:23
Sorry was distracted, I'm waiting on this:
<@mystro256:fedora.im>
16:44:23
https://bodhi.fedoraproject.org/updates/FEDORA-2024-f5e7321651
<@tflink:fedora.im>
16:45:33
huh. I forgot about bodhi for rawhide
<@mystro256:fedora.im>
16:45:44
RIght now I'm using the non-compat package, and it could break once llvm bumps to 19
<@mystro256:fedora.im>
16:45:49
rawhide is 42
<@mystro256:fedora.im>
16:45:58
I'm talking about 41
<@tflink:fedora.im>
16:46:16
yeah but that update was rawhide when it was submitted
<@tflink:fedora.im>
16:46:42
why was it left in testing for a month?
<@tflink:fedora.im>
16:47:12
questions for the llvm folks but that pretty much defeats the purpose of doing the compat packages early
<@trix:fedora.im>
16:47:27
my understanding is there were problems building clang18 with clang18 and needed to build with clang19
<@trix:fedora.im>
16:49:33
so llvm19 / compat llvm18 is an issue. i noted this in the change proposal. the effect if it is similar to F40 is a week or two fixing compat issues and a week or two rebuilding rocm.
<@mystro256:fedora.im>
16:50:00
Well either way, I'm just sitting on my hands waiting for them to do something
<@mystro256:fedora.im>
16:50:05
I can fix it once it lands
<@trix:fedora.im>
16:50:14
right.
<@tflink:fedora.im>
16:50:27
hopefully it won't be as bad as f40 but yeah, this is why we objected to the late llvm. I thought it was handled but I was just looking at koji
<@mystro256:fedora.im>
16:51:05
well I'm ok with late llvm as long as they can get the compat built early
<@mystro256:fedora.im>
16:51:30
not having it land post freeze is not even remotely acceptable
<@mystro256:fedora.im>
16:51:43
not having it land pre freeze is not even remotely acceptable
<@tflink:fedora.im>
16:51:58
yeah, I plan to start complaining
<@mystro256:fedora.im>
16:52:47
I mean we can have both llvm 18 (not compat) and llvm18 going at the same time
<@tflink:fedora.im>
16:52:50
it won't do anything for f41 but this always landing after beta (and frequently during beta freeze) is a problem, IMHO
<@tflink:fedora.im>
16:53:32
anyhow, is there more to discuss here for the moment?
<@mystro256:fedora.im>
16:53:47
Is pytorch good?
<@tflink:fedora.im>
16:54:53
it sounded like pytorch was waiting on hipblaslt and a rebuild
<@trix:fedora.im>
16:55:23
the hipbaslt update should have fixed the problem i am seeing. but the rawhide pytorch is still building. if freeze happened. the f41 will have to wait.
<@trix:fedora.im>
16:55:38
and building != testing.
<@tflink:fedora.im>
16:55:59
yeah, beta freeze started on tuesday
<@trix:fedora.im>
16:56:37
there is a 2.4 pytorch in 41 so on paper we look good.
<@mystro256:fedora.im>
16:57:00
did you make a bodhi update?
<@trix:fedora.im>
16:57:01
but that's only on paper, that build was pre 6.2
<@mystro256:fedora.im>
16:58:10
Nvm 2.4 is in f41
<@tflink:fedora.im>
16:59:39
last time I tried it, f41's pytorch didn't install properly but there is a build there
<@tflink:fedora.im>
17:00:14
but it sounds like the status is mostly "sitting on hands until the llvm18 compat packages land"
<@trix:fedora.im>
17:00:33
😂
<@trix:fedora.im>
17:00:53
there is also python 3.13 not being finished.
<@trix:fedora.im>
17:01:11
testing depends on python-dill.
<@tflink:fedora.im>
17:01:24
!info rocm 6.2 is built but is waiting for the llvm18 compat packages to land for a rebuild
<@trix:fedora.im>
17:01:26
and last i looked that was one of the busted packages
<@tflink:fedora.im>
17:01:56
!info pytorch 2.4 was waiting on rocm 6.2, is building in rawhide will need to be built for f41
<@trix:fedora.im>
17:02:31
python 3.13 breaks maybe a couple of the torch* packages. i have not had bandwidth to check.
<@mystro256:fedora.im>
17:02:58
is 3.13 still not in f41?
<@tflink:fedora.im>
17:03:12
I did a little poking at torchvision this week, it seemed to work
<@mystro256:fedora.im>
17:03:17
if so sounds like we should ask the fesco to delay f41
<@trix:fedora.im>
17:03:34
3.13 is it just doesn't have some packages last i checked.
<@trix:fedora.im>
17:04:57
my guess is there are always some packages that fall on the floor with a python update
<@tflink:fedora.im>
17:05:00
!info pytorch 2.4 is building in rawhide and will be done soon. if you have the bandwidth and machine to test it, testing would be appreciated when that's complete
<@tflink:fedora.im>
17:05:24
we do have another topic for today unless there is more F41 stuff to talk about
<@mystro256:fedora.im>
17:06:06
I guess one thing I forgot to add about llvm, they really ought to have llvm18 in rawhide regardless of f41 status
<@mystro256:fedora.im>
17:06:11
just my 2 cents
<@tflink:fedora.im>
17:06:31
yeah, I'm not sure why the update was just left to rot in testing for a month
<@mystro256:fedora.im>
17:07:01
probably waiting for f41 branch and then forgotten
<@mystro256:fedora.im>
17:07:19
anyway go ahead if there's another topic
<@tflink:fedora.im>
17:07:33
!topic Fedora Chatbot Proposal
<@tflink:fedora.im>
17:08:09
davdunc, amita (not sure what her username is on matrix) you around?
<@jsteffan:fedora.im>
17:08:25
i didn't manage to document anything more about this 🤦
<@jsteffan:fedora.im>
17:09:00
i could write something up quickly (a few minutes right now) to propose some implementation and testing constraints
<@tflink:fedora.im>
17:09:32
david or amita put this on the agenda, I assume they have something to discuss
<@tflink:fedora.im>
17:10:11
but if they're not here, I'm not sure there's anything to say
<@man2dev:fedora.im>
17:11:49
!hi
<@zodbot:fedora.im>
17:11:49
Mohammadreza Hendiani (man2dev)
<@tflink:fedora.im>
17:13:14
!info neither of the submitters for this agenda item are present - it can be submitted again for the next meeting
<@tflink:fedora.im>
17:13:23
!topic open floor
<@tflink:fedora.im>
17:13:32
any other topics that folks want to bring up?
<@jsteffan:fedora.im>
17:13:56
<@jsteffan:fedora.im>
17:13:56
* chat bot that can answer questions about fedora, contributor policies, project history, and general documentation search
<@jsteffan:fedora.im>
17:13:56
* stretch goal: add all manual pages and be able to answer questions about specific commands/programs
<@jsteffan:fedora.im>
17:13:56
<@jsteffan:fedora.im>
17:13:56
<@jsteffan:fedora.im>
17:13:56
Requirement:
<@jsteffan:fedora.im>
17:13:56
<@jsteffan:fedora.im>
17:13:56
* instructlab based implementation
<@jsteffan:fedora.im>
17:13:56
<@jsteffan:fedora.im>
17:13:56
<@jsteffan:fedora.im>
17:13:56
here are my initial thoughts about the chatbot:
<@jsteffan:fedora.im>
17:13:56
<@jsteffan:fedora.im>
17:13:56
Implement:
<@jsteffan:fedora.im>
17:13:56
* define questions that can be easily answered in the documentation hosted at https://docs.fedoraproject.org/en-US/docs/
<@jsteffan:fedora.im>
17:13:56
* fully open source base model
<@jsteffan:fedora.im>
17:13:56
* fine tuning used as the technique
<@jsteffan:fedora.im>
17:13:56
* runnable via podman desktop AI lab
<@jsteffan:fedora.im>
17:13:56
<@jsteffan:fedora.im>
17:13:56
Testing:
<@man2dev:fedora.im>
17:14:05
Tim did you find out what the gitlab problem was?
<@man2dev:fedora.im>
17:14:15
That prevented me from making branch
<@tflink:fedora.im>
17:14:17
sorry, didn't realize that you were typing
<@tflink:fedora.im>
17:14:22
!undo
<@tflink:fedora.im>
17:14:51
ah, this meetbot can't do undo
<@tflink:fedora.im>
17:15:06
!topic chatbot proposal part 2
<@tflink:fedora.im>
17:15:51
!info for folks reading the notes, check the previous open floor topic for more context and info
<@davdunc:fedora.im>
17:16:54
!hi
<@zodbot:fedora.im>
17:16:55
David Duncan (davdunc) - he / him / his
<@davdunc:fedora.im>
17:17:27
sorry I was not available originally.
<@tflink:fedora.im>
17:17:33
davdunc: did you have something specific about the proposal that you wanted to discuss
<@davdunc:fedora.im>
17:17:57
Amita and I worked at Flock to put together a submission for council.
<@man2dev:fedora.im>
17:17:58
If Approved, I was thinking that maybe we can have information from other sources added as well. For example, the arch/gentoo wiki and what have you, which are a great resource. However, these information need to be naturally cleaned up and tagged with proper metadata so it's not an easy task. Or the dataset won't be of much help
<@davdunc:fedora.im>
17:18:01
It's ready.
<@jsteffan:fedora.im>
17:18:48
yes, i would suggest adding more information as we go. i wanted to limit the test if this is going to actually work and be useful to fedora only stuff that we know we have ... and have license to use :-)
<@tflink:fedora.im>
17:19:10
I think we're talking about 2 separate but not unrelated things ATM
<@davdunc:fedora.im>
17:19:24
stopping.
<@tflink:fedora.im>
17:19:45
AFAIK, amita and david's proposal is separate from the one that daMaestro brought up last time
<@davdunc:fedora.im>
17:20:19
it is and I am happy to merge efforts.
<@tflink:fedora.im>
17:21:41
I'm not saying we can't talk about the proposal from last time but that's not what's on the agenda and we have 10 minutes left. I propose we hear what davdunc has to say about the proposal that he and amita worked on and we can talk about potentially combining them outside of the meeting
<@davdunc:fedora.im>
17:22:08
Our efforts were specifically around building a community project
<@tflink:fedora.im>
17:22:09
daMaestro: sorry for making you feel like you had to put something together suddenly
<@davdunc:fedora.im>
17:22:29
and ensuring that we have the framework for a council proposal.
<@man2dev:fedora.im>
17:22:42
Did anyone even do a discussion topic about this on discourse? or on mastodon? or consult legal about this at all? as discussed in the last meeting.
<@davdunc:fedora.im>
17:22:58
!link https://discussion.fedoraproject.org/tag/council
<@tflink:fedora.im>
17:22:58
davdunc: is the proposal public somewhere?
<@tflink:fedora.im>
17:23:18
in process, AFAIK. it's not terribly far along, though
<@davdunc:fedora.im>
17:23:34
Amita shared it as a google doc, but I can drop it on discussions or the wiki.
<@davdunc:fedora.im>
17:24:08
!link https://docs.google.com/document/d/18ynOb9CB8tRa37L2tJUiW1J06F2lQ3Thhy5MCZ5Xqs0/edit?usp=sharing
<@davdunc:fedora.im>
17:24:15
I think that will get it to you.
<@tflink:fedora.im>
17:24:29
kalso, there are currently 2 proposals. neither were aware of eachother until now
<@tflink:fedora.im>
17:25:01
if it's created with a @redhat.com link you can't make it available to everyone - you have to allow access one person at a time
<@tflink:fedora.im>
17:25:20
for reasons that are not entirely clear to me but it's bitten me in the past
<@man2dev:fedora.im>
17:25:29
The point was that before anyone proceeding with the chatbot, we should get community feedback and see if it's okay to even use these datasets by legal.
<@tflink:fedora.im>
17:25:31
if it's created with a @redhat.com account you can't make it available to everyone - you have to allow access one person at a time
<@davdunc:fedora.im>
17:25:36
tflink: I will move to the wiki.
<@jsteffan:fedora.im>
17:25:48
also.. i don't know how much time i can dedicate to driving this... i'd just like to see something like it be prototyped -- so combining or just going with a different proposal will not offend :-)
<@davdunc:fedora.im>
17:26:14
I don't mind driving daMaestro if you are willing to participate.
<@tflink:fedora.im>
17:26:43
agreed. I don't think that anyone is proposing to go cowboy on this but a proposal is probably the best place to start and then the other questions about legality etc. can be addressed
<@davdunc:fedora.im>
17:26:55
absolutely not.
<@jsteffan:fedora.im>
17:27:03
Python 3.13.0rc1 is what is in the f41 compose as of the last iso produced
<@tflink:fedora.im>
17:27:40
this is from the last topic of F41 status
<@tflink:fedora.im>
17:28:04
ah, chaos :)
<@jsteffan:fedora.im>
17:28:10
sure, consider my contributions driveby, testing, and opinion (and any help with packaging that i can muster after tackling the rust pile-o-work i have for myself unrelated)
<@jsteffan:fedora.im>
17:28:36
sorry re: meeting etiquette -- my bad
<@tflink:fedora.im>
17:28:37
it sounds like it'd be good for the interested folks to chat about the two proposals and see where there is overlap and where they could work together
<@davdunc:fedora.im>
17:28:56
we were proposing the project and oversight over individual responsibility so that we can build a strong product delivery
<@davdunc:fedora.im>
17:29:04
definitely.
<@davdunc:fedora.im>
17:29:13
tflink: definitely.
<@tflink:fedora.im>
17:29:22
as I understand them, they are not identical but I only skimmed amita's document earlier today so I am likely missing something
<@davdunc:fedora.im>
17:29:43
we can find the common ground and help it from there.
<@tflink:fedora.im>
17:30:05
since we're out of time for this week, how about we come back to this in 2 weeks at the next meeting
<@tflink:fedora.im>
17:31:27
I don't see an objection, so we can move on to
<@tflink:fedora.im>
17:31:31
!open floor
<@tflink:fedora.im>
17:31:50
anything else that needs to be brought up now and can't wait for the next meeting?
<@davdunc:fedora.im>
17:32:33
thanks tflink
<@jsteffan:fedora.im>
17:32:34
ping me in the main channel for packaging stuff
<@jsteffan:fedora.im>
17:32:51
i can be a review buddy for anything that is blocking us :-)
<@tflink:fedora.im>
17:33:09
ok, thanks for coming everyone
<@tflink:fedora.im>
17:33:33
!endmeeting