<@tflink:fedora.im>
17:34:50
!startmeeting fedora-ai-ml-sig
<@meetbot:fedora.im>
17:34:52
Meeting started at 2025-01-16 17:34:50 UTC
<@meetbot:fedora.im>
17:34:52
The Meeting name is 'fedora-ai-ml-sig'
<@tflink:fedora.im>
17:35:11
!hi
<@zodbot:fedora.im>
17:35:11
Tim Flink (tflink)
<@tflink:fedora.im>
17:35:25
sorry for starting this late, got distracted and didn't notice the time
<@tflink:fedora.im>
17:35:55
anyone still here for the ai-ml-sig meeting?
<@tflink:fedora.im>
17:36:02
!link https://board.net/p/fedora-aiml-sig-meeting-agenda
<@trix:fedora.im>
17:36:05
!hi
<@zodbot:fedora.im>
17:36:05
Tom Rix (trix)
<@man2dev:fedora.im>
17:36:15
!hi
<@zodbot:fedora.im>
17:36:19
Mohammadreza Hendiani (man2dev)
<@tflink:fedora.im>
17:39:03
welp, I guess it's just the 3 of us for now :)
<@tflink:fedora.im>
17:39:10
!topic F42 Update
<@tflink:fedora.im>
17:39:30
Tom Rix take it away
<@trix:fedora.im>
17:40:00
gcc is changes majors, i am working on those, mostly effecting rocm-llvm.
<@trix:fedora.im>
17:40:22
so some churn on rocm-compilersupport as i sort it out.
<@tflink:fedora.im>
17:40:44
was the llvm bundling part added to the rocm feature for F42 if that's been written already?
<@trix:fedora.im>
17:40:58
that was done months ago.
<@trix:fedora.im>
17:41:04
in 6.2.1
<@tflink:fedora.im>
17:41:26
ah, I knew about the fesco ticket but thought that they requested we put it in the feature request for F42
<@tflink:fedora.im>
17:41:59
sorry, I continue to be overwhelmed at work and it's been ENOTIME lately :'(
<@trix:fedora.im>
17:42:04
sorry i lost track of the feature request ticket.. there are a few other things woe could add to that.
<@trix:fedora.im>
17:42:33
like _maybe_ ollama landing..
<@tflink:fedora.im>
17:42:35
has the F42 feature request been written? I think we've usually waited until a bit later in the cycle
<@trix:fedora.im>
17:42:46
i did a long time ago
<@trix:fedora.im>
17:43:00
and then went onto other things.
<@tflink:fedora.im>
17:43:09
ah, cool. thanks for getting that done
<@zodbot:fedora.im>
17:43:27
tflink gave a cookie to trix. They now have 5 cookies, 2 of which were obtained in the Fedora 41 release cycle
<@trix:fedora.im>
17:44:00
rocm-llvm changes are needed for rocm-omp, openmp flavor of rocm.. so the existing rocm-rpp package will be buildable.
<@trix:fedora.im>
17:44:30
jeremy is on the review of rocm-omp, so we are ok-ish.
<@tflink:fedora.im>
17:45:26
and I'm supposed to be doing composable_kernel which I forgot about ... again
<@trix:fedora.im>
17:45:44
ck would be nice to have but it can wait.
<@trix:fedora.im>
17:46:08
it is part of the planning for f43.. which is another topic i guess.
<@tflink:fedora.im>
17:46:30
ok, good to know that I'm not blocking anything yet
<@trix:fedora.im>
17:46:38
no worries.
<@tflink:fedora.im>
17:46:45
let's see if I can summarize for the notes
<@tflink:fedora.im>
17:46:59
!info F42 progress for ai-ml features is progressing
<@tflink:fedora.im>
17:47:27
!info the gcc 15 upgrade for F42 is causing some problems, mostly in rocm-compilersupport but it is being worked on
<@trix:fedora.im>
17:47:59
👍️
<@tflink:fedora.im>
17:48:07
!info reviews that will be needed for F42 features (rocm-omp) are in progress and are expected to be done in time
<@tflink:fedora.im>
17:48:25
!info ollama _may_ be ready in time for F42 but that work is still in progress
<@trix:fedora.im>
17:48:36
and..
<@tflink:fedora.im>
17:48:53
did I miss anything worthy of noting?
<@trix:fedora.im>
17:49:14
gpus for gfx1152 (apu) and gfx1201,gfx1200 (rx 9070) being added _right_ _now_
<@trix:fedora.im>
17:49:36
these are gpus that will be commerical when F42 lands
<@tflink:fedora.im>
17:49:47
I assume that you have or will soon have the HW needed to test the new HW?
<@trix:fedora.im>
17:49:54
yes.
<@trix:fedora.im>
17:50:24
which is a clue to say.. if folks want hw for gfx1200 poke me and i will see about it.
<@tflink:fedora.im>
17:50:27
!info F42 will bring rocm support for new HW (gfx1152, gfx1201, gfx1200) that will be generally available when F42 releases
<@trix:fedora.im>
17:50:55
gfx1200 is going to become our reference vs.. gfx1100.
<@trix:fedora.im>
17:51:10
i guess we could talk about reference gpu ..
<@tflink:fedora.im>
17:51:19
good to know. most of my HW is gfx1100
<@trix:fedora.im>
17:51:38
i'd like to move to new and shiney..
<@tflink:fedora.im>
17:51:42
we can do that, I F42 status was the only topic for today
<@trix:fedora.im>
17:52:03
i'm done with F42. questions ?
<@trix:fedora.im>
17:52:21
oh.. yeah triton landed, thank tomas for the review.
<@tflink:fedora.im>
17:53:11
!info triton landed in rawhide
<@tflink:fedora.im>
17:53:28
!topic rocm reference HW
<@tflink:fedora.im>
17:53:41
I assume that there's enough to say for a topic? or did I misunderstand?
<@trix:fedora.im>
17:53:55
yes. fine.
<@man2dev:fedora.im>
17:53:58
👌
<@tflink:fedora.im>
17:54:10
!info at this time, the reference GPU for ROCm in Fedora is gfx1100 (radeon 7900 et. al)
<@tflink:fedora.im>
17:55:20
in other words, most of the testing that is done (by Tom) is done against gfx1100 even though there are other models which Fedora's packages are built for
<@trix:fedora.im>
17:55:36
yes.
<@trix:fedora.im>
17:56:15
we have gap in testing, so until that improves i say reference is what i have ..
<@trix:fedora.im>
17:56:26
sorry for bluntness.
<@man2dev:fedora.im>
17:56:38
The best test I have been able to do was with coper and that's just testing the if it builds or not
<@trix:fedora.im>
17:57:25
i expect i will get a 1200 soon-ish. so would like to transition to that.
<@tflink:fedora.im>
17:58:27
the question will remain how quickly 1200 penetrates the market but given the current situation, I'd say that's 100% up to you
<@tflink:fedora.im>
17:59:10
if I want to see gfx1100 testing improve, I can start doing that work myself :)
<@trix:fedora.im>
17:59:19
also fine with keepign 1100 as ref.
<@trix:fedora.im>
17:59:32
maybe we pick one for each major family.
<@trix:fedora.im>
17:59:41
1200 is a new family.
<@tflink:fedora.im>
18:00:18
like I said, I think it's up to you right now since you're doing the work
<@trix:fedora.im>
18:00:23
goovy.
<@tflink:fedora.im>
18:00:48
if and when more folks are doing the testing, they can have more of a say
<@tflink:fedora.im>
18:01:16
but I certainly won't discourage you from also testing against gfx1100 going forward :-P
<@tflink:fedora.im>
18:02:10
!info gfx1200 HW (radeon 9070 et. al) will become the new "reference HW" for Fedora's ROCm builds later this year
<@tflink:fedora.im>
18:02:23
does that cover things for the most part?
<@trix:fedora.im>
18:02:43
yup
<@tflink:fedora.im>
18:03:11
!info this does not mean that there will be no testing done on other HW or that gfx1200 will be the only things supported, just that gfx1200 will become the HW of most focus
<@tflink:fedora.im>
18:03:17
any other topics for today?
<@trix:fedora.im>
18:03:36
F43 planning if folks want.
<@tflink:fedora.im>
18:03:54
!topic F43 planning
<@trix:fedora.im>
18:04:45
I am working on the inference side of ROCm, so trying to land migraphx and mivisionx
<@trix:fedora.im>
18:05:15
ck is part of that.
<@trix:fedora.im>
18:05:51
some like rocMLIR that are needed may not be packagble atm.
<@trix:fedora.im>
18:06:04
i'll have to see once F42 branches.
<@man2dev:fedora.im>
18:07:20
I'm looking into open webui but it seems really big, and also trying to decoupling ggml from whisper and llama-cpp
<@man2dev:fedora.im>
18:08:37
I'm looking into open webui but it seems really big, and also trying to decouple ggml from whisper and llama-cpp
<@trix:fedora.im>
18:08:37
could the big whisper and llama be a thing ? now that we have triton
<@tflink:fedora.im>
18:09:02
!info F43 planned features include several ROCm components (migraphx, mivisionx, maybe rocMLIR)
<@tflink:fedora.im>
18:09:51
!info whisper and ollama are also being worked on, no specific ETA other than "later than F42" at this time
<@man2dev:fedora.im>
18:11:03
Sorry guys my internet is really bad right now
<@tflink:fedora.im>
18:12:22
no worries, that happens
<@tflink:fedora.im>
18:12:36
we can table the discussion for another day, F43 isn't for a while yet
<@trix:fedora.im>
18:12:56
all good.
<@trix:fedora.im>
18:13:09
open discussion ?
<@tflink:fedora.im>
18:13:33
!info more F43 planning discussion will happen later, as F43 gets closer
<@tflink:fedora.im>
18:13:36
!topic open floor
<@tflink:fedora.im>
18:13:41
anything else folks want to bring up?
<@trix:fedora.im>
18:14:16
i'm good.
<@tflink:fedora.im>
18:19:29
ok, thanks for coming everyone!
<@tflink:fedora.im>
18:19:55
!info next ai-ml-sig meeting will be on 2025-01-30 @ 17:30 UTC
<@tflink:fedora.im>
18:19:58
!endmeeting