<@tflink:fedora.im>
16:35:03
!startmeeting fedora-ai-ml-sig
<@meetbot:fedora.im>
16:35:04
Meeting started at 2025-03-13 16:35:03 UTC
<@meetbot:fedora.im>
16:35:05
The Meeting name is 'fedora-ai-ml-sig'
<@tflink:fedora.im>
16:35:08
sorry, got distracted
<@tflink:fedora.im>
16:35:36
!hi
<@zodbot:fedora.im>
16:35:37
Tim Flink (tflink)
<@trix:fedora.im>
16:35:55
no worries, i did not see any agenda items, maybe this is short meeting ?
<@tflink:fedora.im>
16:36:21
yeah, looks like. probably should have just canceled
<@man2dev:fedora.im>
16:36:27
!hi
<@zodbot:fedora.im>
16:36:28
Mohammadreza Hendiani (man2dev)
<@tflink:fedora.im>
16:36:30
does anyone have any topics to bring up today?
<@trix:fedora.im>
16:36:54
i'm looking at updating pt to 2.7
<@trix:fedora.im>
16:37:15
it will likely have new buildrequires, i have not figured them all out now.
<@tflink:fedora.im>
16:37:34
!info update to pytorch 2.7 is underway in rawhide
<@trix:fedora.im>
16:37:40
atm i am looking at flashattention.
<@trix:fedora.im>
16:38:00
it has either composable_kernel or triton backend.
<@trix:fedora.im>
16:38:32
ck is the better supported one, but also the one we don't have, so i am also giving ck a refresh.
<@tflink:fedora.im>
16:39:08
did the gcc issues get figured out? IIRC, that was the problem I hit when I tried to review it
<@trix:fedora.im>
16:39:19
good question!
<@trix:fedora.im>
16:39:47
yes i did. i 'fixed' rocm-llvm on monday.
<@xanderlent:fedora.im>
16:39:48
!hi
<@zodbot:fedora.im>
16:39:49
Alexander Lent (xanderlent) - he / him / his
<@tflink:fedora.im>
16:40:07
cool, I'll put that review back on my todo list
<@trix:fedora.im>
16:40:31
issue was <array> was throwing an assert because 'size of' elment in deviceland wasn't set.
<@trix:fedora.im>
16:40:55
issue kicked around in pytorch upstream and landed back on me.
<@trix:fedora.im>
16:41:48
so i am going back and fixing where this issue also hits pytorch. that has happened in rh. now waiting on F42 build of rocm-llvm
<@trix:fedora.im>
16:42:10
so maybe a week or two for F42's pytorch to be fixed.
<@trix:fedora.im>
16:42:40
i likely need to push fix to llvm upstream.
<@trix:fedora.im>
16:42:48
on my todo..
<@tflink:fedora.im>
16:42:55
!info there are reviews needed for new packages, rocAL and composable_kernel are among these
<@trix:fedora.im>
16:43:09
yes.
<@trix:fedora.im>
16:43:22
i also have some for ollama addons.
<@tflink:fedora.im>
16:43:32
F42 should be out of beta freeze before too much longer. I haven't been watching the current status terribly closely, though
<@trix:fedora.im>
16:43:41
python-ollama and a string that leads to emacs-ollama.
<@tflink:fedora.im>
16:43:56
ollama needs emacs?
<@trix:fedora.im>
16:44:12
emacs has an ollama mode
<@man2dev:fedora.im>
16:44:29
its a plugin to use llms with emacs
<@man2dev:fedora.im>
16:44:38
there are several for vim as well
<@trix:fedora.im>
16:44:44
think of cheezy copilot for emacs fans
<@trix:fedora.im>
16:45:20
yes, i'd like to get at least one vim in, but i am not vi fan, so would need help suggesting and verifying
<@trix:fedora.im>
16:45:27
or just doing the vim plugin
<@tflink:fedora.im>
16:45:39
ok, just figured that the plugin would require ollama, not the other way around
<@trix:fedora.im>
16:46:29
yes. ollama has nice network/rest interface lots of things use it
<@trix:fedora.im>
16:47:03
i'd like a coding assistent in my emacs, so that's why i did emacs.
<@man2dev:fedora.im>
16:47:31
https://github.com/ggml-org/llama.vscode.git
<@man2dev:fedora.im>
16:47:31
https://github.com/microsoft/vscode-copilot-release.git
<@man2dev:fedora.im>
16:47:31
https://github.com/ggml-org/llama.vim.git
<@man2dev:fedora.im>
16:47:45
other simulaer packages
<@trix:fedora.im>
16:48:01
i also looked at vscode for fedora, and decided i didn't want to do that.
<@man2dev:fedora.im>
16:48:04
other similar packages
<@trix:fedora.im>
16:48:37
someone that uses vscode day in day out could take that.
<@man2dev:fedora.im>
16:48:40
yes its needs a lot of packages
<@tflink:fedora.im>
16:49:01
rephrasing to make sure I understood: there are reviews that will be needed before pytorch can be updated (composable_kernel, mostly). There will also be reviews needed for bits that ollama requires to support emacs/vim/etc. plugins
<@mystro256:fedora.im>
16:49:09
Sorry was distracted , looking at rocal right now
<@tflink:fedora.im>
16:49:29
good to know, I was going to get to it later today :)
<@trix:fedora.im>
16:49:52
tflink: yes. multiple reviews a set for rocm, some for pytorch, some for ollama.
<@tflink:fedora.im>
16:50:16
are they all blocking the ML review tracker?
<@trix:fedora.im>
16:50:30
ah, i stopped using that.
<@trix:fedora.im>
16:50:48
maybe i should use it again.
<@tflink:fedora.im>
16:50:51
is there a list of the packages which need review somewhere?
<@mystro256:fedora.im>
16:51:07
https://bugzilla.redhat.com/show_bug.cgi?id=2348762
<@mystro256:fedora.im>
16:51:07
(rocm metapackage)
<@mystro256:fedora.im>
16:51:07
I was also reviewing this sorry:
<@trix:fedora.im>
16:51:38
oh yeah that also came up, some asked why don't we have a convience package to grab everything.
<@mystro256:fedora.im>
16:51:44
Tom Usually just CC's me, maybe we should get a better system :)
<@trix:fedora.im>
16:52:34
yes. better system.
<@tflink:fedora.im>
16:52:41
yeah, the only way I know of to learn about the reviews that are needed is poking Tom which doesn't scale terribly well :)
<@trix:fedora.im>
16:53:46
start using hc package list for the rocm things ? what about the ai/ml things ?
<@tflink:fedora.im>
16:54:27
whatever works and doesn't require human input to read is fine with me
<@tflink:fedora.im>
16:54:44
tracking BZ, wiki page (so long as we update it), ...
<@man2dev:fedora.im>
16:55:50
the way i see it the problem is all of these require maintenance and they get lost easily
<@tflink:fedora.im>
16:56:20
I don't disagree but the other option is to not have a list of the reviews that need to be done
<@man2dev:fedora.im>
16:56:23
should we just use a private mailing list
<@tflink:fedora.im>
16:56:56
tracking BZ would probably be easiest since that gets updated when the reviews are complete
<@trix:fedora.im>
16:57:20
i'll start a chart like the hc one in ai/ml sig page for the non rocm ai things.
<@tflink:fedora.im>
16:57:56
!action trix to create a chart in the wiki to list needed ai/ml package reviews
<@trix:fedora.im>
16:57:59
dang, i assigned myself an action item 😑
<@tflink:fedora.im>
16:58:15
so long as we remember to update the list :)
<@man2dev:fedora.im>
16:58:21
my thought was just having separate mailing thread for each topic and ignoring it we are done with it
<@tflink:fedora.im>
16:58:51
we don't have a mailing list, though and new Fedora mailing lists are discouraged in lieu of discourse
<@trix:fedora.im>
16:59:06
email ?!? what's that.
<@tflink:fedora.im>
17:01:40
!info today's meeting has been less organized so as a summary - F42 looks good, updates are coming in rawhide and reviews are needed. There will be a renewed list of needed package reviews coming soon (lists of reviews for both hc/rocm and ai/ml)
<@tflink:fedora.im>
17:01:45
does that look OK to everyone?
<@tflink:fedora.im>
17:02:03
rather, does anyone disagree with my single-sentance-summary?
<@xanderlent:fedora.im>
17:02:32
Looks good to me
<@trix:fedora.im>
17:03:02
👍️
<@tflink:fedora.im>
17:03:14
cool, any other topics to cover today?
<@xanderlent:fedora.im>
17:04:23
Update from me on the Intel NPU:
<@tflink:fedora.im>
17:04:32
!topic intel NPU update
<@tflink:fedora.im>
17:04:45
sorry, trying to keep some level of organization to the minutes :)
<@xanderlent:fedora.im>
17:06:16
<@xanderlent:fedora.im>
17:06:16
I'm still debugging the build since it is complicated; I'll leave that discussion for the usual chat.
<@xanderlent:fedora.im>
17:06:16
It looks like we will be able to use packaged LLVM 18 instead of building from their sources.
<@xanderlent:fedora.im>
17:06:16
<@xanderlent:fedora.im>
17:06:16
First, I've made substantial progress on the remaining compiler component. I have a draft package that mostly finishes the CMake configure step.
<@trix:fedora.im>
17:07:21
errr.. llvm18 umm isn't that going away with llvm20
<@tflink:fedora.im>
17:07:43
hasn't it gone away in rawhide now that llvm20 has landed?
<@tflink:fedora.im>
17:07:52
!info Alexander Lent has made progress on the bits needed for using Intel NPUs in Fedora and it looks like the llvm18 packaged in Fedora will be usable instead of having to build a fork from source
<@xanderlent:fedora.im>
17:08:02
Second, the Intel NPU firmware is going upstream to linux-firmware. I will file a bug and/or PR when the next release happens, and hopefully we will have the firmware in Rawhide shortly.
<@tflink:fedora.im>
17:08:55
!info the intel NPU firmware will be landing upstream in linux-firmware, updates will come once that process is complete
<@xanderlent:fedora.im>
17:09:33
Finally, I have submitted the first review for one of the Huggingface Python packages, which the NPU Python library uses. More to come in the following days/weeks.
<@xanderlent:fedora.im>
17:09:46
(This first one is python-safetensors.)
<@tflink:fedora.im>
17:09:55
I assume you need a reviewer for python-safetensors?
<@tflink:fedora.im>
17:10:34
!info review needed for one of the huggingface python libraries needed for intel's NPU
<@xanderlent:fedora.im>
17:10:38
@trix has already claimed the review.
<@tflink:fedora.im>
17:10:45
ah, cool
<@tflink:fedora.im>
17:10:47
!undo
<@tflink:fedora.im>
17:11:09
!info review is in progress for python-safetensors (one of the huggingface python libraries)
<@trix:fedora.im>
17:11:35
yes, and we got past why shouldn't the rust-* take it.
<@tflink:fedora.im>
17:11:53
it's a python wrapper around rust?
<@trix:fedora.im>
17:12:01
yes.
<@tflink:fedora.im>
17:13:07
great to see progress on this
<@tflink:fedora.im>
17:13:14
anything else on the NPU situation?
<@xanderlent:fedora.im>
17:14:54
I've gently probed the AMD NPU packages (amd-xdna and xrt). I have a draft package that builds but all of the install paths are weird. I'll bring it up in the normal chat with @trix who was also poking at it, I think.
<@tflink:fedora.im>
17:15:40
wow, you've been busy
<@trix:fedora.im>
17:15:59
i am interest in seeing it in Fedora but don't have time to do it.
<@zodbot:fedora.im>
17:16:14
man2dev gave a cookie to xanderlent. They now have 2 cookies, 2 of which were obtained in the Fedora 41 release cycle
<@tflink:fedora.im>
17:16:29
!info some progress has been made on the AMD NPU packages as well, draft packages are ready but will need more work
<@xanderlent:fedora.im>
17:18:49
That's all from me for today.
<@tflink:fedora.im>
17:19:06
that was quite a bit, thanks
<@tflink:fedora.im>
17:19:12
any other topics to cover today?
<@tflink:fedora.im>
17:19:28
!topic open floor
<@tflink:fedora.im>
17:22:17
ok, thanks for coming everyone
<@tflink:fedora.im>
17:22:44
Next meeting will be in 2 weeks - March 27
<@tflink:fedora.im>
17:22:47
!endmeeting