infrastructure
LOGS
16:00:28 <dtometzki> #startmeeting Infrastructure (2021-05-27)
16:00:28 <zodbot> Meeting started Thu May 27 16:00:28 2021 UTC.
16:00:28 <zodbot> This meeting is logged and archived in a public location.
16:00:28 <zodbot> The chair is dtometzki. Information about MeetBot at http://wiki.debian.org/MeetBot.
16:00:28 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
16:00:28 <zodbot> The meeting name has been set to 'infrastructure_(2021-05-27)'
16:00:28 <dtometzki> #meetingname infrastructure
16:00:28 <zodbot> The meeting name has been set to 'infrastructure'
16:00:28 <dtometzki> #chair nirik siddharthvipul mobrien zlopez pingou bodanel dtometzki jnsamyak
16:00:28 <dtometzki> #info Agenda is at: https://board.net/p/fedora-infra
16:00:28 <dtometzki> #info About our team: https://docs.fedoraproject.org/en-US/cpe/
16:00:28 <zodbot> Current chairs: bodanel dtometzki jnsamyak mobrien nirik pingou siddharthvipul zlopez
16:00:28 <dtometzki> #topic ahoy!
16:00:35 <dtometzki> .hi
16:00:36 <zodbot> dtometzki: dtometzki 'Damian Tometzki' <linux@tometzki.de>
16:00:48 <nirik> avast me hearties! (ie, morning)
16:00:53 <darknao> .hi
16:00:54 <zodbot> darknao: darknao 'Francois Andrieu' <naolwen@gmail.com>
16:00:56 <ayustae> Hello
16:02:12 <dtometzki> we will wait to come in and we go forward in one minute
16:02:15 <siddharthvipul> hey hey everyone
16:02:21 <siddharthvipul> .hello siddharthvipul1
16:02:21 <dtometzki> hi
16:02:22 <zodbot> siddharthvipul: siddharthvipul1 'Vipul Siddharth' <siddharthvipul1@gmail.com>
16:03:46 <dtometzki> hope all are healthy ?
16:04:32 <dtometzki> so we go forward
16:04:35 <dtometzki> #topic New folks introductions
16:04:36 <dtometzki> #info This is a place where people who are interested in Fedora Infrastructure can introduce themselves
16:04:36 <dtometzki> #info Getting Started Guide: https://fedoraproject.org/wiki/Infrastructure/GettingStarted
16:05:03 <dtometzki> any new people here ?
16:05:07 <siddharthvipul> dtometzki: hope you are doing good too :)
16:05:14 <dtometzki> yeah
16:06:12 <austinpowered> .hello2
16:06:13 <zodbot> austinpowered: austinpowered 'T.C. Williams' <fedoraproject@wootenwilliams.com>
16:06:51 <siddharthvipul> austinpowered: hey, long time! (I have been missing this meeting lately) :D
16:07:07 <dtometzki> hello
16:07:28 <austinpowered> Been distracted with my boat.
16:07:33 <dtometzki> austinpowered, welcome back
16:07:54 <siddharthvipul> austinpowered: that's one of the top 5 things I have heard to be distracted by
16:07:59 <dtometzki> ok lets go
16:08:03 <dtometzki> #topic Next chair
16:08:03 <dtometzki> #info magic eight ball says:
16:08:03 <dtometzki> #info chair 2021-06-03 - siddharthvipul
16:08:03 <dtometzki> #info chair 2021-06-10 - bodanel
16:08:03 <dtometzki> #info chair 2021-06-17 - ???
16:08:38 <dtometzki> anyone for 06-17 ?
16:08:39 <austinpowered> I'm sort of retired. Too many distractions. ;)
16:08:53 <siddharthvipul> dtometzki: I can volunteer
16:09:27 <dtometzki> #info chair 2021-06-17 - siddharthvipul
16:09:32 <dtometzki> many thanks
16:10:14 <dtometzki> now we come to the news topic
16:10:20 <dtometzki> #topic announcements and information
16:10:20 <dtometzki> #info CPE Infra&Releng EU-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1030 Europe/paris in #centos-meeting
16:10:20 <dtometzki> #info CPE Infra&Releng NA-hours team has a Monday through Thursday 30 minute meeting going through tickets at 1800 UTC in #fedora-meeting-3
16:10:20 <dtometzki> #info work is being done on getting COPR proper powerPC systems
16:10:20 <dtometzki> #info The Red Hat Desktop team is hiring: https://blogs.gnome.org/uraeus/2021/05/20/new-opportunities-in-the-red-hat-desktop-team/
16:10:24 <dtometzki> #info Fedora Linux 32 reached end of life
16:10:25 <dtometzki> #info F34 election voting is open through 3 June: https://communityblog.fedoraproject.org/f34-elections-voting-now-open/
16:10:28 <dtometzki> #info If your team wants support from the Fedora Program Management Team, file an isssue: https://pagure.io/fedora-pgm/pgm_team/issues?template=support_request
16:10:31 <dtometzki> #info nest with Fedora CFP is open! https://communityblog.fedoraproject.org/announcing-dates-cfp-for-nest-with-fedora/ (Aug 5th-8th)
16:10:34 <dtometzki> #info mobrien is away 2021-05-10 to 2021-06-20
16:10:54 <dtometzki> any additional information to that ?
16:11:29 <nirik> Oh, just a quick note:
16:11:57 <nirik> #info tomorrow is a Red Hat recharge day, many RH employees will be out. Monday is a holiday is some parts of the world (US at least) too
16:13:09 <dtometzki> then a nice day and a nice holiday i hope the weather is better in US as in germany
16:13:23 <nirik> it's raining here currently. ;(
16:13:56 <dtometzki> now it stopped raining but it is changing
16:14:34 <dtometzki> #topic Oncall
16:14:34 <dtometzki> #info https://fedoraproject.org/wiki/Infrastructure/Oncall
16:14:34 <dtometzki> #info darknao is on call for 2021-05-13 to 2021-05-20
16:14:34 <dtometzki> #info bodanel is on call for 2021-05-20 to 2021-05-27
16:14:34 <dtometzki> #info siddharthvipul  is on call for 2021-05-27 to 2021-06-03
16:14:35 <dtometzki> #info ? is on call for 2021-06-03 to 2021-06-10
16:14:37 <dtometzki> #info ? is on call for 2021-06-03 to 2021-06-17
16:14:53 <dtometzki> so we have some open positions for on Call
16:14:55 <dtometzki> ?
16:14:59 <nirik> I can take the next one.
16:15:25 <siddharthvipul> I will go ahead and take oncall for this week
16:15:25 <dtometzki> #info nirik is on call for 2021-06-03 to 2021-06-10
16:15:44 <dtometzki> #info dtometzki is on call for 2021-06-03 to 2021-06-17
16:15:58 <siddharthvipul> .oncalltakeeu
16:15:58 <zodbot> siddharthvipul: Error: You don't have the alias.add capability. If you think that you should have this capability, be sure that you are identified before trying again. The 'whoami' command can tell you if you're identified.
16:16:10 <mkonecny> Hm, it looks like the matrix bridge to the Freenode was shot down https://mastodon.matrix.org/@matrix/106301209504019485
16:16:17 <dtometzki> bodanel, you are available )
16:16:20 <dtometzki> ?
16:16:26 <nirik> mkonecny: yes, sorry.
16:16:28 <siddharthvipul> ugh.. okay, I don't remember the command to authenticate :(
16:16:32 <mkonecny> It took me few minutes to figure this out, sorry for being late
16:16:39 <siddharthvipul> it's been a long time since I authenticated last :P
16:16:59 <siddharthvipul> mkonecny: yeah, a lot of freenode drama that might need a call to explain :/
16:17:13 <siddharthvipul> (bridge had to go because of that)
16:17:20 <dtometzki> ...oncalltakeeu
16:17:24 <mkonecny> siddharthvipul: user identify <username> <password>
16:17:29 <siddharthvipul> mkonecny: thank you
16:17:45 <austinpowered> #info
16:17:53 <mkonecny> siddharthvipul: I know about the freenode drama, but the bridge down is fresh
16:18:05 <dtometzki> has anyone some news of the on Call lst week ?
16:18:24 <siddharthvipul> mkonecny: it's all part of the same drama :D
16:18:31 <siddharthvipul> .oncalltakeeu
16:18:31 <zodbot> siddharthvipul: Kneel before zod!
16:18:35 <siddharthvipul> there we go
16:19:15 <dtometzki> #topic Monitoring discussion [nirik]
16:19:15 <dtometzki> #info https://nagios.fedoraproject.org/nagios
16:19:15 <dtometzki> #info Go over existing out items and fix
16:19:17 <siddharthvipul> who was oncall duty for the last week?
16:19:30 <dtometzki> Bodanel
16:19:53 <mkonecny> He may be stuck on matrix bridge as I was
16:20:00 <dtometzki> but he has problems with irc or matrix or both
16:20:28 <dtometzki> nirik do you have some infos ?
16:20:59 <nirik> oh sorry...
16:21:00 <nirik> yes.
16:21:36 <nirik> so we fixed a few things. I got some PR's from darknao I think it was...
16:22:06 <nirik> and... there was someone at the datacenter who I tried to get to fix one alert, and now it seems to be about 10 alerts. So, oh well.
16:22:20 <nirik> otherwise everything is about the same.
16:22:34 <Bodanel_> hi
16:22:36 <dtometzki> ok thanks nirik
16:22:41 <dtometzki> hi Bodanel_
16:22:45 <Bodanel_> hi
16:22:57 <Bodanel_> could not loggin for some reason on my work laptop
16:22:59 <dtometzki> do you have any news about your onCall ?
16:23:10 <dtometzki> last week
16:23:11 <Bodanel_> I got no pings for the last week
16:23:28 <dtometzki> great
16:23:49 <dtometzki> #topic Learning topic
16:23:50 <dtometzki> ```
16:23:50 <dtometzki> #info 2021-05-27 - nirik on vm provisioning process
16:23:50 <dtometzki> #info 2021-06-03 -
16:23:50 <dtometzki> #info 2021-06-10 -
16:23:50 <dtometzki> #info 2021-06-17 -
16:24:03 <dtometzki> i will takeover to nirik
16:24:07 * nirik nods. :)
16:24:26 <nirik> So, our vm provisioning process leverages ansible.
16:24:55 <nirik> In setting up a new vm somewhere, first you add it to dns. ie, you need to pick it's ip address.
16:25:36 <nirik> next you add that ip and a few other variables to the inventory/host_vars/hostname (where hostname is the fully qualified hostname)
16:25:49 <nirik> thats eth0_ip:
16:26:14 <nirik> then if you look in inventory/group_vars/all you can see a bunch of virt_install_ commands...
16:26:29 <mkonecny> nirik: Do we have a static IP or dynamic for the VMs?
16:26:42 <nirik> we do static ips for vm's.
16:26:52 <nirik> so it gets assigned and we use that one
16:27:28 <austinpowered> How do you manage assigned IP addresses?
16:27:29 <nirik> The virt_install_command's have a bunch of variables, but they all pretty much default out to sane values. In the common case you only have to define eth0_ip
16:27:29 <mkonecny> nirik: thanks
16:27:47 <nirik> austinpowered: dns. If it's in dns it's assigned. If it's not it's not. ;)
16:28:14 <austinpowered> OK - so a record is added to DNS first.
16:28:21 <nirik> then if you look at most playbooks they have at the top:
16:28:35 <nirik> - import_playbook: "/srv/web/infra/ansible/playbooks/include/virt-create.yml myhosts=ipsilon:ipsilon_stg"
16:28:44 <nirik> austinpowered: yep
16:28:45 <dtometzki> the linux installation is automated or via image manually ?
16:28:54 <nirik> dtometzki: getting to that. :)
16:29:10 <nirik> so, that playbook... the virt-create.yml... is the place that does the work
16:29:27 <nirik> in there you can see it calls a task:
16:29:32 <nirik> - import_tasks: "{{ tasks_path }}/virt_instance_create.yml"
16:29:44 <nirik> thats tasks/virt_instance_create.yml
16:30:22 <nirik> and finally we get to the work. This task checks to see if a vm already exists/is running. If it is, it just skips all the rest and goes on.
16:30:40 <nirik> If it's not then it creates a logical volume for the vm (if it doesn't exist)
16:30:52 <nirik> then calls virt-install with all the parameters and waits for it to finish.
16:31:10 <nirik> so, ansible fires off virt-install... and waits for it to finish, then restarts the vm and continues.
16:31:54 <nirik> you can adjust the virt-install with various variables... what OS / version / size of disk, etc.
16:32:29 <nirik> so using this the first time it creates the vm. If you ever want to recreate a vm, just undefine it on the host and it will get reinstalled the next time the playbook is run
16:33:00 <nirik> So virt-install does a real actual install with a kickstart file. We have a repo that has those kickstarts in it.
16:33:29 <nirik> We have considered moving to just using the cloud image as it would be much faster, but it's nice to know the full install works and we can customize it a bit more
16:34:24 <nirik> So, thats basically how it works. There's a lot of detail in the variables, but like I said most of them default sanely.
16:34:31 <nirik> Any questions on any of that?
16:35:03 <dtometzki> and the process is the same for aws and onPrem
16:35:11 <dtometzki> ?
16:35:30 <nirik> This is just for our own vm's... for aws we use the images they have usually, we don't do a new install.
16:35:42 <nirik> (ie, the fedora or rhel or centos 'official' images)
16:36:10 <dtometzki> and the fine tuning do ansible ?
16:36:47 <nirik> yeah.
16:37:20 <nirik> Most of what we have in aws is development or one-offs, so we really don't manage much of it from ansible... we might redo that someday
16:37:36 <dtometzki> do you use vmware for virtualization ?
16:38:05 <nirik> no. libvirt/kvm
16:38:17 <Bodanel_> do you plan to use openshift virtualization ?
16:38:40 <nirik> Bodanel_: I'd love to, last I looked it wasn't very usable. But that was a year or two ago now
16:38:54 <nirik> last time I tried I could make a vm, but not access it anyway
16:38:56 <Bodanel_> it got pretty nice
16:39:21 <Bodanel_> could be a variant since we already have some openshift clusters
16:39:27 <nirik> once we have our openshift 4 cluster up we will likely give it a go
16:41:12 <nirik> so, thats the process... :)
16:41:32 <dtometzki> many thanks nirik
16:41:39 <Bodanel_> nirik++
16:42:16 <mkonecny> nirik++
16:42:16 <zodbot> mkonecny: Karma for kevin changed to 24 (for the current release cycle):  https://badges.fedoraproject.org/tags/cookie/any
16:42:22 <dtometzki> any idea for the next week for learning topic ?
16:44:12 <austinpowered> nirik++
16:44:12 <zodbot> austinpowered: Karma for kevin changed to 25 (for the current release cycle):  https://badges.fedoraproject.org/tags/cookie/any
16:44:27 <dtometzki> no ?
16:45:04 <Bodanel_> no, not really
16:45:17 <mkonecny> Does anybody would be interested in release process for Anitya?
16:45:33 <nirik> mkonecny: sure!
16:45:39 <Bodanel_> me
16:45:49 <dtometzki> yes
16:45:51 <nirik> perhaps we could talk also in general release process for any of our apps upstream?
16:45:52 <mkonecny> Ok, so we have topic for next week :-)
16:46:03 <dtometzki> cool mkonecny
16:46:27 <mkonecny> I'm not sure if the release process is same for all of our applications
16:46:48 <nirik> yeah, likely not 100%, but a lot of the process probibly is
16:47:04 <dtometzki> #info 2021-06-03 - release process for Anitya, mkonecny
16:47:14 <mkonecny> dtometzki: :-)
16:47:45 <dtometzki> mkonecny++
16:47:45 <zodbot> dtometzki: Karma for zlopez changed to 1 (for the current release cycle):  https://badges.fedoraproject.org/tags/cookie/any
16:48:04 <dtometzki> #topic Open Floor
16:48:05 <dtometzki> #info møte developement and packaging [siddharthvipul1]
16:48:05 <dtometzki> > porting mote to fedora-messaging vs packaging fedmsg for epel8 vs puting things in container and shippping
16:48:46 <dtometzki> any open floor points to discuss ?
16:50:12 <dtometzki> when no we will close the meeting in one minute
16:51:35 <mkonecny> siddharthvipul: What about the mote?
16:53:42 <dtometzki> siddharthvipul, ?
16:55:01 <mkonecny> It looks like he isn't here
16:55:07 <dtometzki> ok then next week
16:55:20 <dtometzki> Have a nice week and weekend, many thanks to all
16:55:26 <dtometzki> #endmeeting