18:00:00 <nirik> #startmeeting Fedora Infrastructure Ops Daily Standup Meeting 18:00:00 <zodbot> Meeting started Mon Aug 31 18:00:00 2020 UTC. 18:00:00 <zodbot> This meeting is logged and archived in a public location. 18:00:00 <zodbot> The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:00:00 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic. 18:00:00 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting' 18:00:00 <nirik> #chair mboddu nirik smooge pingou mobrien 18:00:01 <nirik> #meetingname fedora_infrastructure_ops_daily_standup_meeting 18:00:01 <nirik> #info meeting is 30 minutes MAX. At the end of 30, its stops 18:00:01 <nirik> #info agenda is at https://board.net/p/fedora-infra-daily 18:00:01 <zodbot> Current chairs: mboddu mobrien nirik pingou smooge 18:00:01 <zodbot> The meeting name has been set to 'fedora_infrastructure_ops_daily_standup_meeting' 18:00:01 <nirik> #topic Tickets needing review 18:00:03 <nirik> #info https://pagure.io/fedora-infrastructure/issues?status=Open&priority=1 18:00:17 * nirik waits to see who's around and who wants to modify tickets. 18:01:21 <mboddu> I am here 18:01:27 <mboddu> And I can modify tickets 18:01:35 <nirik> cool. 18:01:43 <nirik> .ticket 9281 18:01:44 <zodbot> nirik: Issue #9281: Logging in bugzilla via ipsilon returns a 500 error - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9281 18:01:56 <nirik> I wonder on this one if we shouldn't file an upstream ticket... 18:02:32 <mboddu> should or shouldn't? 18:02:33 <smooge> where? 18:03:05 <nirik> https://pagure.io/ipsilon/ 18:03:14 <nirik> should file upstream instead 18:03:29 <nirik> because I don't know that we have the understanding to fix this... 18:03:39 <nirik> or I suppose it could be on the bugzilla side, I am not sure. 18:04:00 <fm-admin> pagure.issue.edit -- mobrien edited the close_status and status fields of ticket fedora-infrastructure#9283 https://pagure.io/fedora-infrastructure/issue/9283 18:04:01 <fm-admin> pagure.issue.comment.added -- mobrien commented on ticket fedora-infrastructure#9283: "Update Varnish configuration to work with version 6.4.0" https://pagure.io/fedora-infrastructure/issue/9283#comment-674651 18:04:17 <mboddu> nirik: Lets start with ipsilon and see what they can find 18:04:36 <nirik> ok, should we ask pingou to refile? or just do it ourselves? 18:04:37 <mboddu> And we dont know if its persistent as Pierre is not around atm 18:04:55 * mboddu can file the ticket 18:05:04 <mboddu> Close and move upstream? 18:05:06 <nirik> yep. 18:05:24 <mboddu> ack 18:05:25 <nirik> I think it's sporadic... might be bugzilla is sometimes throwing the wrong thing 18:05:46 <nirik> .ticket 9282 18:05:47 <zodbot> nirik: Issue #9282: chromium builds hanging on aarch64 builders in koji - fedora-infrastructure - Pagure.io - https://pagure.io/fedora-infrastructure/issue/9282 18:06:05 <nirik> so, this was due to both heavybuilder aarch64 boxes not checking in... 18:06:10 <nirik> because kojid was oom killed. 18:06:27 <nirik> I'd like to push a change to set kojid to Restart on failure... 18:06:48 <nirik> so, keep this open to track that? or we could just close it. 18:06:55 <fm-admin> pagure.issue.new -- mohanboddu opened a new ticket ipsilon#343: "Logging in bugzilla via ipsilon returns a 500 error" https://pagure.io/ipsilon/issue/343 18:07:19 <fm-admin> pagure.issue.edit -- mohanboddu edited the close_status and status fields of ticket fedora-infrastructure#9281 https://pagure.io/fedora-infrastructure/issue/9281 18:07:20 <fm-admin> pagure.issue.comment.added -- mohanboddu commented on ticket fedora-infrastructure#9281: "Logging in bugzilla via ipsilon returns a 500 error" https://pagure.io/fedora-infrastructure/issue/9281#comment-674653 18:07:26 <nirik> or... another solution: 18:07:28 <mobrien> I would say keep it open as then you can reference the ticket in the freeze break request 18:07:49 <mboddu> +1 18:08:04 <nirik> set: OOMScoreAdjust=-1000 in the kojid unit, so the oom killer never kills it. 18:08:07 <fm-admin> pagure.issue.comment.added -- ngompa commented on ticket ipsilon#343: "Logging in bugzilla via ipsilon returns a 500 error" https://pagure.io/ipsilon/issue/343#comment-674657 18:08:44 <nirik> ok, so med/med/ops? 18:08:47 <mboddu> I am not sure not killing it is a good idea 18:08:53 <mboddu> +1 18:09:11 <fm-admin> pagure.issue.tag.added -- mohanboddu tagged ticket fedora-infrastructure#9282: medium-gain, medium-trouble, and ops https://pagure.io/fedora-infrastructure/issue/9282 18:09:12 <fm-admin> pagure.issue.edit -- mohanboddu edited the priority fields of ticket fedora-infrastructure#9282 https://pagure.io/fedora-infrastructure/issue/9282 18:09:35 <nirik> well, restarting also can be bad... if there's a config issue or something it will keep cycling. 18:09:44 <mboddu> True 18:09:51 <smooge> There is not good solution 18:09:59 <nirik> mobrien: you want to discuss 9283 ? 18:10:03 <smooge> Just a series of bad ones like a weekend bender 18:10:11 <mboddu> Haha, true smooge 18:11:14 <mobrien> nirik I downgraded varnish to version 6.3.2 which was on another proxy which is working and its stiill bust so I closed the ticket as invalid as that is not the cause of it 18:11:33 <nirik> huh. ;( 18:12:01 <nirik> mobrien: different gcc versions? 18:12:13 <mobrien> I'm not really sure why its breaking, you'd think since its ansible its the same everywhere 18:12:18 <mobrien> I'll checkk gcc 18:12:33 <nirik> varnish amusingly uses gcc to 'compile' it's rules... 18:12:58 <nirik> thats all the infra ones. 18:13:02 <nirik> mboddu: any releng ones? 18:13:16 <mboddu> Well, none right now as I fixed them already :) 18:13:23 <mboddu> But I have a ticket to discuss 18:13:32 <mobrien> huh, the newer proxy has an older version of gcc 18:13:35 <nirik> 😎 18:13:44 <smooge> man varnish should use yacc 18:13:55 <mboddu> .releng 9468 18:13:56 <nirik> mboddu: go head 18:13:56 <zodbot> mboddu: Issue #9468: Please send openh264 2.1.1 builds to Cisco - releng - Pagure.io - https://pagure.io/releng/issue/9468 18:14:10 <mboddu> nirik: The binaries are deployed on Cisco CDN 18:14:28 <mboddu> But the compose dir has changed the structure 18:14:30 <nirik> cool. Did we get rawhide too? 18:14:34 <mboddu> Yup 18:14:36 <nirik> oh hum. 18:14:47 <nirik> did repodata move? 18:15:14 <mboddu> Yup 18:15:29 <mboddu> nirik: The old os/ vs non os/ dir 18:15:44 <mboddu> Well, the newer composes has os/ in them 18:16:25 <nirik> so, I'd say: sync the new one and make sure it's in place... get adrianr to change it in the mirrormanager db, remove the old ones? 18:17:09 <mboddu> Thats what I am thinking 18:17:17 <nirik> yeah, should work fine 18:17:26 <mboddu> mv the old ones and then remove them if no one complains 18:17:47 <nirik> sure, to be safe. ;) 18:18:12 <nirik> ok, anything else on that or from releng? 18:18:16 <mboddu> nirik: And with the metalink change, they are still pointing to /srv/web/codecs.fedoraproject.org/openh264/ on sundries01, right? 18:18:36 <mboddu> Just making sure as I forgot what we changed :D 18:19:03 <nirik> mboddu: no, they point to the proxies... but the proxies sync from sundries 18:19:23 <nirik> https://codecs.fedoraproject.org/openh264/33/x86_64/repodata/repomd.xml 18:19:28 <mboddu> Ah right, so sync to sundries should just work fine as we used to, thanks 18:19:42 <nirik> yep 18:20:03 <mboddu> Thanks nirik 18:20:05 <mboddu> Thats all I got 18:20:30 <nirik> Oh, I had one releng thing: after a really long path, I have the windows signing cert now, can pass that on to mboddu and jednorozec. I am still working on the apple one. 18:20:46 <nirik> ok, any other tickets or issues or prs or anything folks want to bring up? 18:20:51 <mboddu> nirik: Awesome news 18:21:08 <mboddu> None from me 18:21:50 <nirik> I'm planning on working on stg deployment today. Hopefully unblock the noggin team at least 18:22:00 <mboddu> staging++ 18:23:09 <miausX> Sorry, guys, the candidates to join the apprentice team should wait to the weekly meeting? 18:23:12 <fm-admin> pagure.issue.comment.added -- simo commented on ticket ipsilon#343: "Logging in bugzilla via ipsilon returns a 500 error" https://pagure.io/ipsilon/issue/343#comment-674660 18:23:53 <nirik> miausX: nope, you can ask here... ;) did you send your into email to the list yet? and see https://fedoraproject.org/wiki/Infrastructure/GettingStarted 18:23:59 <mboddu> miausX: If you already attended one of the weekly meetings, then you can request it here 18:24:13 <miausX> nirik: Yup! 18:24:54 <miausX> mboddu: Nope, never attended one. 18:25:52 <miausX> nirik: I know I have a long way behind me to be useful. Just wanted to join the apprentice team to learn. 18:26:01 <mboddu> I guess the email to the list is good enough 18:26:20 <nirik> miausX: is your fas login the same as your irc nick? or ? 18:26:35 <nirik> if nothing more for the meeting, closing that out 18:26:37 <nirik> #endmeeting