18:00:09 <nirik> #startmeeting Infrastructure (2014-03-27)
18:00:09 <zodbot> Meeting started Thu Mar 27 18:00:09 2014 UTC.  The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:00:09 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
18:00:09 <nirik> #meetingname infrastructure
18:00:09 <zodbot> The meeting name has been set to 'infrastructure'
18:00:09 <nirik> #topic welcome y'all
18:00:09 <nirik> #chair smooge relrod nirik abadger1999 lmacken dgilmore mdomsch threebean pingou puiterwijk
18:00:09 <zodbot> Current chairs: abadger1999 dgilmore lmacken mdomsch nirik pingou puiterwijk relrod smooge threebean
18:00:16 <danofsatx-work> here
18:00:20 <nirik> who all is around for a exciting infra meeting?
18:00:25 * danofsatx-work is nuking lunch
18:00:26 * tflink is around
18:00:31 * lmacken 
18:00:33 * docent also
18:00:34 * pingou 
18:00:40 * adimania too
18:00:42 * relrod here
18:00:52 <smooge> here
18:00:56 * abadger1999 in other meeting
18:01:32 <nirik> #topic New folks introductions and Apprentice tasks
18:01:42 * randomuser is around
18:01:44 <nirik> any new folks like to introduce themselves today?
18:01:47 * roshi is around
18:01:50 <nirik> or apprentices with questions or comments?
18:02:23 <randomuser> I poked around with some fedorahosted stuff over the weekend, please yell at me if you find anything broken
18:02:49 <randomuser> EOF
18:03:08 <nirik> randomuser: cool. I see there's one new hosted project add pending... if you want to do it. ;)
18:03:35 <docent> Instead of doing apprentice work I'm poking around Docker for the last month (Fedora Docekrfiles; together with Scott Collier)
18:03:58 <nirik> docent: cool. docker is pretty nifty.
18:04:17 <docent> I was at the gitlab-rpm meeting last week and there is possibility that we'll build some gitlab containers in orde rto test some gitlab spins within fedora
18:04:29 <nirik> nice.
18:04:40 <docent> ok, that's it about me :)
18:05:21 <nirik> #topic Applications status / discussion
18:05:30 <nirik> any applications news this week or upcoming?
18:05:40 <pingou> pkgdb2 is getting slowly closer
18:05:51 <pingou> abadger1999: worked on the cron job to sync ACL pkgdb2 <-> git
18:06:05 <pingou> there is still the bugzilla and postfix ones to do
18:06:22 <nirik> ok
18:06:24 <lmacken> a new bodhi release went out this week to fix el5 repodata, should hopefully fix bug #1080373 after the push that is happening right now finishes.
18:06:31 <nirik> #info pkgdb2 moving forward
18:06:46 <nirik> #info new bodhi release to fix el5 repos, should be fixed later today
18:08:46 <nirik> I'm going to look at making a sundries01/02/01.stg set... this would be to move: geoip, freemedia, mirrormanager-admin, and possibly busmon to.
18:08:56 <nirik> ie, move those off the app servers.
18:09:12 <nirik> since they are all small services that don't really need their own instances.
18:09:13 <pingou> what about the cron jobs?
18:09:14 * relrod is working on the jenkins <-> fedmsg plugin again today. I hope to have it done by this weekend sometime though school has been giving me a lot of work these past few weeks. :(
18:09:39 <pingou> relrod: school first, but cool news :)
18:10:01 * threebean wanders in late
18:10:01 <nirik> pingou: good question. We could do cron on those too... unless the crons need access to shared storage or anything?
18:10:16 <nirik> should identify all the crons we have on bapp02 now.
18:10:19 <pingou> nirik: not for the ones I know
18:10:28 <pingou> but I don't know them all :)
18:10:52 <nirik> we will still need a mirrormanager-backend01 for replacing some bapp02 services.... (s3 uploads, crawling mirrors, updating mirrorlists, etc)
18:11:12 <nirik> and I think there's some pkgdb1 stuff running there?
18:11:29 <nirik> just some crons perhaps
18:11:56 * mirek-hm is late, but here
18:12:26 <nirik> oh, another thing I wanted to bring up app wise...
18:12:49 <nirik> have we started looking at what we need to do for rhel7 migrations? I assume packging would need to be worked for our apps...
18:13:07 * threebean nods
18:13:17 <danofsatx-work> yeah, I noticed there was now a 7 branch in EPEL
18:13:20 <threebean> some bits are ready, others are not.  I don't think we've looked systematically at it yet.
18:13:34 <lmacken> we should probably setup a rhel7 dev instance to test with
18:13:58 * pingou notes we do have an el7 builder on jenkins
18:14:15 <mirek-hm> #info copr is now using 20 builders, which is nearly as twice than previously
18:14:15 <nirik> we also have el7b cloud image...
18:15:03 <mirek-hm> and you can start creating packages in copr, which have rhel7 chroot :)
18:15:16 <nirik> mirek-hm: so that issue this morning was just that it wasn't terminiating old builders?
18:15:54 <mirek-hm> nirik: yes, I still dunno why some are not terminated, but I moved the script from cron.daily to cron.hourly
18:16:11 <mirek-hm> I mean script which terminate those left overs
18:16:11 * nirik would like to start moving to el7 as soon as it's out... but of course there's going to be lots of work needed.
18:16:30 <lmacken> do we have any el5 installs lying around still?
18:16:47 <nirik> mirek-hm: yeah. Wonder if you could add some debugging to the regular playbooks it uses... it terminates them in there after use right?
18:17:03 <mirek-hm> yes
18:17:04 <nirik> lmacken: nope, long gone. ;) app07 lingered on, but it was nuked a while back
18:17:21 <lmacken> nirik: ah okay. I wanted to test that updateinfo sha256 issue, but I guess we'll see what happens :)
18:17:58 <nirik> lmacken: I have one here... http://fedoraproject.org/wiki/Test_Machine_Resources_For_Package_Maintainers
18:18:08 <nirik> thats the one I was testing with the other day
18:18:14 <lmacken> oh, excellent
18:19:10 <nirik> #info start thinking about el7 porting/bringup
18:19:10 <lmacken> cool, on it with root. will test :)
18:19:39 <nirik> ok, any other application news?
18:20:20 <nirik> #topic Sysadmin status / discussion
18:20:30 <nirik> ok, on the sysadmin side...
18:20:47 <nirik> #info migrating netapp lun to another filer, so then they can move our nfs volumes.
18:21:01 <nirik> smooge: any roundup of news on new machines?
18:21:29 <smooge> systems are being wired in. that si about it
18:21:38 <smooge> noting from osu or ibiblio on theirs
18:21:51 <nirik> There is a rhel6 kernel update, so likely I will look at updating *stg* tomorrow and schedule an outage for monday to do the rest.
18:22:01 <smooge> yay
18:22:05 <nirik> smooge: we should actively ping them again... (osu and ibiblio)
18:22:12 * pingou also has to reboot
18:22:55 <nirik> lets see... what else.
18:23:44 <nirik> We will be ordering some new retrace hardware soon and actually our cloud storage got moved to Q1, so we will be looking for it soon too.
18:24:06 <nirik> smooge: we should talk to retrace folks and see needs. I can send an email on that.
18:24:18 <nirik> and we should look around at storage solutions and see what we can get.
18:24:19 <smooge> I sent one yesterday
18:24:24 <smooge> waiting for reply
18:24:25 <mirek-hm> great :)
18:24:44 <smooge> I sent one ot the retrace people that is
18:25:00 <smooge> I thought I ccd you but I guess I didn't
18:25:03 <nirik> smooge: cool. Can you send osu/ibiblio emails too? or want me to?
18:25:19 <smooge> I will do so (and make sure I cc you :))
18:25:48 <nirik> on storage we need something that speaks iscsi (thats what the cloud can consume easily), ideally 2 units so we can fail back and forth, but 1 if it's HA enough I guess.
18:26:12 <nirik> #info added fed-cloud03 as another cloud compute node this week.
18:27:08 <nirik> ok, I think thats mostly it on the sysadmin side off hand...
18:27:14 <nirik> #topic Upcoming Tasks/Items
18:27:14 <nirik> https://apps.fedoraproject.org/calendar/list/infrastructure/
18:27:21 <nirik> anything upcoming folks would like to note or schedule?
18:27:27 <nirik> I'd like to mention a few things:
18:27:42 <nirik> * bodhi2/taskotron FAD.
18:27:52 * threebean nods
18:27:57 <nirik> threebean: has been doing great work moving this forward.
18:28:24 <threebean> so, we just got FPL approval this morning
18:28:29 <nirik> oh nice.
18:28:48 <threebean> so the next step is figuring out, I think, how to actually purchase travel tickets and hotel rooms
18:29:06 <nirik> did we decide for sure on a date?
18:29:21 <nirik> early june?
18:29:40 <threebean> ah, kinda.  I sent out an email to all the potential participants suggesting june 1st through june 4th
18:29:50 <threebean> and I only got back positive confirmations so far.
18:29:54 <pingou> \ó/
18:30:18 <nirik> cool.
18:30:19 <threebean> I think that counts as a decision? :P
18:30:27 <nirik> sounds fine to me.
18:30:29 <pingou> agreed :)
18:30:33 <lmacken> cool :)
18:31:34 * relrod didn't get an email but would love to go (and those dates should be fine for me)
18:31:57 <threebean> oh yeah!
18:32:02 <threebean> relrod: sign up here https://fedoraproject.org/wiki/FAD_Bodhi2_Taskotron_2014
18:32:06 <nirik> we should possibly mail the infra list at least about it too?
18:32:11 <nirik> might be others that are interested?
18:32:29 <relrod> threebean: thanks
18:32:35 <threebean> cool.. its just that this will impact the scope of the budget that the fpl just approved today.
18:32:46 <relrod> :( sorry, I didn't know about that page
18:32:56 <nirik> true. ;( well, we can always cut off today and then re-ask for any additions ?
18:33:27 <threebean> huh.. I probably should've emailed the list with it sooner.  sorry.. first time ;/
18:33:42 <nirik> also, now that we know dates, people can fill in actual costs?
18:34:04 <threebean> yeah, I actually looked up plane fare for the dates and put it in the budget at the bottom already.
18:34:08 <nirik> ah, nice.
18:34:13 <smooge> Ha! I will stay 450 miles away the entire time!
18:34:27 <nirik> smooge: drive on up? ;)
18:34:42 <smooge> only one car to the household so not really :)
18:35:14 <nirik> ok, anything else on this fad? :)
18:35:33 <danofsatx-work> where, again?
18:35:38 <tflink> denver, co
18:35:41 * nirik nods.
18:35:50 <dgilmore> did we decide on dates for sure?
18:36:01 <nirik> dgilmore: everyone said june 1-4th worked.
18:36:08 <threebean> dgilmore: I got back only "yes"s for june1-4th, yeah.
18:36:56 <dgilmore> threebean: nirik: cool, ill look at flights
18:37:41 <nirik> So, I was wondering about another fad later in the year... 'finish ansible migration'. Would there be interest in that from folks? Would people prefer that be seperate later in the year, or perhaps we could see about tying it to flock and have people arrive early or stay late? (but then flock is longer/more busy)
18:38:03 <adimania> I would be interested in that.
18:38:13 * jsmith is half-interested
18:38:29 <nirik> cool. I dont know if everyone interested would also be going to flock? or if seperate would be better?
18:38:30 <dgilmore> nirik: i think seperate from flock
18:39:03 <relrod> separate, and yes interested :)
18:39:03 * pingou is also interested but expensive to fligh
18:39:12 <smooge> I would be interested in that.
18:39:22 <adimania> flight expense may be an issue for me as well.
18:39:32 <nirik> ok. I'll float the idea on the list too, just wanted to toss it out there.... possibly september/oct?
18:39:41 <nirik> adimania: where are you located again?
18:39:48 <adimania> India.
18:40:03 <nirik> ah, ok. Are you going to make it to flock? (in prague)
18:40:15 <relrod> It might be an issue for me with school though, depending on when it was and how long. :/
18:40:21 <adimania> I hope so.
18:40:28 <dgilmore> nirik: a couple of days either side of flock might be doable
18:40:49 <nirik> dgilmore: thats what I was wondering, but as noted it makes flock longer, more time away, etc.
18:41:00 <nirik> anyhow, will float the idea on the list.
18:41:16 <nirik> and finally, talking about flock: have folks submitted talks?
18:41:32 <nirik> Are there any infra wide things we want to submit or work on? workshops, etc?
18:41:34 <adimania> I have submitted a talk and a workshop.
18:41:38 <dgilmore> nirik: I plan on being in .cz for at least 2 weeks anyway
18:41:41 <nirik> adimania: great!
18:41:47 <adimania> talk on ansible and workshop on docker.
18:42:02 * dgilmore needs to submit talks last i looked there was cert issues and i didnt look into it closer
18:42:10 <mirek-hm> I submited copr talk
18:42:12 * tflink may submit a proposal for a talk on phabricator
18:42:14 <nirik> adimania: ah ha. Yours is the infrastructure ansible one? or the jenkins ansible one? I was thinking of doing an ansible one, but you beat me to it.
18:42:41 <nirik> dgilmore: deadline is soon.
18:42:47 <nirik> apr 3rd I think.
18:42:50 <dgilmore> nirik: certs sorted out?
18:42:54 <nirik> so it's really far in advance.
18:42:58 <adimania> dgilmore, that is because *.rhcloud.com cert is installed there.
18:43:04 <nirik> smooge / lmacken: ^
18:43:10 <pingou> nirik: a bit too far in advance :(
18:43:11 <smooge> dgilmore, certs aren't going to be settled for a bit
18:43:24 <mirek-hm> but one of the link goes to somethign.rhcloud.com so then cert is ok.
18:43:29 <dgilmore> pretty shoddy to happen
18:43:40 <pingou> https://flock-lmacken.rhcloud.com/
18:43:49 <dgilmore> pingou: not where i ended up
18:44:01 <adimania> nirik, mine is infrastructure ansible one but I would be more than happy to collaborate with you on this. :)
18:44:04 <smooge> nirik, lmacken the flocktofedora.org is not owned by Red Hat. So it can't get a cert for it. Until the domain is transferred the owner (tom) has to get one.
18:44:05 <nirik> a signed cert really only tells you that someone paid for it.
18:44:07 <relrod> tflink: oh neat.
18:44:13 <mirek-hm> yes, one link is registration.flock.com and that have wrong cert
18:44:17 <mirek-hm> or had
18:44:48 <nirik> adimania: ah, ok. Yeah, happy to help
18:46:10 <nirik> I was thinking of submitting some more community type talks... like 'how to get your way in community projects' or something. will come up with some before the deadline I'm sure.
18:46:35 <pingou> do we want the infra present & future talk?
18:46:42 <pingou> as in, what we are working on?
18:46:59 <nirik> we could. have each person do a part of it?
18:47:22 <adimania> +1
18:47:22 <pingou> if they want, sure that'll make only better :)
18:47:33 <nirik> I could submit that if you like.
18:47:59 <pingou> you can put me co-owner if you want
18:48:49 <nirik> how do you do that? multiple fas names in that field?
18:49:07 <pingou> that what I did for the talk with Stanislav
18:49:11 <nirik> ok
18:49:26 <nirik> #topic Open Floor
18:49:29 * relrod is happy to speak at that too. Could talk about Fedora Mobile or something :)
18:49:36 <nirik> any items for open floor?
18:49:41 <pingou> I won't be there next week, I'll be at LGM w/ ryan :)
18:49:53 <pingou> (and a number of other Fedora contributors)
18:50:21 <danofsatx-work> open floor item: easyfix tickets for fi-apprentices?
18:50:40 <pingou> danofsatx-work: sysadmin or dev?
18:50:46 <danofsatx-work> I've been looking for something to cut my teeth on, but the last tickets were submitted in Feb
18:51:03 <nirik> danofsatx-work: keep meaning to try and file some. ;( will try harder
18:51:05 <danofsatx-work> sysadmin....only code I can write is scripts to to sysadmin work ;)
18:52:17 <danofsatx-work> other than that, nirik knows I want to help with the cloud migration to havana
18:52:18 <nirik> sometimes it's hard to come up with good ones, but I will try. ;)
18:52:31 <smooge> documentation :)..
18:53:25 <adimania> I am going to work some more on mediawiki ansible migration over the weekend. I hope I'll be able to finish it this weekend.
18:54:11 <nirik> adimania: great.
18:55:05 <nirik> ok, if nothing else will close out in a minute.
18:55:54 <nirik> alright. Thanks for coming everyone!
18:55:57 <nirik> #endmeeting