19:02:52 <nirik> #startmeeting Infrastructure (2014-01-23) 19:02:52 <zodbot> Meeting started Thu Jan 23 19:02:52 2014 UTC. The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot. 19:02:52 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic. 19:02:52 <nirik> #meetingname infrastructure 19:02:52 <nirik> #topic welcome y'all 19:02:52 <nirik> #chair smooge relrod nirik abadger1999 lmacken dgilmore mdomsch threebean pingou puiterwijk 19:02:52 <zodbot> The meeting name has been set to 'infrastructure' 19:02:52 <zodbot> Current chairs: abadger1999 dgilmore lmacken mdomsch nirik pingou puiterwijk relrod smooge threebean 19:03:06 * relrod waves 19:03:07 * lmacken 19:03:14 * threebean is here 19:03:16 * adimania says hi 19:03:18 * oddshocks is here but has to split in around 40 minutes 19:03:18 <mariocav> hello 19:03:25 * johe2 is here 19:03:36 * abadger1999 is here but also paying attention to the board meeting 19:04:15 * willo mubbles morning 19:04:45 <nirik> #topic New folks introductions and Apprentice tasks. 19:05:00 <nirik> any new folks like to introduce themselves? or apprentices with questions or comments? 19:05:08 <mariocav> yep, me! 19:05:12 <mariocav> ^^ 19:05:30 <threebean> mariocav: hi there :) 19:05:46 * dgilmore is here but will be heading home soon 19:05:47 <lmacken> (hah, my local fedmsg-notify popped up the meeting topic change before it appeared in my irc client) 19:05:56 <mariocav> well, my name is Mario, I'm from Barcelona. 19:06:05 <nirik> mariocav: welcome. Are you more interested in sysadmin type things? or applications development ? or both? 19:06:12 <nirik> lmacken: yeah, that happens to me sometimes too. ;) 19:06:14 <mariocav> I really don't know 19:06:16 <mariocav> I mean 19:06:31 <mariocav> What I'm doing these days is to read wikis and get information about the services you cover. 19:06:52 <nirik> great. 19:06:52 <mariocav> My experience is very limited (html/css/php/js, c++, and admin of 2 centos servers that offer basic web services - http/dns and mail) 19:07:07 <mariocav> so I don't thing I'll start contributing shortly 19:07:23 <mariocav> Anyways, if someone has any suggestion on what he/she would to next... I'll appreciate 19:07:29 <mariocav> think* 19:07:30 <nirik> well, welcome and do ask questions as you run into them. :) Our usual channels (#fedora-admin, #fedora-apps, #fedora-noc are good for that ongoing) 19:07:40 <mariocav> thank you 19:07:42 * randomuser is lurking around. reading infra docs at a very slow pace 19:07:57 <mariocav> well, that's it 19:07:59 <mariocav> :) 19:08:01 <nirik> randomuser: cool. :) 19:08:07 <nirik> welcome again! 19:08:22 <randomuser> thanks 19:08:29 <nirik> #topic Applications status / discussion 19:08:39 <nirik> any applications news on plans upcoming? 19:08:53 <nirik> I've one thing to sort of note: 19:09:25 <nirik> #info fedorahosted.org/reviewboard is back up with openid (thanks to puiterwijk!). Still some issues to work out, but hopefully we can look at it again and see if it's useful now. 19:09:37 <abadger1999> yay! 19:09:46 <sgallagh> What are the remaining issues? 19:09:51 <abadger1999> thanks puiterwijk! 19:10:03 * sgallagh thought puiterwijk had it solved yesterday 19:10:06 <nirik> sgallagh: well, I had issues trying to add a remote repo and do a review against it. Might be operator error. 19:10:18 <nirik> it's much faster than before IMHO. 19:10:28 <nirik> I think we can make it faster yet if we want. 19:10:38 <sgallagh> nirik: 2-3s per page instead of 20-50s is a big improvement, yes 19:10:55 <nirik> if we move the db to the same datacenter I think it would be faster. 19:11:07 <nirik> right now it's hitting that over the vpn 19:11:33 <sgallagh> Yes. I also saw some upstream commits recently that should hopefully reduce the DB activity as well (for RB 2.0) 19:11:55 <nirik> also, I wonder if it would make sense to move it to it's own instance? or is having the local git repos a big advantage? 19:12:39 <sgallagh> nirik: The local git repos are no longer necessary 19:12:56 <sgallagh> I added patches upstream a while ago to support fedorahosted cgit from remote locations 19:13:02 <nirik> yeah, didn't think so. ;) so, we might move it to it's own instance with it's own db... which might make it faster. 19:13:14 <sgallagh> They were necessary when we originally set it up. 19:13:26 <nirik> then it could possibly be very useful to us. :) 19:13:48 <sgallagh> Well, we need to do some performance testing 19:13:56 <nirik> sure. 19:14:03 <sgallagh> i.e. Is the DB speedup more valuable than the loss of the local git access? 19:14:20 <sgallagh> Because while cgit works pretty well, it *is* network traffic over HTTP 19:14:38 <nirik> sure, but it could still be in the same datacenter as fedorahosted... 19:14:46 * sgallagh nods 19:14:47 <nirik> even on the same vmhost... 19:15:14 <nirik> anyhow, we will see what we see. 19:15:18 <sgallagh> Right, but pointing it at cgit will mean more load on cgit 19:15:47 <nirik> any other application news ? 19:15:47 <sgallagh> Which is notably more heavyweight than pure git 19:15:52 <nirik> sgallagh: true 19:16:19 <nirik> can it use git:// proto ? or just cgit/http? 19:16:25 <johe2> Sorry lost my network. Will follow from mobile Phone 19:16:42 <nirik> hey johe2. :) 19:17:38 <nirik> any other applications news? 19:17:51 <sgallagh> nirik: the pure git protocol doesn't have a feature for retrieving file blobs (major oversight) 19:17:59 <nirik> sgallagh: lame. ;( 19:18:03 <sgallagh> Hence why ReviewBoard has to rely upon cgit or gitweb 19:18:48 * pjones watches people complain about free software instead of fixing it 19:18:48 <threebean> I'm still aiming at deploying the new fmn app to production by the end of next week 19:19:07 <nirik> threebean: cool. 19:19:10 <threebean> (fmn -> fedmsg notifications) 19:19:22 <nirik> pjones: nothing new under the sun. ;) 19:19:27 <sgallagh> pjones: I don't have the technical knowledge to solve that problem. 19:19:40 <sgallagh> And a reasonably-ubiquitous workaround exists. 19:19:50 <nirik> #info fedmsg notifications hopefully deployed by end of next week 19:19:52 <threebean> nirik: I'll need to setup some new hosts. should I file a ticket for that or just do it? 19:20:05 <nirik> threebean: you can just do it. Happy to help out. 19:20:11 <threebean> cool, cool. 19:20:44 <lmacken> I'd like to get the bodhi cloud vm + ansible ball rolling very soon. If anyone is interested in helping port our puppet stuff over, let me know :) 19:21:13 <nirik> lmacken: cool. Yeah in fact I was thinking bodhi might be a good next thing to move off the app servers... 19:21:22 <lmacken> yeah, definitely 19:21:28 <nirik> of course we likely need different bodhi and bodhi2 stuff. 19:21:29 <johe2> Lmacken i would join 19:21:31 <adimania> I am up for helping out in migration 19:21:42 <adimania> can you point out some tickets? 19:21:54 <lmacken> johe2, adimania: cool :) no tickets at the moment, but I'll file one now 19:22:10 <nirik> should be easy to whip up a bodhi-dev.cloud... and look at porting the bodhi2 puppet stuff to ansible. 19:22:23 <relrod> threebean: re: fmn, how are the model changes coming along? 19:22:27 <johe2> Okay. Sounds good 19:22:32 <nirik> lmacken: is there enough bodhi2 to have a web interface yet? or thats the largely unfinished part? 19:23:37 <lmacken> nirik: not anything that people will enjoy poking at, it's super bare-bones at the moment, but I'll try and workon that part this week so we have something to actually see :) 19:23:54 <willo> lmacken: I'd be keen to assist in puppet2ansible as well 19:24:11 <nirik> yeah, that would be cool. sounds like adamw at least might be up for a irc meeting on bodhi2 soon too... rehash what was wanted and such... 19:24:19 <lmacken> part of me just wants to copy/paste the existing bodhi templates, another part wants to start fresh with bootstrap or something I wish we had a fedora-bootstrap template :) 19:24:21 <threebean> relrod: all set 19:24:35 <threebean> relrod: I'll put a new release in staging and ping you when its there. 19:25:12 <relrod> threebean: awesome! 19:25:27 <threebean> lmacken: https://github.com/ralphbean/bootstrap-fedora 19:25:32 <lmacken> threebean: oh snap 19:25:34 <relrod> threebean: thanks for doing those, I know it was kind of a pain ;( 19:25:37 <nirik> :) 19:25:43 <threebean> lmacken: it needs love :) 19:25:51 <lmacken> threebean: it's a good start :) 19:26:20 <lmacken> even with a modern template, I'll bet we still get plenty of flames for changing the look-and-feel :P 19:26:39 <nirik> well, if not at the 1->2 time, when? ;) 19:27:35 <nirik> any folks looking for the board meeting, it's over in #fedora-meeting--1 19:27:38 <nirik> any folks looking for the board meeting, it's over in #fedora-meeting-1 even 19:27:57 <nirik> ok, any other application type news or discussion? 19:28:05 <lmacken> .ticket 4193 19:28:06 <zodbot> lmacken: #4193 (Port the bodhi module to ansible) – Fedora Infrastructure - https://fedorahosted.org/fedora-infrastructure/ticket/4193 19:28:12 <lmacken> for those interested 19:28:33 <nirik> great. I can add more details there. 19:28:49 <nirik> or perhaps I should do a blog post on migrating stuff from puppet to ansible. 19:29:07 <adimania> nirik, that would help a lot 19:29:26 <adimania> some sort of guidelines would be a +1 19:29:47 <nirik> I'll see what I can whip up. ;) 19:30:11 <nirik> #topic Sysadmin status / discussion 19:30:18 <nirik> so, on the sysadmin side of things... 19:30:26 <nirik> #info lots of ansible cleanup this week 19:30:41 <nirik> I setup roles_path today so we don't have to have a long path in role names... 19:31:08 <nirik> I ran --check --diff on all playbooks several times, and then ran real playbooks to fix up things. 19:31:48 <nirik> I fixed out cloud setup task so it doesn't show failed when growing partitions and it can't grow them.... 19:32:04 <nirik> (ie, so you can rerun it multiple times and it doesnt keep showing failed for that task) 19:32:27 <nirik> I have the commits for a daily playbook check/diff run ready. Will push those in later today or tomorrow. 19:32:42 <nirik> and it will send a email out with things that changed or failed int he check run 19:33:20 <nirik> oh, setup mailman01/02 prod instances, but they still need a bunch of work. will ask abompard to work on them. 19:34:25 <nirik> In other news I see there's a new el6 kernel update, so we might schedule mass reboots sometime in the next few weeks. 19:34:25 <threebean> for those that missed it, we got a new collectd plugin -> http://da.gd/s0kH 19:34:34 <nirik> Oh, and... 19:34:46 <threebean> (that's roughly the # of people listening to the fedmsg bus) 19:35:00 <nirik> #info filed 3 new sysadmin easyfix tickets this morning. :) apprentices take a look and see if any one of them interests you. 19:35:43 <nirik> threebean: nice. Thats via everything? websocket/desktop notification/etc? 19:35:52 <threebean> everything but websockets 19:36:00 <threebean> so, koji-shadow and stuff like that + desktop notification 19:36:17 <nirik> cool. 19:36:29 <dgilmore> threebean: you mean koji-stalk 19:36:37 <threebean> right, apologies. 19:37:02 <willo> nirik: will do 19:38:12 <nirik> #info new machines for 4thQ still in limbo as far as I know. 19:38:27 <nirik> #info netapp has been slow lately, storage folks are working on it. 19:38:50 <nirik> #info Smooge will be heading out to our main datacenter in mid-feb. 19:39:29 <nirik> #topic Upcoming Tasks/Items 19:39:30 <nirik> https://apps.fedoraproject.org/calendar/list/infrastructure/ 19:39:39 <nirik> any upcoming items folks would like to note or schedule? 19:40:32 * nirik listens to the crickets. :) 19:40:39 <nirik> #topic Open Floor 19:40:46 <nirik> anyone have items for open floor? 19:40:58 <nirik> suggestions, comments, ideas, brands of popcorn? 19:41:03 * adimania would be stalking nirik for a guide for migrations to ansible. 19:41:40 <nirik> :) adimania: you can also look at the puppet/modules/ask and ansible/roles/ask... I just moved ask over from puppet the other day... 19:41:52 <adimania> ah! 19:41:57 <adimania> that would certainly help 19:42:30 <nirik> but yeah, I will try and do some kind of blog post or the like soon. 19:42:54 <adimania> awesome! 19:43:18 <johe2> Is there a Style guide? 19:43:39 <nirik> for which? our ansible repo? 19:43:46 <adimania> I found http://infrastructure.fedoraproject.org/infra/docs/ansible.txt 19:43:57 <adimania> I think it is more or less up-to-date. 19:44:00 <adimania> right? 19:44:07 <nirik> yeah, thats a basic SOP for our ansible setup 19:44:16 <willo> nirik: Where's your blog? I couldn't find it on your wiki page 19:44:16 <johe2> Yep for ansible 19:44:27 <nirik> there's also a README file and a CONVENTIONS file in the ansible repo itself 19:44:50 <nirik> http://infrastructure.fedoraproject.org/cgit/ansible.git/tree/ 19:44:57 <johe2> Okay, i guess that will work than 19:45:19 <nirik> willo: http://www.scrye.com/wordpress/nirik/ but it's also on fedora planet. 19:45:39 <willo> Ah, yep, thanks 19:46:32 <nirik> cool. 19:46:48 <nirik> well, if nothing else we will move on and continue in #fedora-admin, #fedora-apps and #fedora-noc. ;) 19:47:22 <nirik> ok, thanks for coming everyone! 19:47:25 <nirik> #endmeeting