19:00:03 <nirik> #startmeeting Infrastructure (2013-06-27)
19:00:03 <zodbot> Meeting started Thu Jun 27 19:00:03 2013 UTC.  The chair is nirik. Information about MeetBot at http://wiki.debian.org/MeetBot.
19:00:03 <zodbot> Useful Commands: #action #agreed #halp #info #idea #link #topic.
19:00:03 <nirik> #meetingname infrastructure
19:00:03 <nirik> #topic welcome y'all
19:00:03 <nirik> #chair smooge skvidal CodeBlock ricky nirik abadger1999 lmacken dgilmore mdomsch threebean
19:00:03 <zodbot> The meeting name has been set to 'infrastructure'
19:00:03 <zodbot> Current chairs: CodeBlock abadger1999 dgilmore lmacken mdomsch nirik ricky skvidal smooge threebean
19:00:15 * skvidal is here
19:00:26 <kc4zvw> is here
19:00:30 * cyberworm54 is here
19:00:40 * pingou here
19:00:46 * dgilmore is kinda here
19:01:23 * nirik waits another min for folks to wander in
19:02:30 <nirik> ok...
19:02:37 <nirik> #topic New folks introductions and Apprentice tasks.
19:02:45 <nirik> any new folks or apprentices with questions or comments?
19:03:10 <suehle> here
19:03:14 * cyberworm54 was wondering for easy tickets to fix
19:03:32 <pingou> suehle: welcome to the infra :)
19:03:44 <suehle> I'm always wandering into the wrong meeting. But hi!
19:03:54 <nirik> hi suehle! :)
19:04:00 <pingou> suehle: always a pleasure to see you :)
19:04:35 * abadger1999 here
19:04:40 <cyberworm54> nirik: I have a few questions.. but I swing by fedora later
19:04:47 <threethirtyWork> suehle: is there marketing meeting today?
19:04:53 <nirik> cyberworm54: ok.
19:05:07 <nirik> #topic Applications status / discussion
19:05:15 <nirik> any applications news this week or upcoming?
19:05:31 <pingou> I fixed a couple of bugs on gnome-tagger
19:05:38 <pingou> abadger1999: news on python-fedora?
19:06:11 <abadger1999> pingou: same as last week -- got the old changes backed out and baseclient changes done but not proxyclient.
19:06:27 <abadger1999> been a lot of things needing fixing that popped up on my radar ths week :-(
19:06:50 <nirik> we hopefully will leave freeze next week, but we will see. ;)
19:07:15 <nirik> #topic Sysadmin status / discussion
19:07:26 <nirik> any sysadmin news this week or upcoming?
19:07:27 * skvidal has been working on the ansible logger
19:07:33 <skvidal> to capture all the events on the server side
19:07:38 <skvidal> so we can mine them
19:07:48 <skvidal> that has hit some interesting hangups but last night I think I got through most of them
19:07:48 * nirik has been porting virthosts and postgresql-server and next is koji hub
19:07:57 <skvidal> and now I'm working on refining what we log
19:08:13 <skvidal> I'll have some sample logs for people to look at shortly - I'd like feed back on what other data we need
19:08:19 <nirik> #info ansible playbook runs logging is being worked on by skvidal
19:08:33 <nirik> #info more ansible porting from puppet is happening slowly (since we are in freeze)
19:09:17 <skvidal> nirik: you did the db server thing, rightr?
19:09:28 <skvidal> nirik: oh you already mentioned it
19:09:31 <skvidal> sorry, was typing :)
19:09:39 <nirik> yeah, I setup a base postgresql server one. It likely needs more work.
19:10:02 <skvidal> also - I setup a system to let people get logs from specific searches against fedorapeople.org
19:10:22 <skvidal> so, for example if you wanted logs from skvidal.fedorapeople.org it could return logs containing 'skvidal'
19:10:41 <skvidal> it doesn't have any passwording on it - so they are simply hidden and protected through permissions
19:10:54 <nirik> we should hopefully look at mod_auth_openid for it and just enable it for everyone down the road.
19:10:57 <skvidal> nod
19:11:12 <skvidal> if there are specific repos, for example,  that we wanted logs on
19:11:17 <skvidal> this is a good way of doing it and it works now
19:11:49 <nirik> #info limited fedorapeople.org web logs available on request, will flesh out down the road more
19:12:12 <skvidal> did anyone other than nirik read or care about the traceback/http logs thing on infra-list?
19:12:42 <skvidal> I thought getting tbgrep working (as per lmacken's suggestion) could help us get rid of errors we're currently just not ever noticing
19:12:56 <skvidal> if someone wants to tinker with tbgrep on their own and work out how we should be running it
19:13:07 <skvidal> that might be a low-hanging task that could help us al out
19:13:22 <nirik> #info help wanted to work on tbgrep scripting
19:13:40 * skvidal notices a lot of crickets in here
19:14:00 <nirik> seems like. ;) we're just boring.
19:14:18 <nirik> other stuff upcoming after free is:
19:14:26 <nirik> #info get new bladecenter installed
19:14:32 <nirik> #info get new ppc builder installed
19:14:41 <nirik> #info phx2 trip for nirik in late july.
19:14:48 * abadger1999 likes the idea of automated tbgrep
19:15:15 <abadger1999> the mechanics of gettings logs to the right places ... I'm not qualified to critique :-)
19:15:16 <nirik> yeah, I don't know how big it will end up being, but it's worth a try
19:15:28 <skvidal> abadger1999: you are so qualified
19:16:00 <nirik> anything else on the sysadmin side of things?
19:16:03 <skvidal> abadger1999: all I wanted was some way so that when you set up the host you can easily annotate it's hostvars with a 'has_http_logs=true'
19:16:12 <skvidal> abadger1999: and then the other side could know to grab them
19:16:21 <abadger1999> <nod>
19:16:31 <skvidal> abadger1999: the current mechanism requires remembering to setup rsync on the host and then add that to log02 to retrieve
19:16:38 <nirik> skvidal: so, on that... would it be worth making some of these variables required?
19:16:40 <skvidal> which, at least in my case, I always forget to do
19:17:02 <nirik> ie, you MUST set has_http_logs to either true or false. if you fail to, it errors?
19:17:04 <skvidal> nirik: certainly possible - though a reasonable default in group_vars/all does solve that
19:17:18 <skvidal> nirik: I wouldn't want to have to put has_http_logs=False in every frelling hostvar
19:17:21 <skvidal> that would get.... old
19:17:25 <nirik> yeah, just thinking about us adding a host and making sure we thought of all the things we needed for it.
19:17:31 <nirik> yeah, I suppose so
19:17:47 <skvidal> nod
19:17:52 <nirik> just a idle thought, we can adjust as we go.
19:18:00 <nirik> #topic Fedora 19 release tasks
19:18:13 <nirik> so, anything we need to do to get ready for release? or are we all pretty set?
19:18:42 <nirik> we still do need to check content/permissions/sizes when there's something to stage. ;)
19:18:42 <smooge> we should rebuild all servers next week
19:19:00 <smooge> I am thinking a 2 day outage
19:19:09 <nirik> clearly... monday and tuesday? sounds good to me. ;)
19:19:11 <dgilmore> we should send smooge a big box of corn
19:19:38 <smooge> according to my latest set of tests I am actually not allergic to corn but to something else in Illinois
19:19:39 <nirik> heh
19:19:50 <dgilmore> smooge: probably me :)
19:19:59 <smooge> I don't think you were there in 1996
19:20:12 <nirik> did anyone have a chance to look at archiving old releases? I guess we do that after release now?
19:20:23 <dgilmore> i dont think we did
19:21:06 <nirik> so, we are over 1T for pub/fedora... will that cause mirrors to hate us?
19:21:35 <nirik> new mirrormanager seems to be doing great now.
19:21:50 <smooge> I would do that after release.
19:21:57 <dgilmore> maybe
19:22:02 <nirik> ok.
19:22:14 <nirik> not too much we can do about it right now anyhow.
19:22:33 <nirik> #topic Private Cloud status update / discussion
19:22:34 <smooge> Well I could move them today.. and then they can scream about giant rsyncs
19:22:43 <nirik> smooge: yeah, lets wait
19:22:54 <skvidal> nothing to report on private cloud, is there?
19:22:57 <skvidal> it's just running, at
19:22:58 <skvidal> m
19:22:59 <nirik> not much on cloud. I loaded f19rc2 in there.
19:23:06 <skvidal> cool
19:23:09 <nirik> so if anyone wants to play with it, feel free.
19:23:22 <nirik> much faster boot times now, they fixed the cloud-init thing.
19:23:40 <nirik> it seemed to work fine in my testing.
19:23:58 <nirik> #topic Upcoming Tasks/Items
19:23:59 <nirik> https://apps.fedoraproject.org/calendar/list/infrastructure/
19:24:08 <nirik> anything upcoming people would like to note or schedule?
19:24:47 <nirik> #topic Open Floor
19:24:52 <nirik> anyone have items for open floor?
19:24:54 <smooge> how long does F17 stay good after F19 comes out?
19:25:00 <nirik> 1 month...
19:25:25 <dgilmore> likely July 30
19:25:48 <nirik> #info f17 eol likely july 30th
19:26:28 <smooge> ok thanks. I was thinking of when to archive it.
19:26:41 <nirik> what all do we still have in there?
19:26:42 * nirik looks
19:27:07 <dgilmore> smooge: august 1 ;)
19:27:07 <smooge> 15 and 16 could go
19:27:21 <nirik> yeah, we could do 15/16 sometime in july and 17 in aug?
19:27:28 <smooge> okie dokie
19:27:40 <dgilmore> ill pull down 19 alpha and beta in a couple of weeks
19:28:03 <nirik> we still also need to schedule /mnt/koji move sometime in july...
19:28:36 <nirik> but we can figure it out after release.
19:29:23 <nirik> ok, if nothing else, will close out in a min here.
19:30:22 <nirik> thanks for coming everyone!
19:30:25 <nirik> #endmeeting