jRun returns.

February 28, 2009 5:56 AM

jRun or the Return of Daughter of jRun? jRun III: no one gets out alive?

Tonight I got the second long spell of jRun errors. It takes me back a few years, but not to a good place. Status.metafilter.com doesn't mention any issues, but it was a couple of hours both tonight and a few days ago. Any hints on what is up?
I recognise I'm not in a mefi prime time-zone, but no mefi sucks.

posted by bystander to uptime at 5:56 AM (34 comments total)

I can confirm that yes, we still have a few issues to work out with the new server. We're working on it, and right now the problems tend to happen during US sleeping hours.
posted by pb at 6:01 AM on February 28

Frakking cylons. Can't trust 'em.
posted by cgc373 at 6:03 AM on February 28

No, Boomer is ok now.
posted by Brandon Blatcher at 6:09 AM on February 28

Could we get pb on a night shift for the next while then please?
posted by Meatbomb at 7:22 AM on February 28

Or we could all chip in for the meth or whatever to keep him up 'round the clock.
posted by taz at 7:25 AM on February 28

We were thinking about installing a data jack in vacapinta's skull and just teaching him kung-fu.
posted by cortex at 7:30 AM on February 28

I went to AskMe and answered a question Here...turns out it was from July 2008. Still a cool thread though.
posted by lobstah at 7:42 AM on February 28

Could we get pb on a night shift for the next while then please?

You joke, but I'm pretty sure pb woke up to fix it because he recently set up his phone to wake him up via SMS if the server was down for more than 20min.

We're having a weird issue with the database server we haven't seen in years, which used to cause night outages all the time. It has happened three times in the past two months, but twice this week which is kind of weird but we're looking into it.
posted by mathowie at 8:38 AM on February 28 [1 favorite has favorites]

he recently set up his phone to wake him up via SMS if the server was down for more than 20min.

Oh man, that's hardcore. Gratitude for the dedication, pb. You rock.
posted by carsonb at 8:48 AM on February 28

Yeah, I bow deeply in pb's direction. Somebody send him some chocolates!
posted by languagehat at 8:51 AM on February 28

Or we could all chip in for the meth or whatever to keep him up 'round the clock.

Cyrstal mefi?
posted by srboisvert at 8:52 AM on February 28 [1 favorite has favorites]

heh, thanks. The wake-ups keep me motivated to get this sorted out quickly.

Metafilter: My very complicated alarm clock.
posted by pb at 8:59 AM on February 28 [12 favorites has favorites]

You must get the best gift cards...
posted by inigo2 at 9:09 AM on February 28 [1 favorite has favorites]

Thanks, pb.
posted by rtha at 9:27 AM on February 28

Give it a second! It's going to SPACE!
posted by weapons-grade pandemonium at 9:29 AM on February 28 [1 favorite has favorites]

Chiming in to add to the round of thanks!
posted by amyms at 9:34 AM on February 28

pb rocks my nads. And there is no higher praise.
posted by Jofus at 9:36 AM on February 28

pb rocks my nads.

Eeeeuwww. TMI!

I had a little run in with Jrun last week, but I'm nothing if not stubborn. Just kept refreshing until I hit the jackpot. I send grateful kisses your way pb, because my day always feels a little empty and unfinished without the sweet, sweet sight of the bonnie blue.
posted by Secret Life of Gravy at 9:51 AM on February 28

It's true. I rocked Jofus's nads once, and my life changed forever.
posted by middleclasstool at 9:51 AM on February 28

eponysterical
posted by PeterMcDermott at 10:14 AM on February 28

totally whuffling pb! {{{{pb}}}}

But... I think, in all seriousness, your monitoring app might not be all it could be if it's only reported three outages in the last two months. I get this very, very frequently since the server migration (your-a-pee'in time, of course).
posted by taz at 11:02 AM on February 28

pb rules.
posted by Brandon Blatcher at 11:02 AM on February 28

or, since the hack problem fix, I guess. Now I'm confused. What is it with you cops and your bright lights and specific questions?
posted by taz at 11:06 AM on February 28

and he looks so cute in his profile!
posted by francesca too at 11:09 AM on February 28

your monitoring app might not be all it could be if it's only reported three outages in the last two months. I get this very, very frequently since the server migration

Yeah, I was describing a very specific problem with the database server, which has only happened three times and we think a recent change has fixed it so it won't happen again. Apart from that, the CF web server is itself restarting itself still once or twice a day, accounting for some minutes of downtime here and there. It has gotten much better this week, but in the last month we had days where it was going down once an hour around the clock, so yeah, we have some pretty robust network monitors that are going off for us all the time, but a catastrophic error that the server doesn't recover itself from within 5min was something new and relatively rare.
posted by mathowie at 12:15 PM on February 28

We're having a weird issue with the database server we haven't seen in years, which used to cause night outages all the time.

Oh, oh, I know this one... it's the one where the graveyard shift janitor dude unplugs the server because he needs that outlet to run his floor buffer?
posted by Rhomboid at 12:21 PM on February 28 [2 favorites has favorites]

jwalk, don't jrun.
posted by davemee at 2:42 PM on February 28

which used to cause night outages all the time

That's perfectly natural according to the Scout handbook.
posted by GuyZero at 5:50 PM on February 28 [1 favorite has favorites]

Wasn't there a problem in the past where Windows Update would restart the server after the upgrades were finished installing? (And this happened in the middle of the night.)
posted by philomathoholic at 6:31 PM on February 28

This is clearly a case of server gremlins. They only come out at night, you know.
posted by SteveTheRed at 6:53 PM on February 28

Waitaminute -- pb sleeps?

Seriously, pb is my favourite Paul. And that's saying something.
posted by goodnewsfortheinsane at 7:23 PM on February 28

can confirm that yes, we still have a few issues to work out with the new server. We're working on it, and right now the problems tend to happen during US sleeping hours.

It has happened three times in the past two months, but twice this week which is kind of weird but we're looking into it.

It's happenining a lot more often that that and for a lot longer than you seem to think. Not bitching, mind you, just letting you know. I haven't tracked it, but I reckon it's been down for several hours six or seven times in the last couple of weeks. Ever since the new server came on-line, it's been just like the old days (and not the good kind of old days when there were only 15k of us and we knew each other by first names, either).
posted by dg at 4:02 AM on March 1

You joke, but I'm pretty sure pb woke up to fix it because he recently set up his phone to wake him up via SMS if the server was down for more than 20min.

What do you use to do this?
posted by geoff. at 9:54 AM on March 1

What do you use to do this?

Pretty low tech. I have an iPhone and I use the email to SMS feature by sending an email to [my iPhone number]@mobile.mycingular.com. As far as our monitoring software goes, I'd rather not share the details. There's still a little security in obscurity (but not much).
posted by pb at 11:11 AM on March 1