Another Word for Nerd

I’ve been on vacation since Thanksgiving, but am really in the mood to return to work on Monday. I can’t stand being off work for more than a week or so - I tend to get bored. Bad habits of a work-a-holic I guess.

I’ll also be taking every Friday between now and the end of the year off, since my employer gave me an extra week of vacation (now four weeks total per year) this year as it was my fifth anniversary with them. I didn’t find out about the extra week until last month, so now I’ve got to use it up by 12/31 or I’ll lose it.

Early Sunday afternoon, there was apparently a power and/or UPS failure in the datacenter at my office. By 5pm, most of the systems were back up except for one that I’m responsible for.

Fire up the VPN, hit the ILO remote console (one of the few things that makes using x86 systems as servers bearable) and see “Cannot find boot.bin” Uh-oh. I head to the office at 6pm.

It seems that a certain Sun patch turns non-GRUB systems into non-bootable systems after application. There’s a specific set of steps to follow when this patch is installed and a system is “upgraded” to the GRUB bootloader, but apparently Sun’s “smpatch” utility does not follow these steps. The patch had been applied months ago, but the system didn’t get rebooted until the power outage.

I figured “Okay, the system was running Solaris 10 FCS, so its time to do an upgrade install of S10u4 anyway”. After some other problems and workarounds, four hours later, I watch in resignation as the install hangs and locks up (not accepting keyboard input at a Y/N prompt) while trying to install the CPQary package. This package is the drivers that Solaris x86 needs in order to use the hardware RAID built into the Compaq DL360.

I bite the bullet and do a “nuke from orbit” fresh install of S10u4, planning to restore from backups. I ended up having to rebuild most of the services on the box by hand (which was better in the long run, as things needed cleaning up) as our backup system had also been affected by the power outage and it wasn’t available until Monday morning.

To make a long story short, I went to the office at 6pm Sunday, and finally walked out of my office to go home and get some sleep at 10:30am Monday. 16 hours is the longest single shift I’ve ever pulled anywhere, and certainly the longest after-hours session.

I’ve got one more service to restore onto the box on Tuesday, but it’s non-critical and could wait until I got some rest.

I can’t complain - I might have incidents like these once or twice a year, and it’s a lot better than getting called or paged every other day like I was used to at my last job. I really like my job and my managers and coworkers.

I’m out of the office in VMware training this week.

Update: I took pictures of the training facility, mostly to show off the weird artwork in the hallways and the “no smoking” sign right next to an ashtray.

We have some VERY nice hardware here at work:

Unfortunately I don’t get to play with it, just admire it.

I estimate that it’s 50“, and it has a resolution of 3150×2160.

Only $35K!

I received an email a few minutes ago informing me that I’d been nominated and am in the running for Employee Of The Year (Legal/IT/HR) at work.

My boss walked in this morning and handed me a letter detailing this year’s raise. I’m certainly not complaining!

In addition, someone from another group offered an open position with their team to me this morning, but I had to turn them down as I’m really happy where I’m at right now. I’ll still help them with their particular area of work, but I much prefer being a “general purpose” sysadmin versus concentrating on one single aspect of the services we provide.

I’m hacking on a system at work to automatically generate network accounts based on employee requests. So far I’ve gotten it authenticating against Active Directory (using adLDAP), and have rebuilt PHP with SQLite support.

Tomorrow I build the majority of the guts of the application and a basic proof-of-concept user interface. Wednesday I’ll automate the actual account creation, by either firing off an Expect script or by using the built-in Expect functions in PHP.

After all that works, I’ll throw the pieces together into a first revision of the production application and put it behind a secure webserver (so passwords don’t get passed in cleartext).

it sounds like I’d be a good candidate for attending a Workaholics Anonymous meeting.

I’ve been accused by numerous people of being a Workaholic at various times over the past ten years.

and it makes noises too!

My new phone arrived this morning.

and I got two paragraphs of glowing praise from my manager, as well as an “Exceeded Expectations”! Now that that is over, I think I’ll just rest tonight and get some sleep. Not much else going on.