Well I finally have some time to sit down and write a post about my new job. I work in a fairly large shop (50+ servers). We run a mix of MySQL/MSSQL/Oracle on operating systems ranging from Dos 6.22 running deskview to Red Hat Enterprise Linux. There are about 40 programmers and a dozen datbase administrators. As you can imagine things are a bit hectic. Always something that needs to be done. I have already fixed half a dozen Oracle server problems. The Oracle people (I can’t say guys cause they have at least one female DBA) love me to death. Its good being popular!
My new boss is already comfortable delegating tasks to me. No trial period needed!
Of course I am very good at what I do
(namely fix problems very rapidly). He seems to trust me. A lot of what needs to be done, he and his existing staff didn’t know how to do.
So that makes them somewhat dependant on me I suppose. Which is somewhat scary. I mean I know my stuff and all. I just don’t like having people more senior then me not being able to do my job. I need someone to keep me honest and catch my mistakes.
I was immersed in working the first day. A mysql server crashed due to a power failure on the RAID array. So much for RAID5! My boss joked and said maybe it was only RAID4. Its a nerd joke. So if your not a sysadmin you won’t get it. Anyway the group that the server belongs to (QA) didn’t want it backed up. If a backup existed it would have been a simple matter of reformatting/rebuilding the system and doing a restore. But nooooo. They had an attitude of “its just a dev server. Its not production. It doesn’t need to be backed up.” Grrrr!!!!! And of course the server isn’t on a UPS. Its dev right? Who needs it to be on a battery backup? Bah!
So I tried doing a mysqldump. That failed. Corrupted tables. So I tried to repair the table with myisamcheck. No good. The system keeps crashing if you do much writing on the corrupted raid volume. So I am copying the files (a read only operation) and placing them on a brand new server. Brand new as in it-arrived the-day-I-started-and-I-loaded-it-from-scratch new. Then I have the fun task of reparing the tables. 1 by 1. All this effort for data that supposedly isn’t important. Heh! And if the data is hopelessly corrupted?
I wanted to copy the files over the network and do the dump on the new server from the get go. Its the only non production system with enough disk space (1/2 a terrabyte). But the QA system was to unstable until today to perform that task. Hence the reason for the delay. Afer isolating the fact that the RAID array was fine for read only ops I was good to go.
I still haven’t had time to setup all the e-mail rules I need to sort the automated e-mails. And I have several hundred e-mails coming in on a daily basis. I have some of it under control. I will be coming in tomorrow to setup voicemail and get a handle on e-mail. At least its overtime!
I have no restrictions on access to the building. I can go where I want when I want. Well except into accounting. But thats fine with me.