Pay Attention
Some times I am not paying attention. I knew that on one server I had there was a database. What database it was I never bothered to check into. If I had I probably would not have spent all night last night working on it.
About 2pm I got a mail saying a disc in this server was critical. I looked at it in our reporting system and thought "Augh it was just one error..." I cleared the error and went back about my day. A hour later I noticed that the error was back and the rate at which the errors where being reported was increasing quickly..... the hard disc was dying.
I looked up the model and info for the server and went to the data center to repair it. I was in luck because the server had easy to remove (Hot Swapable) 36gb discs. I rsynced the data off shut down the dbs, did a final rsync, unmounted the disc pulled the old one out. I put the new one in formated it, newfs'ed it and mounted it. Finally I rsynced the data back and started the DBs up and it was up and running.
Sounds simple right but with 20 something gigs of data the inital rsyncs took almost a hour and 1/2 each. I love technology.
Anyways todays plan .... get a list of all the DBs there locations and see which ones need to be moved to more redundant discs.... so I do not have to go through that again.
About 2pm I got a mail saying a disc in this server was critical. I looked at it in our reporting system and thought "Augh it was just one error..." I cleared the error and went back about my day. A hour later I noticed that the error was back and the rate at which the errors where being reported was increasing quickly..... the hard disc was dying.
I looked up the model and info for the server and went to the data center to repair it. I was in luck because the server had easy to remove (Hot Swapable) 36gb discs. I rsynced the data off shut down the dbs, did a final rsync, unmounted the disc pulled the old one out. I put the new one in formated it, newfs'ed it and mounted it. Finally I rsynced the data back and started the DBs up and it was up and running.
Sounds simple right but with 20 something gigs of data the inital rsyncs took almost a hour and 1/2 each. I love technology.
Anyways todays plan .... get a list of all the DBs there locations and see which ones need to be moved to more redundant discs.... so I do not have to go through that again.