System was down again tonight from 1:00 – 2:00 AM Pacific. Bedtime is the best time for server problems (grr, how do they know?)
The main server, ye olde “Black Box” has an intermittent drive failure. The main storage system is software RAID1 but Linux does not gracefully handle the controller errors coming off the bad disk, so its freaking out big time (to put it mildly).
Moved the site over to a secondary server until the primary can be repaired.
Still working to restore e-mail (necessary for new account activations and password resets). Should be fully operational shortly.
