04-08-2021, 10:02 PM
As a large number of you may have noticed, in the last 24 hours, we were down for > 12. I along with Lucifer have spent the better part of the last 18 hours trying to get the server up and running.
At approximately 10 AM UTC on the 2rd of August, the one of the servers that power the site went down. This was caused by a hard drive failure on our main MySQL server (basically our database had a fried hard drive) and thus the whole site went down. Luckily we have extensive backups in place and recovered most if not all of the data.
As a precaution, the Repost Bot was turned off, but it should start up again tomorrow, if the server behaves. We have had to install everything from scratch so please report errors to Lucifer as he deems fit. He will make a post shortly.
We used a backup server for a long time, but it was horribly slow and after a lot of work, we have returned to some sense of normalcy
I am going to bed!
We will continue to monitor the site over the next 24-48 hours to make sure everything is running.
At approximately 10 AM UTC on the 2rd of August, the one of the servers that power the site went down. This was caused by a hard drive failure on our main MySQL server (basically our database had a fried hard drive) and thus the whole site went down. Luckily we have extensive backups in place and recovered most if not all of the data.
As a precaution, the Repost Bot was turned off, but it should start up again tomorrow, if the server behaves. We have had to install everything from scratch so please report errors to Lucifer as he deems fit. He will make a post shortly.
We used a backup server for a long time, but it was horribly slow and after a lot of work, we have returned to some sense of normalcy
I am going to bed!
We will continue to monitor the site over the next 24-48 hours to make sure everything is running.