• Notice for iPhone users: DO NOT use the image size reduction option when uploading photos to the forum. This causes portrait images to post as landscape. We have added a warning to the image insert pop-up as well.

NOTICE: Massive CJ-8.com forum hardware failure & data loss - 10/21/17

bigwalton

Alaskan Postal nutjob
FORUM MANAGER
SOA Member
City
Dexter
State
MI
We are sorry to have to share very bad news. Last night, the data center where the forum is housed had a catastrophic combination of equipment failures that resulted in the loss of both the active/current and backup local copies of the forum database. The active and backup copies were on separate drives and both were destroyed. There was a functional, full off-site backup of the forum, but — for reasons about which we’re not yet completely clear — the most recent remote backup is from early in the morning on May 23 of this year.

To be completely clear, this was not a hacking situation and no user data was compromised in any way, it was purely hardware-related and we are not the only site/entity that was affected.

To say that we are infuriated at this situation would be a massive understatement, but it is what it is. The company we have worked with for hosting the forum for years has failed us and, therefore, you. This is a “perfect storm” type of situation that is not supposed to be possible. At least we do have a working backup, it's just not what it should be.

Sadly, this means that all new threads/posts from May 23rd forward no longer exist, users registered since then will have to re-register, user information (passwords, emails, avatars, signatures, etc) and any paid membership upgrades/renewals are all reset back to the whatever they were in the May backup. Basically, as far as the forum is concerned, it’s as if today is May 23.

I have felt physically ill since I found out about this and typing this is beyond painful. There are no words to express how sorry we are about this situation. Obviously, there will be changes to the way we run, store and verify our backups moving forward and we’re still digging into what happened to fully understand whatever changes need to be made.

It may not mean anything, but we have needed and used our backups in the past for various reasons and have never had a problem with implementing them. It was so seamless that most users would never have known or noticed. Worth noting, we do still have all of the photos that were downloaded to our own server from Photobucket prior to them shutting down the free hosting that wiped photos off of so many internet forums.

The odds against something like this happening are absolutely astronomical.

I will work back through the membership upgrades/renewals but it will likely take some time, so be patient with me. Remember that you will need to use the password on your account from May 23. If you need to get a password reminder/reset, use the password reset function on the login page below the username/password fields.

With deepest regret and apologies,
Eric/bigwalton

I will leave this thread open for the time being, but I won't tolerate bashing or ranting. This is an awful situation but it is what it is and nothing is going to change it.
 
:( I was wondering what happened as earlier today I was only able to see my posts as recent as May 22. Its a shame as all the knowledge, build threads, and everything is gone. But as you said.......it is what it is. This site still rocks and its the first web site I check everyday.:bacon:
 
I thought something seemed odd last night when the site wouldn’t load. Sucks to lose all that valuable info in one spot, but it still exists. Lessons learned make us stronger.
 
Last edited:
Wow. This is bad news for sure. We will build it back. Better and stronger.
 
Eric, for lack of a better term, $hit happens. This is still the best place out there, and the functionality of this forum versus others is amazing. This place is a second home to me, you guys are all family, and we will get through this rough patch together.

Just did a quick check. Time to rebuild some threads...
 
Last edited:
Thanks fellas. Appreciate it but nothing will make the pain of this go away. Absolutely gutted me this morning when I found out the extent of the issues. Many non-kid-friendly words have been uttered at different times today.

Thankfully, I found a PayPal report that made it much easier than I expected to update the paid memberships and renewals than I thought it was going to be, so I think that I have that up-to-date now. If you think your paid membership situation is not correct, please send me a PM.

Now I'll work through the SOA membership status updates...
 
I wondered what was going, I very seldom log out, just run the site in the background on my iPhone.

Don’t beat yourself up too bad, as long as you got your family, friends, and health everything else is secondary.

Regards,
Griff04
 
I am sorry it happened. I noticed it the other day before you shut it down and figured something had happened. Thank for all the effort you put in to keeping this going. It is the best on the net and the people on will support you to get it back up and going.
 
Don't be so hard on yourself, BW! You've always gone far and above what most other forum managers do, in every aspect.

This was an equipment failure... and as CJ8 owners/drivers/maintainers/modifiers, that's something we can ALL understand! :cheers:
 
This was an equipment failure... and as CJ8 owners/drivers/maintainers/modifiers, that's something we can ALL understand! :cheers:

:rotfl:

Yeah, and everyone replying to the email and on FB is saying the same thing about how this isn't a big deal, but when you have 15 years invested in something, it's like a kid or a beloved pet and you hate to see anything bad happen to it.

The difference with the CJ-8 equipment failure comparison is that we paid for and (thought we) had multiple redundant systems in place to ensure this very thing would never happen. So, comparing to my most recent Scrambler equipment failure, it's as if you had two fuel pumps plumbed in parallel and a spare in your parts box in the bed. The main pump went out, the backup pump died as soon as you switched over and when you swap the backup pump in, it works, but you only get enough fuel pressure for a rough idle and 20 MPH :banghead:
 
It sucks it happened, but at least all was not lost. Don't beat yourself. You obviously are making a huge effort on the site and it shows. I think at this point everyone feels worse for you.
 
On the plus side...now no one can tell I slacked all Summer on my J20 build...:D
 
On the plus side...now no one can tell I slacked all Summer on my J20 build...:D

We can also hide what we’ve spent on our builds in the last 5 months. ?
 
Eric,

Sorry to hear about that. I pay for my Jeep addiction as an IT Consultant for Backup and Disaster Recovery so it's especially painful for me. If it makes you feel any better (and it probably doesn't), I can tell you plenty of "funny" stories about catastrophic failures that were "impossible". As you say, there's nothing that can be done now, but if I can help in any way in the future let me know. Hang in there. We all appreciate what all the admins do for the forum.

Chris V.
 
BW

I'm just thankful you were able to recover what you did. Thanks for your hard work keeping this place on track.
 
Thanks again for the positive comments. Just realized we lost all the event stuff from the 10th annual Sand Blast I help run :angry: and that means the same for the National :banghead:

Onwards...
 
Back
Top