MineRealm Community It is currently Sun Oct 21, 2018 2:15 pm

 [ 21 posts ]  Go to page 1, 2, 3  Next
 Server Crash - May 15, 2014 
Author Message
Site Admin
User avatar

Joined:   Dec 3, 2010
Posts:   2,995

Verified IGN:
Intelli

User Reputation:  
4/10


Reply with quote
Post Server Crash - May 15, 2014
Hey everyone,

As you may have noticed, the server went down around 5PM PST on May 15th. Upon investigation, we determined that there was a hardware failure, and sent a request to our datacenter to perform a full chassis swap.

Upon bringing the server back up, we found that the world data for the server was severely corrupted (server wouldn't start up), and that data would have to be restored from backups.

However, upon going to our backups, we found the latest backup was made on May 11th. Backups are supposed to be made ever few hours, so after doing a bit of debugging, I determined there was filesystem corruption, and ran a file system check, which took several hours.

Once I had once again brought the server back up, I had to repair our MySQL tables, which were corrupted, brought the backup system back online (wiped corrupted backup data + re-synced), and then copied over the world data from May 11th.

Fortunately, we utilize a powerful plugin named CoreProtect ( ;) ), and I was able to restore over 1.3 million rows of block data for the past 5 days. However, inventories & chest data will be at their May 11th state.

Image

At this point, I'm doing a bit of final cleanup, such as having Dynmap re-render world data. However, the server is now back online, and should be stable.

Unfortunately, inventory & chest data will be stuck as-is; staff members are not able to spawn items, and will not be able to restore chest contents. However, considering the amount of data corruption that occurred, we're lucky that we were able to restore as much data as we did.

Thank you for your understanding, and thanks for supporting MineRealm!

_________________
"When you do things right, people won't be sure you've done anything at all."
Fri May 16, 2014 12:45 am
Profile
User avatar

Joined:   May 13, 2014
Posts:   22
Location:   

Verified IGN:
Monsieur_Mouette

User Reputation:  
0/10


Reply with quote
Post Re: Server Crash - May 15, 2014
Great, everything gone. Not any compensation?
Fri May 16, 2014 1:31 am
Profile
User avatar

Joined:   Jan 22, 2012
Posts:   435
Location:   TUC HQ

Verified IGN:
_Fala_

User Reputation:  
2/10


Reply with quote
Post Re: Server Crash - May 15, 2014
Monsieur-Mouette wrote:
Great, everything gone. Not any compensation?


Like what? We are a 100% legit server, so we can’t spawn items or give credits as compensation. These things can happen (we normally have a backup). I lost a chest of enchanted tools (been grinding exp the last days), sucks but this is how it is. Take a deep breath, and start over :)

_________________
Image
Fri May 16, 2014 3:25 am
Profile
User avatar

Joined:   May 23, 2012
Posts:   65

Verified IGN:
DarelleZindad

User Reputation:  
4/10


Reply with quote
Post Re: Server Crash - May 15, 2014
This also means if I had placed dia-blocks between may 11th and today they'd be both on the map AND my chests/inventory?
Fri May 16, 2014 5:47 am
Profile
User avatar

Joined:   Dec 3, 2011
Posts:   189

Verified IGN:
faldette

User Reputation:  
2/10


Reply with quote
Post Re: Server Crash - May 15, 2014
Good thing I didn't log in to do anything important... o.o

_________________
......私ね、とても怖い夢をみたの.
Fri May 16, 2014 5:53 am
Profile
User avatar

Joined:   Jan 22, 2012
Posts:   435
Location:   TUC HQ

Verified IGN:
_Fala_

User Reputation:  
2/10


Reply with quote
Post Re: Server Crash - May 15, 2014
DarelleZindad wrote:
This also means if I had placed dia-blocks between may 11th and today they'd be both on the map AND my chests/inventory?


No it means that EVERYTHING you have done between 11th of May and 15th of may has been undone. Your inventory, chests and buildings etc are back to the state they were at the last backup of 11th of May.

So in your case: the diamond blocks you placed, are gone. And if they were in your chest/inventory when the last backup occurred (11th of May), they will be on the place where they were at that moment. So if you mined those diamonds between 11th of May and 15th of May, they are lost.

_________________
Image
Fri May 16, 2014 6:20 am
Profile

Joined:   Aug 29, 2011
Posts:   1,947
Location:   The Milkyway

Verified IGN:
eah

User Reputation:  
7/10


Reply with quote
Post Re: Server Crash - May 15, 2014
Thanks for the hard work and astoundingly data-safe plugins.

_________________
Image
Fri May 16, 2014 6:45 am
Profile
User avatar

Joined:   Jan 11, 2013
Posts:   798
Location:   Down Under

Verified IGN:
Tee

User Reputation:  
5/10


Reply with quote
Post Re: Server Crash - May 15, 2014
Have to correct you falareborn. Inventory and chests are back as they were on May 11 but any physical terrain changes (placing/removing blocks) between that save and the moment of the crash have been reconstructed using CoreProtect logs.

Chests and inventories are unfortunately still as they were at the time of the May 11 save though. Credit balances are completely unaffected by the corruption and are as they were at the time of the crash.

Intelli has also said that the corruption affected the main world only, so the Nether and End worlds have not required any modification and are exactly as they were at the time of the crash.

_________________
Image
Fri May 16, 2014 7:57 am
Profile
User avatar

Joined:   Oct 29, 2013
Posts:   11

Verified IGN:
AvariceUmbreon

User Reputation:  
0/10


Reply with quote
Post Re: Server Crash - May 15, 2014
I lost everything yesterday.... This is a gift from the gods.

_________________
"What's mine is mine and mine and mine.
And mine and mine and mine!
Not yours!"

-Oath of the Orange Lantern Corp
Fri May 16, 2014 10:49 am
Profile
User avatar

Joined:   Mar 14, 2014
Posts:   162
Location:   Nowhere

Verified IGN:
coolaa24

User Reputation:  
0/10


Reply with quote
Post Re: Server Crash - May 15, 2014
Anyone else having trouble connecting to the server? It is around 3:40 PM Eastern Time.

_________________
http://imgur.com/FLQJ3DB
Fri May 16, 2014 11:39 am
Profile
Display posts from previous:  Sort by  
Post new topic Post new reply  [ 21 posts ]  Go to page 1, 2, 3  Next


Who is online

Users browsing this forum: No registered users and 3 guests