vps1.netwisp.com File System Repairs

[Hal]

Greetings,

vps1.netwisp.com is being taken offline because the drive is reporting a problem with the file system. Once the server is offline, we will initiate a repair operation that will repair the problem with the file system. Once its completed, the server will be brought back online.

I will update this thread as things progress.

Thank you

Hal

[Hal]

Greetings,

The file system repairs have been completed and Virtuozzo is bringing the VPSes back online. The process will take some time because the VPSes were not able to be properly shut down due to the file system being in read-only mode. As a result, Virtuozzo is running quota repair operations on each VPS as they are started which is a slow process as it has to scan all the files on the VPS.

I will update this topic once Virtuozzo has finished bringing all the VPSes back online.

Thank you for your patience!

Hal

[Hal]

Greetings,

While Virtuozzo was bringing the VPSes back online, another file system error was encountered. So we've had to reboot the server again to run another repair operation on the file system. At this time the RAID array is showing no faults or failed drives so we do not think there is a hardware problem, but we have initiated a RAID check to verify the status of the array.

I will update everyone when we have more information.

Thank you

Hal

[Hal]

Greetings,

When we ran the file system check this time, we told the server to do a complete check rather than the fast check performed earlier. This is taking longer than the first check and is currently 45% complete.

I will update this thread when more information becomes available about the progress of the repairs.

We apologize for the inconvenice and are working as quickly as possible to get service restored.

Thank you.

Hal

[Hal]

Good Morning.

Here is the latest update on the status of the VPS1 server. At 88% through the automatic fsck, it failed with the error "unexpected inconsistency" and requested that we manually run fsck via the recovery mode. We are in the process of getting that process started and will update this topic when it is underway.

Also, the RAID consistency check has come up clean so the physical hardware is fine. We just have to deal with getting the file system corruption repaired.

We apologize for the delay in getting this matter resolved and we are working as fast as possible to get service restored ASAP.

If you have any questions, you are welcome to open a ticket via our help desk at http://support.netwisp.com and we'll be glad to answer them.

Thank you for your patience and understanding.

Hal

[Hal]

Greetings,

Our latest pass at repairing the file system has completed and we were able to restart the VPSes without incident. So for now, your VPS service has been restored.

However, we have found an issue that may have caused the corruption which may require further server maintenance in order to resolve. We are researching the matter and I will update this topic when we have additional information regarding it.

Thank you for your patience!

Hal