Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.


Messages - Brahim

Pages: [1] 2 3 ... 523
1
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 14, 2017, 07:55:14 pm »
...I am sure many users are like myself, we read fully the documentation, set it up in the best way possible, and in 5 years when a disk fails, we expect it to work. ..
You are still missing the core of it. The software will not fix your hardware issues. Testing whether the product works as intended is rather trivial given its nature. So, setup a test array (maybe in a VM) and practice the recovery aspect to gain confidence. You can even test just using folders. Defects are relatively easy to prove out and should be logged on http://bug.flexraid.com.

The point I am trying to get across is that users need good troubleshooting skills when going with custom built systems. If this was a fully integrated system where we also sold the hardware, then it would be a different story. Those not keen on troubleshooting their own hardware should not build one. Fully integrated systems have their place.
There is no way to write a guide for the various systems that get put together nor is it for us to troubleshoot them. So, the tips provided here are super important to follow.

Everything about your troubles circle back to not following the crucial steps I previously outlined. None has to do with frequency of Update, Verify, or what not. It is strictly a matter of troubleshooting the issues you had at hand. As you have not resolved them, you are likely to face them again.

So:
1. make sure to rebuild the parity anew
2. anytime the process seems to hang, check the Windows event viewer for clues, open Resource Monitor and check for CPU and disk usage, even go one step further and use Process Monitor to check for which files are currently being accessed by the RAID-F service process
3. resolve any issue before retrying (blindly retrying with fingers crossed is a bad strategy)

How often you run Validate and Verify is truly up to you. Obviously, the more frequent the better. :)

2
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 14, 2017, 11:22:36 am »
It really does not matter how long it takes. Again, it will take as long as it needs to. If disk activities drop because of disk issues, then that's just what it is. The proper process is to look at the Windows event viewer for potential clues, and look at Resource Monitor and/or Process Monitor for additional detail. If these show that it is hung on a file, then you have enough info to take the most appropriate action. For instance, you could abort the Restore and then use a file repair tool to correct the problematic file. What you don't do is blindly stop the task and retry it hoping that in itself would fix things.

RAID-F needs a healthy file system to operate over. So, running chkdsk and the like to ensure your file systems are healthy can sometime be needed.

Re-build your parity anew. Don't short cut it. If parity cannot be build without issues, then resolve all issues at each step. Building parity anew will be a good test of the entire system (hardware, drivers, file system, etc.).

3
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 13, 2017, 08:04:48 pm »
The you spent those days doing everything but the correct thing to do. ;)
You can't rush it. It will take as long as it needs to take. You have a very large array with a lot of disks and likely lot of files. All you had to do was let it run its course.

If Resource Monitor and Process Monitor show it using CPU and accessing disk, then it is active. It will only as fast as your system let's it.
Another place to look is in the Windows event viewer for additional clues such as disk/file system errors.

Clearly, you should rethink having all those disks under a single array. You should configure multiple smaller Snapshot arrays in Expert mode and then pool them all under a single pool.

4
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 13, 2017, 04:07:53 pm »
Folders are never an issue. Having copies of a folder across drives is normal. That's how the pooling works. Data is spread across drives for data balancing.

In your pooling configuration, you can switch to folder priority if you wish (http://wiki.flexraid.com/about/flexraid-storage-pooling/). Again, please spend some time on the wiki to understand these rather key points of the product you are using. At least, pay attention to your configuration options and what they mean.

5
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 13, 2017, 12:28:40 pm »
Also, give Process Monitor a try for more detailed access file access info: https://docs.microsoft.com/en-us/sysinternals/downloads/procmon

6
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 13, 2017, 12:18:49 pm »
I did not say Task Manager. I said Resource Monitor.
Look at both CPU and disk usage. If either is active, then it is active. Slow or hung disk activity could be tied to bad sectors/files. To fix those, run chkdsk on your drives and then retry the Restore.

Also, make sure you don't have an anti-virus or the like intruding. You should disable those or configure them to ignore the RAID-F service process's activities.

7
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 13, 2017, 11:27:25 am »
Fire up Resource Monitor and see what the RAID-F service process is doing.

8
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 13, 2017, 10:42:05 am »
Your screenshots are not rending.

9
Snapshot RAID / Re: Quick-validate error: ZipException
« on: December 13, 2017, 10:39:10 am »
Thanks again Brahim.

Hopefully a disk format and full parity re-build will help restore Update performance which had been becoming slower of late. I'm assuming this was because after 18 months of file deletes/adds my RAID had become somewhat fragmented.
Correct. Depending on the amount of changes that the RAID went through, the parity can get quite fragmented overtime. This is particularly true when the RAID has a lot of small files.
If is a good idea to have a clean slate once in a while. This will speed up things similar to how defragmenting a heavily fragmented disk speeds up things a bit.
Defragmenting parity in RAID-F is simply rebuilding the parity anew (after a quick disk format).

10
Snapshot RAID / Re: Crash during create
« on: December 12, 2017, 05:31:24 pm »
Seasonic 850w not adequate?
http://a.co/1OHhz1L

Im only running 6 storage drives 1 os and 1 bacup drive. 30w x 8drives = 240w leaving 600w for everything else, I think that would be adequate. Please tell me if this logic is flawed.

Could you point out some free stress test software?
Ah, sorry I missed that. I saw cheap something and read that as the PSU. You were actually referring to your controller and not PSU.
Do a crash dump analysis: http://www.osronline.com/page.cfm?name=Analyze

11
Snapshot RAID / Re: Quick-validate error: ZipException
« on: December 12, 2017, 02:15:15 pm »
...
Looks like a full Parity rebuild required. :(
Sounds like you were running out of space on the PPU. Remember to do a quick-format on it to force out any Windows junk. Windows has the habit of leaving shadow data on random disks, which shrinks their available free space.

12
Snapshot RAID / Re: Crash during create
« on: December 12, 2017, 02:08:57 pm »
Have you tried running stress tests of your new PC? Computing parity is fairly intensive, so it sounds like something is giving in on your new setup.
+1

@OP
Just get a new power supply. The one you have does not seem to be adequate for the load.

13
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 12, 2017, 02:05:49 pm »
I wish the software aspect came as easily as the hardware aspect for me :)

system is 220 watts under load at the wall, and power supply is 1000 watts with over 80 amps available on the 12 volt rails :)
...
With 23+ disks, expect a much higher usage under peak load. But great that the PSU is 1KW.

....
i am running the restore now, and will post the results of this instance soon
Hopefully, you enabled TRACE logging for more details: http://wiki.flexraid.com/2011/03/26/how-to-enable-more-verbose-logging/

14
Snapshot RAID / Re: hanging on the restore pre-validation process
« on: December 12, 2017, 11:56:50 am »
It is not about CPU or RAM. It is about your power supply and system stability under heavy I/O load.
So, both your PSU and disk controllers must be robust for the load. Not saying it is not. Just saying keep an eye on that aspect.

15
Snapshot RAID / Re: Quick-validate error: ZipException
« on: December 12, 2017, 09:46:53 am »
Hijack the parity disk by giving it a drive letter. Then delete the current flxr.meta and replace its most recent backups. Backups are on the same disk and have numbers appended. The highest number is the latest.

If you have multiple PPUs, do that for each.

Pages: [1] 2 3 ... 523