Author Topic: Transparent RAID Performance Thread - Part 3/4 (Performance Mode)  (Read 38986 times)

Offline ninja6o4

  • Full Member
  • ***
  • Posts: 107
  • Karma: +0/-0
    • View Profile
    • My tRAID config
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #90 on: January 17, 2014, 12:08:08 pm »
As I'm getting more and more excited about tRAID, I started using my system productively and discover some weird behaviour while accessing documents via the LAN.

I have access with my Win 8 Laptop to my Server via Windows SMB. Copying, deleting, moving, all works fine with the tRAID Pool, but:

If I open a document (especially an Office Document (with Office 2013) or a PDF (with Acrobat 10 Pro), I get errors and the application wants to restore / rebuild the content of the document or just says it is corrupt.

If I copy the file from the tRAID Pool to the Server Data SSD (Data Partition on my System-SDD) first and then open the documents, everything works fine.

Did anyone have this as well? Does anyone have an idea what the problem could be?

It sounds somewhat similar to issues I have when accessing the tRAID via LAN.  If you can, try doing some test copies/processes across the LAN.  Not just large files though, but lots of small ones.

The problems I have seem to be exacerbated when it comes to music or photos.. 3-10mb size files.  Teracopy constantly throws CRC mismatches when verifying, and I have to re-copy the file several times before the CRC matches. Not sure why.
My tRAID config: http://i.imgur.com/6UL9GF4.png
Case: Supermicro SC846 24 Bay 4U
MB: Asus Q87E/CSM
CPU: Intel i7-4771
RAM: 4x 8GB
HBA: Dell H310, IT fw
HDD: 8x+2x 3TB WD Reds (tRAID), 2x Samsung 256 Pro SSD (Boot), 2x 1TB WD Blacks, 1x 640GB WD Black
PSU: Corsair HX750w
OS: Server 2008 R2 w/ HyperV

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #91 on: January 17, 2014, 12:46:38 pm »
@myhtpc
Check your NTFS permissions.
Look at the NZFS file file for possible access error clues.

@ninja6o4
Terracopy's checksum feature is known to have issues with TCQ. Basically, it tries to CRC the data before it is flushed from the cache.
If you run a bit for bit verification on the files flag by Terracopy, you will find that they are fine.
So, the data is fine. It is Terracopy that is off. This checksum feature also reduces the througpout as it causes reads during the writes operations.

Offline myhtpc

  • Newbie
  • *
  • Posts: 46
  • Karma: +1/-0
    • View Profile
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #92 on: January 17, 2014, 01:14:50 pm »
I turned out Storage Pool Caching and it now seems to work. Opened approx. 10 different files (ppt, EXcel, Word, pdf) and no errors anymore.

I'll do some more testing over the weekend with cache on, as I believe this will be faster than without.

Offline ninja6o4

  • Full Member
  • ***
  • Posts: 107
  • Karma: +0/-0
    • View Profile
    • My tRAID config
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #93 on: January 17, 2014, 01:38:20 pm »
@ninja6o4
Terracopy's checksum feature is known to have issues with TCQ. Basically, it tries to CRC the data before it is flushed from the cache.
If you run a bit for bit verification on the files flag by Terracopy, you will find that they are fine.
So, the data is fine. It is Terracopy that is off. This checksum feature also reduces the througpout as it causes reads during the writes operations.

You can see from my previous screen that TCQ is off, OS Caching is on.  I also have system write cache turned off in teracopy.
Still, that doesn't explain the weird behaviour i get when converting flac - mp3.

I turned out Storage Pool Caching and it now seems to work. Opened approx. 10 different files (ppt, EXcel, Word, pdf) and no errors anymore.

I'll do some more testing over the weekend with cache on, as I believe this will be faster than without.

That's interesting. I will try that as well.
My tRAID config: http://i.imgur.com/6UL9GF4.png
Case: Supermicro SC846 24 Bay 4U
MB: Asus Q87E/CSM
CPU: Intel i7-4771
RAM: 4x 8GB
HBA: Dell H310, IT fw
HDD: 8x+2x 3TB WD Reds (tRAID), 2x Samsung 256 Pro SSD (Boot), 2x 1TB WD Blacks, 1x 640GB WD Black
PSU: Corsair HX750w
OS: Server 2008 R2 w/ HyperV

Offline ninja6o4

  • Full Member
  • ***
  • Posts: 107
  • Karma: +0/-0
    • View Profile
    • My tRAID config
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #94 on: January 21, 2014, 11:25:11 am »
I turned out Storage Pool Caching and it now seems to work. Opened approx. 10 different files (ppt, EXcel, Word, pdf) and no errors anymore.

I'll do some more testing over the weekend with cache on, as I believe this will be faster than without.

So here was an interesting result. Config is same as before (Energy mode, TCQ off, OS Caching on), but I turned off the Storage Pool Caching as myhtpc did.

Copied more pictures/video from my desktop PC -> Server w/ tRAID.  Using Teracopy, I got 1.5 MB/s through 20 gb of files. Several times the copy would stall for no visible reason before continuing.  However, it completed after a few hours and at the end, Teracopy reported 100% complete, no CRC errors.  Unfortunately, this is far slower than before (averaging 17-20MB/s), but at least it didn't report any errors.
My tRAID config: http://i.imgur.com/6UL9GF4.png
Case: Supermicro SC846 24 Bay 4U
MB: Asus Q87E/CSM
CPU: Intel i7-4771
RAM: 4x 8GB
HBA: Dell H310, IT fw
HDD: 8x+2x 3TB WD Reds (tRAID), 2x Samsung 256 Pro SSD (Boot), 2x 1TB WD Blacks, 1x 640GB WD Black
PSU: Corsair HX750w
OS: Server 2008 R2 w/ HyperV

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #95 on: January 21, 2014, 01:45:47 pm »
Hum... interesting. So, Storage Pool caching is causing issues for some of you.
For those affected, do you the RAID set to Direct I/O?

Offline ninja6o4

  • Full Member
  • ***
  • Posts: 107
  • Karma: +0/-0
    • View Profile
    • My tRAID config
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #96 on: January 21, 2014, 01:54:30 pm »
Hum... interesting. So, Storage Pool caching is causing issues for some of you.
For those affected, do you the RAID set to Direct I/O?

Mine is set to Direct I/O.

On another note, I have all the parts for rebuilding my server, so I am working on that this week. I hope to have a fully built new server to update my signature with this weekend  ;D
My tRAID config: http://i.imgur.com/6UL9GF4.png
Case: Supermicro SC846 24 Bay 4U
MB: Asus Q87E/CSM
CPU: Intel i7-4771
RAM: 4x 8GB
HBA: Dell H310, IT fw
HDD: 8x+2x 3TB WD Reds (tRAID), 2x Samsung 256 Pro SSD (Boot), 2x 1TB WD Blacks, 1x 640GB WD Black
PSU: Corsair HX750w
OS: Server 2008 R2 w/ HyperV

Offline samstudent

  • Newbie
  • *
  • Posts: 42
  • Karma: +0/-0
    • View Profile
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #97 on: January 21, 2014, 03:52:31 pm »
I was also experiencing problems with storage caching. I posted on the forums trying to get help but ultimately I found these responses and tried disabling storage caching and it fixed my problem as well. My problem was that some of my media files would abruptly stop playing and now with storage caching disabled I have zero problems. My direct I/O is set to false.

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #98 on: January 21, 2014, 07:24:33 pm »
So, do we have confirmation that this only happens when writing from over the network?
Or does anyone has a case whereas it happened while writing locally?

Offline knewknow

  • Newbie
  • *
  • Posts: 23
  • Karma: +0/-0
    • View Profile
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #99 on: January 31, 2014, 01:24:36 pm »
Not much activity in the thread for a while... unfortunately I don't have a spare setup to do any testing on this. How's it coming along Brahim?

Offline ninja6o4

  • Full Member
  • ***
  • Posts: 107
  • Karma: +0/-0
    • View Profile
    • My tRAID config
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #100 on: January 31, 2014, 01:46:06 pm »
I didn't have time to do my server gutting/swapping last week so I will be doing that this weekend, and then performing the tests anew. That's my excuse, anyway  ;)
My tRAID config: http://i.imgur.com/6UL9GF4.png
Case: Supermicro SC846 24 Bay 4U
MB: Asus Q87E/CSM
CPU: Intel i7-4771
RAM: 4x 8GB
HBA: Dell H310, IT fw
HDD: 8x+2x 3TB WD Reds (tRAID), 2x Samsung 256 Pro SSD (Boot), 2x 1TB WD Blacks, 1x 640GB WD Black
PSU: Corsair HX750w
OS: Server 2008 R2 w/ HyperV

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: The new "Performance Mode" in Transparent RAID (new beta build 2014-01-03)
« Reply #101 on: January 31, 2014, 02:08:11 pm »
Not much activity in the thread for a while... unfortunately I don't have a spare setup to do any testing on this. How's it coming along Brahim?
Busy working on other features.
I am hoping to push out a new beta build this weekend.

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: Transparent RAID Performance Thread - Part 3/4 (Performance Mode)
« Reply #102 on: March 01, 2014, 10:34:51 am »
Update:

This thread was moved from the beta forum.
The performance mode feature is complete and stable since the 2014-01-31 release.

Offline ssbtech

  • Newbie
  • *
  • Posts: 24
  • Karma: +0/-0
    • View Profile
Re: Transparent RAID Performance Thread - Part 3/4 (Performance Mode)
« Reply #103 on: April 10, 2014, 11:02:36 pm »
I've enabled performance mode and when I copy a file to the pool using a networked PC the server hosting the tRAID throws a BSOD with a STOP 7E error in NZFSD.sys

Repeatable. 

I'll disable performance mode and report back if the problem continues.

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: Transparent RAID Performance Thread - Part 3/4 (Performance Mode)
« Reply #104 on: April 11, 2014, 03:56:49 am »
If you are on the latest release, then please provide a crash dump of the event.