Author Topic: Transparent RAID Performance Thread - Part 3/4 (Performance Mode)  (Read 24869 times)

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,402
  • Karma: +201/-15
    • View Profile
Notice: This thread was moved from the beta forum. The performance mode feature is complete and stable since the 2014-01-31 release.

Overview
In order to address the relatively poor sustained write performance that some users have been experiencing in tRAID, I went back to the drawing board.
What I came up with is a new performance mode that boosts write speeds in Transparent RAID.  8)
This new feature will be publicly released on December 20th 2013, which should give us a bit of time to private beta test it first.

Energy Efficient Mode
This mode is the current mode that you guys all know. Most users have decent performance, but some users are experiencing a significant hit in sustained write speeds.
This mode is energy efficient as disk heads are kept fully independent and out of sync.
Disks also have a greater amplitude to go into sleep state in this mode.

Performance Mode
This mode boosts write speeds at the cost of system power consumption as disks are kept quite active.

The theoretical performance figures are as follow (and depend on the number of configured PPUs):
  • Singe PPU:
    • OS Caching:  up to 100% of source disk write speed
    • TCQ: up to 100% of source disk write speed
  • Multi-PPU:
    • OS Caching:  ? ? ? *
    • TCQ: up to 90% of source disk write speed

* As this new feature requires optimal data prioritization, multi-PPU setups with OS Caching enabled will not get a significant sustained write performance boost.  :(
This is because data prioritization is governed by the OS when in OS Caching mode. This is unlike TCQ where the RAID layer has full control over the data prioritization.
This issue might be resolved later as we fine tune the code or look for workarounds.

Testing
The first series of tests should be file copy performance tests.
What you should post are screenshots of the copy charts or screencasts of the operations.

The baseline of the tests should be the array in Energy Efficiency mode.
So, specifying whether single PPU or dual PPU:
  • Energy Efficiency mode:
    • TCQ results
    • OS Caching results
  • Performance mode:
    • TCQ results
    • OS Caching results


Results:
As posted here and here, it does work as theorized.


vs


And,

vs
« Last Edit: March 02, 2014, 08:35:43 am by Brahim »

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,402
  • Karma: +201/-15
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #1 on: December 04, 2013, 10:18:07 am »
Reserved.

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,402
  • Karma: +201/-15
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #2 on: December 04, 2013, 10:18:16 am »
Reserved.

Offline Devilman

  • Newbie
  • *
  • Posts: 48
  • Karma: +1/-0
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #3 on: December 04, 2013, 10:44:18 am »
Hi Brahim,

I would like to supress my interest in BETA-TESTING the new feature.
Why?:
Right now, I'm in evaluation between raid-f and traid and since the new version (2013-12-01), I almost gave up in traid, since performance was not as hoped and lately the install issues "killed" me.
What do I have:
I have a Test-System running since 2 weeks with
- 6 WD RED 4TB for setup (currently configured as 3xDRU and 1xPPU). (other hdds inside for other purposes)
- 32GB RAM
- XEON QuadCore@2,5GHZ
- SSD 240 GB as system disc

What do I need?
To give you value back, I need some infos, what exatly is needed as feedback (not just saying:wau, it works..), so I can test in your direction for good feedback.

I'm a trial user (maybe this is an exclusion). Running out of time with the trial? (I can't see my trail-end-date anywhere)

Eitherway of your decision, I hope, this will go in the right direction.





Offline SentinelBorg

  • Newbie
  • *
  • Posts: 4
  • Karma: +0/-0
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #4 on: December 04, 2013, 10:51:33 am »
I'm guessing this new mode uses all DRUs to calculate the new/modified parity, instead of reading the old one from the PPUs?

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,402
  • Karma: +201/-15
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #5 on: December 04, 2013, 10:52:34 am »
@Devilman
Details on how to test and how to report will be posted in the reserved posts.
I will focus the next few days on fine tuning things before providing further direction on beta testing.

Offline kubed_zero

  • Newbie
  • *
  • Posts: 20
  • Karma: +0/-1
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #6 on: December 04, 2013, 11:32:16 am »
I'd be interested in testing.

Intel Q6700
8GB Ram
LSI 9211-8i in IT mode
10 2TB HDDs, 64GB 830 series boot drive
Server 2012 R2

Offline pclausen

  • Jr. Member
  • **
  • Posts: 96
  • Karma: +0/-0
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #7 on: December 04, 2013, 12:37:56 pm »
I'd like to participate as well.

Offline shaun.arundell

  • Newbie
  • *
  • Posts: 27
  • Karma: +0/-0
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #8 on: December 04, 2013, 03:10:44 pm »
Brahim

Thank you for taking the effort to develop a solution for our write performance issues.

Re Power consumption with the new mode.

My system, like many Flexraid users, will spend 20+ hours day completely idle, neither reading or writing.
Will the the new mode still allow the disk to sleep when they are not reading or writing ?.(I don't care if
take a few minute to go into sleep mode).

Please add me to the beta, I can install and run all the tests you want on a couple of 3TB WD reds.

regards
shaun

Offline NLS

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1,018
  • Karma: +29/-4
  • Look ma, no hands!
    • View Profile
    • iLogic
Re: The new "Performance Mode" in Transparent RAID
« Reply #9 on: December 04, 2013, 03:19:14 pm »
My blessings.
---
NLS
Production system: SBS2011 fully patched, intel Core2 Quad, 8GB, 12 disks (1 system IDE, 1 backup IDE, 10 for array and parity most SATA3), parity is 3TB, largest data disk is 3TB, millions of smaller files, common browser Chrome latest.

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,402
  • Karma: +201/-15
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #10 on: December 04, 2013, 03:57:23 pm »
...
My system, like many Flexraid users, will spend 20+ hours day completely idle, neither reading or writing.
Will the the new mode still allow the disk to sleep when they are not reading or writing ?.(I don't care if
take a few minute to go into sleep mode).
...
Yes, that was fully thought of. :)
Disks will still be allowed to go into power saving mode even in high performance mode.
The system is smart enough to go high power only when it makes sense. The system won't activate the high performance mode if the writes coming in are only small writes.

Offline NLS

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1,018
  • Karma: +29/-4
  • Look ma, no hands!
    • View Profile
    • iLogic
Re: The new "Performance Mode" in Transparent RAID
« Reply #11 on: December 05, 2013, 08:13:40 am »
What about 20000 small writes? Will these trigger performance mode?
---
NLS
Production system: SBS2011 fully patched, intel Core2 Quad, 8GB, 12 disks (1 system IDE, 1 backup IDE, 10 for array and parity most SATA3), parity is 3TB, largest data disk is 3TB, millions of smaller files, common browser Chrome latest.

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,402
  • Karma: +201/-15
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #12 on: December 05, 2013, 09:40:33 am »
What about 20000 small writes? Will these trigger performance mode?
Sorry, I can't detail any further the magic underneath. ;)

Offline Devilman

  • Newbie
  • *
  • Posts: 48
  • Karma: +1/-0
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #13 on: December 06, 2013, 10:12:22 am »
 :D a few more hours until dec, the 7th....
My system is backuped and ready for testing this weekend....

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,402
  • Karma: +201/-15
    • View Profile
Re: The new "Performance Mode" in Transparent RAID
« Reply #14 on: December 06, 2013, 01:01:41 pm »
:D a few more hours until dec, the 7th....
My system is backuped and ready for testing this weekend....
More like 11:59 PM GMT-11.  :P