Author Topic: [Resolved]Patch for slow write speed to the pool on Linux for AMD Fusion systems  (Read 18403 times)

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #30 on: May 07, 2012, 04:50:09 pm »
Try setting the pool thread to 2.
But again, make sure you understand my above post. There is no difference binary wise between update 7 and the patch.

Offline golduck

  • Newbie
  • *
  • Posts: 41
  • Karma: +2/-0
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #31 on: May 09, 2012, 04:24:40 pm »
nothing to do, the speed is 36 MB/s ...
Sorry for my bad english :(

Offline Costalat

  • Newbie
  • *
  • Posts: 47
  • Karma: +1/-1
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #32 on: May 10, 2012, 07:04:18 am »
Gentlemen, we have real improvements.

Read from pool



Write to pool



AMD Fusion motherboard, pre v7 version.

@Brahim, half way already. Hope you can also improve write speed.

@golduck, have you tested your hardware with ubuntu?
It would be very interesting to crosscheck our results.

!Sorry for the image size!

Offline golduck

  • Newbie
  • *
  • Posts: 41
  • Karma: +2/-0
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #33 on: May 10, 2012, 10:56:45 am »
i use cruise control Raid, one of these day i make some screenshot, the next week i replace the e350 with ivy bridge, for use with ESXi 5 but before make the change i make all the test!
Sorry for my bad english :(

Offline Costalat

  • Newbie
  • *
  • Posts: 47
  • Karma: +1/-1
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #34 on: May 10, 2012, 11:49:56 am »
i use cruise control Raid, one of these day i make some screenshot, the next week i replace the e350 with ivy bridge, for use with ESXi 5 but before make the change i make all the test!

More power (a lot more) and also consumption, around 20W more :p ~50W
Those results will be very interesting to analyse and compare against mine. I would postpone the hardware swap until getting results compared.

Offline golduck

  • Newbie
  • *
  • Posts: 41
  • Karma: +2/-0
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #35 on: May 11, 2012, 04:58:30 pm »
More power (a lot more) and also consumption, around 20W more :p ~50W
Those results will be very interesting to analyse and compare against mine. I would postpone the hardware swap until getting results compared.
tomorrow, if i find the time, make all the result and the test with E-350, i have to change the platform due to the power, e-350 is not sufficient strong for 3 virtual machines, and for vt-d instruction!
Sorry for my bad english :(

Offline golduck

  • Newbie
  • *
  • Posts: 41
  • Karma: +2/-0
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #36 on: May 13, 2012, 05:56:33 pm »
Configuration:
Motherboard: ASUS E35M1-M
RAM: 2x 4GB AMD 1333Mhz DDR3

HDD:
1x 250GB (System)
1x PRU (2TB WD Green attached on Onboard SATA II)
3x DRU (2TB WD Green Attached on Onboard SATA II)
4x DRU (1TB WD Green Attached on PCI-e 1x 8x SataII Port Silicon Image 3132)

ok, i've made the test:

Write on One HDD Without FlexRAID active
Read from One HDD Without FlexRAID active

The cfg of FlexRAID

Write on the pool With FlexRAID active
Read from the pool With FlexRAID active

i hope this is useful from someone!

when i assembly the new server i post the new result!
« Last Edit: May 14, 2012, 01:37:16 am by golduck »
Sorry for my bad english :(

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #37 on: May 14, 2012, 10:09:09 am »
@golduck

1. Are you now saying your write speed went from 36MB/s to 6MB/s?
2. Always use the same file for all the tests
3. Can you attach your sys logs?


Offline golduck

  • Newbie
  • *
  • Posts: 41
  • Karma: +2/-0
    • View Profile
@golduck

1. Are you now saying your write speed went from 36MB/s to 6MB/s?
2. Always use the same file for all the tests
3. Can you attach your sys logs?



1) This is the speed i see yesterday, but when i make the test early the speed was 26 MB/s Read and write, like the 80 MB/s Read and write without Flexraid
2) same position, but not same file, every one big file
3) If you say me how i post the syslog :)

Thanks!
Sorry for my bad english :(

Offline Costalat

  • Newbie
  • *
  • Posts: 47
  • Karma: +1/-1
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #39 on: May 14, 2012, 05:46:12 pm »
@golduck

1. Are you now saying your write speed went from 36MB/s to 6MB/s?
2. Always use the same file for all the tests
3. Can you attach your sys logs?

@Brahim, the 6MB/s is more or less in line with what I'm getting with a similar system.
The same for FlexRAID off transfers.

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #40 on: May 15, 2012, 05:17:46 am »
@Brahim, the 6MB/s is more or less in line with what I'm getting with a similar system.
The same for FlexRAID off transfers.

I don't know, but It does look like Fusion is crippled for FlexRAID purposes.
I had plans to expose of the advanced settings, but I can't think of a setting that would make a real difference yet.

Offline Costalat

  • Newbie
  • *
  • Posts: 47
  • Karma: +1/-1
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #41 on: May 15, 2012, 06:57:26 am »
I don't know, but It does look like Fusion is crippled for FlexRAID purposes.
I had plans to expose of the advanced settings, but I can't think of a setting that would make a real difference yet.

I'm available for a extensive go/no go test :)
Fusion low consumption is unbeatable for the moment...

Until you find a way, I will do massive data write out of flexraid and sync after ( btw, last time this didn't worked as I expected ( I had new data and FlexRAID posted that it was "synchronized"). I'll have to retest the procedure

« Last Edit: May 18, 2012, 03:43:15 am by Costalat »

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #42 on: May 15, 2012, 06:45:56 pm »
I'm available for a extensive go/no go test :)
Fusion low consumption is unbeatable for the moment...

Until you find a way, I will do massive data write out you flexraid and sync after ( btw, last time this didn't worked as I expected ( I had new data and FlexRAID posted that it was "synchronized"). I'll have to retest the procedure

No doubt that they have enough power to handle the task.
Any difference with setting the thread count to 1 vs 2?



Offline Costalat

  • Newbie
  • *
  • Posts: 47
  • Karma: +1/-1
    • View Profile
Re: Patch for slow write speed to the pool on Linux
« Reply #43 on: May 31, 2012, 04:28:25 pm »
No doubt that they have enough power to handle the task.
Any difference with setting the thread count to 1 vs 2?

I think I had thread count set to 2.

Results with latest version:


Offline R27

  • Jr. Member
  • **
  • Posts: 67
  • Karma: +0/-0
    • View Profile
I don't think that the speed issue related to your hardware or FlexRAID thread settings. FR uses fuse filesystem, which is slow by the nature.

I am 99% sure that if you will use mhddfs to pool drives you will see the same w/r speed results. If you want test it - umount FR pool and mount mhddfs to the pool directory -
Code: [Select]
mhddfs /mnt/hdd1,/mnt/hdd2,/mnt/hdd3 /media/pool-o allow_other   and check the r/w speed.