Soft-Raid 0 Performance | Transfer two Data-Streams (CPU+FPGA) to the same Soft-Raid

Soft-Raid 0 Performance | Transfer two Data-Streams (CPU+FPGA) to the same Soft-Raid

[Eric Schwarz]

Hello mailing list,

I have got two questions:

1.) I have set-up a softraid (raid level 0) with mdadm using two M.2 
modules. For one module the throughput is ~350MB/s (no mdadm) for two 
modules the throughput is ~500MB/s which is less than factor 1,5 of the 
throughput of a single drive. The filesystem used is ext4. Is there 
someone having some values for comparison? For me the throughput gain 
seems to be too little. The test was done using a HP Z840 workstation.

2.) We want to configure a softraid (raid level 0) with mdadm which can 
be used from within Linux but also it should be possible to write data 
to the raid w/ DMA directly from the FPGA which is also connected to the 
PCIe bus as a slave as well as the M.2 modules. How can that be achieved 
using existing kernel infrastructure?

Many thanks for helpful replies
Eric

Re: Soft-Raid 0 Performance | Transfer two Data-Streams (CPU+FPGA) to the same Soft-Raid

[Coly Li]

On 2017/1/17 下午11:00, Eric Schwarz wrote:
> Hello mailing list,
> 
> I have got two questions:
> 
> 1.) I have set-up a softraid (raid level 0) with mdadm using two M.2
> modules. For one module the throughput is ~350MB/s (no mdadm) for two
> modules the throughput is ~500MB/s which is less than factor 1,5 of the
> throughput of a single drive. The filesystem used is ext4. Is there
> someone having some values for comparison? For me the throughput gain
> seems to be too little. The test was done using a HP Z840 workstation.
> 

Hi Eric,

Could you attach your testing script as well, than we can have a look.



> 2.) We want to configure a softraid (raid level 0) with mdadm which can
> be used from within Linux but also it should be possible to write data
> to the raid w/ DMA directly from the FPGA which is also connected to the
> PCIe bus as a slave as well as the M.2 modules. How can that be achieved
> using existing kernel infrastructure?
> 

I don't know such existing kernel code. Maybe other people can provide
useful information.

Coly

Re: Soft-Raid 0 Performance | Transfer two Data-Streams (CPU+FPGA) to the same Soft-Raid

[NeilBrown]

[-- Attachment #1: Type: text/plain, Size: 1883 bytes --]

On Wed, Jan 18 2017, Eric Schwarz wrote:

> Hello mailing list,
>
> I have got two questions:
>
> 1.) I have set-up a softraid (raid level 0) with mdadm using two M.2 
> modules. For one module the throughput is ~350MB/s (no mdadm) for two 
> modules the throughput is ~500MB/s which is less than factor 1,5 of the 
> throughput of a single drive. The filesystem used is ext4. Is there 
> someone having some values for comparison? For me the throughput gain 
> seems to be too little. The test was done using a HP Z840 workstation.

Can you try a range of chunk sizes and see what difference it makes?
RAID0 simply remaps each request to the appropriate target device/offset,
imposing very little direct overhead.  There may be an indirect overhead
as a small chunk size causes large request to be chopped up into smaller
requests first.

>
> 2.) We want to configure a softraid (raid level 0) with mdadm which can 
> be used from within Linux but also it should be possible to write data 
> to the raid w/ DMA directly from the FPGA which is also connected to the 
> PCIe bus as a slave as well as the M.2 modules. How can that be achieved 
> using existing kernel infrastructure?

What sort of help do you want from the existing kernel infrastructure.
Presumably your FPGA must already understand RAID0 striping, so you just
need to tell the FPGA what devices, offsets, chunk sizes to use.
I suspect it would be easiest to have a user-space program query the
array and feed data to your FPGA, but as you provide no detail for how
the FPGA would be configured, I'm only guessing.

NeilBrown


>
> Many thanks for helpful replies
> Eric
> --
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: Soft-Raid 0 Performance | Transfer two Data-Streams (CPU+FPGA) to the same Soft-Raid

[Eric Schwarz]

Hi Coly,

>> 1.) I have set-up a softraid (raid level 0) with mdadm using two M.2
>> modules. For one module the throughput is ~350MB/s (no mdadm) for two
>> modules the throughput is ~500MB/s which is less than factor 1,5 of 
>> the
>> throughput of a single drive. The filesystem used is ext4. Is there
>> someone having some values for comparison? For me the throughput gain
>> seems to be too little. The test was done using a HP Z840 workstation.
> 
> Hi Eric,
> 
> Could you attach your testing script as well, than we can have a look.

Create RAID0:
$ mdadm --create /dev/md0 --auto md --level=0 --raid-devices=2 /dev/sdb1 
/dev/sdc1

Write to bare RAID0:
$ dd if=/dev/zero of=/dev/md0 bs=1G count=1 oflag=dsync

dd will show the throughput

Cheers
Eric