NIC with Erasure offload feature support and Ceph

NIC with Erasure offload feature support and Ceph

[Mike]

Hello!

In our project we planing build a petabayte cluster with Erasure pool.
Also we looking on Mellanox ConnectX-4 Lx EN Cards/ConnectX-4 EN Cards
for using its a offloading erasure code feature.

Someone use this feature in test lab/prodaction?


-- 
Mike, runs.

Re: NIC with Erasure offload feature support and Ceph

[Gregory Farnum]

On Tue, Nov 3, 2015 at 3:15 AM, Mike <mike.almateia@gmail.com> wrote:
> Hello!
>
> In our project we planing build a petabayte cluster with Erasure pool.
> Also we looking on Mellanox ConnectX-4 Lx EN Cards/ConnectX-4 EN Cards
> for using its a offloading erasure code feature.
>
> Someone use this feature in test lab/prodaction?

Nope. Ceph's erasure coding is very configurable (in terms of what
kind of EC it's doing) but the offload features in NICs that we've
seen aren't quite flexible enough for what Ceph is doing — it's an
unusual use case and set of requirements where these offload cards are
concerned. (We need to take an incoming stream, look at the raw
stream, then erasure code it into an unknown set of pieces, and then
send those pieces back out over the network to different addresses.)
-Greg
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: NIC with Erasure offload feature support and Ceph

[Mike Almateia]

03-Nov-15 18:07, Gregory Farnum пишет:
> On Tue, Nov 3, 2015 at 3:15 AM, Mike <mike.almateia@gmail.com> wrote:
>> Hello!
>>
>> In our project we planing build a petabayte cluster with Erasure pool.
>> Also we looking on Mellanox ConnectX-4 Lx EN Cards/ConnectX-4 EN Cards
>> for using its a offloading erasure code feature.
>>
>> Someone use this feature in test lab/prodaction?
>
> Nope. Ceph's erasure coding is very configurable (in terms of what
> kind of EC it's doing) but the offload features in NICs that we've
> seen aren't quite flexible enough for what Ceph is doing — it's an
> unusual use case and set of requirements where these offload cards are
> concerned. (We need to take an incoming stream, look at the raw
> stream, then erasure code it into an unknown set of pieces, and then
> send those pieces back out over the network to different addresses.)
> -Greg
>

Thanks for reply.
Mellanox said that offload Erasure Code (RedSolomon algorithm) feature 
support
on NICs will be released around April 2016.
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html