[Lustre-devel] a new Lustre ADIO driver

[Lustre-devel] a new Lustre ADIO driver

[emoly.liu]

sending to lustre-devel@ as well

Hello,

A new Lustre ADIO driver for MPICH2-1.0.7 is available now, which is 
co-developed by SUN Lustre group and Oak Ridge National Lab. (The patch 
is attached.)

Any feedback and performance results are welcomed.

Thanks,
LiuYing

-- 
Best regards,

LiuYing
System Software Engineer, Lustre Group
Sun Microsystems ( China ) Co. Limited

-------------- next part --------------
A non-text attachment was scrubbed...
Name: adio_driver_mpich2-1.0.7.patch
Type: text/x-patch
Size: 95750 bytes
Desc: not available
URL: <http://lists.lustre.org/pipermail/lustre-devel-lustre.org/attachments/20081105/01440520/attachment.bin>

[Lustre-devel] [Lustre-discuss] a new Lustre ADIO driver

[emoly.liu]

Hi,

Here is some description and performance results for the new Lustre ADIO 
driver. You might be interested.

The main purpose of the new lustre adio driver is to collect the small 
size I/O requests into fewer number of larger ones according to Lustre's 
striping feature with low overhead automatically. We also provide some 
hints for performance tuning.

In the following graph, the recent FLASH I/O benchmarking result shows 
that the new driver performs much better than the old one, especially 
for a large-scale system.
In this test, FLASH I/O blocksize is 4*4*4 that means each 3 clients 
write 40KB, 40.5KB and 42KB respectively. The I/O operation iteration 
(nvar) is set to 1024.



HTH,
LiuYing


emoly.liu wrote:
> sending to lustre-devel@ as well
>
> Hello,
>
> A new Lustre ADIO driver for MPICH2-1.0.7 is available now, which is 
> co-developed by SUN Lustre group and Oak Ridge National Lab. (The 
> patch is attached.)
>
> Any feedback and performance results are welcomed.
>
> Thanks,
> LiuYing
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss


-- 
Best regards,

LiuYing
System Software Engineer, Lustre Group
Sun Microsystems ( China ) Co. Limited

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-devel-lustre.org/attachments/20081105/5e7aa2f1/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: flashio_perf.png
Type: image/png
Size: 26625 bytes
Desc: not available
URL: <http://lists.lustre.org/pipermail/lustre-devel-lustre.org/attachments/20081105/5e7aa2f1/attachment.png>

[Lustre-devel] [Lustre-discuss] a new Lustre ADIO driver

[Robert Latham]

On Wed, Nov 05, 2008 at 02:46:41PM +0800, emoly.liu wrote:
> Hi,
>
> Here is some description and performance results for the new Lustre ADIO  
> driver. You might be interested.
>
> The main purpose of the new lustre adio driver is to collect the small  
> size I/O requests into fewer number of larger ones according to Lustre's  
> striping feature with low overhead automatically. We also provide some  
> hints for performance tuning.
>
> In the following graph, the recent FLASH I/O benchmarking result shows  
> that the new driver performs much better than the old one, especially  
> for a large-scale system.
> In this test, FLASH I/O blocksize is 4*4*4 that means each 3 clients  
> write 40KB, 40.5KB and 42KB respectively. The I/O operation iteration  
> (nvar) is set to 1024.

Hi LiuYing

Since this patch is for ROMIO and not really for Lustre, could you
send this to romio-maint at mcs.anl.gov ?  It will reach more of the
ROMIO developers that way.

Thanks
==rob

-- 
Rob Latham
Mathematics and Computer Science Division    A215 0178 EA2D B059 8CDF
Argonne National Lab, IL USA                 B29D F333 664A 4280 315B

[Lustre-devel] [Lustre-discuss] a new Lustre ADIO driver

[emoly.liu]

Hi Robert,

Robert Latham wrote:
>
> Hi LiuYing
>
> Since this patch is for ROMIO and not really for Lustre, could you
> send this to romio-maint at mcs.anl.gov ?  It will reach more of the
> ROMIO developers that way.
>
> Thanks
> ==rob
>
>   
Thanks for your advice. I will send it soon.

-LiuYing

-- 
Best regards,

LiuYing
System Software Engineer, Lustre Group
Sun Microsystems ( China ) Co. Limited

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-devel-lustre.org/attachments/20081128/f9097ded/attachment.htm>