Re: [PATCH RFC v3 2/2] xfs: split metadata and log buffer completion to separate workqueues

[Dave Chinner <david@fromorbit.com>]

On Thu, Nov 13, 2014 at 02:24:01PM -0500, Brian Foster wrote:
> XFS traditionally sends all buffer I/O completion work to a single
> queue. This includes metadata buffer completion and log buffer
> completion. The log buffer completion requires a high priority queue to
> prevent stalls due to log forces getting stuck behind other queued work.
> 
> Rather than continue to prioritize all buffer I/O completion due to the
> needs of log completion, split log buffer completion off to
> m_log_workqueue and move the high priority flag from m_buf_workqueue to
> m_log_workqueue.
> 
> [XXX: Use of XBF_SYNCIO is purely for demonstration. Define a new flag.]
> 
> Signed-off-by: Brian Foster <bfoster@redhat.com>
> ---
>  fs/xfs/xfs_buf.c   | 9 ++++++++-
>  fs/xfs/xfs_super.c | 5 ++---
>  2 files changed, 10 insertions(+), 4 deletions(-)
> 
> diff --git a/fs/xfs/xfs_buf.c b/fs/xfs/xfs_buf.c
> index c06d790..58d729c 100644
> --- a/fs/xfs/xfs_buf.c
> +++ b/fs/xfs/xfs_buf.c
> @@ -1050,8 +1050,15 @@ void
>  xfs_buf_ioend_async(
>  	struct xfs_buf	*bp)
>  {
> +	struct workqueue_struct *wq;
> +
> +	if (bp->b_flags & XBF_SYNCIO)
> +		wq = bp->b_target->bt_mount->m_log_workqueue;
> +	else
> +		wq = bp->b_target->bt_mount->m_buf_workqueue;
> +
>  	INIT_WORK(&bp->b_iodone_work, xfs_buf_ioend_work);
> -	queue_work(bp->b_target->bt_mount->m_buf_workqueue, &bp->b_iodone_work);
> +	queue_work(wq, &bp->b_iodone_work);

I can see what you are doing here, but I still think it would be
better to set this up at IO submission rather than taking all those
cacheline misses chasing pointers on IO completion. Adding an extra
pointer to the struct xfs_buf is not a big deal....

Otherwise this looks fine....

Cheers,

Dave.
-- 
Dave Chinner
david@fromorbit.com

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs