From: sebastien dugue <sebastien.dugue-6ktuUTfB/bM@public.gmane.org>
To: linux-rdma <linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>
Cc: Roland Dreier <rolandd-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>,
Sasha Khapyorsky <sashak-smomgflXvOZWk0Htik3J/w@public.gmane.org>
Subject: [PATCH 0/3] Add support for specific Lustre Qos
Date: Wed, 13 Jan 2010 15:49:52 +0100 [thread overview]
Message-ID: <20100113154952.0f01aa1d@frecb007965> (raw)
These patches allow to have a specific QoS for Lustre traffic.
- Patch 1 adds a new Lustre port space to the rdma_cm kernel module
- Patch 2 defines a new Lustre service ID (matching the new RDMA CMA port
space) and a new 'lustre' keyword in the OpenSM QoS policy parser.
- Patch 3 adds a new port_space parameter for the Lustre ko2iblnd kernel
module that allows to specify the port space to be used by LNET. This
patch has already been submitted to the Lustre community and is only
given here as a reference. The relevant discussion is at
https://bugzilla.lustre.org/show_bug.cgi?id=21732
In order the exercise QoS using this Lustre port space, the following setup
may be used:
1. OpenSM configuration - etc/opensm/opensm.conf
#
# QoS OPTIONS
#
# Enable QoS setup
qos TRUE
# QoS policy file to be used
qos_policy_file /etc/opensm/qospolicy.conf
# QoS default options
qos_max_vls 8
qos_high_limit 1
qos_vlarb_high 0:0,1:0,2:0,3:0,4:0,5:0
qos_vlarb_low 0:1,1:16,2:32,3:64,4:1,5:0
qos_sl2vl 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
The VLARB weights are only indicative.
2. OpenSM QoS policy configuration - /etc/opensm/qos-policy.conf:
qosulps
default : 0 # default SL
lustre, targetportguid 0x1234 : 1 # lustre traffic to a specific
# port guid (ex MDS traffic)
lustre : 2 # lustre default traffic
endqosulps
3. Lustre module configuration - /etc/modprobe.d/lustre.conf
Add the following line to all the Lustre nodes:
options ko2iblnd port_space=339
Sebastien.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next reply other threads:[~2010-01-13 14:49 UTC|newest]
Thread overview: 20+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-01-13 14:49 sebastien dugue [this message]
2010-01-13 14:51 ` [PATCH 1/3] rdma_cm: Add support for a new RDMA_PS_LUSTRE Lustre port space sebastien dugue
2010-01-13 16:56 ` Sean Hefty
[not found] ` <7ED07283D76C422C9210FBE7C832731B-Zpru7NauK7drdx17CPfAsdBPR1lH4CV8@public.gmane.org>
2010-01-13 17:04 ` Roland Dreier
[not found] ` <ada6376ndgs.fsf-BjVyx320WGW9gfZ95n9DRSW4+XlvGpQz@public.gmane.org>
2010-01-14 12:58 ` sebastien dugue
2010-01-14 17:25 ` Roland Dreier
[not found] ` <ada3a28mwdw.fsf-BjVyx320WGW9gfZ95n9DRSW4+XlvGpQz@public.gmane.org>
2010-01-15 7:41 ` sebastien dugue
2010-01-20 1:12 ` Roland Dreier
[not found] ` <adaiqax37g4.fsf-BjVyx320WGW9gfZ95n9DRSW4+XlvGpQz@public.gmane.org>
2010-01-20 7:55 ` sebastien dugue
2010-01-20 8:03 ` Or Gerlitz
[not found] ` <4B56B8E3.3010909-smomgflXvOZWk0Htik3J/w@public.gmane.org>
2010-01-20 9:17 ` sebastien dugue
2010-01-20 15:26 ` Or Gerlitz
[not found] ` <4B572099.3030604-hKgKHo2Ms0FWk0Htik3J/w@public.gmane.org>
2010-01-21 8:28 ` sebastien dugue
2010-01-21 9:12 ` Or Gerlitz
[not found] ` <4B581A68.500-hKgKHo2Ms0FWk0Htik3J/w@public.gmane.org>
2010-01-21 9:26 ` sebastien dugue
2010-01-14 12:47 ` sebastien dugue
2010-01-14 14:09 ` Or Gerlitz
[not found] ` <4B4F25A7.6000900-hKgKHo2Ms0FWk0Htik3J/w@public.gmane.org>
2010-01-14 14:37 ` sebastien dugue
2010-01-13 14:54 ` [PATCH 2/3] opensm/qos_policy: Add a new service ID and keyword for Lustre QoS sebastien dugue
2010-01-13 14:56 ` [PATCH 3/3] Add new port_space parameter to ko2iblnd module sebastien dugue
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20100113154952.0f01aa1d@frecb007965 \
--to=sebastien.dugue-6ktuutfb/bm@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=rolandd-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org \
--cc=sashak-smomgflXvOZWk0Htik3J/w@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox