From: Yevgeny Kliteynik <kliteyn-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org>
To: Jim Schutt <jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
sashak-smomgflXvOZWk0Htik3J/w@public.gmane.org,
eitan-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org
Subject: Re: [PATCH 02/11] opensm: Allow the routing engine to influence SL2VL calculations.
Date: Thu, 14 Jan 2010 14:36:13 +0200 [thread overview]
Message-ID: <4B4F0FBD.3040308@mellanox.co.il> (raw)
In-Reply-To: <1258744509-11148-3-git-send-email-jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
Hi Jim,
Just started reading this stuff, so it's going to take a while :-)
Meanwhile, first question:
On 20/Nov/09 21:15, Jim Schutt wrote:
> Note that the original code assumes that QoS setup is mostly static and
> based only on user configuration. As a result, there is no provision for
> routing engines that want to compute contributions to the SL2VL maps.
>
> Fix this up by adding a callback to struct osm_routing_engine that computes
> a per-port SL2VL map, and call it from the appropriate place in the QoS
> setup path.
>
> Also need to move the call to osm_qos_setup() in do_sweep() to after the
> call to the routing engine, so that any SL2VL map contributions from the
> routing engine are based on the latest information.
[snip...]
> diff --git a/opensm/opensm/osm_state_mgr.c b/opensm/opensm/osm_state_mgr.c
> index 7540adc..c3f49dc 100644
> --- a/opensm/opensm/osm_state_mgr.c
> +++ b/opensm/opensm/osm_state_mgr.c
> @@ -1228,8 +1228,6 @@ repeat_discovery:
>
> osm_pkey_mgr_process(sm->p_subn->p_osm);
>
> - osm_qos_setup(sm->p_subn->p_osm);
> -
> /* try to restore SA DB (this should be before lid_mgr
> because we may want to disable clients reregistration
> when SA DB is restored) */
> @@ -1270,6 +1268,8 @@ repeat_discovery:
> osm_ucast_cache_process(&sm->ucast_mgr))
> osm_ucast_mgr_process(&sm->ucast_mgr);
>
> + osm_qos_setup(sm->p_subn->p_osm);
> +
> if (wait_for_pending_transactions(&sm->p_subn->p_osm->stats))
> return;
>
So I understand that QoS setup has to be re-applied every time routing
engine is executed. There's also another place where routing engine is
executed - when re-route is specifically required:
1100 /*
1101 * If we don't need to do a heavy sweep and we want to
do a reroute,
1102 * just reroute only.
1103 */
1104 if (cl_qmap_count(&sm->p_subn->sw_guid_tbl)
1105 && sm->p_subn->sm_state != IB_SMINFO_STATE_DISCOVERING
1106 && sm->p_subn->opt.force_heavy_sweep == FALSE
1107 && sm->p_subn->force_heavy_sweep == FALSE
1108 && sm->p_subn->force_reroute == TRUE
1109 && sm->p_subn->subnet_initialization_error == FALSE) {
....
1115
1116 osm_ucast_mgr_process(&sm->ucast_mgr);
1117
....
Guess you need to call osm_qos_setup() here as well, right?
-- Yevgeny
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2010-01-14 12:36 UTC|newest]
Thread overview: 40+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-11-20 19:14 [PATCH 00/11] Add new torus routing engine: torus-2QoS Jim Schutt
[not found] ` <1258744509-11148-1-git-send-email-jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
2009-11-20 19:15 ` [PATCH 01/11] opensm: Prepare for routing engine input to path record SL lookup and SL2VL map setup Jim Schutt
2009-11-20 19:15 ` [PATCH 02/11] opensm: Allow the routing engine to influence SL2VL calculations Jim Schutt
[not found] ` <1258744509-11148-3-git-send-email-jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
2010-01-14 12:36 ` Yevgeny Kliteynik [this message]
[not found] ` <4B4F0FBD.3040308-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org>
2010-01-14 16:01 ` Jim Schutt
2010-02-10 16:15 ` Yevgeny Kliteynik
[not found] ` <4B72DBBD.9020709-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org>
2010-02-15 21:45 ` Jim Schutt
2009-11-20 19:15 ` [PATCH 03/11] opensm: Allow the routing engine to participate in path SL calculations Jim Schutt
[not found] ` <1258744509-11148-4-git-send-email-jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
2010-01-14 16:24 ` Yevgeny Kliteynik
[not found] ` <4B4F452B.7040007-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org>
2010-01-18 19:24 ` Jim Schutt
[not found] ` <1263842661.5550.43.camel-mgfCWIlwujvg4c9jKm7R2O1ftBKYq+Ku@public.gmane.org>
2010-01-18 20:19 ` Yevgeny Kliteynik
2009-11-20 19:15 ` [PATCH 04/11] opensm: Track the minimum value in the fabric of data VLs supported Jim Schutt
2009-11-20 19:15 ` [PATCH 06/11] opensm: Enable torus-2QoS routing engine Jim Schutt
2009-11-20 19:15 ` [PATCH 07/11] opensm: Add opensm option to specify file name for extra torus-2QoS configuration information Jim Schutt
2009-11-20 19:15 ` [PATCH 08/11] opensm: Do not require -Q option for torus-2QoS routing engine Jim Schutt
2009-11-20 19:15 ` [PATCH 09/11] opensm: Make it possible to configure no fallback " Jim Schutt
[not found] ` <1258744509-11148-9-git-send-email-jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
2010-03-04 14:35 ` Yevgeny Kliteynik
[not found] ` <4B8FC53C.9060605-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org>
2010-03-04 21:38 ` Jim Schutt
2009-11-20 19:15 ` [PATCH 10/11] opensm: Avoid havoc in minhop caused by torus-2QoS persistent use of osm_port_t:priv Jim Schutt
2009-11-20 19:15 ` [PATCH 11/11] opensm: Update documentation to describe torus-2QoS Jim Schutt
2009-11-20 19:24 ` [PATCH 05/11] opensm: Add torus-2QoS routing engine Jim Schutt
2009-11-20 19:27 ` torus-2QoS example input files (was Re: [PATCH 00/11] Add new torus routing engine: torus-2QoS) Jim Schutt
2009-12-18 20:50 ` [PATCH 00/12] Add specialized multicast support to new torus routing engine: torus-2QoS Jim Schutt
[not found] ` <1261169461-2516-1-git-send-email-jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
2009-12-18 20:54 ` [PATCH 05/12] opensm: Enforce torus-2QoS link ordering convention Jim Schutt
2010-02-16 16:16 ` [PATCH 0/3] opensm: Bug fixes for torus-2QoS patchset Jim Schutt
2010-02-16 16:16 ` [PATCH 1/3] opensm: Use local variables when searching for torus-2QoS master spanning tree root Jim Schutt
2010-02-16 16:16 ` [PATCH 2/3] opensm: Fix handling of torus-2QoS topology discovery for radix 4 torus dimensions Jim Schutt
2010-02-16 16:16 ` [PATCH 3/3] opensm: Avoid havoc in dump_ucast_routes() caused by torus-2QoS persistent use of osm_port_t:priv Jim Schutt
2009-12-18 20:50 ` [PATCH 01/12] opensm: Make error message for torus-2QoS dateline specification match code check Jim Schutt
2009-12-18 20:50 ` [PATCH 02/12] opensm: torus-2QoS should fail to route if message deadlock is possible Jim Schutt
2009-12-18 20:50 ` [PATCH 03/12] opensm: Remove unused port specification from torus-2QoS config file parsing Jim Schutt
[not found] ` <1261169461-2516-4-git-send-email-jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org>
2009-12-18 20:56 ` Jim Schutt
2009-12-18 20:50 ` [PATCH 04/12] opensm: Fix up some torus-2QoS comments to match code Jim Schutt
2009-12-18 20:50 ` [PATCH 06/12] opensm: Remove redundant function names in torus-2QoS logging Jim Schutt
2009-12-18 20:50 ` [PATCH 07/12] opensm: Make torus-2QoS always use OSM_LOG_INFO, never LOG_INFO Jim Schutt
2009-12-18 20:50 ` [PATCH 08/12] opensm: Add struct osm_routing_engine callback to build spanning trees for multicast Jim Schutt
2009-12-18 20:50 ` [PATCH 09/12] opensm: Make mcast_mgr_purge_tree() available outside osm_mcast_mgr.c Jim Schutt
2009-12-18 20:50 ` [PATCH 10/12] opensm: Implement master spanning tree for torus-2QoS multicast support Jim Schutt
2009-12-18 20:51 ` [PATCH 11/12] opensm: Implement multicast support for torus-2QoS Jim Schutt
2009-12-18 20:51 ` [PATCH 12/12] opensm: Update documentation to describe torus-2QoS multicast support Jim Schutt
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4B4F0FBD.3040308@mellanox.co.il \
--to=kliteyn-vpraknaxozvs1mouv/rt9w@public.gmane.org \
--cc=eitan-VPRAkNaXOzVS1MOuV/RT9w@public.gmane.org \
--cc=jaschut-4OHPYypu0djtX7QSmKvirg@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=sashak-smomgflXvOZWk0Htik3J/w@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox