From mboxrd@z Thu Jan 1 00:00:00 1970 From: Tom Ammon Subject: Re: basic questions about partitions Date: Tue, 13 Jul 2010 13:44:16 -0600 Message-ID: <4C3CC210.2000803@utah.edu> References: <4C3B5FEA.1020904@utah.edu> <4C3B6CE8.7080800@utah.edu> <4C3C9970.2060100@utah.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Return-path: In-Reply-To: Sender: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org To: Hal Rosenstock Cc: "linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org" List-Id: linux-rdma@vger.kernel.org Hal, I have some more partition questions. Do I have to configure the nodes as members of partition(s) both in opensm and on the individual node (if the node is a member of two partitions)? And what about the switches - do the switches need be configured as part of any partition? Tom On 7/13/2010 11:44 AM, Hal Rosenstock wrote: > Tom, > > On Tue, Jul 13, 2010 at 12:50 PM, Tom Ammon wrote: >> Hal, >> >>> The procedure is a little different. You'll need to create a child >>> interface (on a partition) first and then you will be able to >>> configure it as follows: >>> >>> echo 0x8001> /sys/class/net/ib0/create_child >>> ifconfig ib0.8001 ... >>> >>> Note that you'll want the 0x8000 bit on for full membership. >> What does "full membership" mean? > For a partition, full members can talk with both full and limited > members whereas limited members can only talk with full members. > >> And are you saying that for full >> membership, any value beginning with 0x8 would work? > The 0x8000 bit is the (full) membership bit so 0x8abc is the pkey for > full membership in the 0xabc partition. 15 bits of pkey can be used > for partition although my example above only used 12 bits. > >> Can an HCA have full membership on multiple partitions simultaneously? > Yes. > > -- Hal > >> Thanks, >> >> Tom >> >> >>> -- Hal >>> >>>> Tom >>>> >>>> On 7/12/2010 1:06 PM, Hal Rosenstock wrote: >>>>> On Mon, Jul 12, 2010 at 3:03 PM, Hal Rosenstock >>>>> wrote: >>>>>> Hi Tom, >>>>>> >>>>>> On 7/12/10, Tom Ammon wrote: >>>>>>> Hi, >>>>>>> >>>>>>> I have some basic questions about IB partitions. >>>>>>> >>>>>>> Can an HCA port belong to more than 1 partition at a time? >>>>>> Yes. >>>>>> >>>>>>> How do you configure partitions with opensm? From reading the opensmd >>>>>>> man page, it looks like you just create a file called >>>>>>> /etc/osm-partitions.conf, with port GUIDs and such, but is this >>>>>>> current? >>>>>> The default location depends on how OpenSM is configured/built. >>>>> I missed this the first time around: >>>>> >>>>> and yes, the syntax indicated is current. >>>>> >>>>> -- Hal >>>>> >>>>>>> I ask because according to the man page the opensm configuration file >>>>>>> is >>>>>>> in /etc/opensm/ . Can you tell opensm where to look for the partitions >>>>>>> file? >>>>>> Yes, with either the -P option on the command line or >>>>>> partition_config_file line in the options file. >>>>>> >>>>>> -- Hal >>>>>> >>>>>>> Thanks, >>>>>>> >>>>>>> Tom >>>>>>> >>>>>>> -- >>>>>>> Tom Ammon >>>>>>> Network Engineer >>>>>>> Office: 801.587.0976 >>>>>>> Mobile: 801.674.9273 >>>>>>> >>>>>>> Center for High Performance Computing >>>>>>> University of Utah >>>>>>> http://www.chpc.utah.edu >>>>>>> >>>>>>> -- >>>>>>> To unsubscribe from this list: send the line "unsubscribe linux-rdma" >>>>>>> in >>>>>>> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org >>>>>>> More majordomo info at http://vger.kernel.org/majordomo-info.html >>>>>>> >>>> -- >>>> Tom Ammon >>>> Network Engineer >>>> Office: 801.587.0976 >>>> Mobile: 801.674.9273 >>>> >>>> Center for High Performance Computing >>>> University of Utah >>>> http://www.chpc.utah.edu >>>> >>>> >> -- >> Tom Ammon >> Network Engineer >> Office: 801.587.0976 >> Mobile: 801.674.9273 >> >> Center for High Performance Computing >> University of Utah >> http://www.chpc.utah.edu >> >> -- Tom Ammon Network Engineer Office: 801.587.0976 Mobile: 801.674.9273 Center for High Performance Computing University of Utah http://www.chpc.utah.edu -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at http://vger.kernel.org/majordomo-info.html