Re: basic questions about partitions

[Tom Ammon <tom.ammon-wbocuHtxKic@public.gmane.org>]

  Hal,

I have some more partition questions. Do I have to configure the nodes 
as members of partition(s) both in opensm and on the individual node (if 
the node is a member of two partitions)? And what about the switches - 
do the switches need be configured as part of any partition?

Tom

On 7/13/2010 11:44 AM, Hal Rosenstock wrote:
> Tom,
>
> On Tue, Jul 13, 2010 at 12:50 PM, Tom Ammon<tom.ammon-wbocuHtxKic@public.gmane.org>  wrote:
>>   Hal,
>>
>>> The procedure is a little different. You'll need to create a child
>>> interface (on a partition) first and then you will be able to
>>> configure it as follows:
>>>
>>> echo 0x8001>    /sys/class/net/ib0/create_child
>>> ifconfig ib0.8001 ...
>>>
>>> Note that you'll want the 0x8000 bit on for full membership.
>> What does "full membership" mean?
> For a partition, full members can talk with both full and limited
> members whereas limited members can only talk with full members.
>
>> And are you saying that for full
>> membership, any value beginning with 0x8 would work?
> The 0x8000 bit is the (full) membership bit so 0x8abc is the pkey for
> full membership in the 0xabc partition. 15 bits of pkey can be used
> for partition although my example above only used 12 bits.
>
>> Can an HCA have full membership on multiple partitions simultaneously?
> Yes.
>
> -- Hal
>
>> Thanks,
>>
>> Tom
>>
>>
>>> -- Hal
>>>
>>>> Tom
>>>>
>>>> On 7/12/2010 1:06 PM, Hal Rosenstock wrote:
>>>>> On Mon, Jul 12, 2010 at 3:03 PM, Hal Rosenstock
>>>>> <hal.rosenstock-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>      wrote:
>>>>>> Hi Tom,
>>>>>>
>>>>>> On 7/12/10, Tom Ammon<tom.ammon-wbocuHtxKic@public.gmane.org>      wrote:
>>>>>>>    Hi,
>>>>>>>
>>>>>>> I have some basic questions about IB partitions.
>>>>>>>
>>>>>>> Can an HCA port belong to more than 1 partition at a time?
>>>>>> Yes.
>>>>>>
>>>>>>> How do you configure partitions with opensm? From reading the opensmd
>>>>>>> man page, it looks like you just create a file called
>>>>>>> /etc/osm-partitions.conf, with port GUIDs and such, but is this
>>>>>>> current?
>>>>>> The default location depends on how OpenSM is configured/built.
>>>>> I missed this the first time around:
>>>>>
>>>>> and yes, the syntax indicated is current.
>>>>>
>>>>> -- Hal
>>>>>
>>>>>>> I ask because according to the man page the opensm configuration file
>>>>>>> is
>>>>>>> in /etc/opensm/ . Can you tell opensm where to look for the partitions
>>>>>>> file?
>>>>>> Yes, with either the -P option on the command line or
>>>>>> partition_config_file line in the options file.
>>>>>>
>>>>>> -- Hal
>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Tom
>>>>>>>
>>>>>>> --
>>>>>>> Tom Ammon
>>>>>>> Network Engineer
>>>>>>> Office: 801.587.0976
>>>>>>> Mobile: 801.674.9273
>>>>>>>
>>>>>>> Center for High Performance Computing
>>>>>>> University of Utah
>>>>>>> http://www.chpc.utah.edu
>>>>>>>
>>>>>>> --
>>>>>>> To unsubscribe from this list: send the line "unsubscribe linux-rdma"
>>>>>>> in
>>>>>>> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
>>>>>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>>>>>
>>>> --
>>>> Tom Ammon
>>>> Network Engineer
>>>> Office: 801.587.0976
>>>> Mobile: 801.674.9273
>>>>
>>>> Center for High Performance Computing
>>>> University of Utah
>>>> http://www.chpc.utah.edu
>>>>
>>>>
>> --
>> Tom Ammon
>> Network Engineer
>> Office: 801.587.0976
>> Mobile: 801.674.9273
>>
>> Center for High Performance Computing
>> University of Utah
>> http://www.chpc.utah.edu
>>
>>

-- 
Tom Ammon
Network Engineer
Office: 801.587.0976
Mobile: 801.674.9273

Center for High Performance Computing
University of Utah
http://www.chpc.utah.edu

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html