RE: Need information about understanding PCIE non-transparent bridge

RE: Need information about understanding PCIE non-transparent bridge

[Allen Hubbe]

Hi Sridhar,

If you have NTB hardware already physically connected and
configured in your BIOS, then you can build and load the
linux ntb modules.

Here is the documentation on linux ntb modules.  It says
what the modules do, and how to use them.

http://lxr.free-electrons.com/source/Documentation/ntb.txt

If you are interested in testing or demonstrating basic NTB
functionality, try ntb_tool and ntb_pingpong.  There is
also a network device over NTB supported by ntb_transport
and ntb_netdev together.

Please let me know if you have any questions not answered in
the documentation.  I am happy to help.

Allen

From: sridhar T S
>
> Hi allen,
>
> myself sridhar, working as senior software engineer.
> i wanted to understand about PCIE non-transparent bridge.
>
> i will be testing the linux device driver for NTB, for now
> i have a very fair understanding about the architecture.
>
> need some ideas about how to test the NTB device driver
> across NTB systems for proper system operations with
> respect to NTB device driver for linux
>
> your inputs and information will be helpful.
>
> thanks in advance.
>
> regards,
> Sridhar 

Re: Need information about understanding PCIE non-transparent bridge

[sridhar T S]

[-- Attachment #1: Type: text/plain, Size: 2225 bytes --]

hi Allen,

yes, am interested in testing the ntb functionality using Linux mainly our
test OS will be Ubuntu.
i would welcome your suggestions and ideas upon the system configuration,
tools/applications, server setup between the primary and secondary machines.

below is my queries:

1. Can you let me know how to use the tools ntb_tool and ntb_pingpong to
test the ntb connection.
2. NTB setup configuration i.e how to configure the two systems for NTB
data access
            a. which file system server to create for testing between
platforms.
            b. third party tools to verify the ntb bandwidth
3. How to access non bar0 data transactions between ntb machines?
            a. can you suggest any tools or applications that can be used
to verfiy from operating system perspective
4. how can we initiate data transfer using the system DMA?

i will keep you posted on any more queries in this thread

regards,
Sridhar

On Fri, May 6, 2016 at 6:35 PM, Allen Hubbe <Allen.Hubbe@emc.com> wrote:

> Hi Sridhar,
>
> If you have NTB hardware already physically connected and
> configured in your BIOS, then you can build and load the
> linux ntb modules.
>
> Here is the documentation on linux ntb modules.  It says
> what the modules do, and how to use them.
>
> http://lxr.free-electrons.com/source/Documentation/ntb.txt
>
> If you are interested in testing or demonstrating basic NTB
> functionality, try ntb_tool and ntb_pingpong.  There is
> also a network device over NTB supported by ntb_transport
> and ntb_netdev together.
>
> Please let me know if you have any questions not answered in
> the documentation.  I am happy to help.
>
> Allen
>
> From: sridhar T S
> >
> > Hi allen,
> >
> > myself sridhar, working as senior software engineer.
> > i wanted to understand about PCIE non-transparent bridge.
> >
> > i will be testing the linux device driver for NTB, for now
> > i have a very fair understanding about the architecture.
> >
> > need some ideas about how to test the NTB device driver
> > across NTB systems for proper system operations with
> > respect to NTB device driver for linux
> >
> > your inputs and information will be helpful.
> >
> > thanks in advance.
> >
> > regards,
> > Sridhar
>
>
>
>

[-- Attachment #2: Type: text/html, Size: 3718 bytes --]

Re: Need information about understanding PCIE non-transparent bridge

[Jon Mason]

On Mon, May 9, 2016 at 5:23 AM, sridhar T S <sridhar.lochu@gmail.com> wrote:
> hi Allen,
>
> yes, am interested in testing the ntb functionality using Linux mainly our
> test OS will be Ubuntu.
> i would welcome your suggestions and ideas upon the system configuration,
> tools/applications, server setup between the primary and secondary machines.
>
> below is my queries:
>
> 1. Can you let me know how to use the tools ntb_tool and ntb_pingpong to
> test the ntb connection.

See Documentation/ntb.txt

> 2. NTB setup configuration i.e how to configure the two systems for NTB data
> access
>             a. which file system server to create for testing between
> platforms.

Not sure what you mean here.  Are you referring to NFS?

>             b. third party tools to verify the ntb bandwidth

None are known to exist

> 3. How to access non bar0 data transactions between ntb machines?
>             a. can you suggest any tools or applications that can be used to
> verfiy from operating system perspective

Each BAR is exposed as a separate memory window.  If you have > 1 BAR,
then you will have a separate MW that the client can use (unless it is
being used by the kernel to workaround HW issues).

> 4. how can we initiate data transfer using the system DMA?

This will happen automatically if the DMA engine is enabled in the kernel

>
> i will keep you posted on any more queries in this thread
>
> regards,
> Sridhar
>
> On Fri, May 6, 2016 at 6:35 PM, Allen Hubbe <Allen.Hubbe@emc.com> wrote:
>>
>> Hi Sridhar,
>>
>> If you have NTB hardware already physically connected and
>> configured in your BIOS, then you can build and load the
>> linux ntb modules.
>>
>> Here is the documentation on linux ntb modules.  It says
>> what the modules do, and how to use them.
>>
>> http://lxr.free-electrons.com/source/Documentation/ntb.txt
>>
>> If you are interested in testing or demonstrating basic NTB
>> functionality, try ntb_tool and ntb_pingpong.  There is
>> also a network device over NTB supported by ntb_transport
>> and ntb_netdev together.
>>
>> Please let me know if you have any questions not answered in
>> the documentation.  I am happy to help.
>>
>> Allen
>>
>> From: sridhar T S
>> >
>> > Hi allen,
>> >
>> > myself sridhar, working as senior software engineer.
>> > i wanted to understand about PCIE non-transparent bridge.
>> >
>> > i will be testing the linux device driver for NTB, for now
>> > i have a very fair understanding about the architecture.
>> >
>> > need some ideas about how to test the NTB device driver
>> > across NTB systems for proper system operations with
>> > respect to NTB device driver for linux
>> >
>> > your inputs and information will be helpful.
>> >
>> > thanks in advance.
>> >
>> > regards,
>> > Sridhar
>>
>>
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "linux-ntb" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to linux-ntb+unsubscribe@googlegroups.com.
> To post to this group, send email to linux-ntb@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/linux-ntb/CAO%2B9SsM2z8QW_RVBaw3g7%3DnOehppq98zQ_1Zw10a7gofiBBgFA%40mail.gmail.com.
>
> For more options, visit https://groups.google.com/d/optout.