DCCP Conformance Test Suite

DCCP Conformance Test Suite

[Wei Yongjun]

Hi Gerrit Renker:

The DCCP Conformance Test Suite is available now with little test cases.
Can you have a look at it and tell me what functions of DCCP need to be
add test cases? I'll continue to add test cases for DCCP. Thanks.

I have do test under IPv4, and there are still some BUGs(?) of DCCP
which need to do patch.

If you or someone have something needed to be tested, you can tell me, I
can wrote test case for it if it is possible.

Download:
It is available at:
http://dccpct.sourceforge.net/download.html

- v6eval with DCCP support:
http://dccpct.sourceforge.net/v6eval-3.0.14-linux-dccp.tar.gz

- Test Suite:
http://dccpct.sourceforge.net/dccp-1.0.0.tar.gz

Usage:
http://dccpct.sourceforge.net/usage.html

Test Report under IPv4:
http://dccpct.sourceforge.net/log/ipv4/index.html


Regards
Wei Yongjun

Re: DCCP Conformance Test Suite

[Leandro Sales]

Nice job, Wei! I have being at OLS and one person from IBM talked
about LTP, are you using this project?

Regards,
Leandro.


On 7/27/08, Wei Yongjun <yjwei@cn.fujitsu.com> wrote:
> Hi Gerrit Renker:
>
> The DCCP Conformance Test Suite is available now with little test cases.
> Can you have a look at it and tell me what functions of DCCP need to be
> add test cases? I'll continue to add test cases for DCCP. Thanks.
>
> I have do test under IPv4, and there are still some BUGs(?) of DCCP
> which need to do patch.
>
> If you or someone have something needed to be tested, you can tell me, I
> can wrote test case for it if it is possible.
>
> Download:
> It is available at:
> http://dccpct.sourceforge.net/download.html
>
> - v6eval with DCCP support:
> http://dccpct.sourceforge.net/v6eval-3.0.14-linux-dccp.tar.gz
>
> - Test Suite:
> http://dccpct.sourceforge.net/dccp-1.0.0.tar.gz
>
> Usage:
> http://dccpct.sourceforge.net/usage.html
>
> Test Report under IPv4:
> http://dccpct.sourceforge.net/log/ipv4/index.html
>
>
> Regards
> Wei Yongjun
>
> --
> To unsubscribe from this list: send the line "unsubscribe dccp" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>



-- 
Leandro Melo de Sales
Pervasive and Embedded Computing Laboratory
Computer Science MSc.
BRisa and E-Phone Projects Manager
Network Admin @ http://embedded.ufcg.edu.br/indexen.html
+55 83 3310-1404 (extension 208)

http://www.leandrosales.com/

-- 
Leandro Melo de Sales
Pervasive and Embedded Computing Laboratory
Computer Science MSc.
BRisa and E-Phone Projects Manager
Network Admin @ http://embedded.ufcg.edu.br/indexen.html
+55 83 3310-1404 (extension 208)

http://www.leandrosales.com/

Re: DCCP Conformance Test Suite

[Wei Yongjun]

Leandro Sales wrote:
> Nice job, Wei! I have being at OLS and one person from IBM talked
> about LTP, are you using this project?
>   

Not LTP,  I used the TAHI's v6eval, which is used for IPv6 DCCP 
Conformance Test Suite.

> Regards,
> Leandro.
>
>
> On 7/27/08, Wei Yongjun <yjwei@cn.fujitsu.com> wrote:
>   
>> Hi Gerrit Renker:
>>
>> The DCCP Conformance Test Suite is available now with little test cases.
>> Can you have a look at it and tell me what functions of DCCP need to be
>> add test cases? I'll continue to add test cases for DCCP. Thanks.
>>
>> I have do test under IPv4, and there are still some BUGs(?) of DCCP
>> which need to do patch.
>>
>> If you or someone have something needed to be tested, you can tell me, I
>> can wrote test case for it if it is possible.
>>
>> Download:
>> It is available at:
>> http://dccpct.sourceforge.net/download.html
>>
>> - v6eval with DCCP support:
>> http://dccpct.sourceforge.net/v6eval-3.0.14-linux-dccp.tar.gz
>>
>> - Test Suite:
>> http://dccpct.sourceforge.net/dccp-1.0.0.tar.gz
>>
>> Usage:
>> http://dccpct.sourceforge.net/usage.html
>>
>> Test Report under IPv4:
>> http://dccpct.sourceforge.net/log/ipv4/index.html
>>
>>
>> Regards
>> Wei Yongjun
>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe dccp" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>
>>     

Re: DCCP Conformance Test Suite

[Wei Yongjun]

Wei Yongjun wrote:
> Leandro Sales wrote:
>> Nice job, Wei! I have being at OLS and one person from IBM talked
>> about LTP, are you using this project?
>>   
>
> Not LTP,  I used the TAHI's v6eval, which is used for IPv6 DCCP 
> Conformance Test Suite.

Sorry, typo error. 

I used the TAHI's v6eval, which is used for IPv6 Conformance Test.

>
>> Regards,
>> Leandro.
>>
>>
>> On 7/27/08, Wei Yongjun <yjwei@cn.fujitsu.com> wrote:
>>  
>>> Hi Gerrit Renker:
>>>
>>> The DCCP Conformance Test Suite is available now with little test 
>>> cases.
>>> Can you have a look at it and tell me what functions of DCCP need to be
>>> add test cases? I'll continue to add test cases for DCCP. Thanks.
>>>
>>> I have do test under IPv4, and there are still some BUGs(?) of DCCP
>>> which need to do patch.
>>>
>>> If you or someone have something needed to be tested, you can tell 
>>> me, I
>>> can wrote test case for it if it is possible.
>>>
>>> Download:
>>> It is available at:
>>> http://dccpct.sourceforge.net/download.html
>>>
>>> - v6eval with DCCP support:
>>> http://dccpct.sourceforge.net/v6eval-3.0.14-linux-dccp.tar.gz
>>>
>>> - Test Suite:
>>> http://dccpct.sourceforge.net/dccp-1.0.0.tar.gz
>>>
>>> Usage:
>>> http://dccpct.sourceforge.net/usage.html
>>>
>>> Test Report under IPv4:
>>> http://dccpct.sourceforge.net/log/ipv4/index.html
>>>
>>>
>>> Regards
>>> Wei Yongjun
>>>
>>> -- 
>>> To unsubscribe from this list: send the line "unsubscribe dccp" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>
>>>     

Re: DCCP Conformance Test Suite

[Gerrit Renker]

| Download:
| It is available at:
| http://dccpct.sourceforge.net/download.html
| 
| - v6eval with DCCP support:
| http://dccpct.sourceforge.net/v6eval-3.0.14-linux-dccp.tar.gz
| 
| - Test Suite:
| http://dccpct.sourceforge.net/dccp-1.0.0.tar.gz
| 
| Usage:
| http://dccpct.sourceforge.net/usage.html
| 
| Test Report under IPv4:
| http://dccpct.sourceforge.net/log/ipv4/index.html
| 
This is a great piece of work and thank you for making it publicly available.
Such a tool has long been missing and I hope that the word will soon spread and 
that there will be ongoing test effort.

Your work has been valuable help in isolating several hard-to-find bugs
and I very much hope that you will continue to contribute.

Regarding future tests, several things come to mind, where fixing
existing bugs takes precedence.
	  
Here are a few suggestions. I am not sure whether they fit the frame of the
TAHI suite. The underlying idea is to use a traffic monitor and controlled
packet drop to check the behaviour of the stack under loss.

The first use is to test stability of protocol signalling. Maybe you
remember the feature-negotiation bug which only appeared when the Ack
completing the setup handshake was dropped. Leandro observed this bug
when packets were (presumably) dropped due to forking many DCCP
connections in parallel. To trigger this bug between two machines
required a modification of the kernel sources - which was
work-intensive.

The second application is to validate the behaviour of Ack Vectors. This
is however a bit complicated to do: the traffic monitor needs to keep
track of which packets were lost, and check if these sequence numbers
show up in the run-length encoded Ack Vector going back in the reverse
direction. If it would be possible to automate such tests, that would be
awesome, since manually verifying Ack Vectors is a very tedious task to
do. The Ack Vector code needs more work anyway, since on 802.11g I found
that they grow up to half a kilobyte in length, which is too much.

Last, there is ongoing work to add ECN support. For ECN it would be
helpful to look at the behaviour, since ECN router support seems quite
young.

Gerrit

Re: DCCP Conformance Test Suite

[Wei Yongjun]

Gerrit Renker wrote:
> | Download:
> | It is available at:
> | http://dccpct.sourceforge.net/download.html
> | 
> | - v6eval with DCCP support:
> | http://dccpct.sourceforge.net/v6eval-3.0.14-linux-dccp.tar.gz
> | 
> | - Test Suite:
> | http://dccpct.sourceforge.net/dccp-1.0.0.tar.gz
> | 
> | Usage:
> | http://dccpct.sourceforge.net/usage.html
> | 
> | Test Report under IPv4:
> | http://dccpct.sourceforge.net/log/ipv4/index.html
> | 
> This is a great piece of work and thank you for making it publicly available.
> Such a tool has long been missing and I hope that the word will soon spread and 
> that there will be ongoing test effort.
>
> Your work has been valuable help in isolating several hard-to-find bugs
> and I very much hope that you will continue to contribute.
>
> Regarding future tests, several things come to mind, where fixing
> existing bugs takes precedence.
> 	  
> Here are a few suggestions. I am not sure whether they fit the frame of the
> TAHI suite. The underlying idea is to use a traffic monitor and controlled
> packet drop to check the behaviour of the stack under loss.
>
> The first use is to test stability of protocol signalling. Maybe you
> remember the feature-negotiation bug which only appeared when the Ack
> completing the setup handshake was dropped. Leandro observed this bug
> when packets were (presumably) dropped due to forking many DCCP
> connections in parallel. To trigger this bug between two machines
> required a modification of the kernel sources - which was
> work-intensive.
>   

Used TAHI's test frame, we can send any packet we want. Say simplely, 
the endpoint under test is an DCCP application wich used the kernel's 
implementation, but the endpoint used for test does not uesd any DCCP 
implementation, it do all of the work by send packet I defined in the 
test case. So this kind test case is easy to do.

> The second application is to validate the behaviour of Ack Vectors. This
> is however a bit complicated to do: the traffic monitor needs to keep
> track of which packets were lost, and check if these sequence numbers
> show up in the run-length encoded Ack Vector going back in the reverse
> direction. If it would be possible to automate such tests, that would be
> awesome, since manually verifying Ack Vectors is a very tedious task to
> do. The Ack Vector code needs more work anyway, since on 802.11g I found
> that they grow up to half a kilobyte in length, which is too much.
>   

Maybe TAHI is available, I'll have a try.
> Last, there is ongoing work to add ECN support. For ECN it would be
> helpful to look at the behaviour, since ECN router support seems quite
> young

Do you mean send packet with ECN in the ip header? I'll have a look to 
the ECN RFC, and check if it can.

Thanks.

Wei Yongjun

Re: DCCP Conformance Test Suite

[Gerrit Renker]

>> Last, there is ongoing work to add ECN support. For ECN it would be
>> helpful to look at the behaviour, since ECN router support seems quite
>> young
>
> Do you mean send packet with ECN in the ip header? I'll have a look to  
> the ECN RFC, and check if it can.
>
ECN is work in progress and will take some time since it requires
changes to CCID-3 and other parts.

For the moment it is probably best to work on the bugs in the existing
code (apparently there are still 22 "fail" cases).

Gerrit