* [PATCH net-next] net_sched: increase drop count when packets are dropped @ 2014-05-13 9:42 Yang Yingliang 2014-05-13 13:49 ` Eric Dumazet 0 siblings, 1 reply; 5+ messages in thread From: Yang Yingliang @ 2014-05-13 9:42 UTC (permalink / raw) To: netdev; +Cc: eric.dumazet, vtlam, nanditad, davem When packets are dropped because of overlimit, the drop count should be increased. Replace kfree_skb() with qdisc_drop() for increasing drop count. Signed-off-by: Yang Yingliang <yangyingliang@huawei.com> --- net/sched/sch_fq.c | 2 +- net/sched/sch_fq_codel.c | 3 ++- net/sched/sch_hhf.c | 3 ++- 3 files changed, 5 insertions(+), 3 deletions(-) diff --git a/net/sched/sch_fq.c b/net/sched/sch_fq.c index 23c682b42f99..958ef7d4b825 100644 --- a/net/sched/sch_fq.c +++ b/net/sched/sch_fq.c @@ -714,7 +714,7 @@ static int fq_change(struct Qdisc *sch, struct nlattr *opt) if (!skb) break; - kfree_skb(skb); + qdisc_drop(skb, sch); drop_count++; } qdisc_tree_decrease_qlen(sch, drop_count); diff --git a/net/sched/sch_fq_codel.c b/net/sched/sch_fq_codel.c index 0bf432c782c1..bcfe4594470f 100644 --- a/net/sched/sch_fq_codel.c +++ b/net/sched/sch_fq_codel.c @@ -344,7 +344,8 @@ static int fq_codel_change(struct Qdisc *sch, struct nlattr *opt) while (sch->q.qlen > sch->limit) { struct sk_buff *skb = fq_codel_dequeue(sch); - kfree_skb(skb); + qdisc_drop(skb, sch); + q->drop_overlimit++; q->cstats.drop_count++; } qdisc_tree_decrease_qlen(sch, q->cstats.drop_count); diff --git a/net/sched/sch_hhf.c b/net/sched/sch_hhf.c index 6aab8619bbb0..71542d2cecac 100644 --- a/net/sched/sch_hhf.c +++ b/net/sched/sch_hhf.c @@ -593,7 +593,8 @@ static int hhf_change(struct Qdisc *sch, struct nlattr *opt) while (sch->q.qlen > sch->limit) { struct sk_buff *skb = hhf_dequeue(sch); - kfree_skb(skb); + qdisc_drop(skb, sch); + q->drop_overlimit++; } qdisc_tree_decrease_qlen(sch, qlen - sch->q.qlen); -- 1.8.0 ^ permalink raw reply related [flat|nested] 5+ messages in thread
* Re: [PATCH net-next] net_sched: increase drop count when packets are dropped 2014-05-13 9:42 [PATCH net-next] net_sched: increase drop count when packets are dropped Yang Yingliang @ 2014-05-13 13:49 ` Eric Dumazet 2014-05-16 9:07 ` Yang Yingliang 0 siblings, 1 reply; 5+ messages in thread From: Eric Dumazet @ 2014-05-13 13:49 UTC (permalink / raw) To: Yang Yingliang; +Cc: netdev, vtlam, nanditad, davem On Tue, 2014-05-13 at 17:42 +0800, Yang Yingliang wrote: > When packets are dropped because of overlimit, the drop count > should be increased. Replace kfree_skb() with qdisc_drop() for > increasing drop count. > > Signed-off-by: Yang Yingliang <yangyingliang@huawei.com> > --- > net/sched/sch_fq.c | 2 +- > net/sched/sch_fq_codel.c | 3 ++- > net/sched/sch_hhf.c | 3 ++- > 3 files changed, 5 insertions(+), 3 deletions(-) > > diff --git a/net/sched/sch_fq.c b/net/sched/sch_fq.c > index 23c682b42f99..958ef7d4b825 100644 > --- a/net/sched/sch_fq.c > +++ b/net/sched/sch_fq.c > @@ -714,7 +714,7 @@ static int fq_change(struct Qdisc *sch, struct nlattr *opt) > > if (!skb) > break; > - kfree_skb(skb); > + qdisc_drop(skb, sch); > drop_count++; > } > qdisc_tree_decrease_qlen(sch, drop_count); > diff --git a/net/sched/sch_fq_codel.c b/net/sched/sch_fq_codel.c > index 0bf432c782c1..bcfe4594470f 100644 > --- a/net/sched/sch_fq_codel.c > +++ b/net/sched/sch_fq_codel.c > @@ -344,7 +344,8 @@ static int fq_codel_change(struct Qdisc *sch, struct nlattr *opt) > while (sch->q.qlen > sch->limit) { > struct sk_buff *skb = fq_codel_dequeue(sch); > > - kfree_skb(skb); > + qdisc_drop(skb, sch); > + q->drop_overlimit++; > q->cstats.drop_count++; > } Could you please refrain from adding random stuff in packet schedulers ? overlimit has a special meaning for HTB like qdisc, having a shapers. fq_codel or hhf do not shape, there is no reason to increment 'overlimit' when they _drop_ a packet. Example of current behavior for HTB : class htb 1:1 root rate 40Gbit ceil 40Gbit burst 625Kb cburst 625Kb Sent 8222081942286 bytes 2240972916 pkt (dropped 0, overlimits 43819454 requeues 0) rate 0bit 0pps backlog 0b 0p requeues 0 lended: 1207852666 borrowed: 0 giants: 0 tokens: 1999 ctokens: 1999 ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH net-next] net_sched: increase drop count when packets are dropped 2014-05-13 13:49 ` Eric Dumazet @ 2014-05-16 9:07 ` Yang Yingliang 2014-05-16 13:22 ` Eric Dumazet 0 siblings, 1 reply; 5+ messages in thread From: Yang Yingliang @ 2014-05-16 9:07 UTC (permalink / raw) To: Eric Dumazet; +Cc: netdev, vtlam, nanditad, davem On 2014/5/13 21:49, Eric Dumazet wrote: > On Tue, 2014-05-13 at 17:42 +0800, Yang Yingliang wrote: >> When packets are dropped because of overlimit, the drop count >> should be increased. Replace kfree_skb() with qdisc_drop() for >> increasing drop count. >> >> Signed-off-by: Yang Yingliang <yangyingliang@huawei.com> >> --- >> net/sched/sch_fq.c | 2 +- >> net/sched/sch_fq_codel.c | 3 ++- >> net/sched/sch_hhf.c | 3 ++- >> 3 files changed, 5 insertions(+), 3 deletions(-) >> >> diff --git a/net/sched/sch_fq.c b/net/sched/sch_fq.c >> index 23c682b42f99..958ef7d4b825 100644 >> --- a/net/sched/sch_fq.c >> +++ b/net/sched/sch_fq.c >> @@ -714,7 +714,7 @@ static int fq_change(struct Qdisc *sch, struct nlattr *opt) >> >> if (!skb) >> break; >> - kfree_skb(skb); >> + qdisc_drop(skb, sch); >> drop_count++; >> } >> qdisc_tree_decrease_qlen(sch, drop_count); >> diff --git a/net/sched/sch_fq_codel.c b/net/sched/sch_fq_codel.c >> index 0bf432c782c1..bcfe4594470f 100644 >> --- a/net/sched/sch_fq_codel.c >> +++ b/net/sched/sch_fq_codel.c >> @@ -344,7 +344,8 @@ static int fq_codel_change(struct Qdisc *sch, struct nlattr *opt) >> while (sch->q.qlen > sch->limit) { >> struct sk_buff *skb = fq_codel_dequeue(sch); >> >> - kfree_skb(skb); >> + qdisc_drop(skb, sch); >> + q->drop_overlimit++; >> q->cstats.drop_count++; >> } > > Could you please refrain from adding random stuff in packet schedulers ? OK :) > > overlimit has a special meaning for HTB like qdisc, having a shapers. I don't really catch up with you here. What's special meaning ? > > fq_codel or hhf do not shape, there is no reason to increment > 'overlimit' when they _drop_ a packet. Do you mean 'drop_overlimit' or 'overlimit' ? fq_codel has both 'overlimits' and 'drop_overlimit' : qdisc fq_codel 1: dev eth4 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn Sent 834 bytes 5 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 maxpacket 256 drop_overlimit 0 new_flow_count 0 ecn_mark 0 new_flows_len 0 old_flows_len 0 Could you please explain more explicitly ? Thanks very much! ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH net-next] net_sched: increase drop count when packets are dropped 2014-05-16 9:07 ` Yang Yingliang @ 2014-05-16 13:22 ` Eric Dumazet 2014-05-19 8:25 ` Yang Yingliang 0 siblings, 1 reply; 5+ messages in thread From: Eric Dumazet @ 2014-05-16 13:22 UTC (permalink / raw) To: Yang Yingliang; +Cc: vtlam, nanditad, davem, netdev On Fri, 2014-05-16 at 17:07 +0800, Yang Yingliang wrote: > On 2014/5/13 21:49, Eric Dumazet wrote: > > On Tue, 2014-05-13 at 17:42 +0800, Yang Yingliang wrote: > >> When packets are dropped because of overlimit, the drop count > >> should be increased. Replace kfree_skb() with qdisc_drop() for > >> increasing drop count. > >> > >> Signed-off-by: Yang Yingliang <yangyingliang@huawei.com> > >> --- > >> net/sched/sch_fq.c | 2 +- > >> net/sched/sch_fq_codel.c | 3 ++- > >> net/sched/sch_hhf.c | 3 ++- > >> 3 files changed, 5 insertions(+), 3 deletions(-) > >> > >> diff --git a/net/sched/sch_fq.c b/net/sched/sch_fq.c > >> index 23c682b42f99..958ef7d4b825 100644 > >> --- a/net/sched/sch_fq.c > >> +++ b/net/sched/sch_fq.c > >> @@ -714,7 +714,7 @@ static int fq_change(struct Qdisc *sch, struct nlattr *opt) > >> > >> if (!skb) > >> break; > >> - kfree_skb(skb); > >> + qdisc_drop(skb, sch); > >> drop_count++; > >> } > >> qdisc_tree_decrease_qlen(sch, drop_count); > >> diff --git a/net/sched/sch_fq_codel.c b/net/sched/sch_fq_codel.c > >> index 0bf432c782c1..bcfe4594470f 100644 > >> --- a/net/sched/sch_fq_codel.c > >> +++ b/net/sched/sch_fq_codel.c > >> @@ -344,7 +344,8 @@ static int fq_codel_change(struct Qdisc *sch, struct nlattr *opt) > >> while (sch->q.qlen > sch->limit) { > >> struct sk_buff *skb = fq_codel_dequeue(sch); > >> > >> - kfree_skb(skb); > >> + qdisc_drop(skb, sch); > >> + q->drop_overlimit++; > >> q->cstats.drop_count++; > >> } > > > > Could you please refrain from adding random stuff in packet schedulers ? > OK :) > > > > > overlimit has a special meaning for HTB like qdisc, having a shapers. > I don't really catch up with you here. What's special meaning ? > > > > > fq_codel or hhf do not shape, there is no reason to increment > > 'overlimit' when they _drop_ a packet. > > Do you mean 'drop_overlimit' or 'overlimit' ? > > fq_codel has both 'overlimits' and 'drop_overlimit' : > > qdisc fq_codel 1: dev eth4 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn > Sent 834 bytes 5 pkt (dropped 0, overlimits 0 requeues 0) > backlog 0b 0p requeues 0 > maxpacket 256 drop_overlimit 0 new_flow_count 0 ecn_mark 0 > new_flows_len 0 old_flows_len 0 > > Could you please explain more explicitly ? Okay fair enough. Read again the changelog you gave. Where is this change mentioned or explained properly ? You give a changelog, then you insert a 'random' change in the patch, not mentioned in the changelog. How I am supposed to be cool ? Instead of cooking a clean patch, you have this tendency of putting 'random' things and expect me/us to carefully check you didn't add a bug. But you know what, its exhausting, The quality of your patches dropped considerably in the last submissions. I ask you to test your patches and prove you don't break things, because I do not trust you anymore. I am going to ask you to give detailed Tested: sections for your next patches. ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH net-next] net_sched: increase drop count when packets are dropped 2014-05-16 13:22 ` Eric Dumazet @ 2014-05-19 8:25 ` Yang Yingliang 0 siblings, 0 replies; 5+ messages in thread From: Yang Yingliang @ 2014-05-19 8:25 UTC (permalink / raw) To: Eric Dumazet; +Cc: vtlam, nanditad, davem, netdev On 2014/5/16 21:22, Eric Dumazet wrote: > On Fri, 2014-05-16 at 17:07 +0800, Yang Yingliang wrote: >> On 2014/5/13 21:49, Eric Dumazet wrote: >>> On Tue, 2014-05-13 at 17:42 +0800, Yang Yingliang wrote: >>>> When packets are dropped because of overlimit, the drop count >>>> should be increased. Replace kfree_skb() with qdisc_drop() for >>>> increasing drop count. >>>> >>>> Signed-off-by: Yang Yingliang <yangyingliang@huawei.com> >>>> --- >>>> net/sched/sch_fq.c | 2 +- >>>> net/sched/sch_fq_codel.c | 3 ++- >>>> net/sched/sch_hhf.c | 3 ++- >>>> 3 files changed, 5 insertions(+), 3 deletions(-) >>>> >>>> diff --git a/net/sched/sch_fq.c b/net/sched/sch_fq.c >>>> index 23c682b42f99..958ef7d4b825 100644 >>>> --- a/net/sched/sch_fq.c >>>> +++ b/net/sched/sch_fq.c >>>> @@ -714,7 +714,7 @@ static int fq_change(struct Qdisc *sch, struct nlattr *opt) >>>> >>>> if (!skb) >>>> break; >>>> - kfree_skb(skb); >>>> + qdisc_drop(skb, sch); >>>> drop_count++; >>>> } >>>> qdisc_tree_decrease_qlen(sch, drop_count); >>>> diff --git a/net/sched/sch_fq_codel.c b/net/sched/sch_fq_codel.c >>>> index 0bf432c782c1..bcfe4594470f 100644 >>>> --- a/net/sched/sch_fq_codel.c >>>> +++ b/net/sched/sch_fq_codel.c >>>> @@ -344,7 +344,8 @@ static int fq_codel_change(struct Qdisc *sch, struct nlattr *opt) >>>> while (sch->q.qlen > sch->limit) { >>>> struct sk_buff *skb = fq_codel_dequeue(sch); >>>> >>>> - kfree_skb(skb); >>>> + qdisc_drop(skb, sch); >>>> + q->drop_overlimit++; >>>> q->cstats.drop_count++; >>>> } >>> >>> Could you please refrain from adding random stuff in packet schedulers ? >> OK :) >> >>> >>> overlimit has a special meaning for HTB like qdisc, having a shapers. >> I don't really catch up with you here. What's special meaning ? >> >>> >>> fq_codel or hhf do not shape, there is no reason to increment >>> 'overlimit' when they _drop_ a packet. >> >> Do you mean 'drop_overlimit' or 'overlimit' ? >> >> fq_codel has both 'overlimits' and 'drop_overlimit' : >> >> qdisc fq_codel 1: dev eth4 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn >> Sent 834 bytes 5 pkt (dropped 0, overlimits 0 requeues 0) >> backlog 0b 0p requeues 0 >> maxpacket 256 drop_overlimit 0 new_flow_count 0 ecn_mark 0 >> new_flows_len 0 old_flows_len 0 >> >> Could you please explain more explicitly ? > > > Okay fair enough. > > Read again the changelog you gave. > > Where is this change mentioned or explained properly ? > > You give a changelog, then you insert a 'random' change in the patch, > not mentioned in the changelog. How I am supposed to be cool ? > > Instead of cooking a clean patch, you have this tendency of putting > 'random' things and expect me/us to carefully check you didn't add a > bug. But you know what, its exhausting, > > The quality of your patches dropped considerably in the last > submissions. > > I ask you to test your patches and prove you don't break things, because > I do not trust you anymore. > > I am going to ask you to give detailed Tested: sections for your next > patches. > First, thanks for explanation ! Then about the patch, I've tested this patch before I sent it. Precisely because of the testing, I add the code that not mentioned in the changelog. Anyway, I'm sorry for the bad changelog, I'll write more explicitly for my next patches. Here is my test way : Step 1. One terminal run iperf to send packets: # iperf -c $ip -i 1 -P 1 -t 6000 Step 2. Another terminal run the script: #!/bin/sh int=1 while(( $int<=5 )) do tc qdisc replace dev eth4 root handle 1: fq_codel limit 10 tc qdisc replace dev eth4 root handle 1: fq_codel limit 100000 done (Besides, to make sure it has execute the code I've changed, I printed some message after my changed code.) Step 3. run '# tc qdisc -s -d show dev eth4' qdisc fq_codel 1: dev eth4 root refcnt 2 limit 10p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn Sent 928883982 bytes 616651 pkt (*dropped 747*, overlimits 0 requeues 0) backlog 0b 0p requeues 0 maxpacket 1514 *drop_overlimit 654* new_flow_count 15 ecn_mark 0 new_flows_len 0 old_flows_len 0 >From the test result, I found that _drop_overlimit_ are smaller than _dropped_ , so I increased _drop_overlimit_ (not overlimits of qstats). Then I got the below result which _drop_overlimit_ and _dropped_ are equal. qdisc fq_codel 1: dev eth4 root refcnt 2 limit 10p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn Sent 3309408635 bytes 2196855 pkt (*dropped 4458*, overlimits 0 requeues 2) backlog 0b 0p requeues 2 maxpacket 1514 *drop_overlimit 4458* new_flow_count 57 ecn_mark 0 new_flows_len 0 old_flows_len 0 (For fq and hhf, I use the same test way) I wonder if _overlimit_ that you mentioned in the earlier mail and _drop_overlimit_ I mentioned here are same variable. If they're same , maybe I miss something, please let me know. Thanks! ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2014-05-19 8:26 UTC | newest] Thread overview: 5+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2014-05-13 9:42 [PATCH net-next] net_sched: increase drop count when packets are dropped Yang Yingliang 2014-05-13 13:49 ` Eric Dumazet 2014-05-16 9:07 ` Yang Yingliang 2014-05-16 13:22 ` Eric Dumazet 2014-05-19 8:25 ` Yang Yingliang
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).