netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* [0/5] GSO: Generic Segmentation Offload
@ 2006-06-20  9:09 Herbert Xu
  2006-06-20  9:10 ` [1/5] [NET]: Merge TSO/UFO fields in sk_buff Herbert Xu
                   ` (5 more replies)
  0 siblings, 6 replies; 21+ messages in thread
From: Herbert Xu @ 2006-06-20  9:09 UTC (permalink / raw)
  To: David S. Miller, netdev

Hi:

This series adds Generic Segmentation Offload (GSO) support to the Linux
networking stack.

Many people have observed that a lot of the savings in TSO come from
traversing the networking stack once rather than many times for each
super-packet.  These savings can be obtained without hardware support.
In fact, the concept can be applied to other protocols such as TCPv6,
UDP, or even DCCP.

The key to minimising the cost in implementing this is to postpone the
segmentation as late as possible.  In the ideal world, the segmentation
would occur inside each NIC driver where they would rip the super-packet
apart and either produce SG lists which are directly fed to the hardware,
or linearise each segment into pre-allocated memory to be fed to the NIC.
This would elminate segmented skb's altogether.

Unfortunately this requires modifying each and every NIC driver so it
would take quite some time.  A much easier solution is to perform the
segmentation just before the entry into the driver's xmit routine.  This
series of patches does this.

I've attached some numbers to demonstrate the savings brought on by
doing this.  The best scenario is obviously the case where the underlying
NIC supports SG.  This means that we simply have to manipulate the SG
entries and place them into individual skb's before passing them to the
driver.  The attached file lo-res shows this.

The test was performed through the loopback device which is a fairly good
approxmiation of an SG-capable NIC.

GSO like TSO is only effective if the MTU is significantly less than the
maximum value of 64K.  So only the case where the MTU was set to 1500 is
of interest.  There we can see that the throughput improved by 17.5%
(3061.05Mb/s => 3598.17Mb/s).  The actual saving in transmission cost is
in fact a lot more than that as the majority of the time here is spent on
the RX side which still has to deal with 1500-byte packets.

The worst-case scenario is where the NIC does not support SG and the user
uses write(2) which means that we have to copy the data twice.  The files
gso-off/gso-on provide data for this case (the test was carried out on
e100).  As you can see, the cost of the extra copy is mostly offset by the
reduction in the cost of going through the networking stack.

For now GSO is off by default but can be enabled through ethtool.  It is
conceivable that with enough optimisation GSO could be a win in most cases
and we could enable it by default.

However, even without enabling GSO explicitly it can still function on
bridged and forwarded packets.  As it is, passing TSO packets through a
bridge only works if all constiuents support TSO.  With GSO, it provides
a fallback so that we may enable TSO for a bridge even if some of its
constituents do not support TSO.

This provides massive savings for Xen as it uses a bridge-based architecture
and TSO/GSO produces a much larger effective MTU for internal traffic between
domains.

Cheers,
-- 
Visit Openswan at http://www.openswan.org/
Email: Herbert Xu ~{PmV>HI~} <herbert@gondor.apana.org.au>
Home Page: http://gondor.apana.org.au/~herbert/
PGP Key: http://gondor.apana.org.au/~herbert/pubkey.txt

^ permalink raw reply	[flat|nested] 21+ messages in thread
* [0/5] GSO: Generic Segmentation Offload
@ 2006-06-22  8:12 Herbert Xu
  2006-06-22  8:15 ` Herbert Xu
                   ` (2 more replies)
  0 siblings, 3 replies; 21+ messages in thread
From: Herbert Xu @ 2006-06-22  8:12 UTC (permalink / raw)
  To: David S. Miller, netdev

[-- Attachment #1: Type: text/plain, Size: 3371 bytes --]

Hi:

This is a repost of the GSO patches.  The main change is the fix to a bug
in the way dev->gso_skb is freed.  This series requires the dev_deactivate
patch that I just posted.

Here is the original description:

This series adds Generic Segmentation Offload (GSO) support to the Linux
networking stack.

Many people have observed that a lot of the savings in TSO come from
traversing the networking stack once rather than many times for each
super-packet.  These savings can be obtained without hardware support.
In fact, the concept can be applied to other protocols such as TCPv6,
UDP, or even DCCP.

The key to minimising the cost in implementing this is to postpone the
segmentation as late as possible.  In the ideal world, the segmentation
would occur inside each NIC driver where they would rip the super-packet
apart and either produce SG lists which are directly fed to the hardware,
or linearise each segment into pre-allocated memory to be fed to the NIC.
This would elminate segmented skb's altogether.

Unfortunately this requires modifying each and every NIC driver so it
would take quite some time.  A much easier solution is to perform the
segmentation just before the entry into the driver's xmit routine.  This
series of patches does this.

I've attached some numbers to demonstrate the savings brought on by
doing this.  The best scenario is obviously the case where the underlying
NIC supports SG.  This means that we simply have to manipulate the SG
entries and place them into individual skb's before passing them to the
driver.  The attached file lo-res shows this.

The test was performed through the loopback device which is a fairly good
approxmiation of an SG-capable NIC.

GSO like TSO is only effective if the MTU is significantly less than the
maximum value of 64K.  So only the case where the MTU was set to 1500 is
of interest.  There we can see that the throughput improved by 17.5%
(3061.05Mb/s => 3598.17Mb/s).  The actual saving in transmission cost is
in fact a lot more than that as the majority of the time here is spent on
the RX side which still has to deal with 1500-byte packets.

The worst-case scenario is where the NIC does not support SG and the user
uses write(2) which means that we have to copy the data twice.  The files
gso-off/gso-on provide data for this case (the test was carried out on
e100).  As you can see, the cost of the extra copy is mostly offset by the
reduction in the cost of going through the networking stack.

For now GSO is off by default but can be enabled through ethtool.  It is
conceivable that with enough optimisation GSO could be a win in most cases
and we could enable it by default.

However, even without enabling GSO explicitly it can still function on
bridged and forwarded packets.  As it is, passing TSO packets through a
bridge only works if all constiuents support TSO.  With GSO, it provides
a fallback so that we may enable TSO for a bridge even if some of its
constituents do not support TSO.

This provides massive savings for Xen as it uses a bridge-based architecture
and TSO/GSO produces a much larger effective MTU for internal traffic between
domains.

Cheers,
-- 
Visit Openswan at http://www.openswan.org/
Email: Herbert Xu ~{PmV>HI~} <herbert@gondor.apana.org.au>
Home Page: http://gondor.apana.org.au/~herbert/
PGP Key: http://gondor.apana.org.au/~herbert/pubkey.txt

[-- Attachment #2: lo-res --]
[-- Type: text/plain, Size: 1632 bytes --]

$ sudo ./ethtool -K lo gso on
$ sudo ifconfig lo mtu 1500
$ netperf -t TCP_STREAM
TCP STREAM TEST to localhost
Recv   Send    Send
Socket Socket  Message  Elapsed
Size   Size    Size     Time     Throughput
bytes  bytes   bytes    secs.    10^6bits/sec

 87380  16384  16384    10.00    3598.17
$ sudo ./ethtool -K lo gso off
$ netperf -t TCP_STREAM
TCP STREAM TEST to localhost
Recv   Send    Send
Socket Socket  Message  Elapsed
Size   Size    Size     Time     Throughput
bytes  bytes   bytes    secs.    10^6bits/sec

 87380  16384  16384    10.00    3061.05
$ sudo ifconfig lo mtu 60000
$ netperf -t TCP_STREAM
TCP STREAM TEST to localhost
Recv   Send    Send
Socket Socket  Message  Elapsed
Size   Size    Size     Time     Throughput
bytes  bytes   bytes    secs.    10^6bits/sec

 87380  16384  16384    10.00    8245.05
$ sudo ./ethtool -K lo gso on
$ netperf -t TCP_STREAM
TCP STREAM TEST to localhost
Recv   Send    Send
Socket Socket  Message  Elapsed
Size   Size    Size     Time     Throughput
bytes  bytes   bytes    secs.    10^6bits/sec

 87380  16384  16384    10.00    8563.36
$ sudo ifconfig lo mtu 16436
$ netperf -t TCP_STREAM
TCP STREAM TEST to localhost
Recv   Send    Send
Socket Socket  Message  Elapsed
Size   Size    Size     Time     Throughput
bytes  bytes   bytes    secs.    10^6bits/sec

 87380  16384  16384    10.00    7359.95
$ sudo ./ethtool -K lo gso off
$ netperf -t TCP_STREAM
TCP STREAM TEST to localhost
Recv   Send    Send
Socket Socket  Message  Elapsed
Size   Size    Size     Time     Throughput
bytes  bytes   bytes    secs.    10^6bits/sec

 87380  16384  16384    10.00    7535.04
$

[-- Attachment #3: gso-off --]
[-- Type: text/plain, Size: 12446 bytes --]

CPU: PIII, speed 1200 MHz (estimated)
Counted CPU_CLK_UNHALTED events (clocks processor is not halted) with a unit mask of 0x00 (No unit mask) count 100000
samples  %        symbol name
1247     21.7551  csum_partial_copy_generic
294       5.1291  prep_new_page
240       4.1870  __alloc_skb
120       2.0935  tcp_sendmsg
113       1.9714  get_offset_pmtmr
113       1.9714  kfree
103       1.7969  skb_release_data
103       1.7969  timer_interrupt
101       1.7620  ip_queue_xmit
96        1.6748  skb_clone
94        1.6399  __kmalloc
94        1.6399  net_rx_action
86        1.5003  tcp_transmit_skb
80        1.3957  kmem_cache_free
76        1.3259  tcp_clean_rtx_queue
67        1.1689  ip_output
66        1.1514  mark_offset_pmtmr
65        1.1340  tcp_v4_rcv
64        1.1165  local_bh_enable
62        1.0816  kmem_cache_alloc
59        1.0293  irq_entries_start
59        1.0293  page_fault
57        0.9944  tcp_push_one
52        0.9072  kfree_skbmem
47        0.8200  __qdisc_run
47        0.8200  csum_partial
47        0.8200  netif_receive_skb
46        0.8025  __kfree_skb
46        0.8025  tcp_init_tso_segs
44        0.7676  __copy_to_user_ll
44        0.7676  dev_queue_xmit
39        0.6804  pfifo_fast_enqueue
39        0.6804  system_call
37        0.6455  __copy_from_user_ll
37        0.6455  ip_rcv
36        0.6281  __tcp_select_window
33        0.5757  sock_wfree
31        0.5408  __do_softirq
31        0.5408  tcp_v4_send_check
30        0.5234  eth_header
28        0.4885  tcp_rcv_established
27        0.4710  restore_nocheck
26        0.4536  pfifo_fast_dequeue
25        0.4361  __do_IRQ
25        0.4361  do_softirq
25        0.4361  tcp_build_and_update_options
25        0.4361  tcp_snd_test
23        0.4013  cache_alloc_refill
23        0.4013  handle_IRQ_event
23        0.4013  tcp_ack
22        0.3838  free_block
22        0.3838  ip_route_input
21        0.3664  __netif_rx_schedule
21        0.3664  schedule
20        0.3489  do_wp_page
20        0.3489  neigh_resolve_output
19        0.3315  do_IRQ
19        0.3315  do_page_fault
19        0.3315  do_select
19        0.3315  fget_light
19        0.3315  ip_local_deliver
18        0.3140  __tcp_push_pending_frames
18        0.3140  end_level_ioapic_irq
17        0.2966  cpu_idle
17        0.2966  delay_pmtmr
17        0.2966  tcp_select_window
16        0.2791  add_wait_queue
16        0.2791  rt_hash_code
16        0.2791  tcp_set_skb_tso_segs
15        0.2617  find_vma
15        0.2617  irq_exit
15        0.2617  update_send_head
14        0.2442  __switch_to
13        0.2268  __skb_checksum_complete
13        0.2268  common_interrupt
13        0.2268  dev_kfree_skb_any
13        0.2268  tcp_event_data_sent
13        0.2268  zap_pte_range
12        0.2094  __d_lookup
12        0.2094  __page_set_anon_rmap
12        0.2094  mod_timer
12        0.2094  ret_from_intr
12        0.2094  sock_poll
12        0.2094  tcp_current_mss
12        0.2094  tcp_write_xmit
11        0.1919  do_no_page
11        0.1919  error_code
11        0.1919  free_hot_cold_page
11        0.1919  i8042_interrupt
10        0.1745  __link_path_walk
10        0.1745  buffered_rmqueue
10        0.1745  sk_reset_timer
9         0.1570  __rmqueue
9         0.1570  dev_hard_start_xmit
9         0.1570  free_pages_bulk
9         0.1570  resume_kernel
9         0.1570  skb_checksum
9         0.1570  tcp_cong_avoid
9         0.1570  tcp_rtt_estimator
8         0.1396  do_anonymous_page
8         0.1396  eth_type_trans
8         0.1396  get_page_from_freelist
8         0.1396  tcp_ack_saw_tstamp
8         0.1396  tcp_v4_checksum_init
7         0.1221  __wake_up
7         0.1221  atomic_notifier_call_chain
7         0.1221  normal_poll
7         0.1221  sk_stream_write_space
7         0.1221  tcp_ack_packets_out
7         0.1221  tcp_check_space
7         0.1221  tcp_cwnd_validate
7         0.1221  tcp_reno_cong_avoid
6         0.1047  __pagevec_lru_add_active
6         0.1047  copy_from_user
6         0.1047  hrtimer_get_softirq_time
6         0.1047  lock_sock
6         0.1047  lookup_bh_lru
6         0.1047  net_tx_action
6         0.1047  remove_wait_queue
6         0.1047  tcp_new_space
6         0.1047  unmap_vmas
5         0.0872  __copy_user_intel
5         0.0872  __handle_mm_fault
5         0.0872  __page_cache_release
5         0.0872  core_sys_select
5         0.0872  del_timer
5         0.0872  dnotify_parent
5         0.0872  filemap_nopage
5         0.0872  find_get_page
5         0.0872  kfree_skb
5         0.0872  lru_cache_add_active
5         0.0872  max_select_fd
5         0.0872  mod_page_state_offset
5         0.0872  note_interrupt
5         0.0872  pipe_poll
5         0.0872  prepare_to_wait
5         0.0872  restore_all
5         0.0872  scheduler_tick
5         0.0872  slab_put_obj
5         0.0872  syscall_exit
5         0.0872  try_to_wake_up
5         0.0872  zone_watermark_ok
4         0.0698  __sk_dst_check
4         0.0698  copy_to_user
4         0.0698  do_poll
4         0.0698  do_pollfd
4         0.0698  fput
4         0.0698  inotify_dentry_parent_queue_event
4         0.0698  inotify_inode_queue_event
4         0.0698  memcpy
4         0.0698  sk_stream_wait_memory
4         0.0698  slab_get_obj
4         0.0698  sock_sendmsg
4         0.0698  strncpy_from_user
4         0.0698  strnlen_user
4         0.0698  tcp_should_expand_sndbuf
4         0.0698  tty_poll
3         0.0523  __alloc_pages
3         0.0523  __copy_user_zeroing_intel
3         0.0523  __d_path
3         0.0523  __find_get_block
3         0.0523  __follow_mount
3         0.0523  __netif_schedule
3         0.0523  __wake_up_bit
3         0.0523  __wake_up_common
3         0.0523  _atomic_dec_and_lock
3         0.0523  activate_task
3         0.0523  anon_vma_prepare
3         0.0523  bh_lru_install
3         0.0523  cond_resched
3         0.0523  do_lookup
3         0.0523  do_path_lookup
3         0.0523  do_readv_writev
3         0.0523  dup_fd
3         0.0523  effective_prio
3         0.0523  hrtimer_run_queues
3         0.0523  ing_filter
3         0.0523  link_path_walk
3         0.0523  notifier_call_chain
3         0.0523  preempt_schedule
3         0.0523  radix_tree_lookup
3         0.0523  release_pages
3         0.0523  run_timer_softirq
3         0.0523  run_workqueue
3         0.0523  sys_sendto
3         0.0523  sys_writev
3         0.0523  tty_ldisc_deref
3         0.0523  unmap_page_range
3         0.0523  vm_normal_page
2         0.0349  __brelse
2         0.0349  __find_get_block_slow
2         0.0349  __getblk
2         0.0349  __mod_page_state_offset
2         0.0349  __mod_timer
2         0.0349  acct_update_integrals
2         0.0349  adjtime_adjustment
2         0.0349  alloc_sock_iocb
2         0.0349  apic_timer_interrupt
2         0.0349  bit_waitqueue
2         0.0349  cache_flusharray
2         0.0349  cache_reap
2         0.0349  d_alloc
2         0.0349  dput
2         0.0349  fget
2         0.0349  finish_wait
2         0.0349  init_timer
2         0.0349  lock_timer_base
2         0.0349  opost_block
2         0.0349  page_remove_rmap
2         0.0349  permission
2         0.0349  poll_get_entry
2         0.0349  poll_initwait
2         0.0349  profile_munmap
2         0.0349  pty_chars_in_buffer
2         0.0349  put_page
2         0.0349  raise_softirq
2         0.0349  recalc_task_prio
2         0.0349  resume_userspace
2         0.0349  ret_from_exception
2         0.0349  rmqueue_bulk
2         0.0349  rw_verify_area
2         0.0349  sched_clock
2         0.0349  setup_frame
2         0.0349  skb_queue_head
2         0.0349  sock_aio_read
2         0.0349  sock_def_readable
2         0.0349  sys_ioctl
2         0.0349  sys_read
2         0.0349  task_curr
2         0.0349  task_timeslice
2         0.0349  tty_ldisc_try
2         0.0349  vfs_read
2         0.0349  vma_adjust
2         0.0349  vma_link
1         0.0174  __block_write_full_page
1         0.0174  __dentry_open
1         0.0174  __dequeue_signal
1         0.0174  __do_page_cache_readahead
1         0.0174  __fput
1         0.0174  __generic_file_aio_read
1         0.0174  __group_complete_signal
1         0.0174  __ip_route_output_key
1         0.0174  __lookup_mnt
1         0.0174  __mark_inode_dirty
1         0.0174  __pollwait
1         0.0174  __put_task_struct
1         0.0174  __put_user_4
1         0.0174  __queue_work
1         0.0174  __rcu_pending
1         0.0174  __sigqueue_alloc
1         0.0174  __vma_link_rb
1         0.0174  alloc_inode
1         0.0174  alloc_slabmgmt
1         0.0174  arch_unmap_area_topdown
1         0.0174  as_add_request
1         0.0174  as_fifo_expired
1         0.0174  as_find_next_arq
1         0.0174  autoremove_wake_function
1         0.0174  bio_init
1         0.0174  block_read_full_page
1         0.0174  cached_lookup
1         0.0174  can_vma_merge_before
1         0.0174  con_chars_in_buffer
1         0.0174  convert_fxsr_from_user
1         0.0174  copy_from_read_buf
1         0.0174  copy_pte_range
1         0.0174  cp_new_stat64
1         0.0174  d_splice_alias
1         0.0174  do_exit
1         0.0174  do_filp_open
1         0.0174  do_fork
1         0.0174  do_getname
1         0.0174  do_gettimeofday
1         0.0174  do_mpage_readpage
1         0.0174  do_sigaction
1         0.0174  do_sock_read
1         0.0174  do_sock_write
1         0.0174  do_sync_write
1         0.0174  do_timer
1         0.0174  drain_array
1         0.0174  dummy_inode_permission
1         0.0174  dup_mm
1         0.0174  dup_task_struct
1         0.0174  elv_queue_empty
1         0.0174  enqueue_hrtimer
1         0.0174  enqueue_task
1         0.0174  exit_mmap
1         0.0174  file_ra_state_init
1         0.0174  filesystems_read_proc
1         0.0174  find_vma_prev
1         0.0174  free_poll_entry
1         0.0174  generic_permission
1         0.0174  get_index
1         0.0174  get_signal_to_deliver
1         0.0174  get_vmalloc_info
1         0.0174  getname
1         0.0174  handle_signal
1         0.0174  hrtimer_try_to_cancel
1         0.0174  inet_csk_init_xmit_timers
1         0.0174  init_buffer_head
1         0.0174  inode_change_ok
1         0.0174  inode_init_once
1         0.0174  kbd_bh
1         0.0174  kmem_cache_zalloc
1         0.0174  kmem_getpages
1         0.0174  load_elf_binary
1         0.0174  locks_remove_posix
1         0.0174  memmove
1         0.0174  mempool_free
1         0.0174  mmput
1         0.0174  mutex_lock
1         0.0174  netlink_insert
1         0.0174  no_singlestep
1         0.0174  nr_blockdev_pages
1         0.0174  number
1         0.0174  open_namei
1         0.0174  page_add_new_anon_rmap
1         0.0174  path_release
1         0.0174  pipe_release
1         0.0174  poke_blanked_console
1         0.0174  proc_pid_readlink
1         0.0174  pty_unthrottle
1         0.0174  put_filp
1         0.0174  radix_tree_insert
1         0.0174  raise_softirq_irqoff
1         0.0174  rb_insert_color
1         0.0174  rcu_do_batch
1         0.0174  rcu_pending
1         0.0174  release_sock
1         0.0174  remove_vma
1         0.0174  restore_sigcontext
1         0.0174  search_binary_handler
1         0.0174  sk_wait_data
1         0.0174  skb_dequeue
1         0.0174  skb_queue_tail
1         0.0174  sock_aio_write
1         0.0174  sock_alloc_send_pskb
1         0.0174  sock_def_write_space
1         0.0174  sock_from_file
1         0.0174  sock_ioctl
1         0.0174  submit_bio
1         0.0174  sys_fcntl64
1         0.0174  sys_fstat64
1         0.0174  sys_rt_sigaction
1         0.0174  sys_rt_sigprocmask
1         0.0174  sys_send
1         0.0174  sys_sigreturn
1         0.0174  sys_socketcall
1         0.0174  sys_waitpid
1         0.0174  tcp_close
1         0.0174  tcp_data_queue
1         0.0174  tcp_fastretrans_alert
1         0.0174  tcp_grow_window
1         0.0174  tcp_mtu_probe
1         0.0174  tcp_v4_do_rcv
1         0.0174  tty_hung_up_p
1         0.0174  tty_insert_flip_string_flags
1         0.0174  tty_paranoia_check
1         0.0174  tty_wakeup
1         0.0174  tty_write
1         0.0174  unlock_buffer
1         0.0174  unmap_region
1         0.0174  update_process_times
1         0.0174  update_wall_time
1         0.0174  update_wall_time_one_tick
1         0.0174  vfs_ioctl
1         0.0174  vfs_permission
1         0.0174  vma_prio_tree_add
1         0.0174  wait_task_zombie

[-- Attachment #4: gso-on --]
[-- Type: text/plain, Size: 12774 bytes --]

CPU: PIII, speed 1200 MHz (estimated)
Counted CPU_CLK_UNHALTED events (clocks processor is not halted) with a unit mask of 0x00 (No unit mask) count 100000
samples  %        symbol name
1255     21.6865  csum_partial_copy_generic
398       6.8775  __copy_from_user_ll
343       5.9271  __alloc_skb
254       4.3891  prep_new_page
243       4.1991  skb_segment
110       1.9008  __kmalloc
106       1.8317  kfree
106       1.8317  timer_interrupt
105       1.8144  skb_copy_and_csum_bits
94        1.6243  net_rx_action
77        1.3306  kmem_cache_free
75        1.2960  tcp_v4_rcv
72        1.2442  kmem_cache_alloc
63        1.0886  page_fault
55        0.9504  mark_offset_pmtmr
54        0.9331  __kfree_skb
52        0.8986  skb_release_data
51        0.8813  csum_partial
50        0.8640  do_softirq
50        0.8640  inet_gso_segment
47        0.8122  get_offset_pmtmr
47        0.8122  irq_entries_start
45        0.7776  netif_receive_skb
43        0.7430  tcp_current_mss
41        0.7085  free_hot_cold_page
40        0.6912  tcp_clean_rtx_queue
36        0.6221  kfree_skbmem
35        0.6048  tcp_sendmsg
35        0.6048  tcp_write_xmit
34        0.5875  __do_softirq
31        0.5357  __do_IRQ
31        0.5357  ip_rcv
31        0.5357  tcp_rcv_established
30        0.5184  __pskb_trim_head
29        0.5011  system_call
28        0.4838  tcp_ack
28        0.4838  tcp_tso_segment
28        0.4838  tcp_tso_should_defer
27        0.4666  __copy_to_user_ll
26        0.4493  restore_nocheck
26        0.4493  rt_hash_code
25        0.4320  do_wp_page
24        0.4147  handle_IRQ_event
24        0.4147  schedule
23        0.3974  do_select
23        0.3974  tcp_tso_acked
22        0.3802  ip_local_deliver
22        0.3802  ip_route_input
21        0.3629  buffered_rmqueue
21        0.3629  free_block
20        0.3456  end_level_ioapic_irq
20        0.3456  tcp_init_tso_segs
19        0.3283  __netif_rx_schedule
19        0.3283  cache_alloc_refill
19        0.3283  dev_kfree_skb_any
18        0.3110  skb_split
17        0.2938  ret_from_intr
17        0.2938  tcp_mark_head_lost
16        0.2765  common_interrupt
16        0.2765  do_page_fault
16        0.2765  get_page_from_freelist
16        0.2765  slab_put_obj
15        0.2592  do_IRQ
15        0.2592  sock_poll
15        0.2592  zap_pte_range
14        0.2419  irq_exit
14        0.2419  tcp_trim_head
14        0.2419  tcp_v4_checksum_init
13        0.2246  __link_path_walk
13        0.2246  add_wait_queue
13        0.2246  delay_pmtmr
13        0.2246  tcp_rtt_estimator
12        0.2074  __skb_checksum_complete
12        0.2074  cpu_idle
12        0.2074  fget_light
12        0.2074  find_vma
12        0.2074  skb_checksum
12        0.2074  tcp_new_space
11        0.1901  copy_from_user
11        0.1901  put_page
11        0.1901  tcp_set_skb_tso_segs
10        0.1728  __d_lookup
10        0.1728  __switch_to
10        0.1728  error_code
10        0.1728  eth_type_trans
10        0.1728  i8042_interrupt
10        0.1728  skb_copy_bits
10        0.1728  tcp_transmit_skb
9         0.1555  dev_hard_start_xmit
9         0.1555  mod_page_state_offset
9         0.1555  strnlen_user
8         0.1382  __page_set_anon_rmap
8         0.1382  do_no_page
8         0.1382  ip_output
8         0.1382  resume_kernel
8         0.1382  skb_clone
8         0.1382  tcp_check_space
8         0.1382  tcp_xmit_retransmit_queue
7         0.1210  __mod_timer
7         0.1210  __tcp_push_pending_frames
7         0.1210  __tcp_select_window
7         0.1210  ip_queue_xmit
7         0.1210  mod_timer
7         0.1210  pipe_poll
7         0.1210  remove_wait_queue
7         0.1210  zone_watermark_ok
6         0.1037  __pagevec_lru_add_active
6         0.1037  core_sys_select
6         0.1037  do_pollfd
6         0.1037  find_get_page
6         0.1037  note_interrupt
6         0.1037  sk_stream_write_space
6         0.1037  skb_gso_segment
6         0.1037  sys_read
6         0.1037  tcp_ack_packets_out
6         0.1037  tcp_cong_avoid
6         0.1037  tcp_reno_cong_avoid
5         0.0864  __rmqueue
5         0.0864  __wake_up
5         0.0864  __wake_up_common
5         0.0864  dev_queue_xmit
5         0.0864  eth_header
5         0.0864  filemap_nopage
5         0.0864  fput
5         0.0864  free_pages_bulk
5         0.0864  internal_add_timer
5         0.0864  local_bh_enable
5         0.0864  lookup_bh_lru
5         0.0864  sys_socketcall
5         0.0864  syscall_exit
5         0.0864  tcp_mtu_probe
5         0.0864  tcp_v4_do_rcv
4         0.0691  __copy_user_intel
4         0.0691  __handle_mm_fault
4         0.0691  __mod_page_state_offset
4         0.0691  __page_cache_release
4         0.0691  __pollwait
4         0.0691  __qdisc_run
4         0.0691  adjtime_adjustment
4         0.0691  apic_timer_interrupt
4         0.0691  cond_resched
4         0.0691  hrtimer_run_queues
4         0.0691  kfree_skb
4         0.0691  lock_timer_base
4         0.0691  normal_poll
4         0.0691  opost_block
4         0.0691  pfifo_fast_enqueue
4         0.0691  preempt_schedule
4         0.0691  pskb_expand_head
4         0.0691  radix_tree_lookup
4         0.0691  resume_userspace
4         0.0691  sk_reset_timer
4         0.0691  skb_dequeue
4         0.0691  sys_send
4         0.0691  tcp_sacktag_write_queue
4         0.0691  tty_ldisc_try
4         0.0691  vfs_permission
3         0.0518  __alloc_pages
3         0.0518  __find_get_block
3         0.0518  __sk_dst_check
3         0.0518  anon_vma_prepare
3         0.0518  do_mmap_pgoff
3         0.0518  do_readv_writev
3         0.0518  do_sock_read
3         0.0518  dup_mm
3         0.0518  generic_permission
3         0.0518  hrtimer_get_softirq_time
3         0.0518  ing_filter
3         0.0518  lru_cache_add_active
3         0.0518  page_add_new_anon_rmap
3         0.0518  permission
3         0.0518  pfifo_fast_dequeue
3         0.0518  pty_chars_in_buffer
3         0.0518  raise_softirq
3         0.0518  rb_insert_color
3         0.0518  release_pages
3         0.0518  restore_all
3         0.0518  run_timer_softirq
3         0.0518  rw_verify_area
3         0.0518  slab_get_obj
3         0.0518  sock_wfree
3         0.0518  tcp_ack_saw_tstamp
3         0.0518  tcp_build_and_update_options
3         0.0518  tcp_event_data_sent
3         0.0518  tcp_should_expand_sndbuf
3         0.0518  tcp_v4_send_check
3         0.0518  tso_fragment
3         0.0518  unmap_vmas
3         0.0518  update_wall_time
3         0.0518  vsnprintf
2         0.0346  __rcu_pending
2         0.0346  _atomic_dec_and_lock
2         0.0346  account_system_time
2         0.0346  acct_update_integrals
2         0.0346  blk_recount_segments
2         0.0346  cache_flusharray
2         0.0346  cleanup_timers
2         0.0346  copy_pte_range
2         0.0346  cp_new_stat64
2         0.0346  current_fs_time
2         0.0346  d_instantiate
2         0.0346  default_wake_function
2         0.0346  dequeue_task
2         0.0346  dnotify_parent
2         0.0346  do_anonymous_page
2         0.0346  do_gettimeofday
2         0.0346  do_path_lookup
2         0.0346  do_setitimer
2         0.0346  do_sys_poll
2         0.0346  drain_array
2         0.0346  effective_prio
2         0.0346  find_next_zero_bit
2         0.0346  inode_init_once
2         0.0346  input_event
2         0.0346  max_select_fd
2         0.0346  memcpy
2         0.0346  memmove
2         0.0346  need_resched
2         0.0346  neigh_resolve_output
2         0.0346  no_singlestep
2         0.0346  notifier_call_chain
2         0.0346  page_remove_rmap
2         0.0346  poll_freewait
2         0.0346  prepare_to_wait
2         0.0346  recalc_task_prio
2         0.0346  rmqueue_bulk
2         0.0346  schedule_timeout
2         0.0346  scheduler_tick
2         0.0346  skb_queue_tail
2         0.0346  sock_aio_read
2         0.0346  sock_aio_write
2         0.0346  sock_from_file
2         0.0346  sock_sendmsg
2         0.0346  strncpy_from_user
2         0.0346  sys_gettimeofday
2         0.0346  sys_sendto
2         0.0346  tcp_cwnd_down
2         0.0346  tcp_data_queue
2         0.0346  tcp_fastretrans_alert
2         0.0346  tcp_parse_options
2         0.0346  tcp_push_one
2         0.0346  tcp_select_window
2         0.0346  tcp_snd_test
2         0.0346  transfer_objects
2         0.0346  try_to_wake_up
2         0.0346  tty_write
2         0.0346  unmap_page_range
2         0.0346  vfs_ioctl
2         0.0346  vma_adjust
1         0.0173  __bread
1         0.0173  __brelse
1         0.0173  __dentry_open
1         0.0173  __dequeue_signal
1         0.0173  __exit_signal
1         0.0173  __find_get_block_slow
1         0.0173  __group_complete_signal
1         0.0173  __insert_inode_hash
1         0.0173  __lookup_mnt
1         0.0173  __netif_schedule
1         0.0173  __pskb_pull_tail
1         0.0173  __pte_alloc
1         0.0173  __tasklet_schedule
1         0.0173  __wake_up_bit
1         0.0173  acct_process
1         0.0173  ack_edge_ioapic_irq
1         0.0173  acquire_console_sem
1         0.0173  activate_task
1         0.0173  alarm_setitimer
1         0.0173  alloc_new_pmd
1         0.0173  as_dispatch_request
1         0.0173  as_merged_request
1         0.0173  autoremove_wake_function
1         0.0173  bh_lru_install
1         0.0173  bit_waitqueue
1         0.0173  block_read_full_page
1         0.0173  cache_reap
1         0.0173  check_itimerval
1         0.0173  clear_user
1         0.0173  con_chars_in_buffer
1         0.0173  convert_fxsr_to_user
1         0.0173  copy_semundo
1         0.0173  copy_strings
1         0.0173  copy_to_user
1         0.0173  d_rehash
1         0.0173  deactivate_task
1         0.0173  dev_gso_segment
1         0.0173  do_fcntl
1         0.0173  do_generic_mapping_read
1         0.0173  do_lookup
1         0.0173  do_poll
1         0.0173  do_sigaction
1         0.0173  do_sync_read
1         0.0173  do_sys_open
1         0.0173  dummy_vm_enough_memory
1         0.0173  dup_fd
1         0.0173  enqueue_task
1         0.0173  exec_permission_lite
1         0.0173  file_ra_state_init
1         0.0173  file_update_time
1         0.0173  filp_close
1         0.0173  find_task_by_pid_type
1         0.0173  finish_wait
1         0.0173  flush_old_exec
1         0.0173  free_one_page
1         0.0173  free_page_and_swap_cache
1         0.0173  free_poll_entry
1         0.0173  free_uid
1         0.0173  get_empty_filp
1         0.0173  get_index
1         0.0173  get_signal_to_deliver
1         0.0173  get_task_mm
1         0.0173  get_vmalloc_info
1         0.0173  getname
1         0.0173  group_send_sig_info
1         0.0173  groups_search
1         0.0173  handle_signal
1         0.0173  hrtimer_try_to_cancel
1         0.0173  inode_setattr
1         0.0173  inode_sub_bytes
1         0.0173  inotify_dentry_parent_queue_event
1         0.0173  inotify_inode_queue_event
1         0.0173  kbd_keycode
1         0.0173  kmem_cache_zalloc
1         0.0173  kthread_should_stop
1         0.0173  locks_remove_flock
1         0.0173  lookup_create
1         0.0173  make_ahead_window
1         0.0173  mark_page_accessed
1         0.0173  math_state_restore
1         0.0173  may_expand_vm
1         0.0173  n_tty_receive_buf
1         0.0173  nameidata_to_filp
1         0.0173  opost
1         0.0173  page_waitqueue
1         0.0173  prio_tree_remove
1         0.0173  proc_file_read
1         0.0173  profile_munmap
1         0.0173  profile_tick
1         0.0173  put_io_context
1         0.0173  rb_next
1         0.0173  rcu_do_batch
1         0.0173  rcu_pending
1         0.0173  recalc_sigpending_tsk
1         0.0173  run_local_timers
1         0.0173  run_posix_cpu_timers
1         0.0173  save_i387
1         0.0173  sched_clock
1         0.0173  setup_frame
1         0.0173  signal_wake_up
1         0.0173  sk_stream_wait_memory
1         0.0173  skb_checksum_help
1         0.0173  slab_destroy
1         0.0173  smp_send_timer_broadcast_ipi
1         0.0173  sock_def_readable
1         0.0173  sock_ioctl
1         0.0173  sys_getpid
1         0.0173  sys_munmap
1         0.0173  syscall_call
1         0.0173  tcp_ack_update_window
1         0.0173  tcp_check_sack_reneging
1         0.0173  tcp_fast_parse_options
1         0.0173  tcp_fragment
1         0.0173  tcp_mtu_to_mss
1         0.0173  tcp_window_allows
1         0.0173  timespec_trunc
1         0.0173  tty_hung_up_p
1         0.0173  tty_ldisc_deref
1         0.0173  tty_poll
1         0.0173  unlink_file_vma
1         0.0173  vfs_getattr
1         0.0173  vfs_read
1         0.0173  vfs_write
1         0.0173  vm_normal_page
1         0.0173  vm_stat_account
1         0.0173  vma_prio_tree_add
1         0.0173  zone_statistics

^ permalink raw reply	[flat|nested] 21+ messages in thread
end of thread, other threads:[~2006-06-24  5:36 UTC | newest]

Thread overview: 21+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2006-06-20  9:09 [0/5] GSO: Generic Segmentation Offload Herbert Xu
2006-06-20  9:10 ` [1/5] [NET]: Merge TSO/UFO fields in sk_buff Herbert Xu
2006-06-21 21:48   ` Michael Chan
2006-06-21 23:27     ` Herbert Xu
2006-06-22  0:46       ` Michael Chan
2006-06-22  1:09         ` Herbert Xu
2006-06-22  1:14           ` David Miller
2006-06-20  9:28 ` [2/5] [NET]: Add generic segmentation offload Herbert Xu
2006-06-20 17:54   ` Michael Chan
2006-06-20 23:46     ` Herbert Xu
2006-06-20  9:29 ` [3/5] [NET]: Add software TSOv4 Herbert Xu
2006-06-20  9:30 ` [4/5] [NET]: Added GSO toggle Herbert Xu
2006-06-20  9:30 ` [5/5] [IPSEC]: Handle GSO packets Herbert Xu
2006-06-20  9:32 ` [0/5] GSO: Generic Segmentation Offload Herbert Xu
2006-06-20 10:40   ` David Miller
2006-06-20 16:18   ` Rick Jones
  -- strict thread matches above, loose matches on Subject: below --
2006-06-22  8:12 Herbert Xu
2006-06-22  8:15 ` Herbert Xu
2006-06-22 10:08 ` David Miller
2006-06-22 14:28 ` YOSHIFUJI Hideaki / 吉藤英明
2006-06-24  5:36   ` Herbert Xu

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).