All of lore.kernel.org
 help / color / mirror / Atom feed
* Problem with apache proxying between domains
@ 2005-02-14 21:15 Andrew Athan
  2005-02-14 22:39 ` Nivedita Singhvi
  0 siblings, 1 reply; 4+ messages in thread
From: Andrew Athan @ 2005-02-14 21:15 UTC (permalink / raw)
  To: xen-devel



I am experiencing some strangeness when using apache to proxy between
dom0 and a subdomain.  The problem strangely shows up only when using
the QuickTime browser plugin inside IE6 to fetch a 9Meg movie which is
served via a PHP page in the subdomain.

If I fetch the If I change the URLs to fetch via the proxy in dom0, the
quicktime browser plugin hangs.  The sniff headers below show that the
TCP window goes to 0, an indication that the plugin is not reading from
the socket.

I don't really know what to make of it.  Perhaps the networking setup is
dropping packets and/or otherwise corrupting the stream, causing the
quicktime browser plugin to stop reading bytes from the socket?

The attached network sniff header lines from Ethereal show the
communication between 216.254.100.240 (browser) and 216.254.100.205
(dom0) which proxies to 216.254.100.181 (dom1).  You will see that we go
to a ZeroWindow condition with about 3 Megs transferred out of the dom0
proxy.  At the tail end -- the TCP connection is then kept alive, but
the QuickTime plugin never becomes "enabled" and can't play the movie.

Fetching the same URL via CURL on the Windows host, dom0 host, or a
separate physical linux host works fine.  I also created a separate
Apache instance on a physically separate linux host, with the exact same
Rewrite rules.  Fetching the movie through this proxy works fine in both
the QuickTime plugin AND CURL.  I did this to eliminate the possibility
of some basic incompatibility between mod_proxy/mod_rewrite and
quicktime movies fetched by the quicktime browser plugin.

I have played with the ProxyIOBufferSize and ProxyBufferSize parameters
in the apache isntance in dom0, and have also tried various combinations
of bvt weights, warpback, etc.

Should I try to capture a sniff of xen-br0 during this interchage?  Will
that help?  WHen I tried this I think I only got partial data, perhaps
because of the xen domain scheduling causing missed packets.

No.     Time        Source                Destination           Protocol
Info
     62 4.649725    216.254.100.240       216.254.100.205       TCP
3889 > http [SYN] Seq=0 Ack=0 Win=64512 Len=0 MSS=1260
     63 4.650013    216.254.100.205       216.254.100.240       TCP
http > 3889 [SYN, ACK] Seq=0 Ack=1 Win=5840 Len=0 MSS=1460
     64 4.650064    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=1 Ack=1 Win=64512 Len=0
     68 4.650744    216.254.100.240       216.254.100.205       HTTP
GET /tiki-download_file.php?fileId=1 HTTP/1.1
     69 4.650961    216.254.100.205       216.254.100.240       TCP
http > 3889 [ACK] Seq=1 Ack=318 Win=6432 Len=0
     73 4.774515    216.254.100.205       216.254.100.240       HTTP
HTTP/1.1 200 OK[Unreassembled Packet]
     74 4.774607    216.254.100.205       216.254.100.240       HTTP
Continuation
     75 4.774664    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=2521 Win=64512 Len=0
     76 4.775122    216.254.100.205       216.254.100.240       HTTP
Continuation
     77 4.775191    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=3781 Win=64512 Len=0
     78 4.775245    216.254.100.205       216.254.100.240       HTTP
Continuation
     79 4.775742    216.254.100.205       216.254.100.240       HTTP
Continuation
     80 4.775772    216.254.100.205       216.254.100.240       HTTP
Continuation
     81 4.775794    216.254.100.205       216.254.100.240       HTTP
Continuation
     82 4.775850    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=8821 Win=64512 Len=0
     83 4.776754    216.254.100.205       216.254.100.240       HTTP
Continuation
     84 4.776821    216.254.100.205       216.254.100.240       HTTP
Continuation
     85 4.776842    216.254.100.205       216.254.100.240       HTTP
Continuation
     86 4.776863    216.254.100.205       216.254.100.240       HTTP
Continuation
     87 4.776885    216.254.100.205       216.254.100.240       HTTP
Continuation
     88 4.777030    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=15121 Win=64512 Len=0
     89 4.777948    216.254.100.205       216.254.100.240       HTTP
Continuation
     90 4.778014    216.254.100.205       216.254.100.240       HTTP
Continuation
     91 4.778037    216.254.100.205       216.254.100.240       HTTP
Continuation
     92 4.778060    216.254.100.205       216.254.100.240       HTTP
Continuation
     93 4.778081    216.254.100.205       216.254.100.240       HTTP
Continuation
     94 4.778150    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=21421 Win=61972 Len=0
     95 4.778210    216.254.100.205       216.254.100.240       HTTP
Continuation
     96 4.779062    216.254.100.205       216.254.100.240       HTTP
Continuation
     97 4.779114    216.254.100.205       216.254.100.240       HTTP
Continuation
     98 4.779137    216.254.100.205       216.254.100.240       HTTP
Continuation
     99 4.779158    216.254.100.205       216.254.100.240       HTTP
Continuation
    100 4.779180    216.254.100.205       216.254.100.240       HTTP
Continuation
    101 4.779224    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=28981 Win=54412 Len=0
    102 4.779280    216.254.100.205       216.254.100.240       HTTP
Continuation
    103 4.779720    216.254.100.205       216.254.100.240       HTTP
Continuation
    104 4.779760    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=31501 Win=51892 Len=0
    105 4.779804    216.254.100.205       216.254.100.240       HTTP
Continuation
    106 4.779828    216.254.100.205       216.254.100.240       HTTP
Continuation
    107 4.779848    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=32836 Win=50557 Len=0
    108 4.785314    216.254.100.205       216.254.100.240       HTTP
Continuation
    109 4.785359    216.254.100.205       216.254.100.240       HTTP
Continuation
    110 4.785383    216.254.100.205       216.254.100.240       HTTP
Continuation
    111 4.785405    216.254.100.205       216.254.100.240       HTTP
Continuation
    112 4.785426    216.254.100.205       216.254.100.240       HTTP
Continuation
    113 4.785482    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=39136 Win=44257 Len=0
    114 4.785564    216.254.100.205       216.254.100.240       HTTP
Continuation
    115 4.785589    216.254.100.205       216.254.100.240       HTTP
Continuation
    116 4.785604    216.254.100.205       216.254.100.240       HTTP
Continuation
    117 4.785632    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=42200 Win=41193 Len=0
    118 4.786417    216.254.100.205       216.254.100.240       HTTP
Continuation
    119 4.786460    216.254.100.205       216.254.100.240       HTTP
Continuation
    120 4.786484    216.254.100.205       216.254.100.240       HTTP
Continuation
    121 4.786507    216.254.100.205       216.254.100.240       HTTP
Continuation
    122 4.786531    216.254.100.205       216.254.100.240       HTTP
Continuation
    123 4.786569    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=48500 Win=34893 Len=0
    124 4.786621    216.254.100.205       216.254.100.240       HTTP
Continuation
    125 4.786643    216.254.100.205       216.254.100.240       HTTP
Continuation
    126 4.786668    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=50304 Win=33089 Len=0
    127 4.786790    216.254.100.205       216.254.100.240       HTTP
Continuation
    128 4.786813    216.254.100.205       216.254.100.240       HTTP
Continuation
    129 4.786838    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=52824 Win=30569 Len=0
    130 4.786876    216.254.100.205       216.254.100.240       HTTP
Continuation
    131 4.787473    216.254.100.205       216.254.100.240       HTTP
Continuation
    132 4.787513    216.254.100.205       216.254.100.240       HTTP
Continuation
    133 4.787537    216.254.100.205       216.254.100.240       HTTP
Continuation
    134 4.787559    216.254.100.205       216.254.100.240       HTTP
Continuation
    135 4.787580    216.254.100.205       216.254.100.240       HTTP
Continuation
    136 4.787620    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=60384 Win=23009 Len=0
    137 4.787674    216.254.100.205       216.254.100.240       HTTP
Continuation
    138 4.787700    216.254.100.205       216.254.100.240       HTTP
Continuation
    139 4.787726    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=62904 Win=20489 Len=0
    140 4.787774    216.254.100.205       216.254.100.240       HTTP
Continuation
    141 4.787903    216.254.100.205       216.254.100.240       HTTP
Continuation
    142 4.787929    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=65252 Win=18141 Len=0
    143 4.793555    216.254.100.205       216.254.100.240       HTTP
Continuation
    144 4.793639    216.254.100.205       216.254.100.240       HTTP
Continuation
    145 4.793665    216.254.100.205       216.254.100.240       HTTP
Continuation
    146 4.793690    216.254.100.205       216.254.100.240       HTTP
Continuation
    147 4.793712    216.254.100.205       216.254.100.240       HTTP
Continuation
    148 4.793771    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=71552 Win=11841 Len=0
    149 4.793854    216.254.100.205       216.254.100.240       HTTP
Continuation
    150 4.793879    216.254.100.205       216.254.100.240       HTTP
Continuation
    151 4.793895    216.254.100.205       216.254.100.240       HTTP
Continuation
    152 4.793916    216.254.100.205       216.254.100.240       HTTP
Continuation
    153 4.793942    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=75876 Win=7517 Len=0
    154 4.793995    216.254.100.205       216.254.100.240       HTTP
Continuation
    155 4.794468    216.254.100.205       216.254.100.240       HTTP
Continuation
    156 4.794499    216.254.100.205       216.254.100.240       HTTP
Continuation
    157 4.794520    216.254.100.205       216.254.100.240       HTTP
Continuation
    158 4.794544    216.254.100.205       216.254.100.240       HTTP
Continuation
    159 4.794580    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=82176 Win=1217 Len=0
    160 4.824230    216.254.100.240       216.254.100.205       TCP
[TCP Dup ACK 159#1] 3889 > http [ACK] Seq=318 Ack=82176 Win=64512 Len=0
    161 4.825237    216.254.100.205       216.254.100.240       HTTP
Continuation
    162 4.825320    216.254.100.205       216.254.100.240       HTTP
Continuation
    163 4.825347    216.254.100.205       216.254.100.240       HTTP
Continuation
    164 4.825369    216.254.100.205       216.254.100.240       HTTP
Continuation
    165 4.825391    216.254.100.205       216.254.100.240       HTTP
Continuation
    166 4.825435    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=88476 Win=58212 Len=0
    167 4.825497    216.254.100.205       216.254.100.240       HTTP
Continuation
    168 4.825521    216.254.100.205       216.254.100.240       HTTP
Continuation
    169 4.825550    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=90996 Win=55692 Len=0
    170 4.825598    216.254.100.205       216.254.100.240       HTTP
Continuation
    171 4.825735    216.254.100.205       216.254.100.240       HTTP
Continuation
    172 4.825760    216.254.100.205       216.254.100.240       HTTP
Continuation
    173 4.825786    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=94776 Win=51912 Len=0
    174 4.826242    216.254.100.205       216.254.100.240       HTTP
Continuation
    175 4.826277    216.254.100.205       216.254.100.240       HTTP
Continuation
    176 4.826306    216.254.100.205       216.254.100.240       HTTP
Continuation
    177 4.826329    216.254.100.205       216.254.100.240       HTTP
Continuation
    178 4.826356    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=99816 Win=46872 Len=0
    179 4.826414    216.254.100.205       216.254.100.240       HTTP
Continuation
    180 4.826438    216.254.100.205       216.254.100.240       HTTP
Continuation
    181 4.826464    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=102336 Win=44352 Len=0
    182 4.826509    216.254.100.205       216.254.100.240       HTTP
Continuation
    183 4.826701    216.254.100.205       216.254.100.240       HTTP
Continuation
    184 4.826728    216.254.100.205       216.254.100.240       HTTP
Continuation
    185 4.826758    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=106116 Win=40572 Len=0
    186 4.826798    216.254.100.205       216.254.100.240       HTTP
Continuation
    187 4.827226    216.254.100.205       216.254.100.240       HTTP
Continuation
    188 4.827252    216.254.100.205       216.254.100.240       HTTP
Continuation
    189 4.827282    216.254.100.205       216.254.100.240       HTTP
Continuation
    190 4.827304    216.254.100.205       216.254.100.240       HTTP
Continuation
    191 4.827330    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=112416 Win=34272 Len=0
    192 4.827375    216.254.100.205       216.254.100.240       HTTP
Continuation
    193 4.827670    216.254.100.205       216.254.100.240       HTTP
Continuation
    194 4.827698    216.254.100.205       216.254.100.240       HTTP
Continuation
    195 4.827721    216.254.100.205       216.254.100.240       HTTP
Continuation
    196 4.827746    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=117456 Win=29232 Len=0
    197 4.827787    216.254.100.205       216.254.100.240       HTTP
Continuation
    198 4.828205    216.254.100.205       216.254.100.240       HTTP
Continuation
    199 4.828234    216.254.100.205       216.254.100.240       HTTP
Continuation
    200 4.828266    216.254.100.205       216.254.100.240       HTTP
Continuation
    201 4.828288    216.254.100.205       216.254.100.240       HTTP
Continuation
    202 4.828319    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=123756 Win=22932 Len=0
    203 4.828366    216.254.100.205       216.254.100.240       HTTP
Continuation
    204 4.828737    216.254.100.205       216.254.100.240       HTTP
Continuation
    205 4.828763    216.254.100.205       216.254.100.240       HTTP
Continuation
    206 4.828784    216.254.100.205       216.254.100.240       HTTP
Continuation
    207 4.828805    216.254.100.205       216.254.100.240       HTTP
Continuation
    208 4.828827    216.254.100.205       216.254.100.240       HTTP
Continuation
    209 4.828846    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=130084 Win=16604 Len=0
    210 4.831221    216.254.100.240       216.254.100.205       TCP
[TCP Dup ACK 209#1] 3889 > http [ACK] Seq=318 Ack=130084 Win=20364 Len=0
    211 4.832343    216.254.100.240       216.254.100.205       TCP
[TCP Dup ACK 209#2] 3889 > http [ACK] Seq=318 Ack=130084 Win=64512 Len=0
    212 4.833477    216.254.100.205       216.254.100.240       HTTP
Continuation
    213 4.833549    216.254.100.205       216.254.100.240       HTTP
Continuation
    214 4.833573    216.254.100.205       216.254.100.240       HTTP
Continuation
    215 4.833597    216.254.100.205       216.254.100.240       HTTP
Continuation
    216 4.833641    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=135124 Win=59472 Len=0
    217 4.833700    216.254.100.205       216.254.100.240       HTTP
Continuation
    218 4.833726    216.254.100.205       216.254.100.240       HTTP
Continuation
    219 4.833750    216.254.100.205       216.254.100.240       HTTP
Continuation
    220 4.833772    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=138188 Win=56408 Len=0
    221 4.833820    216.254.100.205       216.254.100.240       HTTP
Continuation
    222 4.833864    216.254.100.205       216.254.100.240       HTTP
Continuation
    223 4.833890    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=140708 Win=53888 Len=0
    224 4.834354    216.254.100.205       216.254.100.240       HTTP
Continuation
    225 4.834384    216.254.100.205       216.254.100.240       HTTP
Continuation
    226 4.834407    216.254.100.205       216.254.100.240       HTTP
Continuation
    227 4.834431    216.254.100.205       216.254.100.240       HTTP
Continuation
    228 4.834452    216.254.100.205       216.254.100.240       HTTP
Continuation
    229 4.834478    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=146292 Win=48304 Len=0
    230 4.834525    216.254.100.205       216.254.100.240       HTTP
Continuation
    231 4.834884    216.254.100.205       216.254.100.240       HTTP
Continuation
    232 4.834911    216.254.100.205       216.254.100.240       HTTP
Continuation
    233 4.834935    216.254.100.205       216.254.100.240       HTTP
Continuation
    234 4.834958    216.254.100.205       216.254.100.240       HTTP
Continuation
    235 4.834986    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=152592 Win=42004 Len=0
    236 4.835027    216.254.100.205       216.254.100.240       HTTP
Continuation
    237 4.835053    216.254.100.205       216.254.100.240       HTTP
Continuation
    238 4.835077    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=154396 Win=40200 Len=0
    239 4.835362    216.254.100.205       216.254.100.240       HTTP
Continuation
    240 4.835391    216.254.100.205       216.254.100.240       HTTP
Continuation
    241 4.835415    216.254.100.205       216.254.100.240       HTTP
Continuation
    242 4.835445    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=158176 Win=36420 Len=0
    243 4.835486    216.254.100.205       216.254.100.240       HTTP
Continuation
    244 4.835996    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=159436 Win=38920 Len=0
    245 4.836053    216.254.100.205       216.254.100.240       HTTP
Continuation
    246 4.836082    216.254.100.205       216.254.100.240       HTTP
Continuation
    247 4.836104    216.254.100.205       216.254.100.240       HTTP
Continuation
    248 4.836125    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=162500 Win=35856 Len=0
    249 4.837229    216.254.100.240       216.254.100.205       TCP
[TCP Dup ACK 248#1] 3889 > http [ACK] Seq=318 Ack=162500 Win=61448 Len=0
    250 4.838720    216.254.100.240       216.254.100.205       TCP
[TCP Dup ACK 248#2] 3889 > http [ACK] Seq=318 Ack=162500 Win=64512 Len=0
    251 4.838813    216.254.100.205       216.254.100.240       HTTP
Continuation
    252 4.838877    216.254.100.205       216.254.100.240       HTTP
Continuation
    253 4.838909    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=165020 Win=64512 Len=0
    254 4.838963    216.254.100.205       216.254.100.240       HTTP
Continuation
    255 4.838992    216.254.100.205       216.254.100.240       HTTP
Continuation
    256 4.839031    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=167540 Win=61992 Len=0
    257 4.839070    216.254.100.205       216.254.100.240       HTTP
Continuation
    258 4.839417    216.254.100.205       216.254.100.240       HTTP
Continuation
    259 4.839443    216.254.100.205       216.254.100.240       HTTP
Continuation
    260 4.839460    216.254.100.205       216.254.100.240       HTTP
Continuation
    261 4.839482    216.254.100.205       216.254.100.240       HTTP
Continuation
    262 4.839508    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=173124 Win=56408 Len=0
    263 4.839551    216.254.100.205       216.254.100.240       HTTP
Continuation
    264 4.839855    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=174384 Win=64512 Len=0
    265 4.839898    216.254.100.205       216.254.100.240       HTTP
Continuation
    266 4.839923    216.254.100.205       216.254.100.240       HTTP
Continuation
    267 4.839946    216.254.100.205       216.254.100.240       HTTP
Continuation
    268 4.839968    216.254.100.205       216.254.100.240       HTTP
Continuation
    269 4.840018    216.254.100.205       216.254.100.240       HTTP
Continuation
    270 4.840057    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=179968 Win=58928 Len=0
    271 4.840096    216.254.100.205       216.254.100.240       HTTP
Continuation
    272 4.840328    216.254.100.205       216.254.100.240       HTTP
Continuation
    273 4.840354    216.254.100.205       216.254.100.240       HTTP
Continuation
    274 4.840380    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=183748 Win=55148 Len=0
    275 4.840421    216.254.100.205       216.254.100.240       HTTP
Continuation
    276 4.840806    216.254.100.205       216.254.100.240       HTTP
Continuation
    277 4.840835    216.254.100.205       216.254.100.240       HTTP
Continuation
    278 4.840851    216.254.100.205       216.254.100.240       HTTP
Continuation
    279 4.840875    216.254.100.205       216.254.100.240       HTTP
Continuation
    280 4.840904    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=189332 Win=49564 Len=0
    281 4.840949    216.254.100.205       216.254.100.240       HTTP
Continuation
    282 4.841158    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=190592 Win=64512 Len=0
    283 4.841205    216.254.100.205       216.254.100.240       HTTP
Continuation
    284 4.841232    216.254.100.205       216.254.100.240       HTTP
Continuation
    285 4.841259    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=193112 Win=61992 Len=0
    286 4.841310    216.254.100.205       216.254.100.240       HTTP
Continuation
    287 4.841334    216.254.100.205       216.254.100.240       HTTP
Continuation
    288 4.841353    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=194916 Win=60188 Len=0
    289 4.842655    216.254.100.240       216.254.100.205       TCP
[TCP Dup ACK 288#1] 3889 > http [ACK] Seq=318 Ack=194916 Win=63948 Len=0
    290 4.845001    216.254.100.205       216.254.100.240       HTTP
Continuation
    291 4.845084    216.254.100.205       216.254.100.240       HTTP
Continuation
    292 4.845108    216.254.100.205       216.254.100.240       HTTP
Continuation
    293 4.845134    216.254.100.205       216.254.100.240       HTTP
Continuation
    294 4.845208    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=199956 Win=64512 Len=0
    295 4.845302    216.254.100.205       216.254.100.240       HTTP
Continuation
    296 4.845339    216.254.100.205       216.254.100.240       HTTP
Continuation
    297 4.845361    216.254.100.205       216.254.100.240       HTTP
Continuation
    298 4.845377    216.254.100.205       216.254.100.240       HTTP
Continuation
    299 4.845410    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=204280 Win=63948 Len=0
    300 4.845454    216.254.100.205       216.254.100.240       HTTP
Continuation
    301 4.845478    216.254.100.205       216.254.100.240       HTTP
Continuation
    302 4.845504    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=206800 Win=61428 Len=0
    303 4.845547    216.254.100.205       216.254.100.240       HTTP
Continuation
    304 4.845826    216.254.100.205       216.254.100.240       HTTP
Continuation
    305 4.845855    216.254.100.205       216.254.100.240       HTTP
Continuation
    306 4.845876    216.254.100.205       216.254.100.240       HTTP
Continuation
    307 4.845899    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=211124 Win=57104 Len=0
    308 4.845943    216.254.100.205       216.254.100.240       HTTP
Continuation
    309 4.846371    216.254.100.205       216.254.100.240       HTTP
Continuation
    310 4.846402    216.254.100.205       216.254.100.240       HTTP
Continuation
    311 4.846424    216.254.100.205       216.254.100.240       HTTP
Continuation
    312 4.846445    216.254.100.205       216.254.100.240       HTTP
Continuation
    313 4.846479    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=217424 Win=50804 Len=0
    314 4.846534    216.254.100.205       216.254.100.240       HTTP
Continuation
    315 4.846561    216.254.100.205       216.254.100.240       HTTP
Continuation
    316 4.846581    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=219228 Win=49000 Len=0
    317 4.846627    216.254.100.205       216.254.100.240       HTTP
Continuation
    318 4.846836    216.254.100.205       216.254.100.240       HTTP
Continuation
    319 4.846863    216.254.100.205       216.254.100.240       HTTP
Continuation
    320 4.846890    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=223008 Win=45220 Len=0
    321 4.846930    216.254.100.205       216.254.100.240       HTTP
Continuation
    322 4.847559    216.254.100.205       216.254.100.240       HTTP
Continuation
    323 4.847598    216.254.100.205       216.254.100.240       HTTP
Continuation
    324 4.847619    216.254.100.205       216.254.100.240       HTTP
Continuation
    325 4.847651    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=227332 Win=40896 Len=0
    326 4.850740    216.254.100.205       216.254.100.240       HTTP
Continuation
    327 4.850820    216.254.100.205       216.254.100.240       HTTP
Continuation
    328 4.850845    216.254.100.205       216.254.100.240       HTTP
Continuation
    329 4.850869    216.254.100.205       216.254.100.240       HTTP
Continuation
    330 4.850891    216.254.100.205       216.254.100.240       HTTP
Continuation
    331 4.850959    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=233632 Win=58212 Len=0
    332 4.851037    216.254.100.205       216.254.100.240       HTTP
Continuation
    333 4.851064    216.254.100.205       216.254.100.240       HTTP
Continuation
    334 4.851080    216.254.100.205       216.254.100.240       HTTP
Continuation
    335 4.851102    216.254.100.205       216.254.100.240       HTTP
Continuation
    336 4.851152    216.254.100.205       216.254.100.240       HTTP
Continuation
    337 4.851189    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=239216 Win=52628 Len=0
    338 4.851228    216.254.100.205       216.254.100.240       HTTP
Continuation
    339 4.851599    216.254.100.205       216.254.100.240       HTTP
Continuation
    340 4.851625    216.254.100.205       216.254.100.240       HTTP
Continuation
    341 4.851648    216.254.100.205       216.254.100.240       HTTP
Continuation
    342 4.851665    216.254.100.205       216.254.100.240       HTTP
Continuation
    343 4.851693    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=244800 Win=47044 Len=0
    344 4.851734    216.254.100.205       216.254.100.240       HTTP
Continuation
    345 4.852133    216.254.100.205       216.254.100.240       HTTP
Continuation
    346 4.852163    216.254.100.205       216.254.100.240       HTTP
Continuation
    347 4.852186    216.254.100.205       216.254.100.240       HTTP
Continuation
    348 4.852208    216.254.100.205       216.254.100.240       HTTP
Continuation
    349 4.852237    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=251100 Win=40744 Len=0
    350 4.852282    216.254.100.205       216.254.100.240       HTTP
Continuation
    351 4.852301    216.254.100.205       216.254.100.240       HTTP
Continuation
    352 4.852328    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=252904 Win=38940 Len=0
    353 4.852383    216.254.100.205       216.254.100.240       HTTP
Continuation
    354 4.852494    216.254.100.205       216.254.100.240       HTTP
Continuation
    355 4.852521    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=255424 Win=36420 Len=0
    356 4.853043    216.254.100.205       216.254.100.240       HTTP
Continuation
    357 4.853071    216.254.100.205       216.254.100.240       HTTP
Continuation
    358 4.853094    216.254.100.205       216.254.100.240       HTTP
Continuation
    359 4.853117    216.254.100.205       216.254.100.240       HTTP
Continuation
    360 4.853138    216.254.100.205       216.254.100.240       HTTP
Continuation
    361 4.853166    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=261724 Win=30120 Len=0
    362 4.853209    216.254.100.205       216.254.100.240       HTTP
Continuation
    363 4.853564    216.254.100.205       216.254.100.240       HTTP
Continuation
    364 4.853592    216.254.100.205       216.254.100.240       HTTP
Continuation
    365 4.853614    216.254.100.205       216.254.100.240       HTTP
Continuation
    366 4.853636    216.254.100.205       216.254.100.240       HTTP
Continuation
    367 4.853665    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=267852 Win=23992 Len=0
    368 4.856461    216.254.100.205       216.254.100.240       HTTP
Continuation
    369 4.856572    216.254.100.205       216.254.100.240       HTTP
Continuation
    370 4.856599    216.254.100.205       216.254.100.240       HTTP
Continuation
    371 4.856625    216.254.100.205       216.254.100.240       HTTP
Continuation
    372 4.856649    216.254.100.205       216.254.100.240       HTTP
Continuation
    373 4.856714    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=274152 Win=17692 Len=0
    374 4.856823    216.254.100.205       216.254.100.240       HTTP
Continuation
    375 4.856852    216.254.100.205       216.254.100.240       HTTP
Continuation
    376 4.856868    216.254.100.205       216.254.100.240       HTTP
Continuation
    377 4.856891    216.254.100.205       216.254.100.240       HTTP
Continuation
    378 4.856914    216.254.100.205       216.254.100.240       HTTP
Continuation
    379 4.856943    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=279736 Win=12108 Len=0
    380 4.856997    216.254.100.205       216.254.100.240       HTTP
Continuation
    381 4.857306    216.254.100.205       216.254.100.240       HTTP
Continuation
    382 4.857333    216.254.100.205       216.254.100.240       HTTP
Continuation
    383 4.857361    216.254.100.205       216.254.100.240       HTTP
Continuation
    384 4.857378    216.254.100.205       216.254.100.240       HTTP
Continuation
    385 4.857406    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=285320 Win=6524 Len=0
    386 4.857450    216.254.100.205       216.254.100.240       HTTP
Continuation
    387 4.857843    216.254.100.205       216.254.100.240       HTTP
Continuation
    388 4.857872    216.254.100.205       216.254.100.240       HTTP
Continuation
    389 4.857894    216.254.100.205       216.254.100.240       HTTP
Continuation
    390 4.857915    216.254.100.205       216.254.100.240       HTTP
Continuation
    391 4.857946    216.254.100.240       216.254.100.205       TCP
3889 > http [ACK] Seq=318 Ack=291620 Win=224 Len=0
    392 5.060921    216.254.100.205       216.254.100.240       HTTP
Continuation
    393 5.222632    216.254.100.240       216.254.100.205       TCP
[TCP ZeroWindow] 3889 > http [ACK] Seq=318 Ack=291844 Win=0 Len=0
    400 5.440282    216.254.100.205       216.254.100.240       TCP
[TCP Keep-Alive] http > 3889 [ACK] Seq=291843 Ack=318 Win=6432 Len=0
    401 5.440390    216.254.100.240       216.254.100.205       TCP
[TCP ZeroWindow] [TCP Keep-Alive ACK] 3889 > http [ACK] Seq=318
Ack=291844 Win=0 Len=0
    404 5.880280    216.254.100.205       216.254.100.240       TCP
[TCP Keep-Alive] http > 3889 [ACK] Seq=291843 Ack=318 Win=6432 Len=0
    405 5.880392    216.254.100.240       216.254.100.205       TCP
[TCP ZeroWindow] [TCP Keep-Alive ACK] 3889 > http [ACK] Seq=318
Ack=291844 Win=0 Len=0
    420 6.760267    216.254.100.205       216.254.100.240       TCP
[TCP Keep-Alive] http > 3889 [ACK] Seq=291843 Ack=318 Win=6432 Len=0
    421 6.760368    216.254.100.240       216.254.100.205       TCP
[TCP ZeroWindow] [TCP Keep-Alive ACK] 3889 > http [ACK] Seq=318
Ack=291844 Win=0 Len=0
    436 8.520475    216.254.100.205       216.254.100.240       TCP
[TCP Keep-Alive] http > 3889 [ACK] Seq=291843 Ack=318 Win=6432 Len=0
    437 8.520584    216.254.100.240       216.254.100.205       TCP
[TCP ZeroWindow] [TCP Keep-Alive ACK] 3889 > http [ACK] Seq=318
Ack=291844 Win=0 Len=0
    479 12.040682   216.254.100.205       216.254.100.240       TCP
[TCP Keep-Alive] http > 3889 [ACK] Seq=291843 Ack=318 Win=6432 Len=0
    480 12.040778   216.254.100.240       216.254.100.205       TCP
[TCP ZeroWindow] [TCP Keep-Alive ACK] 3889 > http [ACK] Seq=318
Ack=291844 Win=0 Len=0
    553 19.063159   216.254.100.205       216.254.100.240       TCP
[TCP Keep-Alive] http > 3889 [ACK] Seq=291843 Ack=318 Win=6432 Len=0
    554 19.063262   216.254.100.240       216.254.100.205       TCP
[TCP ZeroWindow] [TCP Keep-Alive ACK] 3889 > http [ACK] Seq=318
Ack=291844 Win=0 Len=0





-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Problem with apache proxying between domains
  2005-02-14 21:15 Problem with apache proxying between domains Andrew Athan
@ 2005-02-14 22:39 ` Nivedita Singhvi
  2005-02-14 23:28   ` Andrew Athan
  0 siblings, 1 reply; 4+ messages in thread
From: Nivedita Singhvi @ 2005-02-14 22:39 UTC (permalink / raw)
  To: Andrew Athan; +Cc: xen-devel

Andrew Athan wrote:

> The attached network sniff header lines from Ethereal show the
> communication between 216.254.100.240 (browser) and 216.254.100.205
> (dom0) which proxies to 216.254.100.181 (dom1).  You will see that we go
> to a ZeroWindow condition with about 3 Megs transferred out of the dom0
> proxy.  At the tail end -- the TCP connection is then kept alive, but
> the QuickTime plugin never becomes "enabled" and can't play the movie.

Can you attach to the process via strace or something and check
what it's doing? Is it getting scheduled or waiting on IO?
Since it keepalives successfully, I'm assuming your interface
hasn't gone down. Also, check for a memory failure - could be
a mem leak.

> Fetching the same URL via CURL on the Windows host, dom0 host, or a
> separate physical linux host works fine.  I also created a separate
> Apache instance on a physically separate linux host, with the exact same
> Rewrite rules.  Fetching the movie through this proxy works fine in both
> the QuickTime plugin AND CURL.  I did this to eliminate the possibility
> of some basic incompatibility between mod_proxy/mod_rewrite and
> quicktime movies fetched by the quicktime browser plugin.

It does look like reading process stops reading. Did you
alter the default socket buffer sizes, at all, btw?

> I have played with the ProxyIOBufferSize and ProxyBufferSize parameters
> in the apache isntance in dom0, and have also tried various combinations
> of bvt weights, warpback, etc.
> 
> Should I try to capture a sniff of xen-br0 during this interchage?  Will
> that help?  WHen I tried this I think I only got partial data, perhaps
> because of the xen domain scheduling causing missed packets.

You do seem to be missing packets in your trace as well.

netstat -tan
netstat -s
ifconfig -a
/proc/slabinfo
vmstat

would be useful on both dom0 and of course, dom1..

thanks,
Nivedita


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Problem with apache proxying between domains
  2005-02-14 22:39 ` Nivedita Singhvi
@ 2005-02-14 23:28   ` Andrew Athan
  2005-02-15  0:41     ` Nivedita Singhvi
  0 siblings, 1 reply; 4+ messages in thread
From: Andrew Athan @ 2005-02-14 23:28 UTC (permalink / raw)
  To: Nivedita Singhvi; +Cc: xen-devel

What's the equivalent of strace on Windows XP?

:-)

I can strace the two apache processes on the Linux hosts, but not sure I 
can get useful information about the quicktime plugin in the browser.

By the way, dom1 is using swap which is an LVM volume in dom0.  Could 
there be some kind of deadlock in which dom0's apache is blocking on a 
network read which dom1 cannot service because it needs swap, which dom0 
cannot supply via LVM because the dom0 inter-domain stuff is "stuck" 
trying to service the apache inter-domain network request ??

I needed to make progress, so I have punted on inter-domain apache 
proxying for now.  However, I can set up a test config easily enough if 
that is of interest to the group.  The missing packets are somewhat 
worrisome to me, since I would have thought that inter-domain 
communication was lossless.

A.

Nivedita Singhvi wrote:

> Andrew Athan wrote:
>
>> The attached network sniff header lines from Ethereal show the
>> communication between 216.254.100.240 (browser) and 216.254.100.205
>> (dom0) which proxies to 216.254.100.181 (dom1).  You will see that we go
>> to a ZeroWindow condition with about 3 Megs transferred out of the dom0
>> proxy.  At the tail end -- the TCP connection is then kept alive, but
>> the QuickTime plugin never becomes "enabled" and can't play the movie.
>
>
> Can you attach to the process via strace or something and check
> what it's doing? Is it getting scheduled or waiting on IO?
> Since it keepalives successfully, I'm assuming your interface
> hasn't gone down. Also, check for a memory failure - could be
> a mem leak.
>
>> Fetching the same URL via CURL on the Windows host, dom0 host, or a
>> separate physical linux host works fine.  I also created a separate
>> Apache instance on a physically separate linux host, with the exact same
>> Rewrite rules.  Fetching the movie through this proxy works fine in both
>> the QuickTime plugin AND CURL.  I did this to eliminate the possibility
>> of some basic incompatibility between mod_proxy/mod_rewrite and
>> quicktime movies fetched by the quicktime browser plugin.
>
>
> It does look like reading process stops reading. Did you
> alter the default socket buffer sizes, at all, btw?
>
>> I have played with the ProxyIOBufferSize and ProxyBufferSize parameters
>> in the apache isntance in dom0, and have also tried various combinations
>> of bvt weights, warpback, etc.
>>
>> Should I try to capture a sniff of xen-br0 during this interchage?  Will
>> that help?  WHen I tried this I think I only got partial data, perhaps
>> because of the xen domain scheduling causing missed packets.
>
>
> You do seem to be missing packets in your trace as well.
>
> netstat -tan
> netstat -s
> ifconfig -a
> /proc/slabinfo
> vmstat
>
> would be useful on both dom0 and of course, dom1..
>
> thanks,
> Nivedita
>
>
> -------------------------------------------------------
> SF email is sponsored by - The IT Product Guide
> Read honest & candid reviews on hundreds of IT Products from real users.
> Discover which products truly live up to the hype. Start reading now.
> http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xen-devel




-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Problem with apache proxying between domains
  2005-02-14 23:28   ` Andrew Athan
@ 2005-02-15  0:41     ` Nivedita Singhvi
  0 siblings, 0 replies; 4+ messages in thread
From: Nivedita Singhvi @ 2005-02-15  0:41 UTC (permalink / raw)
  To: Andrew Athan; +Cc: xen-devel

Andrew Athan wrote:

> What's the equivalent of strace on Windows XP?

Ah, right, you did say 240 was a windows box.

I don't know that your browser read any data at all.
It starts off with a 64K window - and if you notice
in the log, it just ramps down till it goes to zero.
Doesn't look like any data got pushed to the application.
205 (dom0) sure pushed a bunch of data out, so not sure
that the problem is between dom0 <-> dom1. At least,
no evidence yet of that.

If it's not too much trouble, could you also grab
a trace of a successful transfer?

> I can strace the two apache processes on the Linux hosts, but not sure I 
> can get useful information about the quicktime plugin in the browser.

Might help to collect stats off dom1, though.

> By the way, dom1 is using swap which is an LVM volume in dom0.  Could 
> there be some kind of deadlock in which dom0's apache is blocking on a 
> network read which dom1 cannot service because it needs swap, which dom0 
> cannot supply via LVM because the dom0 inter-domain stuff is "stuck" 
> trying to service the apache inter-domain network request ??

See above - your trace is showing the exchange between dom0 and
the browser box, correct? It has a problem on the receiver end
(windows browser not reading) - double check that..

> I needed to make progress, so I have punted on inter-domain apache 
> proxying for now.  However, I can set up a test config easily enough if 
> that is of interest to the group.  The missing packets are somewhat 
> worrisome to me, since I would have thought that inter-domain 
> communication was lossless.

Could be ethereal that's missing the packets, not
necessarily the interfaces that dropped them, stats would tell..

thanks,
Nivedita



-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2005-02-15  0:41 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2005-02-14 21:15 Problem with apache proxying between domains Andrew Athan
2005-02-14 22:39 ` Nivedita Singhvi
2005-02-14 23:28   ` Andrew Athan
2005-02-15  0:41     ` Nivedita Singhvi

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.