sky2 hangs without any messages

netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed

* sky2 hangs without any messages
@ 2007-05-23  7:54 Tino Keitel
  2007-05-23 14:50 ` Stephen Hemminger
  2007-06-27 17:31 ` Stephen Hemminger
  0 siblings, 2 replies; 17+ messages in thread
From: Tino Keitel @ 2007-05-23  7:54 UTC (permalink / raw)
  To: netdev

[-- Attachment #1: Type: text/plain, Size: 1211 bytes --]

Hi folks,

in the last 2 days, I had 2 outages of the NIC of my Mac mini Core Duo.
I checked the kernel log but I found nothing sky2 related. After
reloading the module, the interface worked again.

Both freezes were connected to access from a remote NFS client to a
directory with ~4700 files in it. Both times, after reloading the
module and waiting some minutes until the NFS client had recovered from
the hanging NFS server, the same action worked.

The network is 100 mbit full duplex. I use NFS over TCP and kernel
2.6.21 with the "disable flow control" patch, the configuration is
attached.

Here are the sky2 messages that appeared when I discovered the freeze
and reloaded the driver:

sky2 eth0: disabling interface
ACPI: PCI interrupt for device 0000:01:00.0 disabled
ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 17
PCI: Setting latency timer of device 0000:01:00.0 to 64
sky2 0000:01:00.0: v1.14 addr 0x90200000 irq 17 Yukon-EC (0xb6) rev 2
Device driver eth0 lacks bus and class support for being resumed.
sky2 eth0: addr 00:16:cb:a4:e1:68
sky2 eth0: enabling interface
sky2 eth0: ram buffer 48K
sky2 eth0: Link is up at 100 Mbps, full duplex, flow control none

Regards,
Tino

[-- Attachment #2: config.gz --]
[-- Type: application/octet-stream, Size: 9836 bytes --]

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-05-23  7:54 sky2 hangs without any messages Tino Keitel
@ 2007-05-23 14:50 ` Stephen Hemminger
  2007-05-23 15:01   ` Tino Keitel
  2007-06-27 17:31 ` Stephen Hemminger
  1 sibling, 1 reply; 17+ messages in thread
From: Stephen Hemminger @ 2007-05-23 14:50 UTC (permalink / raw)
  To: Tino Keitel; +Cc: netdev

On Wed, 23 May 2007 09:54:31 +0200
Tino Keitel <tino.keitel@tikei.de> wrote:

> Hi folks,
> 
> in the last 2 days, I had 2 outages of the NIC of my Mac mini Core Duo.
> I checked the kernel log but I found nothing sky2 related. After
> reloading the module, the interface worked again.
> 
> Both freezes were connected to access from a remote NFS client to a
> directory with ~4700 files in it. Both times, after reloading the
> module and waiting some minutes until the NFS client had recovered from
> the hanging NFS server, the same action worked.
> 
> The network is 100 mbit full duplex. I use NFS over TCP and kernel
> 2.6.21 with the "disable flow control" patch, the configuration is
> attached.
> 

Don't use that patch, it isn't needed and probably causes problem.

Please get output of 'ethtool -d eth0'; more recent versions of
ethtool can decode the register format. Older versions just print hex.
-- 
Stephen Hemminger <shemminger@linux-foundation.org>

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-05-23 14:50 ` Stephen Hemminger
@ 2007-05-23 15:01   ` Tino Keitel
  2007-05-23 15:49     ` Stephen Hemminger
  0 siblings, 1 reply; 17+ messages in thread
From: Tino Keitel @ 2007-05-23 15:01 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: netdev

[-- Attachment #1: Type: text/plain, Size: 325 bytes --]

On Wed, May 23, 2007 at 07:50:26 -0700, Stephen Hemminger wrote:

[...]

> Don't use that patch, it isn't needed and probably causes problem.
> 
> Please get output of 'ethtool -d eth0'; more recent versions of
> ethtool can decode the register format. Older versions just print hex.

Hi,

see the attachment.

Regards,
Tino

[-- Attachment #2: registers.txt --]
[-- Type: text/plain, Size: 56094 bytes --]

Offset	Values
--------	-----
000:	 00 00 00 00 4a 16 03 a6 00 00 00 00 1d 00 00 c0
010:	 00 00 00 00 3f 3f 00 2e 00 00 00 00 00 00 00 00
020:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
030:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
040:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
050:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
060:	 00 00 01 00 1c 00 00 00 ff ff ff ff 00 00 00 00
070:	 f0 01 f8 01 c0 01 c1 01 00 03 ab 05 06 02 52 60
080:	 00 00 00 00 4a 16 03 a6 00 00 00 00 1d 00 00 c0
090:	 00 00 00 00 3f 3f 00 2e 00 00 00 00 00 00 00 00
0a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0e0:	 00 00 01 00 1c 00 00 00 ff ff ff ff 00 00 00 00
0f0:	 f0 01 f8 01 c0 01 c1 01 00 03 ab 05 06 02 52 60
100:	 00 16 cb a4 e1 68 00 00 00 16 cb a4 e1 68 00 00
110:	 00 00 00 00 00 00 00 00 4a 31 20 b6 0c 80 00 00
120:	 01 00 00 00 00 00 00 00 4a 31 20 b6 0c 80 00 00
130:	 00 00 00 00 00 00 00 00 02 02 00 00 00 00 00 00
140:	 00 00 00 00 00 00 00 00 02 02 00 00 00 00 00 00
150:	 00 00 00 00 00 00 00 00 01 00 00 00 0e 0a 00 00
160:	 00 00 00 00 00 00 00 00 00 00 00 00 03 00 00 00
170:	 00 10 00 00 00 10 00 00 00 10 00 00 00 10 00 00
180:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
190:	 24 24 24 24 24 24 24 24 24 00 00 00 00 00 00 00
1a0:	 02 00 0a 00 00 00 00 00 00 00 00 00 00 00 00 00
1b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
200:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
210:	 56 12 00 00 00 00 00 00 00 00 00 00 00 00 00 00
220:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
230:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
240:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
250:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
260:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
270:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
280:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
290:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
300:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
310:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
320:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
330:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
340:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
350:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
360:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
370:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
380:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
390:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
400:	 f8 05 00 c1 00 00 00 00 10 78 06 30 00 00 00 00
410:	 00 01 7f 00 00 00 00 00 e7 ca e7 ca 0e 00 0e 00
420:	 00 00 7f 00 ce 00 00 00 10 78 06 30 00 00 00 00
430:	 0f 00 00 00 aa 61 00 00 22 22 22 00 08 00 00 00
440:	 80 00 00 00 30 05 00 00 a6 00 00 00 a6 a6 00 00
450:	 2a 22 00 00 ff 03 00 00 00 00 90 0c 00 00 00 00
460:	 fc 00 00 00 76 01 00 00 00 00 00 00 00 00 00 00
470:	 3c 00 e0 01 0f 00 00 00 e0 01 e0 01 2d 00 68 01
480:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
490:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
4a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
4b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
4c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
4d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
4e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
4f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
500:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
510:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
520:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
530:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
540:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
550:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
560:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
570:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
580:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
590:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
5a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
5b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
5c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
5d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
5e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
5f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
600:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
610:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
620:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
630:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
640:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
650:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
660:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
670:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
680:	 4b 00 9f c1 00 00 00 00 02 44 b6 2e 00 00 00 00
690:	 d2 05 00 00 00 00 01 00 28 00 22 00 00 00 00 00
6a0:	 00 00 00 00 91 01 00 00 4d 44 b6 2e 00 00 00 00
6b0:	 00 00 00 00 aa 11 00 80 22 22 22 00 01 00 00 00
6c0:	 00 06 20 00 f8 00 00 00 1f 00 00 00 1f 00 00 00
6d0:	 2a 22 00 00 ff 01 00 00 00 c0 53 1e 00 00 00 00
6e0:	 91 01 00 00 91 01 00 00 00 00 00 00 00 00 00 00
6f0:	 11 00 88 00 11 00 00 00 e0 00 08 00 00 00 00 00
700:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
710:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
720:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
730:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
740:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
750:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
760:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
770:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
780:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
790:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
7a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
7b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
7c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
7d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
7e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
7f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
800:	 00 00 00 00 7f 0e 00 00 8e 01 00 00 8e 01 00 00
810:	 80 0d 00 00 a0 03 00 00 e0 0a 00 00 40 07 00 00
820:	 00 00 00 00 00 00 00 00 1a 22 02 00 00 00 00 00
830:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
840:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
850:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
860:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
870:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
880:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
890:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
8a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
8b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
8c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
8d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
8e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
8f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
900:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
910:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
920:	 00 00 00 00 00 00 00 00 15 22 02 00 00 00 00 00
930:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
940:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
950:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
960:	 00 00 00 00 00 00 00 00 15 22 02 00 00 00 00 00
970:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
980:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
990:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
9a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
9b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
9c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
9d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
9e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
9f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a80:	 80 0e 00 00 ff 17 00 00 b8 17 00 00 b8 17 00 00
a90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
aa0:	 00 00 00 00 00 00 00 00 2a 22 02 00 00 00 00 00
ab0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ac0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ad0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ae0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
af0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ba0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
bb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
bc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
bd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
be0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
bf0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c40:	 7f 00 00 00 70 00 00 00 8a 22 00 09 7b 18 00 00
c50:	 0b 00 00 00 7c 01 00 00 00 00 00 00 81 00 00 00
c60:	 0e 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c70:	 0e 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ca0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
cb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
cc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
cd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ce0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
cf0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d40:	 7f 00 00 00 10 00 00 00 0a 22 02 01 00 00 00 00
d50:	 00 00 00 00 00 00 00 00 00 00 00 00 81 00 00 00
d60:	 38 00 00 00 38 00 00 00 00 00 00 00 00 00 00 00
d70:	 38 00 00 00 38 00 00 00 00 00 00 00 00 00 00 00
d80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
da0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
db0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
dc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
dd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
de0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
df0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e00:	 00 00 00 00 00 00 00 00 02 02 00 00 00 00 00 00
e10:	 00 00 00 00 00 00 00 00 02 02 00 00 00 00 00 00
e20:	 05 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e40:	 05 90 ff 1f 00 00 00 00 00 00 00 00 00 00 00 00
e50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e60:	 00 fc 03 00 00 00 00 00 08 00 00 00 00 00 00 00
e70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e80:	 0a 22 02 00 ff 07 00 00 00 80 b4 12 00 00 00 00
e90:	 91 01 00 00 00 00 00 00 0a 00 00 00 f9 04 00 00
ea0:	 1a 00 00 00 1a 00 39 00 00 00 00 00 10 10 00 00
eb0:	 d4 30 00 00 d4 30 00 00 04 02 00 00 00 00 00 00
ec0:	 48 e8 01 00 48 e8 01 00 04 02 00 00 00 00 00 00
ed0:	 c4 09 00 00 c4 09 00 00 04 02 00 00 00 00 00 00
ee0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ef0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f00:	 56 00 00 00 02 20 00 00 05 00 00 00 08 00 00 00
f10:	 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f20:	 55 05 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f30:	 3b 3b 3b 3b 3b 3b 3b 00 00 00 00 00 00 00 00 00
f40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
fa0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
fb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
fc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
fd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
fe0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ff0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1000:	 c5 4b 02 bd 18 9d 0f e1 ef 58 da 34 58 66 01 50
1010:	 42 cb f8 97 5f ef f3 69 98 1c 77 be 11 e4 09 49
1020:	 c8 69 e5 b4 22 1e 1f a7 26 d3 89 a0 53 dd 55 70
1030:	 fd c3 d7 63 9c 8b 83 cd 17 79 ab 61 e7 98 32 57
1040:	 ad 14 36 ef 39 a9 0f 4f 2b 48 e8 c4 69 b0 b9 9d
1050:	 4d d9 ba c6 3f d6 7e d9 4d d9 3a 62 eb bf 54 72
1060:	 6d b8 21 fd 54 04 0d ad 37 f3 ca e2 7f d1 84 e4
1070:	 47 f3 5c be 1c 7b 93 aa 2e 35 49 25 4e ef 43 03
1080:	 e4 9a 70 d5 b0 4f 5f 49 e6 77 e2 f0 d3 33 39 68
1090:	 ee ae 63 6a b8 40 23 19 2e d8 0d 92 8f cc 79 02
10a0:	 7b a2 88 d4 4d 46 d4 7b eb e7 2a ea 86 8a 7f 72
10b0:	 c4 0e 0e 81 4b eb bf 09 5e d3 24 42 45 4a 06 79
10c0:	 b0 67 c0 60 52 7b 07 26 23 f8 84 28 fb aa 71 a8
10d0:	 d3 3d cf b4 34 03 d7 77 e7 91 fd a1 7f c3 65 c5
10e0:	 6b 29 ab 57 bb 5c 73 1d db 8a af 61 db c0 0b f2
10f0:	 e6 1c bd 95 09 0f a2 0c 9e 22 7f 74 a5 2d 0c d3
1100:	 d9 31 00 16 19 5f 8a e8 a4 53 84 7d e8 c4 55 3a
1110:	 f7 6a 83 38 14 1d 5b 79 b4 de 97 7a c2 4c 19 e7
1120:	 6c 2b 7f cf b8 2e db 68 66 30 15 cf 01 91 5c dd
1130:	 01 04 42 1e 5b fb 07 18 0f ed b7 c6 91 89 11 b1
1140:	 36 89 cf 35 9c 17 49 c5 f4 0a a6 22 20 48 2c 44
1150:	 f0 88 48 c5 98 d7 ff 6c b4 27 cf 00 77 df 3a 54
1160:	 c6 0e 01 1d c0 49 53 26 96 c0 3e 32 04 1b 13 f9
1170:	 81 ef 3a c3 14 23 20 23 c5 3b 8d 1c dc 08 1e 76
1180:	 ac 0d 76 7d b1 02 2b c3 14 b9 5a 13 c9 91 1d f0
1190:	 44 39 8a d5 5c ef 27 f5 9b bc ee c3 1b 98 11 7b
11a0:	 66 1c 00 ef 53 23 75 f3 c1 61 67 61 91 af 0f 0e
11b0:	 20 6e d2 62 53 0f 3b 08 1a 21 f5 96 b2 9d 74 7a
11c0:	 82 ac fe ee 6f 2d e3 d8 85 b3 6b 27 cb 34 34 76
11d0:	 ac 7d 0c 46 97 97 f8 b9 59 6f 3e 0a c1 ae 13 d8
11e0:	 47 23 1d 14 36 6d 45 20 94 22 2e 23 d2 b8 d9 9f
11f0:	 ce af 68 fd b2 1c cc 83 16 4f c3 7c 86 3e c8 96
1200:	 e1 b7 4e 96 13 3c 8f 12 d2 56 8e 8d 4a 6b 7a 8e
1210:	 0f 89 e6 6e b6 61 68 22 cc df 80 f5 fd 18 b8 e8
1220:	 21 43 87 70 8c 47 5a 37 92 69 0d d0 5f 58 09 c7
1230:	 83 30 a9 24 30 12 ee 16 59 02 c3 24 fb 38 39 95
1240:	 df bf bc 4d b4 4b cd d8 06 00 df 65 c5 ae 04 10
1250:	 36 18 47 5d b3 b9 9a 36 23 eb 0a 02 4b 1e 66 fa
1260:	 41 2d 7c f1 99 6f 2e f2 56 d7 81 75 50 93 ac a3
1270:	 16 3a 00 7e 1f cf 97 70 94 e0 ff f0 57 1a b0 c2
1280:	 0d ad 57 7d 93 df 7f cf 8f cd ba 5f 33 14 c6 60
1290:	 d0 3a 49 46 2f 0e 6e 4d 3d 53 cc ea 8e f0 03 86
12a0:	 50 ff 6c 8a 39 6b 6f bb 60 0d ec e8 16 7e 54 bc
12b0:	 74 52 0f 35 10 01 5f ec fd ea 6e d8 56 f0 15 46
12c0:	 53 cf 9b ec dd ed 47 a8 89 ea fc ee 2c 7f 14 3d
12d0:	 2f 48 86 f6 90 ab fc 75 17 9a 9a 10 98 fc 90 ce
12e0:	 4b 68 6b ea 84 66 ff 4f 1e 5f a6 ab da 20 54 07
12f0:	 46 49 5e 05 52 cf 6d e6 83 bc 39 f6 82 19 35 4b
1300:	 c3 19 e7 be 30 4f df 10 9c e3 d7 21 5d 3e 51 f0
1310:	 de 20 1e f7 64 d7 08 2e 07 9d 81 70 a3 18 29 71
1320:	 d4 bd f3 d6 a3 5c 62 5e 38 49 d5 ca 59 a3 8f 9f
1330:	 09 28 9c 74 2f 43 9a bc 06 f2 bb a4 e5 04 c2 3c
1340:	 a7 18 13 b4 2d f6 0f 9d a6 95 54 82 b2 ed 05 d8
1350:	 23 0a 9c df 92 26 4f d0 68 b5 f1 aa 1e 6e c8 93
1360:	 68 ae e0 e7 19 1f 13 4d ef a0 80 c2 f3 b2 c1 1e
1370:	 cd 0c d3 bf 97 4b d3 3c 47 fd 8e d0 2e ee a9 e3
1380:	 4f 5a 03 49 3e 07 19 6c 14 18 7e 48 9d 81 79 3a
1390:	 ed a7 48 6d 36 7c 2f 7b ae 81 c7 cc e7 48 2b d0
13a0:	 cf 4f 95 a4 3b da f7 2d a5 32 64 65 3e a2 18 7c
13b0:	 08 26 4a be 13 86 6f 4c 15 60 03 32 98 1c 9c de
13c0:	 c7 90 6b a5 15 5f 32 e1 a8 21 26 b0 f9 48 ae f5
13d0:	 4c ac a6 d2 c9 93 86 68 06 7f 87 25 c1 f2 07 ab
13e0:	 56 11 45 c9 fb 7b 2f 97 c4 e8 df 13 84 5c d9 93
13f0:	 d1 1f 55 91 0b 4f cb d9 a6 69 2a 36 d9 fc 97 ee
1400:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1410:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1420:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1430:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1440:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1450:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1460:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1470:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1480:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1490:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
14a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
14b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
14c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
14d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
14e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
14f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1500:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1510:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1520:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1530:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1540:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1550:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1560:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1570:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1580:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1590:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
15a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
15b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
15c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
15d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
15e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
15f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1600:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1610:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1620:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1630:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1640:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1650:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1660:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1670:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1680:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1690:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
16a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
16b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
16c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
16d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
16e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
16f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1700:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1710:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1720:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1730:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1740:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1750:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1760:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1770:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1780:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1790:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
17a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
17b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
17c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
17d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
17e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
17f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1800:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1810:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1820:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1830:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1840:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1850:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1860:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1870:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1880:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1890:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
18a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
18b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
18c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
18d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
18e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
18f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1900:	 00 0c be 01 09 67 00 16 cb a4 e1 68 08 00 45 08
1910:	 05 c4 12 0a 40 00 40 06 a5 96 0a 64 01 01 3c f2
1920:	 35 35 1e d0 df 23 44 46 a5 dd 27 16 0d 10 50 10
1930:	 32 40 00 00 00 00 02 fb 08 0a 04 7f 10 8a 47 30
1940:	 4b 50 9b 88 f7 3d 50 65 ce 94 6e d6 75 d0 bb 6a
1950:	 1a c5 38 a6 1a e7 05 01 41 63 94 39 c4 66 4c 7b
1960:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1970:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1980:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1990:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
19a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
19b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
19c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
19d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
19e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
19f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1a90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1aa0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ab0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ac0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ad0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ae0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1af0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1b90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ba0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1bb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1bc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1bd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1be0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1bf0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1c00:	 ab 11 62 43 07 00 10 00 22 00 00 02 40 00 00 00
1c10:	 04 00 20 90 00 00 00 00 01 10 00 00 00 00 00 00
1c20:	 00 00 00 00 00 00 00 00 00 00 00 00 ab 11 21 53
1c30:	 00 00 fe ff 48 00 00 00 00 00 00 00 0b 01 00 00
1c40:	 00 00 f0 01 00 80 a0 01 01 50 02 fe 00 20 00 13
1c50:	 03 5c fc 80 00 00 00 78 00 00 00 01 05 e0 82 00
1c60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1c70:	 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1c80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1c90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ca0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1cb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1cc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1cd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ce0:	 10 00 11 00 c0 0f 04 05 00 40 1b 00 11 a4 03 00
1cf0:	 48 00 11 10 00 00 00 00 00 00 00 00 00 00 00 00
1d00:	 01 00 01 00 00 00 00 00 00 00 10 00 11 20 06 00
1d10:	 01 00 00 00 00 00 00 00 1f 00 00 00 01 00 00 00
1d20:	 0f 1c 00 00 24 1d 20 90 eb 01 50 f0 00 00 00 00
1d30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1d40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1d50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1d60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1d70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1d80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1d90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1da0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1db0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1dc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1dd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1de0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1df0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e00:	 03 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e10:	 00 14 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e20:	 30 75 00 00 78 00 02 02 04 00 20 03 04 00 2c 01
1e30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1e90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ea0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1eb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ec0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ed0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ee0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ef0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1f90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1fa0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1fb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1fc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1fd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1fe0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1ff0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2000:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2010:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2020:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2030:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2040:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2050:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2060:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2070:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2080:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2090:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2100:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2110:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2120:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2130:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2140:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2150:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2160:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2170:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2180:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2190:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
21a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
21b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
21c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
21d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
21e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
21f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2200:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2210:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2220:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2230:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2240:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2250:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2260:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2270:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2280:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2290:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
22a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
22b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
22c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
22d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
22e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
22f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2300:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2310:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2320:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2330:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2340:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2350:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2360:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2370:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2380:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2390:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
23a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
23b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
23c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
23d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
23e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
23f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2400:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2410:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2420:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2430:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2440:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2450:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2460:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2470:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2480:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2490:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
24a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
24b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
24c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
24d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
24e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
24f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2500:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2510:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2520:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2530:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2540:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2550:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2560:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2570:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2580:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2590:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
25a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
25b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
25c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
25d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
25e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
25f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2600:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2610:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2620:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2630:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2640:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2650:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2660:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2670:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2680:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2690:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
26a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
26b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
26c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
26d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
26e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
26f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2700:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2710:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2720:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2730:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2740:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2750:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2760:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2770:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2780:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2790:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
27a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
27b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
27c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
27d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
27e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
27f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2800:	 04 f4 00 00 00 18 00 00 00 10 00 00 00 e0 00 00
2810:	 ff ff 00 00 c4 d7 00 00 1e 22 00 00 00 16 00 00
2820:	 cb a4 00 00 e1 68 00 00 00 16 00 00 cb a4 00 00
2830:	 e1 68 00 00 00 00 00 00 00 08 00 00 00 00 00 00
2840:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2850:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2860:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2870:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2880:	 80 04 00 00 80 44 00 00 00 00 00 00 00 00 00 00
2890:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
28a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
28b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
28c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
28d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
28e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
28f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2900:	 99 48 00 00 20 00 00 00 37 00 00 00 00 00 00 00
2910:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2920:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2930:	 29 d1 00 00 14 47 00 00 00 00 00 00 00 00 00 00
2940:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2950:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2960:	 a9 08 00 00 05 00 00 00 61 ff 00 00 0e 00 00 00
2970:	 e1 e7 00 00 00 00 00 00 0e 3a 00 00 00 00 00 00
2980:	 0e 47 00 00 00 00 00 00 c9 d7 00 00 0a 00 00 00
2990:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
29a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
29b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
29c0:	 41 e8 00 00 23 00 00 00 3f 00 00 00 00 00 00 00
29d0:	 00 00 00 00 00 00 00 00 93 01 00 00 00 00 00 00
29e0:	 c1 ce 00 00 c6 7a 00 00 00 00 00 00 00 00 00 00
29f0:	 7e 46 00 00 05 00 00 00 6a 1c 00 00 09 00 00 00
2a00:	 b2 7a 00 00 00 00 00 00 5d 77 00 00 00 00 00 00
2a10:	 79 60 00 00 00 00 00 00 a3 34 00 00 14 00 00 00
2a20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2a30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2a40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2a50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2a60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2a70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2a80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2a90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2aa0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ab0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ac0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ad0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ae0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2af0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2b90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ba0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2bb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2bc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2bd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2be0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2bf0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2c00:	 04 f0 00 00 00 18 00 00 00 10 00 00 00 e0 00 00
2c10:	 ff ff 00 00 c4 d7 00 00 1e 22 00 00 00 16 00 00
2c20:	 cb a4 00 00 e1 68 00 00 00 16 00 00 cb a4 00 00
2c30:	 e1 68 00 00 00 00 00 00 00 08 00 00 00 00 00 00
2c40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2c50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2c60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2c70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2c80:	 80 04 00 00 80 44 00 00 00 00 00 00 00 00 00 00
2c90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ca0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2cb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2cc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2cd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ce0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2cf0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2d00:	 99 48 00 00 20 00 00 00 37 00 00 00 00 00 00 00
2d10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2d20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2d30:	 29 d1 00 00 14 47 00 00 00 00 00 00 00 00 00 00
2d40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2d50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2d60:	 a9 08 00 00 05 00 00 00 61 ff 00 00 0e 00 00 00
2d70:	 e1 e7 00 00 00 00 00 00 0e 3a 00 00 00 00 00 00
2d80:	 0e 47 00 00 00 00 00 00 c9 d7 00 00 0a 00 00 00
2d90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2da0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2db0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2dc0:	 41 e8 00 00 23 00 00 00 3f 00 00 00 00 00 00 00
2dd0:	 00 00 00 00 00 00 00 00 93 01 00 00 00 00 00 00
2de0:	 c1 ce 00 00 c6 7a 00 00 00 00 00 00 00 00 00 00
2df0:	 7e 46 00 00 05 00 00 00 6a 1c 00 00 09 00 00 00
2e00:	 b2 7a 00 00 00 00 00 00 5d 77 00 00 00 00 00 00
2e10:	 79 60 00 00 00 00 00 00 a3 34 00 00 14 00 00 00
2e20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2e30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2e40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2e50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2e60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2e70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2e80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2e90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ea0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2eb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ec0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ed0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ee0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ef0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2f90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2fa0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2fb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2fc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2fd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2fe0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2ff0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3000:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3010:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3020:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3030:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3040:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3050:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3060:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3070:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3080:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3090:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
30a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
30b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
30c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
30d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
30e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
30f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3100:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3110:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3120:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3130:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3140:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3150:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3160:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3170:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3180:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3190:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
31a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
31b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
31c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
31d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
31e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
31f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3200:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3210:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3220:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3230:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3240:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3250:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3260:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3270:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3280:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3290:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
32a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
32b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
32c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
32d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
32e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
32f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3300:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3310:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3320:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3330:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3340:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3350:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3360:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3370:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3380:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3390:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
33a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
33b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
33c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
33d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
33e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
33f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3400:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3410:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3420:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3430:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3440:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3450:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3460:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3470:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3480:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3490:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
34a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
34b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
34c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
34d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
34e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
34f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3500:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3510:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3520:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3530:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3540:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3550:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3560:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3570:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3580:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3590:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
35a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
35b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
35c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
35d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
35e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
35f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3600:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3610:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3620:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3630:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3640:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3650:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3660:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3670:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3680:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3690:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
36a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
36b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
36c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
36d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
36e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
36f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3700:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3710:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3720:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3730:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3740:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3750:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3760:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3770:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3780:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3790:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
37a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
37b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
37c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
37d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
37e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
37f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3800:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3810:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3820:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3830:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3840:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3850:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3860:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3870:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3880:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3890:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
38a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
38b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
38c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
38d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
38e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
38f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3900:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3910:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3920:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3930:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3940:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3950:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3960:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3970:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3980:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3990:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
39a0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
39b0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
39c0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
39d0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
39e0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
39f0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3a90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3aa0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ab0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ac0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ad0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ae0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3af0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3b90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ba0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3bb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3bc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3bd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3be0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3bf0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3c90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ca0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3cb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3cc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3cd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ce0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3cf0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3d90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3da0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3db0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3dc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3dd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3de0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3df0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3e90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ea0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3eb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ec0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ed0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ee0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ef0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f00:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f10:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f20:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f30:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f40:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f50:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f60:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f70:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f80:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3f90:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3fa0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3fb0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3fc0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3fd0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3fe0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3ff0:	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00


^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-05-23 15:01   ` Tino Keitel
@ 2007-05-23 15:49     ` Stephen Hemminger
  0 siblings, 0 replies; 17+ messages in thread
From: Stephen Hemminger @ 2007-05-23 15:49 UTC (permalink / raw)
  To: Tino Keitel; +Cc: netdev

Does this patch fix the problem? It is something I saw while doing
review for support of newer chips.
--------------------
Subject: sky2: don't set bogus bit in PHY register

This code inherited from the sk98lin driver is incorrect on the Yukon2.
The definition used for these bits is incorrect. Actual usage varies
with chip type, and we don't need to mess with them (yet).

Signed-off-by: Stephen Hemminger <shemminger@linux-foundation.org>


--- a/drivers/net/sky2.c	2007-05-23 08:44:09.000000000 -0700
+++ b/drivers/net/sky2.c	2007-05-23 08:47:11.000000000 -0700
@@ -658,7 +658,7 @@ static void sky2_mac_init(struct sky2_hw
 	const u8 *addr = hw->dev[port]->dev_addr;
 
 	sky2_write32(hw, SK_REG(port, GPHY_CTRL), GPC_RST_SET);
-	sky2_write32(hw, SK_REG(port, GPHY_CTRL), GPC_RST_CLR|GPC_ENA_PAUSE);
+	sky2_write32(hw, SK_REG(port, GPHY_CTRL), GPC_RST_CLR);
 
 	sky2_write8(hw, SK_REG(port, GMAC_CTRL), GMC_RST_CLR);
 
--- a/drivers/net/sky2.h	2007-05-23 08:44:09.000000000 -0700
+++ b/drivers/net/sky2.h	2007-05-23 08:47:11.000000000 -0700
@@ -1732,28 +1732,6 @@ enum {
 
 /*	GPHY_CTRL		32 bit	GPHY Control Reg (YUKON only) */
 enum {
-	GPC_SEL_BDT	= 1<<28, /* Select Bi-Dir. Transfer for MDC/MDIO */
-	GPC_INT_POL_HI	= 1<<27, /* IRQ Polarity is Active HIGH */
-	GPC_75_OHM	= 1<<26, /* Use 75 Ohm Termination instead of 50 */
-	GPC_DIS_FC	= 1<<25, /* Disable Automatic Fiber/Copper Detection */
-	GPC_DIS_SLEEP	= 1<<24, /* Disable Energy Detect */
-	GPC_HWCFG_M_3	= 1<<23, /* HWCFG_MODE[3] */
-	GPC_HWCFG_M_2	= 1<<22, /* HWCFG_MODE[2] */
-	GPC_HWCFG_M_1	= 1<<21, /* HWCFG_MODE[1] */
-	GPC_HWCFG_M_0	= 1<<20, /* HWCFG_MODE[0] */
-	GPC_ANEG_0	= 1<<19, /* ANEG[0] */
-	GPC_ENA_XC	= 1<<18, /* Enable MDI crossover */
-	GPC_DIS_125	= 1<<17, /* Disable 125 MHz clock */
-	GPC_ANEG_3	= 1<<16, /* ANEG[3] */
-	GPC_ANEG_2	= 1<<15, /* ANEG[2] */
-	GPC_ANEG_1	= 1<<14, /* ANEG[1] */
-	GPC_ENA_PAUSE	= 1<<13, /* Enable Pause (SYM_OR_REM) */
-	GPC_PHYADDR_4	= 1<<12, /* Bit 4 of Phy Addr */
-	GPC_PHYADDR_3	= 1<<11, /* Bit 3 of Phy Addr */
-	GPC_PHYADDR_2	= 1<<10, /* Bit 2 of Phy Addr */
-	GPC_PHYADDR_1	= 1<<9,	 /* Bit 1 of Phy Addr */
-	GPC_PHYADDR_0	= 1<<8,	 /* Bit 0 of Phy Addr */
-						/* Bits  7..2:	reserved */
 	GPC_RST_CLR	= 1<<1,	/* Clear GPHY Reset */
 	GPC_RST_SET	= 1<<0,	/* Set   GPHY Reset */
 };

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-05-23  7:54 sky2 hangs without any messages Tino Keitel
  2007-05-23 14:50 ` Stephen Hemminger
@ 2007-06-27 17:31 ` Stephen Hemminger
  1 sibling, 0 replies; 17+ messages in thread
From: Stephen Hemminger @ 2007-06-27 17:31 UTC (permalink / raw)
  To: Tino Keitel; +Cc: netdev

On Wed, 23 May 2007 09:54:31 +0200
Tino Keitel <tino.keitel@tikei.de> wrote:

> Hi folks,
> 
> in the last 2 days, I had 2 outages of the NIC of my Mac mini Core Duo.
> I checked the kernel log but I found nothing sky2 related. After
> reloading the module, the interface worked again.
> 
> Both freezes were connected to access from a remote NFS client to a
> directory with ~4700 files in it. Both times, after reloading the
> module and waiting some minutes until the NFS client had recovered from
> the hanging NFS server, the same action worked.
> 
> The network is 100 mbit full duplex. I use NFS over TCP and kernel
> 2.6.21 with the "disable flow control" patch, the configuration is
> attached.
> 
> Here are the sky2 messages that appeared when I discovered the freeze
> and reloaded the driver:
> 
> sky2 eth0: disabling interface
> ACPI: PCI interrupt for device 0000:01:00.0 disabled
> ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 17
> PCI: Setting latency timer of device 0000:01:00.0 to 64
> sky2 0000:01:00.0: v1.14 addr 0x90200000 irq 17 Yukon-EC (0xb6) rev 2
> Device driver eth0 lacks bus and class support for being resumed.
> sky2 eth0: addr 00:16:cb:a4:e1:68
> sky2 eth0: enabling interface
> sky2 eth0: ram buffer 48K
> sky2 eth0: Link is up at 100 Mbps, full duplex, flow control none
> 


There is a reproducible hang (due to missed IRQ) in sky2.  It is more reproducible
with slower CPU's like Mac Mini.

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
       [not found] <6278d2220707020315q7c3df1cci5c7bb52316ad6081@mail.gmail.com>
@ 2007-07-02 10:17 ` Daniel J Blueman
       [not found] ` <20070703123546.5d41410b@freepuppy.localdomain.hemminger.net>
  1 sibling, 0 replies; 17+ messages in thread
From: Daniel J Blueman @ 2007-07-02 10:17 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: netdev

Hi Stephen,

Tino Keitel <tino.keitel@tikei.de> wrote:
>> in the last 2 days, I had 2 outages of the NIC of my Mac mini Core Duo.
>> I checked the kernel log but I found nothing sky2 related. After
>> reloading the module, the interface worked again.

> There is a reproducible hang (due to missed IRQ) in sky2.  It is more reproducible
> with slower CPU's like Mac Mini.

This feels like the same problem I hit once every ~2 days on my server
platform or laptop [1]: both Yukon-ECs, rev 1 and 2, running NFSv4
over TCP over a gig-e switch, ia32, PCI-E.

Observations:

1. problem happens with both rev-1 and 2 Yukon-ECs, so less likely a silicon bug
2. reproducible with 1500 MTU on both ends
3. reproducible with and without receive offloading disabled (ie
'ethtool -K gig0 rx off') [check with tx offload too?]
4. reproducible with two different gig-e switches and different cables
5. reproducible with MSI interrupts [check with legacy interrupts?]

Is there anything that I can do to help debug this missing IRQ hang?
I'm thinking of moving to the vendor driver [2] to see if the issue is
entirely avoidable in software.

Thanks,
  Daniel

--- [1]

sky2 0000:02:00.0: v1.14 addr 0xd6000000 irq 16 Yukon-EC (0xb6) rev 2
sky2 gig0: addr 00:16:b6:70:d8:3d
sky2 gig0: enabling interface
sky2 gig0: ram buffer 48K
sky2 gig0: Link is up at 1000 Mbps, full duplex, flow control both
<NFS hang observed>
NETDEV WATCHDOG: gig0: transmit timed out
sky2 gig0: tx timeout
sky2 gig0: transmit ring 424 .. 401 report=427 done=427
sky2 gig0: disabling interface
sky2 gig0: enabling interface
sky2 gig0: ram buffer 48K
sky2 gig0: Link is up at 1000 Mbps, full duplex, flow control both
<NFS resumes after a few minutes>

$ grep gig0 /proc/interrupts
218:      27297          0   PCI-MSI-edge      gig0

--- [2]

http://www.syskonnect.de/e_en/products/adapters/pcie_server/sk-9exx/software/linux/driver/install-8_31.tar.bz2
-- 
Daniel J Blueman

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
       [not found]       ` <20070705101046.542c1f8e@freepuppy.localdomain.hemminger.net>
@ 2007-07-11 10:15         ` Daniel J Blueman
  2007-07-11 15:27           ` Stephen Hemminger
  0 siblings, 1 reply; 17+ messages in thread
From: Daniel J Blueman @ 2007-07-11 10:15 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: Linux Netdev

On 05/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> Well, it didn't fix my test, but it made it better.  The following seemed
> to work longer...
>
> --- a/drivers/net/sky2.c        2007-07-05 09:09:45.000000000 -0700
> +++ b/drivers/net/sky2.c        2007-07-05 09:09:51.000000000 -0700
> @@ -2490,6 +2490,13 @@ static int sky2_poll(struct net_device *
>
>         work_done = sky2_status_intr(hw, work_limit);
>         if (work_done < work_limit) {
> +               /* Bug/Errata workaround?
> +                * Need to kick the TX irq moderation timer.
> +                */
> +               if (sky2_read8(hw, STAT_TX_TIMER_CTRL) == TIM_START) {
> +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_STOP);
> +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_START);
> +               }
>                 netif_rx_complete(dev0);
>
>                 /* end of interrupt, re-enables also acts as I/O synchronization */

I spoke too soon on this. With the above patch on 2.6.22-rc7, it
failed much sooner than the previous patch with the
read32(B0_Y2_SP_LISR); I'll try to reproduce with the older patch.

Note the ifconfig error/dropped/frame count at the time of failure:

# ethtool -g lan0
Ring parameters for lan0:
Pre-set maximums:
RX:             168
RX Mini:        0
RX Jumbo:       0
TX:             511
Current hardware settings:
RX:             168
RX Mini:        0
RX Jumbo:       0
TX:             511

# ethtool -a lan0
Pause parameters for lan0:
Autonegotiate:  on
RX:             on
TX:             on

# ethtool -c lan0
Coalesce parameters for lan0:
Adaptive RX: off  TX: off
stats-block-usecs: 0
sample-interval: 0
pkt-rate-low: 0
pkt-rate-high: 0

rx-usecs: 100
rx-frames: 16
rx-usecs-irq: 20
rx-frames-irq: 16

tx-usecs: 1000
tx-frames: 10
tx-usecs-irq: 0
tx-frames-irq: 0

rx-usecs-low: 0
rx-frame-low: 0
tx-usecs-low: 0
tx-frame-low: 0

rx-usecs-high: 0
rx-frame-high: 0
tx-usecs-high: 0
tx-frame-high: 0

# ethtool -k lan0
Offload parameters for lan0:
Cannot get device udp large send offload settings: Operation not supported
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp segmentation offload: on
udp fragmentation offload: off
generic segmentation offload: off

# ethtool -S lan0
NIC statistics:
     tx_bytes: 2624901638
     rx_bytes: 125131827
     tx_broadcast: 177
     rx_broadcast: 245
     tx_multicast: 0
     rx_multicast: 0
     tx_unicast: 1818345
     rx_unicast: 973657
     tx_mac_pause: 0
     rx_mac_pause: 0
     collisions: 0
     late_collision: 0
     aborted: 0
     single_collisions: 0
     multi_collisions: 0
     rx_short: 0
     rx_runt: 0
     rx_64_byte_packets: 2475
     rx_65_to_127_byte_packets: 891841
     rx_128_to_255_byte_packets: 3748
     rx_256_to_511_byte_packets: 42082
     rx_512_to_1023_byte_packets: 3133
     rx_1024_to_1518_byte_packets: 30623
     rx_1518_to_max_byte_packets: 0
     rx_too_long: 0
     rx_fifo_overflow: 0
     rx_jabber: 0
     rx_fcs_error: 0
     tx_64_byte_packets: 1429
     tx_65_to_127_byte_packets: 35881
     tx_128_to_255_byte_packets: 17013
     tx_256_to_511_byte_packets: 25872
     tx_512_to_1023_byte_packets: 30901
     tx_1024_to_1518_byte_packets: 1707426
     tx_1519_to_max_byte_packets: 0
     tx_fifo_underrun: 0

# ifconfig lan0
lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
          inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:973893 errors:1 dropped:1 overruns:0 frame:1
          TX packets:819179 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:107601061 (102.6 MiB)  TX bytes:2551658362 (2.3 GiB)
          Interrupt:16

# dmesg
...
ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 16
PCI: Setting latency timer of device 0000:01:00.0 to 64
sky2 0000:01:00.0: v1.14 addr 0xdfbfc000 irq 16 Yukon-EC (0xb6) rev 1
sky2 eth1: addr 00:03:2d:05:9c:27
sky2 lan0: enabling interface
sky2 lan0: ram buffer 48K
sky2 lan0: Link is up at 1000 Mbps, full duplex, flow control both
...
lan0: hw csum failure.
 [<b02b707c>] __skb_checksum_complete_head+0x5c/0x60
 [<b02b7088>] __skb_checksum_complete+0x8/0x10
 [<b0313aab>] nf_ip_checksum+0xbb/0x130
 [<b02d8b9c>] udp_error+0x13c/0x1b0
 [<b02ba4cd>] dev_hard_start_xmit+0x1cd/0x230
 [<b02e93c0>] ip_finish_output+0x0/0x260
 [<b02d8a60>] udp_error+0x0/0x1b0
 [<b02d5736>] nf_conntrack_in+0xf6/0x4d0
 [<b02bbe85>] dev_queue_xmit+0x95/0x260
 [<b02eac51>] ip_output+0x141/0x2e0
 [<b02e93c0>] ip_finish_output+0x0/0x260
 [<b02ea20f>] ip_queue_xmit+0x1cf/0x3d0
 [<b02e7cd0>] dst_output+0x0/0x10
 [<b02d33a3>] nf_iterate+0x63/0x90
 [<b02e4fb0>] ip_rcv_finish+0x0/0x280
 [<b02d3519>] nf_hook_slow+0x59/0xe0
 [<b02e4fb0>] ip_rcv_finish+0x0/0x280
 [<b02e5740>] ip_rcv+0x2f0/0x4d0
 [<b02e4fb0>] ip_rcv_finish+0x0/0x280
 [<b0321d56>] packet_rcv_spkt+0xe6/0x180
 [<b02b9f38>] netif_receive_skb+0x1f8/0x2e0
 [<f0840db1>] sky2_poll+0x351/0x9c0 [sky2]
 [<b01206b4>] run_timer_softirq+0x124/0x180
 [<b02bbc6c>] net_rx_action+0x5c/0x100
 [<b011dd62>] __do_softirq+0x42/0x90
 [<b010642c>] do_softirq+0x5c/0xb0
 [<b0139e30>] handle_edge_irq+0x0/0xe0
 [<b011dc8a>] irq_exit+0x5a/0x60
 [<b01064ec>] do_IRQ+0x6c/0xb0
 [<b0104807>] common_interrupt+0x23/0x28
 [<b0420000>] xt_tcpudp_init+0x0/0x10
 [<b0102c9a>] default_idle+0x2a/0x40
 [<b01023d3>] cpu_idle+0x43/0x70
 [<b0404b25>] start_kernel+0x215/0x2a0
 [<b0404450>] unknown_bootoption+0x0/0x260
 =======================

Daniel
-- 
Daniel J Blueman

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-11 10:15         ` Daniel J Blueman
@ 2007-07-11 15:27           ` Stephen Hemminger
  2007-07-11 15:43             ` Daniel J Blueman
  0 siblings, 1 reply; 17+ messages in thread
From: Stephen Hemminger @ 2007-07-11 15:27 UTC (permalink / raw)
  To: Daniel J Blueman; +Cc: Linux Netdev

On Wed, 11 Jul 2007 11:15:20 +0100
"Daniel J Blueman" <daniel.blueman@gmail.com> wrote:

> On 05/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > Well, it didn't fix my test, but it made it better.  The following seemed
> > to work longer...
> >
> > --- a/drivers/net/sky2.c        2007-07-05 09:09:45.000000000 -0700
> > +++ b/drivers/net/sky2.c        2007-07-05 09:09:51.000000000 -0700
> > @@ -2490,6 +2490,13 @@ static int sky2_poll(struct net_device *
> >
> >         work_done = sky2_status_intr(hw, work_limit);
> >         if (work_done < work_limit) {
> > +               /* Bug/Errata workaround?
> > +                * Need to kick the TX irq moderation timer.
> > +                */
> > +               if (sky2_read8(hw, STAT_TX_TIMER_CTRL) == TIM_START) {
> > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_STOP);
> > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_START);
> > +               }
> >                 netif_rx_complete(dev0);
> >
> >                 /* end of interrupt, re-enables also acts as I/O synchronization */
> 
> I spoke too soon on this. With the above patch on 2.6.22-rc7, it
> failed much sooner than the previous patch with the
> read32(B0_Y2_SP_LISR); I'll try to reproduce with the older patch.
> 
> Note the ifconfig error/dropped/frame count at the time of failure:
> 
> # ethtool -g lan0
> Ring parameters for lan0:
> Pre-set maximums:
> RX:             168
> RX Mini:        0
> RX Jumbo:       0
> TX:             511
> Current hardware settings:
> RX:             168
> RX Mini:        0
> RX Jumbo:       0
> TX:             511
> 
> # ethtool -a lan0
> Pause parameters for lan0:
> Autonegotiate:  on
> RX:             on
> TX:             on
> 
> # ethtool -c lan0
> Coalesce parameters for lan0:
> Adaptive RX: off  TX: off
> stats-block-usecs: 0
> sample-interval: 0
> pkt-rate-low: 0
> pkt-rate-high: 0
> 
> rx-usecs: 100
> rx-frames: 16
> rx-usecs-irq: 20
> rx-frames-irq: 16
> 
> tx-usecs: 1000
> tx-frames: 10
> tx-usecs-irq: 0
> tx-frames-irq: 0
> 
> rx-usecs-low: 0
> rx-frame-low: 0
> tx-usecs-low: 0
> tx-frame-low: 0
> 
> rx-usecs-high: 0
> rx-frame-high: 0
> tx-usecs-high: 0
> tx-frame-high: 0
> 
> # ethtool -k lan0
> Offload parameters for lan0:
> Cannot get device udp large send offload settings: Operation not supported
> rx-checksumming: on
> tx-checksumming: on
> scatter-gather: on
> tcp segmentation offload: on
> udp fragmentation offload: off
> generic segmentation offload: off
> 
> # ethtool -S lan0
> NIC statistics:
>      tx_bytes: 2624901638
>      rx_bytes: 125131827
>      tx_broadcast: 177
>      rx_broadcast: 245
>      tx_multicast: 0
>      rx_multicast: 0
>      tx_unicast: 1818345
>      rx_unicast: 973657
>      tx_mac_pause: 0
>      rx_mac_pause: 0
>      collisions: 0
>      late_collision: 0
>      aborted: 0
>      single_collisions: 0
>      multi_collisions: 0
>      rx_short: 0
>      rx_runt: 0
>      rx_64_byte_packets: 2475
>      rx_65_to_127_byte_packets: 891841
>      rx_128_to_255_byte_packets: 3748
>      rx_256_to_511_byte_packets: 42082
>      rx_512_to_1023_byte_packets: 3133
>      rx_1024_to_1518_byte_packets: 30623
>      rx_1518_to_max_byte_packets: 0
>      rx_too_long: 0
>      rx_fifo_overflow: 0
>      rx_jabber: 0
>      rx_fcs_error: 0
>      tx_64_byte_packets: 1429
>      tx_65_to_127_byte_packets: 35881
>      tx_128_to_255_byte_packets: 17013
>      tx_256_to_511_byte_packets: 25872
>      tx_512_to_1023_byte_packets: 30901
>      tx_1024_to_1518_byte_packets: 1707426
>      tx_1519_to_max_byte_packets: 0
>      tx_fifo_underrun: 0
> 
> # ifconfig lan0
> lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
>           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:973893 errors:1 dropped:1 overruns:0 frame:1
>           TX packets:819179 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:1000
>           RX bytes:107601061 (102.6 MiB)  TX bytes:2551658362 (2.3 GiB)
>           Interrupt:16
> 
> # dmesg
> ...
> ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 16
> PCI: Setting latency timer of device 0000:01:00.0 to 64
> sky2 0000:01:00.0: v1.14 addr 0xdfbfc000 irq 16 Yukon-EC (0xb6) rev 1
> sky2 eth1: addr 00:03:2d:05:9c:27
> sky2 lan0: enabling interface
> sky2 lan0: ram buffer 48K
> sky2 lan0: Link is up at 1000 Mbps, full duplex, flow control both
> ...
> lan0: hw csum failure.
>  [<b02b707c>] __skb_checksum_complete_head+0x5c/0x60
>  [<b02b7088>] __skb_checksum_complete+0x8/0x10
>  [<b0313aab>] nf_ip_checksum+0xbb/0x130
>  [<b02d8b9c>] udp_error+0x13c/0x1b0
>  [<b02ba4cd>] dev_hard_start_xmit+0x1cd/0x230
>  [<b02e93c0>] ip_finish_output+0x0/0x260
>  [<b02d8a60>] udp_error+0x0/0x1b0
>  [<b02d5736>] nf_conntrack_in+0xf6/0x4d0
>  [<b02bbe85>] dev_queue_xmit+0x95/0x260
>  [<b02eac51>] ip_output+0x141/0x2e0
>  [<b02e93c0>] ip_finish_output+0x0/0x260
>  [<b02ea20f>] ip_queue_xmit+0x1cf/0x3d0
>  [<b02e7cd0>] dst_output+0x0/0x10
>  [<b02d33a3>] nf_iterate+0x63/0x90
>  [<b02e4fb0>] ip_rcv_finish+0x0/0x280
>  [<b02d3519>] nf_hook_slow+0x59/0xe0
>  [<b02e4fb0>] ip_rcv_finish+0x0/0x280
>  [<b02e5740>] ip_rcv+0x2f0/0x4d0
>  [<b02e4fb0>] ip_rcv_finish+0x0/0x280
>  [<b0321d56>] packet_rcv_spkt+0xe6/0x180
>  [<b02b9f38>] netif_receive_skb+0x1f8/0x2e0
>  [<f0840db1>] sky2_poll+0x351/0x9c0 [sky2]
>  [<b01206b4>] run_timer_softirq+0x124/0x180
>  [<b02bbc6c>] net_rx_action+0x5c/0x100
>  [<b011dd62>] __do_softirq+0x42/0x90
>  [<b010642c>] do_softirq+0x5c/0xb0
>  [<b0139e30>] handle_edge_irq+0x0/0xe0
>  [<b011dc8a>] irq_exit+0x5a/0x60
>  [<b01064ec>] do_IRQ+0x6c/0xb0
>  [<b0104807>] common_interrupt+0x23/0x28
>  [<b0420000>] xt_tcpudp_init+0x0/0x10
>  [<b0102c9a>] default_idle+0x2a/0x40
>  [<b01023d3>] cpu_idle+0x43/0x70
>  [<b0404b25>] start_kernel+0x215/0x2a0
>  [<b0404450>] unknown_bootoption+0x0/0x260

The last message means some how frame was received with checksum for count
wrong. I have only seen it when coalescing is messed up.

I ran for 2+ days with the patch, and only 20min without. Usually my ISP connection
gives up after that because of crappy DSL box, and that makes DNS not work.


-- 
Stephen Hemminger <shemminger@linux-foundation.org>

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-11 15:27           ` Stephen Hemminger
@ 2007-07-11 15:43             ` Daniel J Blueman
  2007-07-11 21:39               ` Daniel J Blueman
  0 siblings, 1 reply; 17+ messages in thread
From: Daniel J Blueman @ 2007-07-11 15:43 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: Linux Netdev

On 11/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> On Wed, 11 Jul 2007 11:15:20 +0100
> "Daniel J Blueman" <daniel.blueman@gmail.com> wrote:
>
> > On 05/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > > Well, it didn't fix my test, but it made it better.  The following seemed
> > > to work longer...
> > >
> > > --- a/drivers/net/sky2.c        2007-07-05 09:09:45.000000000 -0700
> > > +++ b/drivers/net/sky2.c        2007-07-05 09:09:51.000000000 -0700
> > > @@ -2490,6 +2490,13 @@ static int sky2_poll(struct net_device *
> > >
> > >         work_done = sky2_status_intr(hw, work_limit);
> > >         if (work_done < work_limit) {
> > > +               /* Bug/Errata workaround?
> > > +                * Need to kick the TX irq moderation timer.
> > > +                */
> > > +               if (sky2_read8(hw, STAT_TX_TIMER_CTRL) == TIM_START) {
> > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_STOP);
> > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_START);
> > > +               }
> > >                 netif_rx_complete(dev0);
> > >
> > >                 /* end of interrupt, re-enables also acts as I/O synchronization */
> >
> > I spoke too soon on this. With the above patch on 2.6.22-rc7, it
> > failed much sooner than the previous patch with the
> > read32(B0_Y2_SP_LISR); I'll try to reproduce with the older patch.
> >
> > Note the ifconfig error/dropped/frame count at the time of failure:
> >
> > # ethtool -g lan0
> > Ring parameters for lan0:
> > Pre-set maximums:
> > RX:             168
> > RX Mini:        0
> > RX Jumbo:       0
> > TX:             511
> > Current hardware settings:
> > RX:             168
> > RX Mini:        0
> > RX Jumbo:       0
> > TX:             511
> >
> > # ethtool -a lan0
> > Pause parameters for lan0:
> > Autonegotiate:  on
> > RX:             on
> > TX:             on
> >
> > # ethtool -c lan0
> > Coalesce parameters for lan0:
> > Adaptive RX: off  TX: off
> > stats-block-usecs: 0
> > sample-interval: 0
> > pkt-rate-low: 0
> > pkt-rate-high: 0
> >
> > rx-usecs: 100
> > rx-frames: 16
> > rx-usecs-irq: 20
> > rx-frames-irq: 16
> >
> > tx-usecs: 1000
> > tx-frames: 10
> > tx-usecs-irq: 0
> > tx-frames-irq: 0
> >
> > rx-usecs-low: 0
> > rx-frame-low: 0
> > tx-usecs-low: 0
> > tx-frame-low: 0
> >
> > rx-usecs-high: 0
> > rx-frame-high: 0
> > tx-usecs-high: 0
> > tx-frame-high: 0
> >
> > # ethtool -k lan0
> > Offload parameters for lan0:
> > Cannot get device udp large send offload settings: Operation not supported
> > rx-checksumming: on
> > tx-checksumming: on
> > scatter-gather: on
> > tcp segmentation offload: on
> > udp fragmentation offload: off
> > generic segmentation offload: off
> >
> > # ethtool -S lan0
> > NIC statistics:
> >      tx_bytes: 2624901638
> >      rx_bytes: 125131827
> >      tx_broadcast: 177
> >      rx_broadcast: 245
> >      tx_multicast: 0
> >      rx_multicast: 0
> >      tx_unicast: 1818345
> >      rx_unicast: 973657
> >      tx_mac_pause: 0
> >      rx_mac_pause: 0
> >      collisions: 0
> >      late_collision: 0
> >      aborted: 0
> >      single_collisions: 0
> >      multi_collisions: 0
> >      rx_short: 0
> >      rx_runt: 0
> >      rx_64_byte_packets: 2475
> >      rx_65_to_127_byte_packets: 891841
> >      rx_128_to_255_byte_packets: 3748
> >      rx_256_to_511_byte_packets: 42082
> >      rx_512_to_1023_byte_packets: 3133
> >      rx_1024_to_1518_byte_packets: 30623
> >      rx_1518_to_max_byte_packets: 0
> >      rx_too_long: 0
> >      rx_fifo_overflow: 0
> >      rx_jabber: 0
> >      rx_fcs_error: 0
> >      tx_64_byte_packets: 1429
> >      tx_65_to_127_byte_packets: 35881
> >      tx_128_to_255_byte_packets: 17013
> >      tx_256_to_511_byte_packets: 25872
> >      tx_512_to_1023_byte_packets: 30901
> >      tx_1024_to_1518_byte_packets: 1707426
> >      tx_1519_to_max_byte_packets: 0
> >      tx_fifo_underrun: 0
> >
> > # ifconfig lan0
> > lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
> >           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
> >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> >           RX packets:973893 errors:1 dropped:1 overruns:0 frame:1
> >           TX packets:819179 errors:0 dropped:0 overruns:0 carrier:0
> >           collisions:0 txqueuelen:1000
> >           RX bytes:107601061 (102.6 MiB)  TX bytes:2551658362 (2.3 GiB)
> >           Interrupt:16
> >
> > # dmesg
> > ...
> > ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 16
> > PCI: Setting latency timer of device 0000:01:00.0 to 64
> > sky2 0000:01:00.0: v1.14 addr 0xdfbfc000 irq 16 Yukon-EC (0xb6) rev 1
> > sky2 eth1: addr 00:03:2d:05:9c:27
> > sky2 lan0: enabling interface
> > sky2 lan0: ram buffer 48K
> > sky2 lan0: Link is up at 1000 Mbps, full duplex, flow control both
> > ...
> > lan0: hw csum failure.
> >  [<b02b707c>] __skb_checksum_complete_head+0x5c/0x60
> >  [<b02b7088>] __skb_checksum_complete+0x8/0x10
> >  [<b0313aab>] nf_ip_checksum+0xbb/0x130
> >  [<b02d8b9c>] udp_error+0x13c/0x1b0
> >  [<b02ba4cd>] dev_hard_start_xmit+0x1cd/0x230
> >  [<b02e93c0>] ip_finish_output+0x0/0x260
> >  [<b02d8a60>] udp_error+0x0/0x1b0
> >  [<b02d5736>] nf_conntrack_in+0xf6/0x4d0
> >  [<b02bbe85>] dev_queue_xmit+0x95/0x260
> >  [<b02eac51>] ip_output+0x141/0x2e0
> >  [<b02e93c0>] ip_finish_output+0x0/0x260
> >  [<b02ea20f>] ip_queue_xmit+0x1cf/0x3d0
> >  [<b02e7cd0>] dst_output+0x0/0x10
> >  [<b02d33a3>] nf_iterate+0x63/0x90
> >  [<b02e4fb0>] ip_rcv_finish+0x0/0x280
> >  [<b02d3519>] nf_hook_slow+0x59/0xe0
> >  [<b02e4fb0>] ip_rcv_finish+0x0/0x280
> >  [<b02e5740>] ip_rcv+0x2f0/0x4d0
> >  [<b02e4fb0>] ip_rcv_finish+0x0/0x280
> >  [<b0321d56>] packet_rcv_spkt+0xe6/0x180
> >  [<b02b9f38>] netif_receive_skb+0x1f8/0x2e0
> >  [<f0840db1>] sky2_poll+0x351/0x9c0 [sky2]
> >  [<b01206b4>] run_timer_softirq+0x124/0x180
> >  [<b02bbc6c>] net_rx_action+0x5c/0x100
> >  [<b011dd62>] __do_softirq+0x42/0x90
> >  [<b010642c>] do_softirq+0x5c/0xb0
> >  [<b0139e30>] handle_edge_irq+0x0/0xe0
> >  [<b011dc8a>] irq_exit+0x5a/0x60
> >  [<b01064ec>] do_IRQ+0x6c/0xb0
> >  [<b0104807>] common_interrupt+0x23/0x28
> >  [<b0420000>] xt_tcpudp_init+0x0/0x10
> >  [<b0102c9a>] default_idle+0x2a/0x40
> >  [<b01023d3>] cpu_idle+0x43/0x70
> >  [<b0404b25>] start_kernel+0x215/0x2a0
> >  [<b0404450>] unknown_bootoption+0x0/0x260
>
> The last message means some how frame was received with checksum for count
> wrong. I have only seen it when coalescing is messed up.
>
> I ran for 2+ days with the patch, and only 20min without. Usually my ISP connection
> gives up after that because of crappy DSL box, and that makes DNS not work.

It wedged when I was copying a few GBs of data from my server to a
local disk at the time, and running rsync over ssh on a large file on
my server to my laptop's disk.

This would be the typical load that would cause the NIC to lockup from
missing an IRQ or otherwise, however, it did feel like the new code
didn't un-wedge the Yukon-EC's bus master unit.

What other tricks can be used to reset the Yukon-EC's bus master unit?

I'll try the read32(B0_Y2_SP_LISR) trick, as before.

Daniel
-- 
Daniel J Blueman

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-11 15:43             ` Daniel J Blueman
@ 2007-07-11 21:39               ` Daniel J Blueman
  2007-07-11 21:45                 ` Stephen Hemminger
  0 siblings, 1 reply; 17+ messages in thread
From: Daniel J Blueman @ 2007-07-11 21:39 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: Linux Netdev

On 11/07/07, Daniel J Blueman <daniel.blueman@gmail.com> wrote:
> > > On 05/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > > > Well, it didn't fix my test, but it made it better.  The following seemed
> > > > to work longer...
> > > >
> > > > --- a/drivers/net/sky2.c        2007-07-05 09:09:45.000000000 -0700
> > > > +++ b/drivers/net/sky2.c        2007-07-05 09:09:51.000000000 -0700
> > > > @@ -2490,6 +2490,13 @@ static int sky2_poll(struct net_device *
> > > >
> > > >         work_done = sky2_status_intr(hw, work_limit);
> > > >         if (work_done < work_limit) {
> > > > +               /* Bug/Errata workaround?
> > > > +                * Need to kick the TX irq moderation timer.
> > > > +                */
> > > > +               if (sky2_read8(hw, STAT_TX_TIMER_CTRL) == TIM_START) {
> > > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_STOP);
> > > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_START);
> > > > +               }
> > > >                 netif_rx_complete(dev0);
> > > >
> > > >                 /* end of interrupt, re-enables also acts as I/O synchronization */
> > >
> > > I spoke too soon on this. With the above patch on 2.6.22-rc7, it
> > > failed much sooner than the previous patch with the
> > > read32(B0_Y2_SP_LISR); I'll try to reproduce with the older patch.
> > >
> > > Note the ifconfig error/dropped/frame count at the time of failure:
[snip]
> > The last message means some how frame was received with checksum for count
> > wrong. I have only seen it when coalescing is messed up.
> >
> > I ran for 2+ days with the patch, and only 20min without. Usually my ISP connection
> > gives up after that because of crappy DSL box, and that makes DNS not work.
>
> It wedged when I was copying a few GBs of data from my server to a
> local disk at the time, and running rsync over ssh on a large file on
> my server to my laptop's disk.
>
> This would be the typical load that would cause the NIC to lockup from
> missing an IRQ or otherwise, however, it did feel like the new code
> didn't un-wedge the Yukon-EC's bus master unit.
>
> What other tricks can be used to reset the Yukon-EC's bus master unit?
>
> I'll try the read32(B0_Y2_SP_LISR) trick, as before.

Nope, this still locks up as you found.

I have a reliable reproducer:

1. export directory over NFS TCP on server
2. mount directory on client
3. run 'iozone -a' in directory on client

I'm reproducing this with NFSv4 (with callbacks working) with 1500
octet MTU with one client, all gigabit. It would be good to hear if
you can reproduce the problem there.

Daniel
-- 
Daniel J Blueman

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-11 21:39               ` Daniel J Blueman
@ 2007-07-11 21:45                 ` Stephen Hemminger
  2007-07-11 22:21                   ` Daniel J Blueman
  0 siblings, 1 reply; 17+ messages in thread
From: Stephen Hemminger @ 2007-07-11 21:45 UTC (permalink / raw)
  To: Daniel J Blueman; +Cc: Linux Netdev

On Wed, 11 Jul 2007 22:39:49 +0100
"Daniel J Blueman" <daniel.blueman@gmail.com> wrote:

> On 11/07/07, Daniel J Blueman <daniel.blueman@gmail.com> wrote:
> > > > On 05/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > > > > Well, it didn't fix my test, but it made it better.  The following seemed
> > > > > to work longer...
> > > > >
> > > > > --- a/drivers/net/sky2.c        2007-07-05 09:09:45.000000000 -0700
> > > > > +++ b/drivers/net/sky2.c        2007-07-05 09:09:51.000000000 -0700
> > > > > @@ -2490,6 +2490,13 @@ static int sky2_poll(struct net_device *
> > > > >
> > > > >         work_done = sky2_status_intr(hw, work_limit);
> > > > >         if (work_done < work_limit) {
> > > > > +               /* Bug/Errata workaround?
> > > > > +                * Need to kick the TX irq moderation timer.
> > > > > +                */
> > > > > +               if (sky2_read8(hw, STAT_TX_TIMER_CTRL) == TIM_START) {
> > > > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_STOP);
> > > > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_START);
> > > > > +               }
> > > > >                 netif_rx_complete(dev0);
> > > > >
> > > > >                 /* end of interrupt, re-enables also acts as I/O synchronization */
> > > >
> > > > I spoke too soon on this. With the above patch on 2.6.22-rc7, it
> > > > failed much sooner than the previous patch with the
> > > > read32(B0_Y2_SP_LISR); I'll try to reproduce with the older patch.
> > > >
> > > > Note the ifconfig error/dropped/frame count at the time of failure:
> [snip]
> > > The last message means some how frame was received with checksum for count
> > > wrong. I have only seen it when coalescing is messed up.
> > >
> > > I ran for 2+ days with the patch, and only 20min without. Usually my ISP connection
> > > gives up after that because of crappy DSL box, and that makes DNS not work.
> >
> > It wedged when I was copying a few GBs of data from my server to a
> > local disk at the time, and running rsync over ssh on a large file on
> > my server to my laptop's disk.
> >
> > This would be the typical load that would cause the NIC to lockup from
> > missing an IRQ or otherwise, however, it did feel like the new code
> > didn't un-wedge the Yukon-EC's bus master unit.
> >
> > What other tricks can be used to reset the Yukon-EC's bus master unit?
> >
> > I'll try the read32(B0_Y2_SP_LISR) trick, as before.
> 
> Nope, this still locks up as you found.
> 
> I have a reliable reproducer:
> 
> 1. export directory over NFS TCP on server
> 2. mount directory on client
> 3. run 'iozone -a' in directory on client
> 
> I'm reproducing this with NFSv4 (with callbacks working) with 1500
> octet MTU with one client, all gigabit. It would be good to hear if
> you can reproduce the problem there.
> 
> Daniel

Please try again with post 2.6.22 git version (1.16)?

-- 
Stephen Hemminger <shemminger@linux-foundation.org>

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-11 21:45                 ` Stephen Hemminger
@ 2007-07-11 22:21                   ` Daniel J Blueman
  2007-07-11 22:55                     ` Daniel J Blueman
  0 siblings, 1 reply; 17+ messages in thread
From: Daniel J Blueman @ 2007-07-11 22:21 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: Linux Netdev

On 11/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> On Wed, 11 Jul 2007 22:39:49 +0100
> "Daniel J Blueman" <daniel.blueman@gmail.com> wrote:
>
> > On 11/07/07, Daniel J Blueman <daniel.blueman@gmail.com> wrote:
> > > > > On 05/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > > > > > Well, it didn't fix my test, but it made it better.  The following seemed
> > > > > > to work longer...
> > > > > >
> > > > > > --- a/drivers/net/sky2.c        2007-07-05 09:09:45.000000000 -0700
> > > > > > +++ b/drivers/net/sky2.c        2007-07-05 09:09:51.000000000 -0700
> > > > > > @@ -2490,6 +2490,13 @@ static int sky2_poll(struct net_device *
> > > > > >
> > > > > >         work_done = sky2_status_intr(hw, work_limit);
> > > > > >         if (work_done < work_limit) {
> > > > > > +               /* Bug/Errata workaround?
> > > > > > +                * Need to kick the TX irq moderation timer.
> > > > > > +                */
> > > > > > +               if (sky2_read8(hw, STAT_TX_TIMER_CTRL) == TIM_START) {
> > > > > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_STOP);
> > > > > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_START);
> > > > > > +               }
> > > > > >                 netif_rx_complete(dev0);
> > > > > >
> > > > > >                 /* end of interrupt, re-enables also acts as I/O synchronization */
> > > > >
> > > > > I spoke too soon on this. With the above patch on 2.6.22-rc7, it
> > > > > failed much sooner than the previous patch with the
> > > > > read32(B0_Y2_SP_LISR); I'll try to reproduce with the older patch.
> > > > >
> > > > > Note the ifconfig error/dropped/frame count at the time of failure:
> > [snip]
> > > > The last message means some how frame was received with checksum for count
> > > > wrong. I have only seen it when coalescing is messed up.
> > > >
> > > > I ran for 2+ days with the patch, and only 20min without. Usually my ISP connection
> > > > gives up after that because of crappy DSL box, and that makes DNS not work.
> > >
> > > It wedged when I was copying a few GBs of data from my server to a
> > > local disk at the time, and running rsync over ssh on a large file on
> > > my server to my laptop's disk.
> > >
> > > This would be the typical load that would cause the NIC to lockup from
> > > missing an IRQ or otherwise, however, it did feel like the new code
> > > didn't un-wedge the Yukon-EC's bus master unit.
> > >
> > > What other tricks can be used to reset the Yukon-EC's bus master unit?
> > >
> > > I'll try the read32(B0_Y2_SP_LISR) trick, as before.
> >
> > Nope, this still locks up as you found.
> >
> > I have a reliable reproducer:
> >
> > 1. export directory over NFS TCP on server
> > 2. mount directory on client
> > 3. run 'iozone -a' in directory on client
> >
> > I'm reproducing this with NFSv4 (with callbacks working) with 1500
> > octet MTU with one client, all gigabit. It would be good to hear if
> > you can reproduce the problem there.
> >
> > Daniel
>
> Please try again with post 2.6.22 git version (1.16)?

Reproduced with 2.6.22 w/ sky2 1.16 from git. We observe this
characteristic failure on the NFS server (always around 2-3GB of
transmit):

$ ifconfig lan0
lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
          inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:24007220 errors:1 dropped:1 overruns:0 frame:1
          TX packets:13886495 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:171026170 (163.1 MiB)  TX bytes:2262910580 (2.1 GiB)
          Interrupt:16

I'll rebuild with debugfs and grab the debug you've exported.

Daniel
-- 
Daniel J Blueman

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-11 22:21                   ` Daniel J Blueman
@ 2007-07-11 22:55                     ` Daniel J Blueman
  2007-07-12  1:46                       ` Stephen Hemminger
  0 siblings, 1 reply; 17+ messages in thread
From: Daniel J Blueman @ 2007-07-11 22:55 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: Linux Netdev

On 11/07/07, Daniel J Blueman <daniel.blueman@gmail.com> wrote:
> On 11/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > On Wed, 11 Jul 2007 22:39:49 +0100
> > "Daniel J Blueman" <daniel.blueman@gmail.com> wrote:
> >
> > > On 11/07/07, Daniel J Blueman <daniel.blueman@gmail.com> wrote:
> > > > > > On 05/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > > > > > > Well, it didn't fix my test, but it made it better.  The following seemed
> > > > > > > to work longer...
> > > > > > >
> > > > > > > --- a/drivers/net/sky2.c        2007-07-05 09:09:45.000000000 -0700
> > > > > > > +++ b/drivers/net/sky2.c        2007-07-05 09:09:51.000000000 -0700
> > > > > > > @@ -2490,6 +2490,13 @@ static int sky2_poll(struct net_device *
> > > > > > >
> > > > > > >         work_done = sky2_status_intr(hw, work_limit);
> > > > > > >         if (work_done < work_limit) {
> > > > > > > +               /* Bug/Errata workaround?
> > > > > > > +                * Need to kick the TX irq moderation timer.
> > > > > > > +                */
> > > > > > > +               if (sky2_read8(hw, STAT_TX_TIMER_CTRL) == TIM_START) {
> > > > > > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_STOP);
> > > > > > > +                       sky2_write8(hw, STAT_TX_TIMER_CTRL, TIM_START);
> > > > > > > +               }
> > > > > > >                 netif_rx_complete(dev0);
> > > > > > >
> > > > > > >                 /* end of interrupt, re-enables also acts as I/O synchronization */
> > > > > >
> > > > > > I spoke too soon on this. With the above patch on 2.6.22-rc7, it
> > > > > > failed much sooner than the previous patch with the
> > > > > > read32(B0_Y2_SP_LISR); I'll try to reproduce with the older patch.
> > > > > >
> > > > > > Note the ifconfig error/dropped/frame count at the time of failure:
> > > [snip]
> > > > > The last message means some how frame was received with checksum for count
> > > > > wrong. I have only seen it when coalescing is messed up.
> > > > >
> > > > > I ran for 2+ days with the patch, and only 20min without. Usually my ISP connection
> > > > > gives up after that because of crappy DSL box, and that makes DNS not work.
> > > >
> > > > It wedged when I was copying a few GBs of data from my server to a
> > > > local disk at the time, and running rsync over ssh on a large file on
> > > > my server to my laptop's disk.
> > > >
> > > > This would be the typical load that would cause the NIC to lockup from
> > > > missing an IRQ or otherwise, however, it did feel like the new code
> > > > didn't un-wedge the Yukon-EC's bus master unit.
> > > >
> > > > What other tricks can be used to reset the Yukon-EC's bus master unit?
> > > >
> > > > I'll try the read32(B0_Y2_SP_LISR) trick, as before.
> > >
> > > Nope, this still locks up as you found.
> > >
> > > I have a reliable reproducer:
> > >
> > > 1. export directory over NFS TCP on server
> > > 2. mount directory on client
> > > 3. run 'iozone -a' in directory on client
> > >
> > > I'm reproducing this with NFSv4 (with callbacks working) with 1500
> > > octet MTU with one client, all gigabit. It would be good to hear if
> > > you can reproduce the problem there.
> > >
> > > Daniel
> >
> > Please try again with post 2.6.22 git version (1.16)?
>
> Reproduced with 2.6.22 w/ sky2 1.16 from git. We observe this
> characteristic failure on the NFS server (always around 2-3GB of
> transmit):
>
> $ ifconfig lan0
> lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
>           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:24007220 errors:1 dropped:1 overruns:0 frame:1
>           TX packets:13886495 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:1000
>           RX bytes:171026170 (163.1 MiB)  TX bytes:2262910580 (2.1 GiB)
>           Interrupt:16
>
> I'll rebuild with debugfs and grab the debug you've exported.

In quiescent state [1] and in failure state [2]. This time, 2 framing
failures [3]; took 3.6GB of transmit to hit the window.

Daniel

--- [1]

# cat sky2/lan0
IRQ src=0 mask=c000001d control=0
Status ring (empty)
Tx ring pending=191...191 report=191 done=191

Rx ring hw get=956 put=61 last=1023

--- [2]

# cat sky2/lan0
IRQ src=0 mask=c000001d control=0
Status ring (empty)
Tx ring pending=251...251 report=251 done=251

Rx ring hw get=1020 put=160 last=1023

--- [3]

$ ifconfig lan0
lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
          inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:13304841 errors:1 dropped:1 overruns:0 frame:2
          TX packets:7493765 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:232720755 (221.9 MiB)  TX bytes:3964088142 (3.6 GiB)
          Interrupt:16
-- 
Daniel J Blueman

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-11 22:55                     ` Daniel J Blueman
@ 2007-07-12  1:46                       ` Stephen Hemminger
  2007-07-12 21:29                         ` Daniel J Blueman
  0 siblings, 1 reply; 17+ messages in thread
From: Stephen Hemminger @ 2007-07-12  1:46 UTC (permalink / raw)
  To: Daniel J Blueman; +Cc: Linux Netdev

On Wed, 11 Jul 2007 23:55:29 +0100
"Daniel J Blueman" <daniel.blueman@gmail.com> wrote:

> > >
> > > Please try again with post 2.6.22 git version (1.16)?
> >
> > Reproduced with 2.6.22 w/ sky2 1.16 from git. We observe this
> > characteristic failure on the NFS server (always around 2-3GB of
> > transmit):
> >
> > $ ifconfig lan0
> > lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
> >           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
> >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> >           RX packets:24007220 errors:1 dropped:1 overruns:0 frame:1
> >           TX packets:13886495 errors:0 dropped:0 overruns:0 carrier:0
> >           collisions:0 txqueuelen:1000
> >           RX bytes:171026170 (163.1 MiB)  TX bytes:2262910580 (2.1 GiB)
> >           Interrupt:16
> >
> > I'll rebuild with debugfs and grab the debug you've exported.
> 
> In quiescent state [1] and in failure state [2]. This time, 2 framing
> failures [3]; took 3.6GB of transmit to hit the window.

Since the IRQ workaround has a timeout of 100ms. I observed cases where
the TCP connection dropped (because of lost packets), but the network device
then recovered.  Can you ping the other side after it hangs?  Or reconnect?

Ifconfig lumps a bunch of different errors together so it can confuse the issue.
Preference is for:
 	ip -s -s link show eth0
or 
	grep -v '^0' /sys/class/net/eth0/statistics/*

If the framing error does reproduce with the hang, perhaps the chip needs some
receive flush logic to recover. Receive errors normally put a message in syslog
output, did you look there?

> Daniel
> 
> --- [1]
> 
> # cat sky2/lan0
> IRQ src=0 mask=c000001d control=0
> Status ring (empty)
> Tx ring pending=191...191 report=191 done=191
> 
> Rx ring hw get=956 put=61 last=1023
> 
> --- [2]
> 
> # cat sky2/lan0
> IRQ src=0 mask=c000001d control=0
> Status ring (empty)
> Tx ring pending=251...251 report=251 done=251
> 
> Rx ring hw get=1020 put=160 last=1023
> 
> --- [3]
> 
> $ ifconfig lan0
> lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
>           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:13304841 errors:1 dropped:1 overruns:0 frame:2
>           TX packets:7493765 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:1000
>           RX bytes:232720755 (221.9 MiB)  TX bytes:3964088142 (3.6 GiB)
>           Interrupt:16

You aren't hung because of lost IRQ. When than happens the debugfs output will have
a bunch of Tx packets stuck (not cleaned up), and Status messages, and receive packets.

-- 
Stephen Hemminger <shemminger@linux-foundation.org>

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-12  1:46                       ` Stephen Hemminger
@ 2007-07-12 21:29                         ` Daniel J Blueman
  2007-07-12 21:43                           ` Stephen Hemminger
  0 siblings, 1 reply; 17+ messages in thread
From: Daniel J Blueman @ 2007-07-12 21:29 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: Linux Netdev

On 12/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> On Wed, 11 Jul 2007 23:55:29 +0100
> "Daniel J Blueman" <daniel.blueman@gmail.com> wrote:
>
> > > >
> > > > Please try again with post 2.6.22 git version (1.16)?
> > >
> > > Reproduced with 2.6.22 w/ sky2 1.16 from git. We observe this
> > > characteristic failure on the NFS server (always around 2-3GB of
> > > transmit):
> > >
> > > $ ifconfig lan0
> > > lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
> > >           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
> > >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> > >           RX packets:24007220 errors:1 dropped:1 overruns:0 frame:1
> > >           TX packets:13886495 errors:0 dropped:0 overruns:0 carrier:0
> > >           collisions:0 txqueuelen:1000
> > >           RX bytes:171026170 (163.1 MiB)  TX bytes:2262910580 (2.1 GiB)
> > >           Interrupt:16
> > >
> > > I'll rebuild with debugfs and grab the debug you've exported.
> >
> > In quiescent state [1] and in failure state [2]. This time, 2 framing
> > failures [3]; took 3.6GB of transmit to hit the window.
>
> Since the IRQ workaround has a timeout of 100ms. I observed cases where
> the TCP connection dropped (because of lost packets), but the network device
> then recovered.  Can you ping the other side after it hangs?  Or reconnect?
>
> Ifconfig lumps a bunch of different errors together so it can confuse the issue.
> Preference is for:
>         ip -s -s link show eth0
> or
>         grep -v '^0' /sys/class/net/eth0/statistics/*
>
> If the framing error does reproduce with the hang, perhaps the chip needs some
> receive flush logic to recover. Receive errors normally put a message in syslog
> output, did you look there?
>
> > Daniel
> >
> > --- [1]
> >
> > # cat sky2/lan0
> > IRQ src=0 mask=c000001d control=0
> > Status ring (empty)
> > Tx ring pending=191...191 report=191 done=191
> >
> > Rx ring hw get=956 put=61 last=1023
> >
> > --- [2]
> >
> > # cat sky2/lan0
> > IRQ src=0 mask=c000001d control=0
> > Status ring (empty)
> > Tx ring pending=251...251 report=251 done=251
> >
> > Rx ring hw get=1020 put=160 last=1023
> >
> > --- [3]
> >
> > $ ifconfig lan0
> > lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
> >           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
> >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> >           RX packets:13304841 errors:1 dropped:1 overruns:0 frame:2
> >           TX packets:7493765 errors:0 dropped:0 overruns:0 carrier:0
> >           collisions:0 txqueuelen:1000
> >           RX bytes:232720755 (221.9 MiB)  TX bytes:3964088142 (3.6 GiB)
> >           Interrupt:16
>
> You aren't hung because of lost IRQ. When than happens the debugfs output will have
> a bunch of Tx packets stuck (not cleaned up), and Status messages, and receive packets.

I'll grab the above info when I next get chance.

The vendor driver recovery process may be worthwhile taking a look at;
I guess you've seen the code near the bottom of skge.c (under 'case
SK_DRV_RECOVER')? The driver kicks the chip with
SK_PNMI_EVT_XMAC_RESET and calls SkYuk2RestartRxBmu - perhaps
something like this sequence is needed for a more targetted approach?

I'll also confirm if your driver is detecting the hang I'm seeing, or not.

Daniel
-- 
Daniel J Blueman

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-12 21:29                         ` Daniel J Blueman
@ 2007-07-12 21:43                           ` Stephen Hemminger
  2007-07-13  8:53                             ` Daniel J Blueman
  0 siblings, 1 reply; 17+ messages in thread
From: Stephen Hemminger @ 2007-07-12 21:43 UTC (permalink / raw)
  To: Daniel J Blueman; +Cc: Linux Netdev

On Thu, 12 Jul 2007 22:29:50 +0100
"Daniel J Blueman" <daniel.blueman@gmail.com> wrote:

> On 12/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > On Wed, 11 Jul 2007 23:55:29 +0100
> > "Daniel J Blueman" <daniel.blueman@gmail.com> wrote:
> >
> > > > >
> > > > > Please try again with post 2.6.22 git version (1.16)?
> > > >
> > > > Reproduced with 2.6.22 w/ sky2 1.16 from git. We observe this
> > > > characteristic failure on the NFS server (always around 2-3GB of
> > > > transmit):
> > > >
> > > > $ ifconfig lan0
> > > > lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
> > > >           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
> > > >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> > > >           RX packets:24007220 errors:1 dropped:1 overruns:0 frame:1
> > > >           TX packets:13886495 errors:0 dropped:0 overruns:0 carrier:0
> > > >           collisions:0 txqueuelen:1000
> > > >           RX bytes:171026170 (163.1 MiB)  TX bytes:2262910580 (2.1 GiB)
> > > >           Interrupt:16
> > > >
> > > > I'll rebuild with debugfs and grab the debug you've exported.
> > >
> > > In quiescent state [1] and in failure state [2]. This time, 2 framing
> > > failures [3]; took 3.6GB of transmit to hit the window.
> >
> > Since the IRQ workaround has a timeout of 100ms. I observed cases where
> > the TCP connection dropped (because of lost packets), but the network device
> > then recovered.  Can you ping the other side after it hangs?  Or reconnect?
> >
> > Ifconfig lumps a bunch of different errors together so it can confuse the issue.
> > Preference is for:
> >         ip -s -s link show eth0
> > or
> >         grep -v '^0' /sys/class/net/eth0/statistics/*
> >
> > If the framing error does reproduce with the hang, perhaps the chip needs some
> > receive flush logic to recover. Receive errors normally put a message in syslog
> > output, did you look there?
> >
> > > Daniel
> > >
> > > --- [1]
> > >
> > > # cat sky2/lan0
> > > IRQ src=0 mask=c000001d control=0
> > > Status ring (empty)
> > > Tx ring pending=191...191 report=191 done=191
> > >
> > > Rx ring hw get=956 put=61 last=1023
> > >
> > > --- [2]
> > >
> > > # cat sky2/lan0
> > > IRQ src=0 mask=c000001d control=0
> > > Status ring (empty)
> > > Tx ring pending=251...251 report=251 done=251
> > >
> > > Rx ring hw get=1020 put=160 last=1023
> > >
> > > --- [3]
> > >
> > > $ ifconfig lan0
> > > lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
> > >           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
> > >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> > >           RX packets:13304841 errors:1 dropped:1 overruns:0 frame:2
> > >           TX packets:7493765 errors:0 dropped:0 overruns:0 carrier:0
> > >           collisions:0 txqueuelen:1000
> > >           RX bytes:232720755 (221.9 MiB)  TX bytes:3964088142 (3.6 GiB)
> > >           Interrupt:16
> >
> > You aren't hung because of lost IRQ. When than happens the debugfs output will have
> > a bunch of Tx packets stuck (not cleaned up), and Status messages, and receive packets.
> 
> I'll grab the above info when I next get chance.
> 
> The vendor driver recovery process may be worthwhile taking a look at;
> I guess you've seen the code near the bottom of skge.c (under 'case
> SK_DRV_RECOVER')? The driver kicks the chip with
> SK_PNMI_EVT_XMAC_RESET and calls SkYuk2RestartRxBmu - perhaps
> something like this sequence is needed for a more targetted approach?

That code triggers (falsely) on an idle or barely active link. It won't work.
It is covering over a bunch of problems in the vendor driver that like improper
flow control.

-- 
Stephen Hemminger <shemminger@linux-foundation.org>

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: sky2 hangs without any messages
  2007-07-12 21:43                           ` Stephen Hemminger
@ 2007-07-13  8:53                             ` Daniel J Blueman
  0 siblings, 0 replies; 17+ messages in thread
From: Daniel J Blueman @ 2007-07-13  8:53 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: Linux Netdev

On 12/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> On Thu, 12 Jul 2007 22:29:50 +0100
> "Daniel J Blueman" <daniel.blueman@gmail.com> wrote:
>
> > On 12/07/07, Stephen Hemminger <shemminger@linux-foundation.org> wrote:
> > > On Wed, 11 Jul 2007 23:55:29 +0100
> > > "Daniel J Blueman" <daniel.blueman@gmail.com> wrote:
> > >
> > > > > >
> > > > > > Please try again with post 2.6.22 git version (1.16)?
> > > > >
> > > > > Reproduced with 2.6.22 w/ sky2 1.16 from git. We observe this
> > > > > characteristic failure on the NFS server (always around 2-3GB of
> > > > > transmit):
> > > > >
> > > > > $ ifconfig lan0
> > > > > lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
> > > > >           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
> > > > >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> > > > >           RX packets:24007220 errors:1 dropped:1 overruns:0 frame:1
> > > > >           TX packets:13886495 errors:0 dropped:0 overruns:0 carrier:0
> > > > >           collisions:0 txqueuelen:1000
> > > > >           RX bytes:171026170 (163.1 MiB)  TX bytes:2262910580 (2.1 GiB)
> > > > >           Interrupt:16
> > > > >
> > > > > I'll rebuild with debugfs and grab the debug you've exported.
> > > >
> > > > In quiescent state [1] and in failure state [2]. This time, 2 framing
> > > > failures [3]; took 3.6GB of transmit to hit the window.
> > >
> > > Since the IRQ workaround has a timeout of 100ms. I observed cases where
> > > the TCP connection dropped (because of lost packets), but the network device
> > > then recovered.  Can you ping the other side after it hangs?  Or reconnect?
> > >
> > > Ifconfig lumps a bunch of different errors together so it can confuse the issue.
> > > Preference is for:
> > >         ip -s -s link show eth0
> > > or
> > >         grep -v '^0' /sys/class/net/eth0/statistics/*
> > >
> > > If the framing error does reproduce with the hang, perhaps the chip needs some
> > > receive flush logic to recover. Receive errors normally put a message in syslog
> > > output, did you look there?
> > >
> > > > Daniel
> > > >
> > > > --- [1]
> > > >
> > > > # cat sky2/lan0
> > > > IRQ src=0 mask=c000001d control=0
> > > > Status ring (empty)
> > > > Tx ring pending=191...191 report=191 done=191
> > > >
> > > > Rx ring hw get=956 put=61 last=1023
> > > >
> > > > --- [2]
> > > >
> > > > # cat sky2/lan0
> > > > IRQ src=0 mask=c000001d control=0
> > > > Status ring (empty)
> > > > Tx ring pending=251...251 report=251 done=251
> > > >
> > > > Rx ring hw get=1020 put=160 last=1023
> > > >
> > > > --- [3]
> > > >
> > > > $ ifconfig lan0
> > > > lan0      Link encap:Ethernet  HWaddr 00:03:2D:05:9C:27
> > > >           inet addr:192.168.0.250  Bcast:192.168.0.255  Mask:255.255.255.0
> > > >           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
> > > >           RX packets:13304841 errors:1 dropped:1 overruns:0 frame:2
> > > >           TX packets:7493765 errors:0 dropped:0 overruns:0 carrier:0
> > > >           collisions:0 txqueuelen:1000
> > > >           RX bytes:232720755 (221.9 MiB)  TX bytes:3964088142 (3.6 GiB)
> > > >           Interrupt:16
> > >
> > > You aren't hung because of lost IRQ. When than happens the debugfs output will have
> > > a bunch of Tx packets stuck (not cleaned up), and Status messages, and receive packets.
> >
> > I'll grab the above info when I next get chance.
> >
> > The vendor driver recovery process may be worthwhile taking a look at;
> > I guess you've seen the code near the bottom of skge.c (under 'case
> > SK_DRV_RECOVER')? The driver kicks the chip with
> > SK_PNMI_EVT_XMAC_RESET and calls SkYuk2RestartRxBmu - perhaps
> > something like this sequence is needed for a more targetted approach?
>
> That code triggers (falsely) on an idle or barely active link. It won't work.
> It is covering over a bunch of problems in the vendor driver that like improper
> flow control.

Yes. Although my point was about how it resets the relevant parts of
the chip; the OS just sees a netif_stop_queue and a netif_wake_queue,
rather than marking the interface down etc.

Daniel
-- 
Daniel J Blueman

^ permalink raw reply	[flat|nested] 17+ messages in thread

end of thread, other threads:[~2007-07-13  8:53 UTC | newest]

Thread overview: 17+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2007-05-23  7:54 sky2 hangs without any messages Tino Keitel
2007-05-23 14:50 ` Stephen Hemminger
2007-05-23 15:01   ` Tino Keitel
2007-05-23 15:49     ` Stephen Hemminger
2007-06-27 17:31 ` Stephen Hemminger
     [not found] <6278d2220707020315q7c3df1cci5c7bb52316ad6081@mail.gmail.com>
2007-07-02 10:17 ` Daniel J Blueman
     [not found] ` <20070703123546.5d41410b@freepuppy.localdomain.hemminger.net>
     [not found]   ` <6278d2220707031402o7b13e45egc564076a1114b6f5@mail.gmail.com>
     [not found]     ` <6278d2220707050609s3579915bo50cf259ba73712f4@mail.gmail.com>
     [not found]       ` <20070705101046.542c1f8e@freepuppy.localdomain.hemminger.net>
2007-07-11 10:15         ` Daniel J Blueman
2007-07-11 15:27           ` Stephen Hemminger
2007-07-11 15:43             ` Daniel J Blueman
2007-07-11 21:39               ` Daniel J Blueman
2007-07-11 21:45                 ` Stephen Hemminger
2007-07-11 22:21                   ` Daniel J Blueman
2007-07-11 22:55                     ` Daniel J Blueman
2007-07-12  1:46                       ` Stephen Hemminger
2007-07-12 21:29                         ` Daniel J Blueman
2007-07-12 21:43                           ` Stephen Hemminger
2007-07-13  8:53                             ` Daniel J Blueman

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).