2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours

All of lore.kernel.org
 help / color / mirror / Atom feed

* 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
@ 2005-09-30  6:54 Danny ter Haar
  2005-09-30  7:13   ` Andrew Morton
  0 siblings, 1 reply; 9+ messages in thread
From: Danny ter Haar @ 2005-09-30  6:54 UTC (permalink / raw)
  To: linux-kernel

Known story:
last stable kernel for this machine is/was 2.6.12-mm1

Every 2.6.1[34] kernel panics so far.
Sometimes after 40 minutes, sometimes after 4 days.

Config/more info at:
http://newsgate.newsserver.nl/kernel/2.6.14-rc2-git7/

This time it was scsi system again which "blew-up"

Obvious difference i see between 2.6.12 en 2.6.1[34] is that the 
scsi/ethernet cards have different IRQ's set. 
If i'm correct acpi code changed in 2.6.13, right ?

Since the 2.6.12-mm1 kernel survived 3 weeks+ and gave super performance
i'm convinced it's not a hardware issue.

Just giving feedback.

Will try git8 and mm2 and of course report here when they fail.

Danny

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
  2005-09-30  6:54 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours Danny ter Haar
@ 2005-09-30  7:13   ` Andrew Morton
  0 siblings, 0 replies; 9+ messages in thread
From: Andrew Morton @ 2005-09-30  7:13 UTC (permalink / raw)
  To: Danny ter Haar; +Cc: linux-kernel, linux-scsi

dth@cistron.nl (Danny ter Haar) wrote:
>
> Known story:
> last stable kernel for this machine is/was 2.6.12-mm1
> 
> Every 2.6.1[34] kernel panics so far.
> Sometimes after 40 minutes, sometimes after 4 days.
> 
> Config/more info at:
> http://newsgate.newsserver.nl/kernel/2.6.14-rc2-git7/

The aic79xx driver shat itself.

The log buffer starts with

scsi1 (4:0): rejecting I/O to offline device
scsi1 (4:0): rejecting I/O to offline device
scsi1 (4:0): rejecting I/O to offline device

So we've probably lost the info which will tell us how the problems
started.  A serial console would be nice.

> This time it was scsi system again which "blew-up"
> 
> Obvious difference i see between 2.6.12 en 2.6.1[34] is that the 
> scsi/ethernet cards have different IRQ's set. 
> If i'm correct acpi code changed in 2.6.13, right ?
> 
> Since the 2.6.12-mm1 kernel survived 3 weeks+ and gave super performance
> i'm convinced it's not a hardware issue.
> 
> Just giving feedback.
> 
> Will try git8 and mm2 and of course report here when they fail.

Are all the failures due to the aic79xx driver failing in this manner?  If
not then please report the different failures separately, thanks.

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
@ 2005-09-30  7:13   ` Andrew Morton
  0 siblings, 0 replies; 9+ messages in thread
From: Andrew Morton @ 2005-09-30  7:13 UTC (permalink / raw)
  To: Danny ter Haar; +Cc: linux-kernel, linux-scsi

dth@cistron.nl (Danny ter Haar) wrote:
>
> Known story:
> last stable kernel for this machine is/was 2.6.12-mm1
> 
> Every 2.6.1[34] kernel panics so far.
> Sometimes after 40 minutes, sometimes after 4 days.
> 
> Config/more info at:
> http://newsgate.newsserver.nl/kernel/2.6.14-rc2-git7/

The aic79xx driver shat itself.

The log buffer starts with

scsi1 (4:0): rejecting I/O to offline device
scsi1 (4:0): rejecting I/O to offline device
scsi1 (4:0): rejecting I/O to offline device

So we've probably lost the info which will tell us how the problems
started.  A serial console would be nice.

> This time it was scsi system again which "blew-up"
> 
> Obvious difference i see between 2.6.12 en 2.6.1[34] is that the 
> scsi/ethernet cards have different IRQ's set. 
> If i'm correct acpi code changed in 2.6.13, right ?
> 
> Since the 2.6.12-mm1 kernel survived 3 weeks+ and gave super performance
> i'm convinced it's not a hardware issue.
> 
> Just giving feedback.
> 
> Will try git8 and mm2 and of course report here when they fail.

Are all the failures due to the aic79xx driver failing in this manner?  If
not then please report the different failures separately, thanks.

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
  2005-09-30  7:13   ` Andrew Morton
  (?)
@ 2005-09-30  7:39   ` Danny ter Haar
  2005-09-30 12:44     ` Sander
  -1 siblings, 1 reply; 9+ messages in thread
From: Danny ter Haar @ 2005-09-30  7:39 UTC (permalink / raw)
  To: Andrew Morton; +Cc: Danny ter Haar, linux-kernel, linux-scsi

Quoting Andrew Morton (akpm@osdl.org):
> So we've probably lost the info which will tell us how the problems
> started.  A serial console would be nice.


This is from serial console.
Unfortunatly it's a portmaster2 which has no buffer.
What i do is start a screen, do a telnet to the portmaster
and attach the serial console. I can't go back anyfurther
than this since the output of the new kernel booting replaced it.
Mayby i can tell screen to have more lines of history ?! 

> Are all the failures due to the aic79xx driver failing in this manner?  If
> not then please report the different failures separately, thanks.

So far, all new kernels indeed barfed with scsi errors.
It somehow seems to miss a scsi event and a chain of events occur
which also sometimes lead to shutdown ethernet interfaces.

This is the difference in IRQ settings i talked about earlier:

Linux 2.6.14-rc2-git7 (root@newsgate) (gcc 4.0.2 ) #1 1CPU
irq  0:   3736032 timer                 irq 12:         3
irq  1:         8 i8042                 irq 16:   4519576 aic79xx
irq  4:       449 serial                irq 17:  34901765 aic79xx, eth3
irq  9:         0 acpi                  irq 18:  89100231 acenic

vs

Linux 2.6.12-mm1 (root@newsgate) (gcc 3.3.6 ) #1 Mon Jun 20 11:13:18 CEST 2005 1CPU [newsgate.(none)]
irq  0:   3822422 timer                 irq 12:         3
irq  1:         8 i8042                 irq 16:  82787217 acenic
irq  4:       353 serial                irq 17:   4194166 aic79xx
irq  9:         0 acpi                  irq 18:  28628408 aic79xx, eth3





-- 
Police aren't effective because of their uniforms, badges, guns, or
nightsticks, they're effective because of their radios [seen on /.]

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
  2005-09-30  7:39   ` Danny ter Haar
@ 2005-09-30 12:44     ` Sander
  2005-09-30 16:22       ` Danny ter Haar
  0 siblings, 1 reply; 9+ messages in thread
From: Sander @ 2005-09-30 12:44 UTC (permalink / raw)
  To: Danny ter Haar; +Cc: Andrew Morton, linux-kernel, linux-scsi

Danny ter Haar wrote (ao):
> Quoting Andrew Morton (akpm@osdl.org):
> > So we've probably lost the info which will tell us how the problems
> > started.  A serial console would be nice.
> 
> This is from serial console.
> Unfortunatly it's a portmaster2 which has no buffer.
> What i do is start a screen, do a telnet to the portmaster
> and attach the serial console. I can't go back anyfurther
> than this since the output of the new kernel booting replaced it.
> Mayby i can tell screen to have more lines of history ?! 

This might help?

>From 'man screen':

       C-a H       (log)         Begins/ends logging of the current window  to
                                 the file "screenlog.n".

-- 
Humilis IT Services and Solutions
http://www.humilis.net

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
  2005-09-30 12:44     ` Sander
@ 2005-09-30 16:22       ` Danny ter Haar
  0 siblings, 0 replies; 9+ messages in thread
From: Danny ter Haar @ 2005-09-30 16:22 UTC (permalink / raw)
  To: linux-scsi, linux-kernel

Sander  <sander@humilis.net> wrote:
>This might help?
>From 'man screen':
>       C-a H       (log)         Begins/ends logging of the current window  to
>                                 the file "screenlog.n".

*thanks*

done so.

If it crashes i know now at leas i will have _all_ output!

git8 stil running:
-------------
newsgate:~# procinfo
Linux 2.6.14-rc2-git8 (root@newsgate) (gcc 4.0.2 ) #1 1CPU [newsgate.(none)]

Memory:      Total        Used        Free      Shared     Buffers
Mem:       4062040     4041212       20828           0         568
Swap:            0           0           0

Bootup: Fri Sep 30 10:21:34 2005    Load average: 4.73 4.60 4.47 5/74 23214

user  :       0:57:57.56  12.1%  page in :        0
nice  :       0:08:26.32   1.8%  page out:        0
system:       2:23:25.64  29.9%  swap in :        0
idle  :       0:01:16.27   0.3%  swap out:        0
uptime:       7:59:59.89         context : 77591356

irq  0:   7195064 timer                 irq 12:         3
irq  1:         8 i8042                 irq 16:   7430483 aic79xx
irq  4:       400 serial                irq 17:  73394066 aic79xx, eth3
irq  9:         0 acpi                  irq 18: 138587870 acenic

--------------

Danny


^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
  2005-09-30  7:13   ` Andrew Morton
  (?)
  (?)
@ 2005-09-30 11:33   ` Danny ter Haar
  2005-09-30 13:04     ` Jens Laas
  -1 siblings, 1 reply; 9+ messages in thread
From: Danny ter Haar @ 2005-09-30 11:33 UTC (permalink / raw)
  To: linux-scsi, linux-kernel

Andrew Morton  <akpm@osdl.org> wrote:
>The log buffer starts with
>scsi1 (4:0): rejecting I/O to offline device
>scsi1 (4:0): rejecting I/O to offline device
>scsi1 (4:0): rejecting I/O to offline device
>So we've probably lost the info which will tell us how the problems
>started.  A serial console would be nice.

My colleque found in kern.log the real first announcement:

Sep 30 00:17:17 newsgate kernel: hw tcp v4 csum failed
Sep 30 00:20:48 newsgate kernel: hw tcp v4 csum failed
Sep 30 00:26:54 newsgate kernel: scsi1: Transmission error detected
Sep 30 00:26:54 newsgate kernel: LQISTAT1[0x8]:(LQICRCI_NLQ) LASTPHASE[0x1]:(P_DATAOUT|P_BUSFREE)
Sep 30 00:26:54 newsgate kernel: SCSISIGI[0x60]:(P_DATAIN_DT) PERRDIAG[0x4]:(CRCERR)
Sep 30 00:26:54 newsgate kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 30 00:26:54 newsgate kernel: scsi1: Dumping Card State at program address 0xf Mode 0x33
Sep 30 00:26:54 newsgate kernel: Card was paused
Sep 30 00:26:54 newsgate kernel: HS_MAILBOX[0x0] INTCTL[0xc0]:(SWTMINTEN|SWTMINTMASK)
Sep 30 00:26:54 newsgate kernel: SEQINTSTAT[0x10]:(SEQ_SWTMRTO) SAVED_MODE[0x11]
Sep 30 00:26:54 newsgate kernel: DFFSTAT[0x24]:(CURRFIFO_0|FIFO1FREE) SCSISIGI[0xb6]:(P_MESGOUT|REQI|BSYI|ATNI)
Sep 30 00:26:54 newsgate kernel: SCSIPHASE[0x4]:(MSG_OUT_PHASE) SCSIBUS[0xf7] LASTPHASE[0x1]:(P_DATAOUT|P_BUSFREE)
Sep 30 00:26:54 newsgate kernel: SCSISEQ0[0x0] SCSISEQ1[0x12]:(ENAUTOATNP|ENRSELI)
Sep 30 00:26:54 newsgate kernel: SEQCTL0[0x0] SEQINTCTL[0x0] SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0]
Sep 30 00:26:54 newsgate kernel: SSTAT0[0x2]:(SPIORDY) SSTAT1[0x19]:(REQINIT|BUSFREE|PHASEMIS)
Sep 30 00:26:54 newsgate kernel: SSTAT2[0x20]:(NONPACKREQ) SSTAT3[0x0] PERRDIAG[0x0]
Sep 30 00:26:54 newsgate kernel: SIMODE1[0xa4]:(ENSCSIPERR|ENSCSIRST|ENSELTIMO)
Sep 30 00:26:54 newsgate kernel: LQISTAT0[0x0] LQISTAT1[0x8]:(LQICRCI_NLQ) LQISTAT2[0xc0]:(LQIPHASE_OUTPKT|PACKETIZED)
Sep 30 00:26:54 newsgate kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0xe1]:(LQOSTOP0|LQOPKT)
Sep 30 00:26:54 newsgate kernel:
Sep 30 00:26:54 newsgate kernel: SCB Count = 128 CMDS_PENDING = 6 LASTSCB 0x6b CURRSCB 0x14 NEXTSCB 0xff80
Sep 30 00:26:54 newsgate kernel: qinstart = 16079 qinfifonext = 16079
Sep 30 00:26:54 newsgate kernel: QINFIFO:
Sep 30 00:26:54 newsgate kernel: WAITING_TID_QUEUES:
Sep 30 00:26:54 newsgate kernel: Pending list:
Sep 30 00:26:54 newsgate kernel:  20 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x47]
Sep 30 00:26:54 newsgate kernel: 107 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x47]
Sep 30 00:26:54 newsgate kernel:  74 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x47]
Sep 30 00:26:54 newsgate kernel:   3 FIFO_USE[0x1] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x47]
Sep 30 00:26:54 newsgate kernel:  28 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0xf7]:(TID)
Sep 30 00:26:54 newsgate kernel:  62 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0xf7]:(TID)
Sep 30 00:26:54 newsgate kernel: Total 6
Sep 30 00:26:54 newsgate kernel: Kernel Free SCB list: 116 115 105 35 111 108 29 106 13 76 112 34 17 69 84 51 122 23 87 99 43 32 91 88 75 11 92
+40 46 30 5 102 52 70 16 41 15 97 36 0 119 19 100 126 22 54 65 39 93 55 117 50 61 121 2 25 26 60 27 45 8 123 53 57 125 78 47 66 49 4 103 101 77
+24 37 72 90 82 48 79 56 86 118 1 120 59 94 73 21 58 113 64 85 89 81 18 98 96 6 12 31 95 114 7 44 14 127 124 67 33 71 109 63 68 9 104 42 10 80 83+110 38
Sep 30 00:26:54 newsgate kernel: Sequencer Complete DMA-inprog list:
Sep 30 00:26:54 newsgate kernel: Sequencer Complete list:
Sep 30 00:26:54 newsgate kernel: Sequencer DMA-Up and Complete list:
Sep 30 00:26:54 newsgate kernel:
Sep 30 00:26:54 newsgate kernel: scsi1: FIFO0 Active, LONGJMP == 0x233, SCB 0x4a
Sep 30 00:26:54 newsgate kernel: SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVEPTRS)
Sep 30 00:26:54 newsgate kernel: SEQINTSRC[0x0] DFCNTRL[0x8]:(HDMAEN) DFSTATUS[0xc8]:(HDONE|PKT_PRELOAD_AVAIL|PRELOAD_AVAIL)
Sep 30 00:26:54 newsgate kernel: SG_CACHE_SHADOW[0x50] SG_STATE[0x3]:(SEGS_AVAIL|LOADING_NEEDED)
Sep 30 00:26:54 newsgate kernel: DFFSXFRCTL[0x0] SOFFCNT[0x0] MDFFSTAT[0x46]:(DATAINFIFO|DLZERO|SHCNTNEGATIVE)
Sep 30 00:26:54 newsgate kernel: SHADDR = 0x0d65c9200, SHCNT = 0xfffe00 HADDR = 0x0d65c9000, HCNT = 0x0
Sep 30 00:26:54 newsgate kernel: CCSGCTL[0x10]:(SG_CACHE_AVAIL)
Sep 30 00:26:54 newsgate kernel: scsi1: FIFO1 Free, LONGJMP == 0x823a, SCB 0x6a
Sep 30 00:26:54 newsgate kernel: SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVEPTRS)
Sep 30 00:26:54 newsgate kernel: SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL)
Sep 30 00:26:54 newsgate kernel: SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0]
Sep 30 00:26:54 newsgate kernel: SOFFCNT[0x0] MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0
Sep 30 00:26:54 newsgate kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x0]
Sep 30 00:26:54 newsgate kernel: LQIN: 0x4 0x0 0x0 0x4a 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x28 0x0 0x0 0x0 0x2 0x0
Sep 30 00:26:54 newsgate kernel: scsi1: LQISTATE = 0x2b, LQOSTATE = 0x0, OPTIONMODE = 0x52
Sep 30 00:26:54 newsgate kernel: scsi1: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x2
Sep 30 00:26:54 newsgate kernel: SIMODE0[0xc]:(ENOVERRUN|ENIOERR)
Sep 30 00:26:54 newsgate kernel: CCSCBCTL[0x0]
Sep 30 00:26:54 newsgate kernel: scsi1: REG0 == 0x14, SINDEX = 0x150, DINDEX = 0x10a
Sep 30 00:26:54 newsgate kernel: scsi1: SCBPTR == 0x74, SCB_NEXT == 0xff40, SCB_NEXT2 == 0xff74
Sep 30 00:26:54 newsgate kernel: CDB 28 0 7 80 8 a0
Sep 30 00:26:54 newsgate kernel: STACK: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Sep 30 00:26:54 newsgate kernel: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>
Sep 30 00:26:54 newsgate kernel: LQICRC_NLQ
Sep 30 00:26:54 newsgate kernel: scsi1: Unexpected PKT busfree condition
Sep 30 00:26:54 newsgate kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 30 00:26:54 newsgate kernel: scsi1: Dumping Card State at program address 0xf Mode 0x33
Sep 30 00:26:54 newsgate kernel: Card was paused
Sep 30 00:26:54 newsgate kernel: HS_MAILBOX[0x0] INTCTL[0xc0]:(SWTMINTEN|SWTMINTMASK)
Sep 30 00:26:54 newsgate kernel: SEQINTSTAT[0x10]:(SEQ_SWTMRTO) SAVED_MODE[0x11]
Sep 30 00:26:54 newsgate kernel: DFFSTAT[0x24]:(CURRFIFO_0|FIFO1FREE) SCSISIGI[0xb6]:(P_MESGOUT|REQI|BSYI|ATNI)
Sep 30 00:26:54 newsgate kernel: SCSIPHASE[0x4]:(MSG_OUT_PHASE) SCSIBUS[0xf7] LASTPHASE[0x1]:(P_DATAOUT|P_BUSFREE)
Sep 30 00:26:54 newsgate kernel: SCSISEQ0[0x0] SCSISEQ1[0x12]:(ENAUTOATNP|ENRSELI)
Sep 30 00:26:54 newsgate kernel: SEQCTL0[0x0] SEQINTCTL[0x0] SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0]
Sep 30 00:26:54 newsgate kernel: SSTAT0[0x2]:(SPIORDY) SSTAT1[0x19]:(REQINIT|BUSFREE|PHASEMIS)
Sep 30 00:26:54 newsgate kernel: SSTAT2[0x20]:(NONPACKREQ) SSTAT3[0x0] PERRDIAG[0x0]
Sep 30 00:26:54 newsgate kernel: SIMODE1[0xa4]:(ENSCSIPERR|ENSCSIRST|ENSELTIMO)
Sep 30 00:26:54 newsgate kernel: LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0xc0]:(LQIPHASE_OUTPKT|PACKETIZED)
Sep 30 00:26:54 newsgate kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0xe1]:(LQOSTOP0|LQOPKT)
Sep 30 00:26:54 newsgate kernel:
Sep 30 00:26:54 newsgate kernel: SCB Count = 128 CMDS_PENDING = 6 LASTSCB 0x6b CURRSCB 0x14 NEXTSCB 0xff80
Sep 30 00:26:54 newsgate kernel: qinstart = 16079 qinfifonext = 16079
Sep 30 00:26:54 newsgate kernel: QINFIFO:
Sep 30 00:26:54 newsgate kernel: WAITING_TID_QUEUES:
Sep 30 00:26:54 newsgate kernel: Pending list:
Sep 30 00:26:54 newsgate kernel:  20 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x47]
Sep 30 00:26:54 newsgate kernel: 107 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x47]
Sep 30 00:26:54 newsgate kernel:  74 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x47]
Sep 30 00:26:54 newsgate kernel:   3 FIFO_USE[0x1] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0x47]
Sep 30 00:26:54 newsgate kernel:  28 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0xf7]:(TID)
Sep 30 00:26:54 newsgate kernel:  62 FIFO_USE[0x0] SCB_CONTROL[0x60]:(TAG_ENB|DISCENB) SCB_SCSIID[0xf7]:(TID)
Sep 30 00:26:54 newsgate kernel: Total 6
Sep 30 00:26:54 newsgate kernel: Kernel Free SCB list: 116 115 105 35 111 108 29 106 13 76 112 34 17 69 84 51 122 23 87 99 43 32 91 88
+75 11 92 40 46 30 5 102 52 70 16 41 15 97 36 0 119 19 100 126 22 54 65 39 93 55 117 50 61 121 2 25 26 60 27 45 8 123 53 57 125 78 47
+66 49 4 103 101 77 24 37 72 90 82 48 79 56 86 118 1 120 59 94 73 21 58 113 64 85 89 81 18 98 96 6 12 31 95 114 7 44 14 127 124 67 33
+71 109 63 68 9 104 42 10 80 83 110 38
Sep 30 00:26:54 newsgate kernel: Sequencer Complete DMA-inprog list:
Sep 30 00:26:54 newsgate kernel: Sequencer Complete list:
Sep 30 00:26:54 newsgate kernel: Sequencer DMA-Up and Complete list:
Sep 30 00:26:54 newsgate kernel:
Sep 30 00:26:54 newsgate kernel: scsi1: FIFO0 Active, LONGJMP == 0x233, SCB 0x4a
Sep 30 00:26:54 newsgate kernel: SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVEPTRS)
Sep 30 00:26:54 newsgate kernel: SEQINTSRC[0x0] DFCNTRL[0x8]:(HDMAEN) DFSTATUS[0xc8]:(HDONE|PKT_PRELOAD_AVAIL|PRELOAD_AVAIL)
Sep 30 00:26:54 newsgate kernel: SG_CACHE_SHADOW[0x50] SG_STATE[0x3]:(SEGS_AVAIL|LOADING_NEEDED)
Sep 30 00:26:54 newsgate kernel: DFFSXFRCTL[0x0] SOFFCNT[0x0] MDFFSTAT[0x46]:(DATAINFIFO|DLZERO|SHCNTNEGATIVE)
Sep 30 00:26:54 newsgate kernel: SHADDR = 0x0d65c9200, SHCNT = 0xfffe00 HADDR = 0x0d65c9000, HCNT = 0x0
Sep 30 00:26:54 newsgate kernel: CCSGCTL[0x10]:(SG_CACHE_AVAIL)
Sep 30 00:26:54 newsgate kernel: scsi1: FIFO1 Free, LONGJMP == 0x823a, SCB 0x6a
Sep 30 00:26:54 newsgate kernel: SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVEPTRS)
Sep 30 00:26:54 newsgate kernel: SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL)
Sep 30 00:26:54 newsgate kernel: SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0]
Sep 30 00:26:54 newsgate kernel: SOFFCNT[0x0] MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0
Sep 30 00:26:54 newsgate kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x0]
Sep 30 00:26:54 newsgate kernel: LQIN: 0x4 0x0 0x0 0x4a 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x28 0x0 0x0 0x0 0x2 0x0
Sep 30 00:26:54 newsgate kernel: scsi1: LQISTATE = 0x2b, LQOSTATE = 0x0, OPTIONMODE = 0x52
Sep 30 00:26:54 newsgate kernel: scsi1: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x2
Sep 30 00:26:54 newsgate kernel: SIMODE0[0xc]:(ENOVERRUN|ENIOERR)
Sep 30 00:26:54 newsgate kernel: CCSCBCTL[0x0]
Sep 30 00:26:54 newsgate kernel: scsi1: REG0 == 0x14, SINDEX = 0x150, DINDEX = 0x10a
Sep 30 00:26:54 newsgate kernel: scsi1: SCBPTR == 0x74, SCB_NEXT == 0xff40, SCB_NEXT2 == 0xff74
Sep 30 00:26:54 newsgate kernel: CDB 28 0 7 80 8 a0
Sep 30 00:26:54 newsgate kernel: STACK: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Sep 30 00:26:54 newsgate kernel: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>
Sep 30 00:27:28 newsgate kernel: scsi1:0:15:0: Attempting to queue an ABORT message:CDB: 0x28 0x0 0x9 0xd4 0xb 0xd7 0x0 0x0 0x80 0x0
Sep 30 00:27:28 newsgate kernel: scsi1: At time of recovery, card was not paused
Sep 30 00:27:28 newsgate kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 30 00:27:28 newsgate kernel: scsi1: Dumping Card State at program address 0x25 Mode 0x11
Sep 30 00:27:28 newsgate kernel: Card was paused
Sep 30 00:27:28 newsgate kernel: HS_MAILBOX[0x0] INTCTL[0xc0]:(SWTMINTEN|SWTMINTMASK)
Sep 30 00:27:28 newsgate kernel: SEQINTSTAT[0x10]:(SEQ_SWTMRTO) SAVED_MODE[0x33]
Sep 30 00:27:28 newsgate kernel: DFFSTAT[0x34]:(CURRFIFO_0|FIFO0FREE|FIFO1FREE)
Sep 30 00:27:28 newsgate kernel: SCSISIGI[0x66]:(P_DATAIN_DT|REQI|BSYI) SCSIPHASE[0x0]
Sep 30 00:27:28 newsgate kernel: SCSIBUS[0x9b] LASTPHASE[0x60]:(P_DATAIN_DT) SCSISEQ0[0x0]
Sep 30 00:27:28 newsgate kernel: SCSISEQ1[0x12]:(ENAUTOATNP|ENRSELI) SEQCTL0[0x0]
Sep 30 00:27:28 newsgate kernel: SEQINTCTL[0x0] SEQ_FLAGS[0x20]:(DPHASE) SEQ_FLAGS2[0x0]
Sep 30 00:27:28 newsgate kernel: SSTAT0[0x0] SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0]
Sep 30 00:27:28 newsgate kernel: PERRDIAG[0x0] SIMODE1[0xa4]:(ENSCSIPERR|ENSCSIRST|ENSELTIMO)
Sep 30 00:27:28 newsgate kernel: LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0xc0]:(LQIPHASE_OUTPKT|PACKETIZED)
Sep 30 00:27:28 newsgate kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0xe1]:(LQOSTOP0|LQOPKT)

etc...

Hope this gives more info on the crash..

Danny

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
  2005-09-30 11:33   ` Danny ter Haar
@ 2005-09-30 13:04     ` Jens Laas
  2005-10-04 10:47       ` Age Strand
  0 siblings, 1 reply; 9+ messages in thread
From: Jens Laas @ 2005-09-30 13:04 UTC (permalink / raw)
  To: Danny ter Haar; +Cc: linux-scsi

(05.09.30 kl.11:33) Danny ter Haar skrev följande till linux-scsi@vger.kern...:

> Andrew Morton  <akpm@osdl.org> wrote:

> My colleque found in kern.log the real first announcement:
>
> Sep 30 00:26:54 newsgate kernel: scsi1: Transmission error detected
> Sep 30 00:26:54 newsgate kernel: LQISTAT1[0x8]:(LQICRCI_NLQ) LASTPHASE[0x1]:(P_DATAOUT|P_BUSFREE)
> Sep 30 00:26:54 newsgate kernel: SCSISIGI[0x60]:(P_DATAIN_DT) PERRDIAG[0x4]:(CRCERR)
> Sep 30 00:26:54 newsgate kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<

I dont know if its the same problem as above but we have seen this:
Sep  1 14:21:00 mail1 kernel: scsi1: Unexpected PKT busfree condition
Sep  1 14:21:00 mail1 kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins 
<<<<<<<<<<<<<<<<<

busfree is mentioned in both.

What is most disappointing is that there is no recovery. Which is no fun 
when 2700 mail accounts becomes unreachable.

I would expect the card to be reinitialized and communication resumed.

Failing that I would like the error be communicated upwards in the kernel 
so some sort of recovery on fs level can be done (forced unmount perhaps).

Cheers,
Jens

> etc...
>
> Hope this gives more info on the crash..
>
> Danny
>
> -
> To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>

-----------------------------------------------------------------------
     'This mail automatically becomes portable when carried.'
-----------------------------------------------------------------------
     Jens Låås                              Email: jens.laas@data.slu.se
     Department of Computer Services, SLU   Phone: +46 18 67 35 15
     Vindbrovägen 1
     P.O. Box 7079
     S-750 07 Uppsala
     SWEDEN
-----------------------------------------------------------------------
-
To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours
  2005-09-30 13:04     ` Jens Laas
@ 2005-10-04 10:47       ` Age Strand
  0 siblings, 0 replies; 9+ messages in thread
From: Age Strand @ 2005-10-04 10:47 UTC (permalink / raw)
  To: Jens Laas; +Cc: Danny ter Haar, linux-scsi

[-- Attachment #1: Type: text/plain, Size: 5085 bytes --]

On Fri, 2005-09-30 at 15:04 +0200, Jens Laas wrote:
> (05.09.30 kl.11:33) Danny ter Haar skrev följande till linux-scsi@vger.kern...:
> 
> > Andrew Morton  <akpm@osdl.org> wrote:
> 
> > My colleque found in kern.log the real first announcement:
> >
> > Sep 30 00:26:54 newsgate kernel: scsi1: Transmission error detected
> > Sep 30 00:26:54 newsgate kernel: LQISTAT1[0x8]:(LQICRCI_NLQ) LASTPHASE[0x1]:(P_DATAOUT|P_BUSFREE)
> > Sep 30 00:26:54 newsgate kernel: SCSISIGI[0x60]:(P_DATAIN_DT) PERRDIAG[0x4]:(CRCERR)
> > Sep 30 00:26:54 newsgate kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
> 
> I dont know if its the same problem as above but we have seen this:
> Sep  1 14:21:00 mail1 kernel: scsi1: Unexpected PKT busfree condition
> Sep  1 14:21:00 mail1 kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins 
> <<<<<<<<<<<<<<<<<
> 
> busfree is mentioned in both.
> 
> What is most disappointing is that there is no recovery. Which is no fun 
> when 2700 mail accounts becomes unreachable.
> 
> I would expect the card to be reinitialized and communication resumed.
> 
> Failing that I would like the error be communicated upwards in the kernel 
> so some sort of recovery on fs level can be done (forced unmount perhaps).

Hi Jens, 

I'll just chime in here and say that I have seen problems with the
aic79xx driver and 39320A-R hardware - albeit on older kernels (2.6.9).
This is the kernel RHEL4 ships with.

Our setup is:

Dell PowerEdge 2850
Dell PowerVault 220S external rack, with 14 disks (one hot-spare).
Kernel 2.6.9-11.ELsmp
Machine is file server for 600+ persons.

We're having problems with an md RAID running off an Adaptec 39320A-R
card. We're getting PKT busfree errors at random intervals which result
in RAID disks going offline. We had to scrap the 79xx raid setup due to
this after it first flipped the hot-spare offline a couple of times, and
then it kicked an additional 2 active disks offline. Not good for a
RAID5.  All this within a week of operation. 

We're back to running a PERC4/DC hw RAID on the disk array now. Slower
but stable.

>From what I gather there is a bit of a debate going on about the aix7Yxx
driver tree and SCSI core in general, SAS etc etc. Christoph informed me
that the adaptec xx320 support could do with some updating and that the
developers just recently had 320 hw to play with.

Having that in mind, we've set out to experiment with another setup.
We're now using a 39160 controller to host a software raid on the disk
array. It's been running for a couple of days now and we've had one
"Unexpected busfree while idle" message since start of test. Nothing bad
happened though, the aic7xx driver recovered from it. It sent an ABORT
message and it was successful.

When this happened using the aic79xx driver it offlined the disks at
once. By doing that it triggered a bug in the md driver sending it off
on a Mission Impossible trying to update the superblock on all disks a
100 times, then fail, then try 100 times again, et cetera ad nauseam.
Fixed in later versions of md, I hear. 

So it seems the aic7xxx driver handles busfree error conditions better
than aic79xx. 

I've seen people suggest checking cable and termination - and some have
indicated that adaptec 29160/39160 hw is extremely picky about these
things. 
See: http://monkey.org/openbsd/archive/tech/0108/msg00131.html
(yes, I know; old post, openbsd etc etc - might be relevant anyhow)

Anyway, I'm ranting. We've removed the 39320 hw from our server now, but
the log from the ordeal is attached in case anyone wants to look at what
happened. The machine setup at the time was:

Dell PowerEdge 2850
Dell PowerVault 220S external rack, with 14 disks (one hot-spare).
Kernel 2.6.9-11.ELsmp
Adaptec 39320A-R SCSI controller
md0: sw raid sda1 - sdn1 (14 disks, one hot spare). 


Cheers,
aage


> Cheers,
> Jens
> 
> > etc...
> >
> > Hope this gives more info on the crash..
> >
> > Danny
> >
> > -
> > To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >
> 
> -----------------------------------------------------------------------
>      'This mail automatically becomes portable when carried.'
> -----------------------------------------------------------------------
>      Jens Låås                              Email: jens.laas@data.slu.se
>      Department of Computer Services, SLU   Phone: +46 18 67 35 15
>      Vindbrovägen 1
>      P.O. Box 7079
>      S-750 07 Uppsala
>      SWEDEN
> -----------------------------------------------------------------------
> -
> To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
-- 
Åge Strand
Overingeniør Unix Drift, Havforskningsinstituttet 
Tlf: 55238500 / 55236863 (direkte)

[-- Attachment #2: pktbuserr.txt --]
[-- Type: text/plain, Size: 41181 bytes --]

Sep 21 07:07:05 artemis kernel: scsi0: Unexpected PKT busfree condition
Sep 21 07:07:05 artemis kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 21 07:07:05 artemis kernel: scsi0: Dumping Card State at program address 0xc7 Mode 0x33
Sep 21 07:07:05 artemis kernel: Card was paused
Sep 21 07:07:05 artemis kernel: HS_MAILBOX[0x0] INTCTL[0xc0] SEQINTSTAT[0x0] SAVED_MODE[0x11] 
Sep 21 07:07:05 artemis kernel: DFFSTAT[0x33] SCSISIGI[0xb6] SCSIPHASE[0x0] SCSIBUS[0xc0] 
Sep 21 07:07:05 artemis kernel: LASTPHASE[0x1] SCSISEQ0[0x0] SCSISEQ1[0x12] SEQCTL0[0x0] 
Sep 21 07:07:05 artemis kernel: SEQINTCTL[0x0] SEQ_FLAGS[0x40] SEQ_FLAGS2[0x0] SSTAT0[0x2] 
Sep 21 07:07:05 artemis kernel: SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0xc0] 
Sep 21 07:07:05 artemis kernel: SIMODE1[0xac] LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x0] 
Sep 21 07:07:05 artemis kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0x0] 
Sep 21 07:07:05 artemis kernel: 
Sep 21 07:07:05 artemis kernel: SCB Count = 56 CMDS_PENDING = 1 LASTSCB 0x0 CURRSCB 0x19 NEXTSCB 0xff80
Sep 21 07:07:05 artemis kernel: qinstart = 3719 qinfifonext = 3719
Sep 21 07:07:05 artemis kernel: QINFIFO:
Sep 21 07:07:05 artemis kernel: WAITING_TID_QUEUES:
Sep 21 07:07:05 artemis kernel: Pending list:
Sep 21 07:07:05 artemis kernel:  25 FIFO_USE[0x0] SCB_CONTROL[0x40] SCB_SCSIID[0x67] 
Sep 21 07:07:05 artemis kernel: Total 1
Sep 21 07:07:05 artemis kernel: Kernel Free SCB list: 30 3 5 2 0 18 13 50 37 26 32 54 20 42 24 43 49 8 33 41 15 1 44 10 27 35 4 46 34 12 23 48 51 16 11 29 39 47 55 38 7 14 28 21 45 22 40 31 9 36 17 19 6 53 52 
Sep 21 07:07:05 artemis kernel: Sequencer Complete DMA-inprog list: 
Sep 21 07:07:05 artemis kernel: Sequencer Complete list: 
Sep 21 07:07:05 artemis kernel: Sequencer DMA-Up and Complete list: 
Sep 21 07:07:05 artemis kernel: 
Sep 21 07:07:05 artemis kernel: scsi0: FIFO0 Free, LONGJMP == 0x823a, SCB 0x19
Sep 21 07:07:05 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:07:05 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:07:05 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:07:05 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:07:05 artemis kernel: scsi0: FIFO1 Free, LONGJMP == 0x8063, SCB 0x19
Sep 21 07:07:05 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:07:05 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:07:05 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:07:05 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:07:05 artemis kernel: LQIN: 0x8 0x0 0x0 0x19 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 
Sep 21 07:07:05 artemis kernel: scsi0: LQISTATE = 0x0, LQOSTATE = 0x0, OPTIONMODE = 0x52
Sep 21 07:07:05 artemis kernel: scsi0: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x1
Sep 21 07:07:05 artemis kernel: SIMODE0[0xc] 
Sep 21 07:07:05 artemis kernel: CCSCBCTL[0x4] 
Sep 21 07:07:05 artemis kernel: scsi0: REG0 == 0x7, SINDEX = 0x10e, DINDEX = 0x10e
Sep 21 07:07:05 artemis kernel: scsi0: SCBPTR == 0x19, SCB_NEXT == 0xff40, SCB_NEXT2 == 0xff5a
Sep 21 07:07:05 artemis kernel: CDB 1c 1 1 8 0 0
Sep 21 07:07:05 artemis kernel: STACK: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Sep 21 07:07:05 artemis kernel: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>
Sep 21 07:07:05 artemis kernel: DevQ(0:0:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:1:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:2:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:3:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:4:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:5:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:6:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:8:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:9:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:10:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:11:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:12:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:13:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:14:0): 0 waiting
Sep 21 07:07:05 artemis kernel: DevQ(0:15:0): 0 waiting
Sep 21 07:08:35 artemis kernel: scsi0:0:14:0: Attempting to abort cmd cc585080: 0x2a 0x0 0x11 0x17 0x5d 0xbf 0x0 0x0 0x8 0x0
Sep 21 07:08:35 artemis kernel: scsi0: At time of recovery, card was not paused
Sep 21 07:08:35 artemis kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 21 07:08:35 artemis kernel: scsi0: Dumping Card State at program address 0x26 Mode 0x22
Sep 21 07:08:35 artemis kernel: Card was paused
Sep 21 07:08:35 artemis kernel: HS_MAILBOX[0x0] INTCTL[0xc0] SEQINTSTAT[0x0] SAVED_MODE[0x11] 
Sep 21 07:08:35 artemis kernel: DFFSTAT[0x33] SCSISIGI[0xa6] SCSIPHASE[0x0] SCSIBUS[0xc0] 
Sep 21 07:08:35 artemis kernel: LASTPHASE[0x1] SCSISEQ0[0x0] SCSISEQ1[0x12] SEQCTL0[0x0] 
Sep 21 07:08:35 artemis kernel: SEQINTCTL[0x0] SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0] SSTAT0[0x2] 
Sep 21 07:08:35 artemis kernel: SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0xc0] 
Sep 21 07:08:35 artemis kernel: SIMODE1[0xac] LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x0] 
Sep 21 07:08:35 artemis kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0x0] 
Sep 21 07:08:35 artemis kernel: 
Sep 21 07:08:35 artemis kernel: SCB Count = 56 CMDS_PENDING = 3 LASTSCB 0x0 CURRSCB 0x1e NEXTSCB 0xff80
Sep 21 07:08:35 artemis kernel: qinstart = 3721 qinfifonext = 3721
Sep 21 07:08:35 artemis kernel: QINFIFO:
Sep 21 07:08:35 artemis kernel: WAITING_TID_QUEUES:
Sep 21 07:08:35 artemis kernel:        14 ( 0x1e )
Sep 21 07:08:35 artemis kernel:        8 ( 0x3 )
Sep 21 07:08:35 artemis kernel: Pending list:
Sep 21 07:08:35 artemis kernel:   3 FIFO_USE[0x0] SCB_CONTROL[0x60] SCB_SCSIID[0x87] 
Sep 21 07:08:35 artemis kernel:  30 FIFO_USE[0x0] SCB_CONTROL[0x60] SCB_SCSIID[0xe7] 
Sep 21 07:08:35 artemis kernel:  25 FIFO_USE[0x0] SCB_CONTROL[0x40] SCB_SCSIID[0x67] 
Sep 21 07:08:35 artemis kernel: Total 3
Sep 21 07:08:35 artemis kernel: Kernel Free SCB list: 5 2 0 18 13 50 37 26 32 54 20 42 24 43 49 8 33 41 15 1 44 10 27 35 4 46 34 12 23 48 51 16 11 29 39 47 55 38 7 14 28 21 45 22 40 31 9 36 17 19 6 53 52 
Sep 21 07:08:35 artemis kernel: Sequencer Complete DMA-inprog list: 
Sep 21 07:08:35 artemis kernel: Sequencer Complete list: 
Sep 21 07:08:35 artemis kernel: Sequencer DMA-Up and Complete list: 
Sep 21 07:08:35 artemis kernel: 
Sep 21 07:08:35 artemis kernel: scsi0: FIFO0 Free, LONGJMP == 0x823a, SCB 0x19
Sep 21 07:08:35 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:35 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:35 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:35 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:35 artemis kernel: scsi0: FIFO1 Free, LONGJMP == 0x8063, SCB 0x19
Sep 21 07:08:35 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:35 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:35 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:35 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:35 artemis kernel: LQIN: 0x8 0x0 0x0 0x19 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 
Sep 21 07:08:35 artemis kernel: scsi0: LQISTATE = 0x0, LQOSTATE = 0x0, OPTIONMODE = 0x52
Sep 21 07:08:35 artemis kernel: scsi0: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x1
Sep 21 07:08:35 artemis kernel: SIMODE0[0xc] 
Sep 21 07:08:35 artemis kernel: CCSCBCTL[0x4] 
Sep 21 07:08:35 artemis kernel: scsi0: REG0 == 0x3, SINDEX = 0x112, DINDEX = 0x112
Sep 21 07:08:35 artemis kernel: scsi0: SCBPTR == 0x1e, SCB_NEXT == 0xff00, SCB_NEXT2 == 0x3
Sep 21 07:08:35 artemis kernel: CDB 2a 0 11 17 5d bf
Sep 21 07:08:35 artemis kernel: STACK: 0x14 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Sep 21 07:08:35 artemis kernel: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>
Sep 21 07:08:35 artemis kernel: DevQ(0:0:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:1:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:2:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:3:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:4:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:5:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:6:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:8:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:9:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:10:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:11:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:12:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:13:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:14:0): 0 waiting
Sep 21 07:08:35 artemis kernel: DevQ(0:15:0): 0 waiting
Sep 21 07:08:35 artemis kernel: scsi0:0:14:0: Cmd aborted from QINFIFO
Sep 21 07:08:45 artemis kernel: scsi0:0:14:0: Attempting to abort cmd cc585080: 0x0 0x0 0x0 0x0 0x0 0x0
Sep 21 07:08:45 artemis kernel: scsi0: At time of recovery, card was not paused
Sep 21 07:08:45 artemis kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 21 07:08:45 artemis kernel: scsi0: Dumping Card State at program address 0x2 Mode 0x22
Sep 21 07:08:45 artemis kernel: Card was paused
Sep 21 07:08:45 artemis kernel: HS_MAILBOX[0x0] INTCTL[0xc0] SEQINTSTAT[0x0] SAVED_MODE[0x11] 
Sep 21 07:08:45 artemis kernel: DFFSTAT[0x33] SCSISIGI[0xa6] SCSIPHASE[0x0] SCSIBUS[0xc0] 
Sep 21 07:08:45 artemis kernel: LASTPHASE[0x1] SCSISEQ0[0x0] SCSISEQ1[0x12] SEQCTL0[0x0] 
Sep 21 07:08:45 artemis kernel: SEQINTCTL[0x0] SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0] SSTAT0[0x2] 
Sep 21 07:08:45 artemis kernel: SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0xc0] 
Sep 21 07:08:45 artemis kernel: SIMODE1[0xac] LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x0] 
Sep 21 07:08:45 artemis kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0x0] 
Sep 21 07:08:45 artemis kernel: 
Sep 21 07:08:45 artemis kernel: SCB Count = 56 CMDS_PENDING = 3 LASTSCB 0x0 CURRSCB 0x3 NEXTSCB 0xff80
Sep 21 07:08:45 artemis kernel: qinstart = 3722 qinfifonext = 3722
Sep 21 07:08:45 artemis kernel: QINFIFO:
Sep 21 07:08:45 artemis kernel: WAITING_TID_QUEUES:
Sep 21 07:08:45 artemis kernel:        8 ( 0x3 )
Sep 21 07:08:45 artemis kernel:        14 ( 0x1e )
Sep 21 07:08:45 artemis kernel: Pending list:
Sep 21 07:08:45 artemis kernel:  30 FIFO_USE[0x0] SCB_CONTROL[0x60] SCB_SCSIID[0xe7] 
Sep 21 07:08:45 artemis kernel:   3 FIFO_USE[0x0] SCB_CONTROL[0x60] SCB_SCSIID[0x87] 
Sep 21 07:08:45 artemis kernel:  25 FIFO_USE[0x0] SCB_CONTROL[0x40] SCB_SCSIID[0x67] 
Sep 21 07:08:45 artemis kernel: Total 3
Sep 21 07:08:45 artemis kernel: Kernel Free SCB list: 5 2 0 18 13 50 37 26 32 54 20 42 24 43 49 8 33 41 15 1 44 10 27 35 4 46 34 12 23 48 51 16 11 29 39 47 55 38 7 14 28 21 45 22 40 31 9 36 17 19 6 53 52 
Sep 21 07:08:45 artemis kernel: Sequencer Complete DMA-inprog list: 
Sep 21 07:08:45 artemis kernel: Sequencer Complete list: 
Sep 21 07:08:45 artemis kernel: Sequencer DMA-Up and Complete list: 
Sep 21 07:08:45 artemis kernel: 
Sep 21 07:08:45 artemis kernel: scsi0: FIFO0 Free, LONGJMP == 0x823a, SCB 0x19
Sep 21 07:08:45 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:45 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:45 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:45 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:45 artemis kernel: scsi0: FIFO1 Free, LONGJMP == 0x8063, SCB 0x19
Sep 21 07:08:45 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:45 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:45 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:45 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:45 artemis kernel: LQIN: 0x8 0x0 0x0 0x19 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 
Sep 21 07:08:45 artemis kernel: scsi0: LQISTATE = 0x0, LQOSTATE = 0x0, OPTIONMODE = 0x52
Sep 21 07:08:45 artemis kernel: scsi0: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x1
Sep 21 07:08:45 artemis kernel: SIMODE0[0xc] 
Sep 21 07:08:45 artemis kernel: CCSCBCTL[0x4] 
Sep 21 07:08:45 artemis kernel: scsi0: REG0 == 0x1e, SINDEX = 0x11e, DINDEX = 0x11e
Sep 21 07:08:45 artemis kernel: scsi0: SCBPTR == 0x3, SCB_NEXT == 0xffc0, SCB_NEXT2 == 0x1e
Sep 21 07:08:45 artemis kernel: CDB 28 0 7 cb 4a 3f
Sep 21 07:08:45 artemis kernel: STACK: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Sep 21 07:08:45 artemis kernel: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>
Sep 21 07:08:45 artemis kernel: DevQ(0:0:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:1:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:2:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:3:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:4:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:5:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:6:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:8:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:9:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:10:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:11:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:12:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:13:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:14:0): 0 waiting
Sep 21 07:08:45 artemis kernel: DevQ(0:15:0): 0 waiting
Sep 21 07:08:45 artemis kernel: scsi0:0:14:0: Cmd aborted from QINFIFO
Sep 21 07:08:45 artemis kernel: scsi0:0:8:0: Attempting to abort cmd e722e800: 0x28 0x0 0x7 0xcb 0x4a 0x3f 0x0 0x0 0x8 0x0
Sep 21 07:08:45 artemis kernel: scsi0: At time of recovery, card was not paused
Sep 21 07:08:45 artemis kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 21 07:08:45 artemis kernel: scsi0: Dumping Card State at program address 0x26 Mode 0x22
Sep 21 07:08:45 artemis kernel: Card was paused
Sep 21 07:08:45 artemis kernel: HS_MAILBOX[0x0] INTCTL[0xc0] SEQINTSTAT[0x0] SAVED_MODE[0x11] 
Sep 21 07:08:45 artemis kernel: DFFSTAT[0x33] SCSISIGI[0xa6] SCSIPHASE[0x0] SCSIBUS[0xc0] 
Sep 21 07:08:45 artemis kernel: LASTPHASE[0x1] SCSISEQ0[0x0] SCSISEQ1[0x12] SEQCTL0[0x0] 
Sep 21 07:08:45 artemis kernel: SEQINTCTL[0x0] SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0] SSTAT0[0x2] 
Sep 21 07:08:45 artemis kernel: SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0xc0] 
Sep 21 07:08:45 artemis kernel: SIMODE1[0xac] LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x0] 
Sep 21 07:08:45 artemis kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0x0] 
Sep 21 07:08:45 artemis kernel: 
Sep 21 07:08:45 artemis kernel: SCB Count = 56 CMDS_PENDING = 2 LASTSCB 0x0 CURRSCB 0x3 NEXTSCB 0xff80
Sep 21 07:08:45 artemis kernel: qinstart = 3722 qinfifonext = 3722
Sep 21 07:08:45 artemis kernel: QINFIFO:
Sep 21 07:08:45 artemis kernel: WAITING_TID_QUEUES:
Sep 21 07:08:45 artemis kernel:        8 ( 0x3 )
Sep 21 07:08:45 artemis kernel: Pending list:
Sep 21 07:08:45 artemis kernel:   3 FIFO_USE[0x0] SCB_CONTROL[0x60] SCB_SCSIID[0x87] 
Sep 21 07:08:45 artemis kernel:  25 FIFO_USE[0x0] SCB_CONTROL[0x40] SCB_SCSIID[0x67] 
Sep 21 07:08:45 artemis kernel: Total 2
Sep 21 07:08:45 artemis kernel: Kernel Free SCB list: 30 5 2 0 18 13 50 37 26 32 54 20 42 24 43 49 8 33 41 15 1 44 10 27 35 4 46 34 12 23 48 51 16 11 29 39 47 55 38 7 14 28 21 45 22 40 31 9 36 17 19 6 53 52 
Sep 21 07:08:45 artemis kernel: Sequencer Complete DMA-inprog list: 
Sep 21 07:08:45 artemis kernel: Sequencer Complete list: 
Sep 21 07:08:45 artemis kernel: Sequencer DMA-Up and Complete list: 
Sep 21 07:08:45 artemis kernel: 
Sep 21 07:08:45 artemis kernel: scsi0: FIFO0 Free, LONGJMP == 0x823a, SCB 0x19
Sep 21 07:08:45 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:45 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:45 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:45 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:45 artemis kernel: scsi0: FIFO1 Free, LONGJMP == 0x8063, SCB 0x19
Sep 21 07:08:45 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:45 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:46 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:46 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:46 artemis kernel: LQIN: 0x8 0x0 0x0 0x19 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 
Sep 21 07:08:46 artemis kernel: scsi0: LQISTATE = 0x0, LQOSTATE = 0x0, OPTIONMODE = 0x52
Sep 21 07:08:46 artemis kernel: scsi0: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x1
Sep 21 07:08:46 artemis kernel: SIMODE0[0xc] 
Sep 21 07:08:46 artemis kernel: CCSCBCTL[0x4] 
Sep 21 07:08:46 artemis kernel: scsi0: REG0 == 0x1e, SINDEX = 0x11e, DINDEX = 0x11e
Sep 21 07:08:46 artemis kernel: scsi0: SCBPTR == 0x3, SCB_NEXT == 0xffc0, SCB_NEXT2 == 0xff5a
Sep 21 07:08:46 artemis kernel: CDB 28 0 7 cb 4a 3f
Sep 21 07:08:46 artemis kernel: STACK: 0x14 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Sep 21 07:08:46 artemis kernel: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>
Sep 21 07:08:46 artemis kernel: DevQ(0:0:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:1:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:2:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:3:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:4:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:5:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:6:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:8:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:9:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:10:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:11:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:12:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:13:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:14:0): 0 waiting
Sep 21 07:08:46 artemis kernel: DevQ(0:15:0): 0 waiting
Sep 21 07:08:46 artemis kernel: scsi0:0:8:0: Cmd aborted from QINFIFO
Sep 21 07:08:55 artemis kernel: scsi0:0:8:0: Attempting to abort cmd e722e800: 0x0 0x0 0x0 0x0 0x0 0x0
Sep 21 07:08:55 artemis kernel: scsi0: At time of recovery, card was not paused
Sep 21 07:08:55 artemis kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 21 07:08:55 artemis kernel: scsi0: Dumping Card State at program address 0xc Mode 0x33
Sep 21 07:08:55 artemis kernel: Card was paused
Sep 21 07:08:55 artemis kernel: HS_MAILBOX[0x0] INTCTL[0xc0] SEQINTSTAT[0x0] SAVED_MODE[0x11] 
Sep 21 07:08:55 artemis kernel: DFFSTAT[0x33] SCSISIGI[0xa6] SCSIPHASE[0x0] SCSIBUS[0xc0] 
Sep 21 07:08:55 artemis kernel: LASTPHASE[0x1] SCSISEQ0[0x0] SCSISEQ1[0x12] SEQCTL0[0x0] 
Sep 21 07:08:55 artemis kernel: SEQINTCTL[0x0] SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0] SSTAT0[0x2] 
Sep 21 07:08:55 artemis kernel: SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0xc0] 
Sep 21 07:08:55 artemis kernel: SIMODE1[0xac] LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x0] 
Sep 21 07:08:55 artemis kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0x0] 
Sep 21 07:08:55 artemis kernel: 
Sep 21 07:08:55 artemis kernel: SCB Count = 56 CMDS_PENDING = 2 LASTSCB 0x0 CURRSCB 0x3 NEXTSCB 0xff80
Sep 21 07:08:55 artemis kernel: qinstart = 3723 qinfifonext = 3723
Sep 21 07:08:55 artemis kernel: QINFIFO:
Sep 21 07:08:55 artemis kernel: WAITING_TID_QUEUES:
Sep 21 07:08:55 artemis kernel:        8 ( 0x3 )
Sep 21 07:08:55 artemis kernel: Pending list:
Sep 21 07:08:55 artemis kernel:   3 FIFO_USE[0x0] SCB_CONTROL[0x60] SCB_SCSIID[0x87] 
Sep 21 07:08:55 artemis kernel:  25 FIFO_USE[0x0] SCB_CONTROL[0x40] SCB_SCSIID[0x67] 
Sep 21 07:08:55 artemis kernel: Total 2
Sep 21 07:08:55 artemis kernel: Kernel Free SCB list: 30 5 2 0 18 13 50 37 26 32 54 20 42 24 43 49 8 33 41 15 1 44 10 27 35 4 46 34 12 23 48 51 16 11 29 39 47 55 38 7 14 28 21 45 22 40 31 9 36 17 19 6 53 52 
Sep 21 07:08:55 artemis kernel: Sequencer Complete DMA-inprog list: 
Sep 21 07:08:55 artemis kernel: Sequencer Complete list: 
Sep 21 07:08:55 artemis kernel: Sequencer DMA-Up and Complete list: 
Sep 21 07:08:55 artemis kernel: 
Sep 21 07:08:55 artemis kernel: scsi0: FIFO0 Free, LONGJMP == 0x823a, SCB 0x19
Sep 21 07:08:55 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:55 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:55 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:55 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:55 artemis kernel: scsi0: FIFO1 Free, LONGJMP == 0x8063, SCB 0x19
Sep 21 07:08:55 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:55 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:55 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:55 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:55 artemis kernel: LQIN: 0x8 0x0 0x0 0x19 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 
Sep 21 07:08:55 artemis kernel: scsi0: LQISTATE = 0x0, LQOSTATE = 0x0, OPTIONMODE = 0x52
Sep 21 07:08:55 artemis kernel: scsi0: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x1
Sep 21 07:08:55 artemis kernel: SIMODE0[0xc] 
Sep 21 07:08:55 artemis kernel: CCSCBCTL[0x4] 
Sep 21 07:08:55 artemis kernel: scsi0: REG0 == 0x7, SINDEX = 0x112, DINDEX = 0x112
Sep 21 07:08:55 artemis kernel: scsi0: SCBPTR == 0x3, SCB_NEXT == 0xff00, SCB_NEXT2 == 0xff5a
Sep 21 07:08:55 artemis kernel: CDB 0 0 0 0 0 0
Sep 21 07:08:55 artemis kernel: STACK: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Sep 21 07:08:55 artemis kernel: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>
Sep 21 07:08:55 artemis kernel: DevQ(0:0:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:1:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:2:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:3:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:4:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:5:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:6:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:8:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:9:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:10:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:11:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:12:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:13:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:14:0): 0 waiting
Sep 21 07:08:55 artemis kernel: DevQ(0:15:0): 0 waiting
Sep 21 07:08:55 artemis kernel: scsi0:0:8:0: Cmd aborted from QINFIFO
Sep 21 07:08:55 artemis kernel: scsi0:0:6:0: Attempting to abort cmd d53ce080: 0x1c 0x1 0x1 0x8 0x0 0x0
Sep 21 07:08:55 artemis kernel: scsi0: At time of recovery, card was not paused
Sep 21 07:08:55 artemis kernel: >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
Sep 21 07:08:55 artemis kernel: scsi0: Dumping Card State at program address 0xa Mode 0x33
Sep 21 07:08:55 artemis kernel: Card was paused
Sep 21 07:08:55 artemis kernel: HS_MAILBOX[0x0] INTCTL[0xc0] SEQINTSTAT[0x0] SAVED_MODE[0x11] 
Sep 21 07:08:55 artemis kernel: DFFSTAT[0x33] SCSISIGI[0xa6] SCSIPHASE[0x0] SCSIBUS[0xc0] 
Sep 21 07:08:55 artemis kernel: LASTPHASE[0x1] SCSISEQ0[0x0] SCSISEQ1[0x12] SEQCTL0[0x0] 
Sep 21 07:08:55 artemis kernel: SEQINTCTL[0x0] SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0] SSTAT0[0x2] 
Sep 21 07:08:55 artemis kernel: SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0xc0] 
Sep 21 07:08:55 artemis kernel: SIMODE1[0xac] LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x0] 
Sep 21 07:08:55 artemis kernel: LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0x0] 
Sep 21 07:08:55 artemis kernel: 
Sep 21 07:08:55 artemis kernel: SCB Count = 56 CMDS_PENDING = 1 LASTSCB 0x0 CURRSCB 0x3 NEXTSCB 0xff80
Sep 21 07:08:55 artemis kernel: qinstart = 3723 qinfifonext = 3723
Sep 21 07:08:55 artemis kernel: QINFIFO:
Sep 21 07:08:55 artemis kernel: WAITING_TID_QUEUES:
Sep 21 07:08:55 artemis kernel: Pending list:
Sep 21 07:08:55 artemis kernel:  25 FIFO_USE[0x0] SCB_CONTROL[0x40] SCB_SCSIID[0x67] 
Sep 21 07:08:55 artemis kernel: Total 1
Sep 21 07:08:55 artemis kernel: Kernel Free SCB list: 3 30 5 2 0 18 13 50 37 26 32 54 20 42 24 43 49 8 33 41 15 1 44 10 27 35 4 46 34 12 23 48 51 16 11 29 39 47 55 38 7 14 28 21 45 22 40 31 9 36 17 19 6 53 52 
Sep 21 07:08:55 artemis kernel: Sequencer Complete DMA-inprog list: 
Sep 21 07:08:55 artemis kernel: Sequencer Complete list: 
Sep 21 07:08:55 artemis kernel: Sequencer DMA-Up and Complete list: 
Sep 21 07:08:55 artemis kernel: 
Sep 21 07:08:55 artemis kernel: scsi0: FIFO0 Free, LONGJMP == 0x823a, SCB 0x19
Sep 21 07:08:55 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:55 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:55 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:55 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:55 artemis kernel: scsi0: FIFO1 Free, LONGJMP == 0x8063, SCB 0x19
Sep 21 07:08:56 artemis kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89] 
Sep 21 07:08:56 artemis kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0] DFFSXFRCTL[0x0] 
Sep 21 07:08:56 artemis kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = 0x00, SHCNT = 0x0 
Sep 21 07:08:56 artemis kernel: HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10] 
Sep 21 07:08:56 artemis kernel: LQIN: 0x8 0x0 0x0 0x19 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 
Sep 21 07:08:56 artemis kernel: scsi0: LQISTATE = 0x0, LQOSTATE = 0x0, OPTIONMODE = 0x52
Sep 21 07:08:56 artemis kernel: scsi0: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x1
Sep 21 07:08:56 artemis kernel: SIMODE0[0xc] 
Sep 21 07:08:56 artemis kernel: CCSCBCTL[0x4] 
Sep 21 07:08:56 artemis kernel: scsi0: REG0 == 0x7, SINDEX = 0x112, DINDEX = 0x112
Sep 21 07:08:56 artemis kernel: scsi0: SCBPTR == 0x3, SCB_NEXT == 0xff00, SCB_NEXT2 == 0xff5a
Sep 21 07:08:56 artemis kernel: CDB 0 0 0 0 0 0
Sep 21 07:08:56 artemis kernel: STACK: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Sep 21 07:08:56 artemis kernel: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>
Sep 21 07:08:56 artemis kernel: DevQ(0:0:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:1:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:2:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:3:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:4:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:5:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:6:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:8:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:9:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:10:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:11:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:12:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:13:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:14:0): 0 waiting
Sep 21 07:08:56 artemis kernel: DevQ(0:15:0): 0 waiting
Sep 21 07:08:56 artemis kernel: (scsi0:A:6:0): Device is disconnected, re-queuing SCB
Sep 21 07:08:56 artemis kernel: Recovery code sleeping
Sep 21 07:09:00 artemis kernel: Recovery code awake
Sep 21 07:09:00 artemis kernel: Timer Expired
Sep 21 07:09:00 artemis kernel: Recovery code sleeping
Sep 21 07:09:05 artemis kernel: Recovery code awake
Sep 21 07:09:05 artemis kernel: Timer Expired
Sep 21 07:09:05 artemis kernel: scsi0: Device reset returning 0x2003
Sep 21 07:09:05 artemis kernel: Recovery code sleeping
Sep 21 07:09:10 artemis kernel: Recovery code awake
Sep 21 07:09:10 artemis kernel: Timer Expired
Sep 21 07:09:10 artemis kernel: scsi0: Device reset returning 0x2003
Sep 21 07:09:10 artemis kernel: Recovery code sleeping
Sep 21 07:09:15 artemis kernel: Recovery code awake
Sep 21 07:09:15 artemis kernel: Timer Expired
Sep 21 07:09:15 artemis kernel: scsi0: Device reset returning 0x2003
Sep 21 07:09:15 artemis kernel: Recovery SCB completes
Sep 21 07:09:15 artemis last message repeated 3 times
Sep 21 07:09:25 artemis kernel: scsi: Device offlined - not ready after error recovery: host 0 channel 0 id 14 lun 0
Sep 21 07:09:25 artemis kernel: scsi: Device offlined - not ready after error recovery: host 0 channel 0 id 8 lun 0
Sep 21 07:09:25 artemis kernel: scsi0 (14:0): rejecting I/O to offline device
Sep 21 07:09:25 artemis kernel: scsi0 (8:0): rejecting I/O to offline device
Sep 21 07:09:25 artemis kernel: md: write_disk_sb failed for device sdm1
Sep 21 07:09:25 artemis kernel: raid5: Disk failure on sdg1, disabling device. Operation continuing on 12 devices
Sep 21 07:09:25 artemis kernel: scsi0 (14:0): rejecting I/O to offline device
Sep 21 07:09:25 artemis kernel: raid5: Disk failure on sdm1, disabling device. Operation continuing on 11 devices
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0): read_block_bitmap: Cannot read block bitmap - block_group = 5985, block_bitmap = 196145216
Sep 21 07:09:26 artemis kernel: Aborting journal on device md0.
Sep 21 07:09:26 artemis kernel: ext3_abort called.
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0): ext3_journal_start_sb: Detected aborted journal
Sep 21 07:09:26 artemis kernel: Remounting filesystem read-only
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0) in start_transaction: Journal has aborted
Sep 21 07:09:26 artemis kernel: md: errors occurred during superblock update, repeating
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 409993217
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 196082917
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: RAID5 conf printout:
Sep 21 07:09:26 artemis kernel:  --- rd:13 wd:11 fd:2
Sep 21 07:09:26 artemis kernel:  disk 0, o:1, dev:sda1
Sep 21 07:09:26 artemis kernel:  disk 1, o:1, dev:sdb1
Sep 21 07:09:26 artemis kernel:  disk 2, o:1, dev:sdc1
Sep 21 07:09:26 artemis kernel:  disk 3, o:1, dev:sdd1
Sep 21 07:09:26 artemis kernel:  disk 4, o:1, dev:sde1
Sep 21 07:09:26 artemis kernel:  disk 5, o:1, dev:sdf1
Sep 21 07:09:26 artemis kernel:  disk 6, o:0, dev:sdg1
Sep 21 07:09:26 artemis kernel:  disk 7, o:1, dev:sdh1
Sep 21 07:09:26 artemis kernel:  disk 8, o:1, dev:sdi1
Sep 21 07:09:26 artemis kernel:  disk 9, o:1, dev:sdj1
Sep 21 07:09:26 artemis kernel:  disk 10, o:1, dev:sdk1
Sep 21 07:09:26 artemis kernel:  disk 11, o:1, dev:sdl1
Sep 21 07:09:26 artemis kernel:  disk 12, o:0, dev:sdm1
Sep 21 07:09:26 artemis kernel: RAID5 conf printout:
Sep 21 07:09:26 artemis kernel:  --- rd:13 wd:11 fd:2
Sep 21 07:09:26 artemis kernel:  disk 0, o:1, dev:sda1
Sep 21 07:09:26 artemis kernel:  disk 1, o:1, dev:sdb1
Sep 21 07:09:26 artemis kernel:  disk 2, o:1, dev:sdc1
Sep 21 07:09:26 artemis kernel:  disk 3, o:1, dev:sdd1
Sep 21 07:09:26 artemis kernel:  disk 4, o:1, dev:sde1
Sep 21 07:09:26 artemis kernel:  disk 5, o:1, dev:sdf1
Sep 21 07:09:26 artemis kernel:  disk 6, o:0, dev:sdg1
Sep 21 07:09:26 artemis kernel:  disk 7, o:1, dev:sdh1
Sep 21 07:09:26 artemis kernel:  disk 8, o:1, dev:sdi1
Sep 21 07:09:26 artemis kernel:  disk 9, o:1, dev:sdj1
Sep 21 07:09:26 artemis kernel:  disk 10, o:1, dev:sdk1
Sep 21 07:09:26 artemis kernel:  disk 11, o:1, dev:sdl1
Sep 21 07:09:26 artemis kernel: RAID5 conf printout:
Sep 21 07:09:26 artemis kernel:  --- rd:13 wd:11 fd:2
Sep 21 07:09:26 artemis kernel:  disk 0, o:1, dev:sda1
Sep 21 07:09:26 artemis kernel:  disk 1, o:1, dev:sdb1
Sep 21 07:09:26 artemis kernel:  disk 2, o:1, dev:sdc1
Sep 21 07:09:26 artemis kernel:  disk 3, o:1, dev:sdd1
Sep 21 07:09:26 artemis kernel:  disk 4, o:1, dev:sde1
Sep 21 07:09:26 artemis kernel:  disk 5, o:1, dev:sdf1
Sep 21 07:09:26 artemis kernel:  disk 6, o:0, dev:sdg1
Sep 21 07:09:26 artemis kernel:  disk 7, o:1, dev:sdh1
Sep 21 07:09:26 artemis kernel:  disk 8, o:1, dev:sdi1
Sep 21 07:09:26 artemis kernel:  disk 9, o:1, dev:sdj1
Sep 21 07:09:26 artemis kernel:  disk 10, o:1, dev:sdk1
Sep 21 07:09:26 artemis kernel:  disk 11, o:1, dev:sdl1
Sep 21 07:09:26 artemis kernel: RAID5 conf printout:
Sep 21 07:09:26 artemis kernel:  --- rd:13 wd:11 fd:2
Sep 21 07:09:26 artemis kernel:  disk 0, o:1, dev:sda1
Sep 21 07:09:26 artemis kernel:  disk 1, o:1, dev:sdb1
Sep 21 07:09:26 artemis kernel:  disk 2, o:1, dev:sdc1
Sep 21 07:09:26 artemis kernel:  disk 3, o:1, dev:sdd1
Sep 21 07:09:26 artemis kernel:  disk 4, o:1, dev:sde1
Sep 21 07:09:26 artemis kernel:  disk 5, o:1, dev:sdf1
Sep 21 07:09:26 artemis kernel:  disk 7, o:1, dev:sdh1
Sep 21 07:09:26 artemis kernel:  disk 8, o:1, dev:sdi1
Sep 21 07:09:26 artemis kernel:  disk 9, o:1, dev:sdj1
Sep 21 07:09:26 artemis kernel:  disk 10, o:1, dev:sdk1
Sep 21 07:09:26 artemis kernel:  disk 11, o:1, dev:sdl1
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 1648
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 196082918
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 409997396
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 196082919
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 196082920
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 196082921
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 196082922
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: Buffer I/O error on device md0, logical block 196082923
Sep 21 07:09:26 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0) in ext3_prepare_write: IO failure
Sep 21 07:09:26 artemis kernel: __journal_remove_journal_head: freeing b_committed_data
Sep 21 07:09:26 artemis kernel: __journal_remove_journal_head: freeing b_frozen_data
Sep 21 07:09:26 artemis kernel: __journal_remove_journal_head: freeing b_committed_data
Sep 21 07:09:26 artemis kernel: __journal_remove_journal_head: freeing b_frozen_data
Sep 21 07:09:26 artemis kernel: journal commit I/O error
Sep 21 07:09:26 artemis last message repeated 4 times
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #205193231 offset 0
Sep 21 07:09:26 artemis kernel: 
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #205193231 offset 0
Sep 21 07:09:26 artemis kernel: 
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #205193231 offset 0
Sep 21 07:09:26 artemis kernel: 
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #205193231 offset 0
Sep 21 07:09:26 artemis kernel: 
Sep 21 07:09:26 artemis kernel: EXT3-fs error (device md0): ext3_get_inode_loc: unable to read inode block - inode=101744803, block=203489285
Sep 21 07:09:32 artemis kernel: printk: 29321 messages suppressed.
Sep 21 07:09:32 artemis kernel: Buffer I/O error on device md0, logical block 0
Sep 21 07:09:32 artemis kernel: lost page write due to I/O error on md0
Sep 21 07:09:55 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #114671669 contains a hole at offset 0
Sep 21 07:09:55 artemis last message repeated 9 times
Sep 21 07:10:01 artemis crond(pam_unix)[2692]: session opened for user root by (uid=0)
Sep 21 07:10:01 artemis tac_plus[2593]: Received signal 15, shutting down
Sep 21 07:10:01 artemis tacacs: tac_plus shutdown succeeded
Sep 21 07:10:01 artemis tac_plus[2712]: Reading config
Sep 21 07:10:01 artemis tac_plus[2712]: Version F4.0.3.alpha Initialized 1
Sep 21 07:10:01 artemis crond(pam_unix)[2692]: session closed for user root
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #145948742 offset 0
Sep 21 07:14:14 artemis kernel: 
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #145948742 contains a hole at offset 0
Sep 21 07:14:14 artemis last message repeated 2 times
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #27312185 offset 0
Sep 21 07:14:14 artemis kernel: 
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #27312185 contains a hole at offset 0
Sep 21 07:14:14 artemis last message repeated 2 times
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #93552693 offset 0
Sep 21 07:14:14 artemis kernel: 
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #93552693 contains a hole at offset 0
Sep 21 07:14:14 artemis last message repeated 2 times
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #40730714 offset 0
Sep 21 07:14:14 artemis kernel: 
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #40730714 contains a hole at offset 0
Sep 21 07:14:14 artemis last message repeated 2 times
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #99172467 offset 0
Sep 21 07:14:14 artemis kernel: 
Sep 21 07:14:14 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #99172467 contains a hole at offset 0
Sep 21 07:14:14 artemis last message repeated 2 times
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #145948742 contains a hole at offset 0
Sep 21 07:14:15 artemis last message repeated 2 times
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #93552693 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #40730714 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #93552693 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #93552693 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #40730714 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #40730714 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #27312185 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #99172467 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #27312185 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #27312185 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #99172467 contains a hole at offset 0
Sep 21 07:14:15 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #99172467 contains a hole at offset 0
Sep 21 07:14:17 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #27312185 contains a hole at offset 0
Sep 21 07:14:17 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #27312185 contains a hole at offset 0
Sep 21 07:14:17 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #27312185 offset 0
Sep 21 07:14:17 artemis kernel: 
Sep 21 07:14:17 artemis kernel: EXT3-fs error (device md0): ext3_readdir: directory #27312185 contains a hole at offset 0
Sep 21 07:14:32 artemis last message repeated 5 times
Sep 21 07:14:34 artemis kernel: EXT3-fs error (device md0): ext3_get_inode_loc: unable to read inode block - inode=19955841, block=39911428
Sep 21 07:14:34 artemis kernel: EXT3-fs error (device md0): ext3_get_inode_loc: unable to read inode block - inode=95354932, block=190709761
Sep 21 07:14:34 artemis kernel: EXT3-fs error (device md0): ext3_get_inode_loc: unable to read inode block - inode=187089029, block=374177796
Sep 21 07:14:34 artemis kernel: EXT3-fs error (device md0): ext3_get_inode_loc: unable to read inode block - inode=116441237, block=232882180
Sep 21 07:14:38 artemis kernel: EXT3-fs error (device md0): ext3_get_inode_loc: unable to read inode block - inode=166854730, block=333709314
Sep 21 07:14:38 artemis kernel: EXT3-fs error (device md0): ext3_get_inode_loc: unable to read inode block - inode=192053347, block=384106499
Sep 21 07:14:38 artemis kernel: EXT3-fs error (device md0): ext3_find_entry: reading directory #157302868 offset 0
... and the list goes on forever

^ permalink raw reply	[flat|nested] 9+ messages in thread

end of thread, other threads:[~2005-10-04 10:47 UTC | newest]

Thread overview: 9+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2005-09-30  6:54 2.6.14-rc2-git7 crashed on amd64 (usenet gateway) after 18 hours Danny ter Haar
2005-09-30  7:13 ` Andrew Morton
2005-09-30  7:13   ` Andrew Morton
2005-09-30  7:39   ` Danny ter Haar
2005-09-30 12:44     ` Sander
2005-09-30 16:22       ` Danny ter Haar
2005-09-30 11:33   ` Danny ter Haar
2005-09-30 13:04     ` Jens Laas
2005-10-04 10:47       ` Age Strand

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.