public inbox for linux-scsi@vger.kernel.org
 help / color / mirror / Atom feed
* Re: [Bugme-new] [Bug 11898] New: mke2fs hang on AIC79 device.
       [not found] <bug-11898-10286@http.bugzilla.kernel.org/>
@ 2008-10-30  8:53 ` Andrew Morton
  2008-10-30 10:22   ` Shi, Alex
  0 siblings, 1 reply; 5+ messages in thread
From: Andrew Morton @ 2008-10-30  8:53 UTC (permalink / raw)
  To: alex.shi; +Cc: bugme-daemon, linux-scsi


(switched to email.  Please respond via emailed reply-to-all, not via the
bugzilla web interface).

On Thu, 30 Oct 2008 01:17:37 -0700 (PDT) bugme-daemon@bugzilla.kernel.org wrote:

> http://bugzilla.kernel.org/show_bug.cgi?id=11898
> 
>            Summary: mke2fs hang on AIC79 device.
>            Product: IO/Storage
>            Version: 2.5
>      KernelVersion: 2.6.28-rc1/rc2
>           Platform: All
>         OS/Version: Linux
>               Tree: Mainline
>             Status: NEW
>           Severity: blocking
>           Priority: P1
>          Component: SCSI
>         AssignedTo: linux-scsi@vger.kernel.org
>         ReportedBy: alex.shi@intel.com
> 
> 
> Latest working kernel version:2.6.27
> Earliest failing kernel version:2.6.28-rc1
> Distribution:RHEL 4.91
> Hardware Environment:AIC79xx
> Software Environment: 
> Problem Description:
> 
> Steps to reproduce: mke2fs /dev/sdx 
> 
> 
> [root@linux-b03 ~]#  mke2fs /dev/sdb1
> mke2fs 1.39 (29-May-2006)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> 3842720 inodes, 7679996 blocks
> 383999 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=4294967296
> 235 block groups
> 32768 blocks per group, 32768 fragments per group
> 16352 inodes per group
> Superblock backups stored on blocks:
>         32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
>         4096000
> 
> Writing inode tables: done
> Writing superblocks and filesystem accounting information:
> 
> ..... hang .... 

Can you please work out where it hung?  Enable the softlockup detector,
nmi watchdog, try to get a sysrq-w or sysrq-t trace, etc?

Thanks.


> lspci : 
> 
> 
> 04:02.0 SCSI storage controller: Adaptec AIC-7902B U320 (rev 10)
>         Subsystem: Super Micro Computer Inc Unknown device 8080
>         Flags: bus master, 66MHz, slow devsel, latency 64, IRQ 16
>         I/O ports at 2400 [disabled] [size=256]
>         Memory at c8200000 (64-bit, non-prefetchable) [size=8K]
>         I/O ports at 2000 [disabled] [size=256]
>         [virtual] Expansion ROM at c2000000 [disabled] [size=512K]
>         Capabilities: <access denied>
> 
> 04:02.1 SCSI storage controller: Adaptec AIC-7902B U320 (rev 10)
>         Subsystem: Super Micro Computer Inc Unknown device 8080
>         Flags: bus master, 66MHz, slow devsel, latency 64, IRQ 17
>         I/O ports at 2c00 [disabled] [size=256]
>         Memory at c8202000 (64-bit, non-prefetchable) [size=8K]
>         I/O ports at 2800 [disabled] [size=256]
>         [virtual] Expansion ROM at c2080000 [disabled] [size=512K]
>         Capabilities: <access denied>
> 
> dmesg: 
> 
> 8D0, 0014 (r0 PTLTD )
> ACPI: RSDT BFF631DD, 003C (r1 PTLTD    RSDT    6040000  LTP        0)
> ACPI: FACP BFF68E10, 0074 (r1 INTEL  TUMWATER  6040000 PTL         3)
> ACPI: DSDT BFF64ACF, 4341 (r1  Intel BLAKFORD  6040000 MSFT  100000E)
> ACPI: FACS BFF69FC0, 0040
> ACPI: APIC BFF68E84, 00C8 (r1 PTLTD      APIC    6040000  LTP        0)
> ACPI: MCFG BFF68F4C, 003C (r1 PTLTD    MCFG    6040000  LTP        0)
> ACPI: BOOT BFF68F88, 0028 (r1 PTLTD  $SBFTBL$  6040000  LTP        1)
> ACPI: SPCR BFF68FB0, 0050 (r1 PTLTD  $UCRTBL$  6040000 PTL         1)
> ACPI: SSDT BFF63219, 13EC (r1  PmRef    CpuPm     3000 INTL 20050228)
> ACPI: Local APIC address 0xfee00000
> (7 early reservations) ==> bootmem [0000000000 - 0140000000]
>   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
>   #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
>   #2 [0000200000 - 00006cabc8]    TEXT DATA BSS ==> [0000200000 - 00006cabc8]
>   #3 [0037eba000 - 0037fefe92]          RAMDISK ==> [0037eba000 - 0037fefe92]
>   #4 [000009c800 - 0000100000]    BIOS reserved ==> [000009c800 - 0000100000]
>   #5 [0000008000 - 000000b000]          PGTABLE ==> [0000008000 - 000000b000]
>   #6 [000000b000 - 000000c000]          PGTABLE ==> [000000b000 - 000000c000]
> found SMP MP-table at [ffff8800000f5900] 000f5900
>  [ffffe20000000000-ffffe200045fffff] PMD -> [ffff880028200000-ffff88002c7fffff]
> on node 0
> Zone PFN ranges:
>   DMA      0x00000000 -> 0x00001000
>   DMA32    0x00001000 -> 0x00100000
>   Normal   0x00100000 -> 0x00140000
> Movable zone start PFN for each node
> early_node_map[3] active PFN ranges
>     0: 0x00000000 -> 0x0000009c
>     0: 0x00000100 -> 0x000bff60
>     0: 0x00100000 -> 0x00140000
> On node 0 totalpages: 1048316
>   DMA zone: 56 pages used for memmap
>   DMA zone: 1334 pages reserved
>   DMA zone: 2606 pages, LIFO batch:0
>   DMA32 zone: 14280 pages used for memmap
>   DMA32 zone: 767896 pages, LIFO batch:31
>   Normal zone: 3584 pages used for memmap
>   Normal zone: 258560 pages, LIFO batch:31
>   Movable zone: 0 pages used for memmap
> ACPI: PM-Timer IO Port: 0x1008
> ACPI: Local APIC address 0xfee00000
> ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> ACPI: LAPIC (acpi_id[0x01] lapic_id[0x04] enabled)
> ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
> ACPI: LAPIC (acpi_id[0x03] lapic_id[0x05] enabled)
> ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
> ACPI: LAPIC (acpi_id[0x05] lapic_id[0x06] enabled)
> ACPI: LAPIC (acpi_id[0x06] lapic_id[0x03] enabled)
> ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
> ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
> ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
> IOAPIC[0]: apic_id 8, version 0, address 0xfec00000, GSI 0-23
> ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
> IOAPIC[1]: apic_id 9, version 0, address 0xfec80000, GSI 24-47
> ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> ACPI: IRQ0 used by override.
> ACPI: IRQ2 used by override.
> ACPI: IRQ9 used by override.
> Using ACPI (MADT) for SMP configuration information
> SMP: Allowing 8 CPUs, 0 hotplug CPUs
> Allocating PCI resources starting at c2000000 (gap: c0000000:20000000)
> PERCPU: Allocating 45056 bytes of per cpu data
> NR_CPUS: 8, nr_cpu_ids: 8, nr_node_ids 1
> Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 1029062
> Kernel command line: ro root=LABEL=/1 profile=2 console=ttyS0,38400 
> kernel profiling enabled (shift: 2)
> Initializing CPU#0
> PID hash table entries: 4096 (order: 12, 32768 bytes)
> Fast TSC calibration using PIT
> Detected 2400.210 MHz processor.
> Console: colour VGA+ 80x25
> console [ttyS0] enabled
> Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> Checking aperture...
> No AGP bridge found
> Calgary: detecting Calgary via BIOS EBDA area
> Calgary: Unable to locate Rio Grande table in EBDA - bailing!
> PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
> Placing software IO TLB between 0x20000000 - 0x24000000
> Memory: 4039052k/5242880k available (2745k kernel code, 153224k reserved, 1353k
> data, 328k init)
> Calibrating delay loop (skipped), value calculated using timer frequency..
> 4800.42 BogoMIPS (lpj=9600840)
> Mount-cache hash table entries: 256
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 0
> CPU: Processor Core ID: 0
> CPU0: Thermal monitoring handled by SMI
> using mwait in idle threads.
> ACPI: Core revision 20080926
> Parsing all Control Methods:
> Table [DSDT](id 0001) - 421 Objects with 47 Devices 131 Methods 22 Regions
> Parsing all Control Methods:
> Table [SSDT](id 0002) - 43 Objects with 0 Devices 16 Methods 0 Regions
>  tbxface-0596 [00] tb_load_namespace     : ACPI Tables successfully acquired
> evxfevnt-0091 [00] enable                : Transition to ACPI mode successful
> Setting APIC routing to flat
> ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
> CPU0: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> Booting processor 1 APIC 0x4 ip 0x6000
> Initializing CPU#1
> Calibrating delay using timer specific routine.. 4800.39 BogoMIPS (lpj=9600793)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 1
> CPU: Processor Core ID: 0
> CPU1: Thermal monitoring enabled (TM2)
> CPU1: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#1]: passed.
> Booting processor 2 APIC 0x1 ip 0x6000
> Initializing CPU#2
> Calibrating delay using timer specific routine.. 4800.39 BogoMIPS (lpj=9600792)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 0
> CPU: Processor Core ID: 1
> CPU2: Thermal monitoring enabled (TM2)
> CPU2: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#2]: passed.
> Booting processor 3 APIC 0x5 ip 0x6000
> Initializing CPU#3
> Calibrating delay using timer specific routine.. 4800.39 BogoMIPS (lpj=9600792)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 1
> CPU: Processor Core ID: 1
> CPU3: Thermal monitoring enabled (TM2)
> CPU3: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#3]: passed.
> Booting processor 4 APIC 0x2 ip 0x6000
> Initializing CPU#4
> Calibrating delay using timer specific routine.. 4800.36 BogoMIPS (lpj=9600737)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 0
> CPU: Processor Core ID: 2
> CPU4: Thermal monitoring enabled (TM2)
> CPU4: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#4]: passed.
> Booting processor 5 APIC 0x6 ip 0x6000
> Initializing CPU#5
> Calibrating delay using timer specific routine.. 4800.39 BogoMIPS (lpj=9600791)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 1
> CPU: Processor Core ID: 2
> CPU5: Thermal monitoring enabled (TM2)
> CPU5: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#5]: passed.
> Booting processor 6 APIC 0x3 ip 0x6000
> Initializing CPU#6
> Calibrating delay using timer specific routine.. 4800.36 BogoMIPS (lpj=9600728)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 0
> CPU: Processor Core ID: 3
> CPU6: Thermal monitoring enabled (TM2)
> CPU6: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#6]: passed.
> Booting processor 7 APIC 0x7 ip 0x6000
> Initializing CPU#7
> Calibrating delay using timer specific routine.. 4801.13 BogoMIPS (lpj=9602264)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 1
> CPU: Processor Core ID: 3
> CPU7: Thermal monitoring enabled (TM2)
> CPU7: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#7]: passed.
> Brought up 8 CPUs
> Total of 8 processors activated (38403.86 BogoMIPS).
> net_namespace: 888 bytes
> NET: Registered protocol family 16
> ACPI: bus type pci registered
> PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 10
> PCI: MCFG area at e0000000 reserved in E820
> PCI: Using MMCONFIG at e0000000 - e0afffff
> PCI: Using configuration type 1 for base access
> evgpeblk-0957 [00] ev_create_gpe_block   : GPE 00 to 1F [_GPE] 4 regs on int
> 0x9
> ACPI: EC: Look up EC in DSDT
> Completing Region/Field/Buffer/Package
> initialization:.........................................................................
> Initialized 17/22 Regions 0/0 Fields 35/35 Buffers 21/21 Packages (473 nodes)
> Initializing Device/Processor/Thermal objects by executing _INI methods:.
> Executed 1 _INI methods requiring 0 _STA executions (examined 57 objects)
> evgpeblk-1054 [00] ev_initialize_gpe_bloc: Found 9 Wake, Enabled 0 Runtime GPEs
> in this block
> ACPI: Interpreter enabled
> ACPI: (supports S0 S1 S5)
> ACPI: Using IOAPIC for interrupt routing
> ACPI: PCI Root Bridge [PCI0] (0000:00)
> pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:00.0: PME# disabled
> pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:02.0: PME# disabled
> pci 0000:00:04.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:04.0: PME# disabled
> pci 0000:00:06.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:06.0: PME# disabled
> pci 0000:00:08.0: reg 10 64bit mmio: [0xfe700000-0xfe7003ff]
> pci 0000:00:08.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:08.0: PME# disabled
> pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:1c.0: PME# disabled
> pci 0000:00:1d.0: reg 20 io port: [0x1800-0x181f]
> pci 0000:00:1d.1: reg 20 io port: [0x1820-0x183f]
> pci 0000:00:1d.2: reg 20 io port: [0x1840-0x185f]
> pci 0000:00:1d.7: reg 10 32bit mmio: [0xc8000000-0xc80003ff]
> pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
> pci 0000:00:1d.7: PME# disabled
> pci 0000:00:1f.0: Force enabled HPET at 0xfed00000
> pci 0000:00:1f.1: reg 10 io port: [0x00-0x07]
> pci 0000:00:1f.1: reg 14 io port: [0x00-0x03]
> pci 0000:00:1f.1: reg 18 io port: [0x00-0x07]
> pci 0000:00:1f.1: reg 1c io port: [0x00-0x03]
> pci 0000:00:1f.1: reg 20 io port: [0x1860-0x186f]
> pci 0000:00:1f.3: reg 20 io port: [0x1100-0x111f]
> pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:01:00.0: PME# disabled
> pci 0000:01:00.3: PME# supported from D0 D3hot D3cold
> pci 0000:01:00.3: PME# disabled
> pci 0000:00:02.0: bridge io port: [0x2000-0x3fff]
> pci 0000:00:02.0: bridge 32bit mmio: [0xc8100000-0xc83fffff]
> pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:02:00.0: PME# disabled
> pci 0000:02:02.0: PME# supported from D0 D3hot D3cold
> pci 0000:02:02.0: PME# disabled
> pci 0000:01:00.0: bridge io port: [0x2000-0x3fff]
> pci 0000:01:00.0: bridge 32bit mmio: [0xc8200000-0xc83fffff]
> pci 0000:03:00.0: PXH quirk detected; SHPC device MSI disabled
> pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:03:00.0: PME# disabled
> pci 0000:03:00.2: PXH quirk detected; SHPC device MSI disabled
> pci 0000:03:00.2: PME# supported from D0 D3hot D3cold
> pci 0000:03:00.2: PME# disabled
> pci 0000:02:00.0: bridge io port: [0x2000-0x2fff]
> pci 0000:02:00.0: bridge 32bit mmio: [0xc8200000-0xc82fffff]
> pci 0000:04:02.0: reg 10 io port: [0x2400-0x24ff]
> pci 0000:04:02.0: reg 14 64bit mmio: [0xc8200000-0xc8201fff]
> pci 0000:04:02.0: reg 1c io port: [0x2000-0x20ff]
> pci 0000:04:02.0: reg 30 32bit mmio: [0x000000-0x07ffff]
> pci 0000:04:02.1: reg 10 io port: [0x2c00-0x2cff]
> pci 0000:04:02.1: reg 14 64bit mmio: [0xc8202000-0xc8203fff]
> pci 0000:04:02.1: reg 1c io port: [0x2800-0x28ff]
> pci 0000:04:02.1: reg 30 32bit mmio: [0x000000-0x07ffff]
> pci 0000:03:00.0: bridge io port: [0x2000-0x2fff]
> pci 0000:03:00.0: bridge 32bit mmio: [0xc8200000-0xc82fffff]
> pci 0000:06:00.0: reg 10 32bit mmio: [0xc8320000-0xc833ffff]
> pci 0000:06:00.0: reg 14 32bit mmio: [0xc8300000-0xc831ffff]
> pci 0000:06:00.0: reg 18 io port: [0x3000-0x301f]
> pci 0000:06:00.0: reg 30 32bit mmio: [0x000000-0x00ffff]
> pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:06:00.0: PME# disabled
> pci 0000:06:00.1: reg 10 32bit mmio: [0xc8360000-0xc837ffff]
> pci 0000:06:00.1: reg 14 32bit mmio: [0xc8340000-0xc835ffff]
> pci 0000:06:00.1: reg 18 io port: [0x3020-0x303f]
> pci 0000:06:00.1: reg 30 32bit mmio: [0x000000-0x00ffff]
> pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
> pci 0000:06:00.1: PME# disabled
> pci 0000:02:02.0: bridge io port: [0x3000-0x3fff]
> pci 0000:02:02.0: bridge 32bit mmio: [0xc8300000-0xc83fffff]
> pci 0000:0b:01.0: reg 10 32bit mmio: [0xd0000000-0xd7ffffff]
> pci 0000:0b:01.0: reg 14 io port: [0x4000-0x40ff]
> pci 0000:0b:01.0: reg 18 32bit mmio: [0xc8400000-0xc840ffff]
> pci 0000:0b:01.0: reg 30 32bit mmio: [0x000000-0x01ffff]
> pci 0000:0b:01.0: supports D1 D2
> pci 0000:00:1e.0: transparent bridge
> pci 0000:00:1e.0: bridge io port: [0x4000-0x4fff]
> pci 0000:00:1e.0: bridge 32bit mmio: [0xc8400000-0xc84fffff]
> pci 0000:00:1e.0: bridge 64bit mmio pref: [0xd0000000-0xd7ffffff]
> bus 00 -> node 0
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMD0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMD0.BPD0.PXH0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMD0.BPD0.PXH1._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMD0.BPD2._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMF3._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P4._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P6._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCIB._PRT]
> ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 11 14 15) *9
> ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 7 10 11 14 15)
> ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 10 *11 14 15)
> ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 *10 11 14 15)
> ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.
> ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 6 7 10 11 14 15) *0, disabled.
> ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.
> ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 6 7 10 11 14 15) *0, disabled.
> SCSI subsystem initialized
> PCI: Using ACPI for IRQ routing
> PCI-GART: No AMD northbridge found.
> hpet clockevent registered
> HPET: 3 timers in total, 0 timers will be used for per-cpu timer
> hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
> hpet0: 3 comparators, 64-bit 14.318180 MHz counter
> pnp: PnP ACPI init
> ACPI: bus type pnp registered
> pnp: PnP ACPI: found 13 devices
> ACPI: ACPI bus type pnp unregistered
> system 00:01: ioport range 0x4d0-0x4d1 has been reserved
> system 00:01: ioport range 0x295-0x296 has been reserved
> system 00:01: ioport range 0xca2-0xca3 has been reserved
> system 00:01: ioport range 0xca8-0xcaf has been reserved
> system 00:01: ioport range 0x1000-0x107f has been reserved
> system 00:01: ioport range 0x1180-0x11bf has been reserved
> system 00:01: ioport range 0x800-0x80f has been reserved
> system 00:01: ioport range 0xfe00-0xfe00 has been reserved
> system 00:01: iomem range 0xe0000000-0xefffffff could not be reserved
> system 00:01: iomem range 0xfee00000-0xfee0ffff could not be reserved
> system 00:01: iomem range 0xfec80000-0xfec80fff has been reserved
> system 00:01: iomem range 0xfed1c000-0xfed1ffff has been reserved
> system 00:01: iomem range 0xfe000000-0xfe01ffff has been reserved
> system 00:01: iomem range 0xfe600000-0xfe6fffff has been reserved
> pci 0000:03:00.0: PCI bridge, secondary bus 0000:04
> pci 0000:03:00.0:   IO window: 0x2000-0x2fff
> pci 0000:03:00.0:   MEM window: 0xc8200000-0xc82fffff
> pci 0000:03:00.0:   PREFETCH window: 0x000000c2000000-0x000000c20fffff
> pci 0000:03:00.2: PCI bridge, secondary bus 0000:05
> pci 0000:03:00.2:   IO window: disabled
> pci 0000:03:00.2:   MEM window: disabled
> pci 0000:03:00.2:   PREFETCH window: disabled
> pci 0000:02:00.0: PCI bridge, secondary bus 0000:03
> pci 0000:02:00.0:   IO window: 0x2000-0x2fff
> pci 0000:02:00.0:   MEM window: 0xc8200000-0xc82fffff
> pci 0000:02:00.0:   PREFETCH window: 0x000000c2000000-0x000000c20fffff
> pci 0000:02:02.0: PCI bridge, secondary bus 0000:06
> pci 0000:02:02.0:   IO window: 0x3000-0x3fff
> pci 0000:02:02.0:   MEM window: 0xc8300000-0xc83fffff
> pci 0000:02:02.0:   PREFETCH window: 0x000000c2100000-0x000000c21fffff
> pci 0000:01:00.0: PCI bridge, secondary bus 0000:02
> pci 0000:01:00.0:   IO window: 0x2000-0x3fff
> pci 0000:01:00.0:   MEM window: 0xc8200000-0xc83fffff
> pci 0000:01:00.0:   PREFETCH window: 0x000000c2000000-0x000000c21fffff
> pci 0000:01:00.3: PCI bridge, secondary bus 0000:07
> pci 0000:01:00.3:   IO window: disabled
> pci 0000:01:00.3:   MEM window: disabled
> pci 0000:01:00.3:   PREFETCH window: disabled
> pci 0000:00:02.0: PCI bridge, secondary bus 0000:01
> pci 0000:00:02.0:   IO window: 0x2000-0x3fff
> pci 0000:00:02.0:   MEM window: 0xc8100000-0xc83fffff
> pci 0000:00:02.0:   PREFETCH window: 0x000000c2000000-0x000000c21fffff
> pci 0000:00:04.0: PCI bridge, secondary bus 0000:08
> pci 0000:00:04.0:   IO window: disabled
> pci 0000:00:04.0:   MEM window: disabled
> pci 0000:00:04.0:   PREFETCH window: disabled
> pci 0000:00:06.0: PCI bridge, secondary bus 0000:09
> pci 0000:00:06.0:   IO window: disabled
> pci 0000:00:06.0:   MEM window: disabled
> pci 0000:00:06.0:   PREFETCH window: disabled
> pci 0000:00:1c.0: PCI bridge, secondary bus 0000:0a
> pci 0000:00:1c.0:   IO window: disabled
> pci 0000:00:1c.0:   MEM window: disabled
> pci 0000:00:1c.0:   PREFETCH window: disabled
> pci 0000:00:1e.0: PCI bridge, secondary bus 0000:0b
> pci 0000:00:1e.0:   IO window: 0x4000-0x4fff
> pci 0000:00:1e.0:   MEM window: 0xc8400000-0xc84fffff
> pci 0000:00:1e.0:   PREFETCH window: 0x000000d0000000-0x000000d7ffffff
> pci 0000:00:02.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:00:02.0: setting latency timer to 64
> pci 0000:01:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:01:00.0: setting latency timer to 64
> pci 0000:02:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:02:00.0: setting latency timer to 64
> pci 0000:03:00.0: setting latency timer to 64
> pci 0000:03:00.2: setting latency timer to 64
> pci 0000:02:02.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
> pci 0000:02:02.0: setting latency timer to 64
> pci 0000:01:00.3: setting latency timer to 64
> pci 0000:00:04.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:00:04.0: setting latency timer to 64
> pci 0000:00:06.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:00:06.0: setting latency timer to 64
> pci 0000:00:1c.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
> pci 0000:00:1c.0: setting latency timer to 64
> pci 0000:00:1e.0: setting latency timer to 64
> bus: 00 index 0 io port: [0x00-0xffff]
> bus: 00 index 1 mmio: [0x000000-0xffffffffffffffff]
> bus: 01 index 0 io port: [0x2000-0x3fff]
> bus: 01 index 1 mmio: [0xc8100000-0xc83fffff]
> bus: 01 index 2 mmio: [0xc2000000-0xc21fffff]
> bus: 01 index 3 mmio: [0x0-0x0]
> bus: 02 index 0 io port: [0x2000-0x3fff]
> bus: 02 index 1 mmio: [0xc8200000-0xc83fffff]
> bus: 02 index 2 mmio: [0xc2000000-0xc21fffff]
> bus: 02 index 3 mmio: [0x0-0x0]
> bus: 03 index 0 io port: [0x2000-0x2fff]
> bus: 03 index 1 mmio: [0xc8200000-0xc82fffff]
> bus: 03 index 2 mmio: [0xc2000000-0xc20fffff]
> bus: 03 index 3 mmio: [0x0-0x0]
> bus: 04 index 0 io port: [0x2000-0x2fff]
> bus: 04 index 1 mmio: [0xc8200000-0xc82fffff]
> bus: 04 index 2 mmio: [0xc2000000-0xc20fffff]
> bus: 04 index 3 mmio: [0x0-0x0]
> bus: 05 index 0 mmio: [0x0-0x0]
> bus: 05 index 1 mmio: [0x0-0x0]
> bus: 05 index 2 mmio: [0x0-0x0]
> bus: 05 index 3 mmio: [0x0-0x0]
> bus: 06 index 0 io port: [0x3000-0x3fff]
> bus: 06 index 1 mmio: [0xc8300000-0xc83fffff]
> bus: 06 index 2 mmio: [0xc2100000-0xc21fffff]
> bus: 06 index 3 mmio: [0x0-0x0]
> bus: 07 index 0 mmio: [0x0-0x0]
> bus: 07 index 1 mmio: [0x0-0x0]
> bus: 07 index 2 mmio: [0x0-0x0]
> bus: 07 index 3 mmio: [0x0-0x0]
> bus: 08 index 0 mmio: [0x0-0x0]
> bus: 08 index 1 mmio: [0x0-0x0]
> bus: 08 index 2 mmio: [0x0-0x0]
> bus: 08 index 3 mmio: [0x0-0x0]
> bus: 09 index 0 mmio: [0x0-0x0]
> bus: 09 index 1 mmio: [0x0-0x0]
> bus: 09 index 2 mmio: [0x0-0x0]
> bus: 09 index 3 mmio: [0x0-0x0]
> bus: 0a index 0 mmio: [0x0-0x0]
> bus: 0a index 1 mmio: [0x0-0x0]
> bus: 0a index 2 mmio: [0x0-0x0]
> bus: 0a index 3 mmio: [0x0-0x0]
> bus: 0b index 0 io port: [0x4000-0x4fff]
> bus: 0b index 1 mmio: [0xc8400000-0xc84fffff]
> bus: 0b index 2 mmio: [0xd0000000-0xd7ffffff]
> bus: 0b index 3 io port: [0x00-0xffff]
> bus: 0b index 4 mmio: [0x000000-0xffffffffffffffff]
> NET: Registered protocol family 2
> IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
> TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
> TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
> TCP: Hash tables configured (established 262144 bind 65536)
> TCP reno registered
> NET: Registered protocol family 1
> checking if image is initramfs... it is
> Freeing initrd memory: 1239k freed
> Simple Boot Flag at 0x38 set to 0x1
> HugeTLB registered 2 MB page size, pre-allocated 0 pages
> Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
> msgmni has been set to 7893
> io scheduler noop registered
> io scheduler anticipatory registered (default)
> io scheduler deadline registered
> io scheduler cfq registered
> pci 0000:0b:01.0: Boot video device
> input: Power Button (FF) as /class/input/input0
> ACPI: Power Button (FF) [PWRF]
> input: Power Button (CM) as /class/input/input1
> ACPI: Power Button (CM) [PWRB]
> ACPI: SSDT BFF64605, 0200 (r1  PmRef  Cpu0Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00C6) - 5 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:00: registered as cooling_device0
> ACPI: Processor [CPU0] (supports 8 throttling states)
> ACPI: SSDT BFF64805, 0066 (r1  PmRef  Cpu1Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00C9) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:01: registered as cooling_device1
> ACPI: Processor [CPU1] (supports 8 throttling states)
> ACPI: SSDT BFF6486B, 0066 (r1  PmRef  Cpu2Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00CC) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:02: registered as cooling_device2
> ACPI: Processor [CPU2] (supports 8 throttling states)
> ACPI: SSDT BFF648D1, 0066 (r1  PmRef  Cpu3Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00CF) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:03: registered as cooling_device3
> ACPI: Processor [CPU3] (supports 8 throttling states)
> ACPI: SSDT BFF64937, 0066 (r1  PmRef  CPU4Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00D2) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:04: registered as cooling_device4
> ACPI: Processor [CPU4] (supports 8 throttling states)
> ACPI: SSDT BFF6499D, 0066 (r1  PmRef  CPU5Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00D5) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:05: registered as cooling_device5
> ACPI: Processor [CPU5] (supports 8 throttling states)
> ACPI: SSDT BFF64A03, 0066 (r1  PmRef  Cpu6Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00D8) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:06: registered as cooling_device6
> ACPI: Processor [CPU6] (supports 8 throttling states)
> ACPI: SSDT BFF64A69, 0066 (r1  PmRef  Cpu7Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00DB) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:07: registered as cooling_device7
> ACPI: Processor [CPU7] (supports 8 throttling states)
> Real Time Clock Driver v1.12ac
> intel_rng: FWH not detected
> Linux agpgart interface v0.103
> Hangcheck: starting hangcheck timer 0.9.0 (tick is 180 seconds, margin is 60
> seconds).
> Hangcheck: Using get_cycles().
> Serial: 8250/16550 driver4 ports, IRQ sharing disabled
> serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> 00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> 00:0a: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> Floppy drive(s): fd0 is 1.44M
> FDC 0 is a post-1991 82077
> brd: module loaded
> loop: module loaded
> Intel(R) PRO/1000 Network Driver - version 7.3.20-k3-NAPI
> Copyright (c) 1999-2006 Intel Corporation.
> console [netcon0] enabled
> netconsole: network logging started
> Uniform Multi-Platform E-IDE driver
> piix 0000:00:1f.1: IDE controller (0x8086:0x269e rev 0x09)
> pci 0000:00:1f.1: PCI INT A -> GSI 18 (level, low) -> IRQ 18
> piix 0000:00:1f.1: IDE port disabled
> piix 0000:00:1f.1: not 100% native mode: will probe irqs later
>     ide0: BM-DMA at 0x1860-0x1867
> Probing IDE interface ide0...
> hdb: LITE-ON COMBO SOHC-5236V, ATAPI CD/DVD-ROM drive
> hdb: host max PIO4 wanted PIO255(auto-tune) selected PIO4
> hdb: UDMA/44 mode selected
> ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
> ide_generic: please use "probe_mask=0x3f" module parameter for probing all
> legacy ISA IDE ports
> ide-gd driver 1.18
> ide-cd driver 5.00
> ide-cd: hdb: ATAPI 52X DVD-ROM CD-R/RW drive, 1536kB Cache
> Uniform CD-ROM driver Revision: 3.20
> aic79xx 0000:04:02.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> scsi0 : Adaptec AIC79XX PCI-X SCSI HBA DRIVER, Rev 3.0
>         <Adaptec AIC7902 Ultra320 SCSI adapter>
>         aic7902: Ultra320 Wide Channel A, SCSI Id=7, PCI-X 67-100MHz, 512 SCBs
> scsi 0:0:6:0: Direct-Access     HITACHI  HUS103073FL3800  SA1B PQ: 0 ANSI: 3
>  target0:0:6: asynchronous
> scsi0:A:6:0: Tagged Queuing enabled.  Depth 32
>  target0:0:6: Beginning Domain Validation
>  target0:0:6: wide asynchronous
>  target0:0:6: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RDSTRM RTI WRFLOW PCOMP
> (6.25 ns, offset 80)
>  target0:0:6: Ending Domain Validation
> scsi 0:0:8:0: Processor         SUPER    GEM359 REV001    1.09 PQ: 0 ANSI: 2
>  target0:0:8: asynchronous
>  target0:0:8: Beginning Domain Validation
>  target0:0:8: Ending Domain Validation
> scsi 0:0:9:0: Direct-Access     SEAGATE  ST336607LC       0007 PQ: 0 ANSI: 3
>  target0:0:9: asynchronous
> scsi0:A:9:0: Tagged Queuing enabled.  Depth 32
>  target0:0:9: Beginning Domain Validation
>  target0:0:9: wide asynchronous
>  target0:0:9: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RDSTRM RTI WRFLOW PCOMP
> (6.25 ns, offset 63)
>  target0:0:9: Ending Domain Validation
> aic79xx 0000:04:02.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
> scsi1 : Adaptec AIC79XX PCI-X SCSI HBA DRIVER, Rev 3.0
>         <Adaptec AIC7902 Ultra320 SCSI adapter>
>         aic7902: Ultra320 Wide Channel B, SCSI Id=7, PCI-X 67-100MHz, 512 SCBs
> Driver 'sd' needs updating - please use bus_type methods
> sd 0:0:6:0: [sda] 143374805 512-byte hardware sectors: (73.4 GB/68.3 GiB)
> sd 0:0:6:0: [sda] Write Protect is off
> sd 0:0:6:0: [sda] Mode Sense: c3 00 10 08
> sd 0:0:6:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and
> FUA
> sd 0:0:6:0: [sda] 143374805 512-byte hardware sectors: (73.4 GB/68.3 GiB)
> sd 0:0:6:0: [sda] Write Protect is off
> sd 0:0:6:0: [sda] Mode Sense: c3 00 10 08
> sd 0:0:6:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and
> FUA
>  sda: sda1 sda2
> sd 0:0:6:0: [sda] Attached SCSI disk
> sd 0:0:9:0: [sdb] 71687372 512-byte hardware sectors: (36.7 GB/34.1 GiB)
> sd 0:0:9:0: [sdb] Write Protect is off
> sd 0:0:9:0: [sdb] Mode Sense: ab 00 10 08
> sd 0:0:9:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and
> FUA
> sd 0:0:9:0: [sdb] 71687372 512-byte hardware sectors: (36.7 GB/34.1 GiB)
> sd 0:0:9:0: [sdb] Write Protect is off
> sd 0:0:9:0: [sdb] Mode Sense: ab 00 10 08
> sd 0:0:9:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and
> FUA
>  sdb: sdb1 sdb2
> sd 0:0:9:0: [sdb] Attached SCSI disk
> PNP: PS/2 Controller [PNP0303:KBC0,PNP0f13:MSE0] at 0x60,0x64 irq 1,12
> serio: i8042 KBD port at 0x60,0x64 irq 1
> serio: i8042 AUX port at 0x60,0x64 irq 12
> mice: PS/2 mouse device common for all mice
> dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
> oprofile: using NMI interrupt.
> TCP cubic registered
> input: AT Translated Set 2 keyboard as /class/input/input2
> NET: Registered protocol family 10
> IPv6 over IPv4 tunneling driver
> NET: Registered protocol family 17
> RPC: Registered udp transport module.
> RPC: Registered tcp transport module.
> Freeing unused kernel memory: 328k freed
> end_request: I/O error, dev fd0, sector 0
> end_request: I/O error, dev fd0, sector 0
> EXT3-fs: INFO: recovery required on readonly filesystem.
> EXT3-fs: write access will be enabled during recovery.
> input: PS/2 Generic Mouse as /class/input/input3
> kjournald starting.  Commit interval 5 seconds
> EXT3-fs: recovery complete.
> EXT3-fs: mounted filesystem with ordered data mode.
> e1000e: Intel(R) PRO/1000 Network Driver - 0.3.3.3-k6
> e1000e: Copyright (c) 1999-2008 Intel Corporation.
> e1000e 0000:06:00.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
> e1000e 0000:06:00.0: setting latency timer to 64
> e1000e 0000:06:00.0: irq 95 for MSI/MSI-X
> 0000:06:00.0: eth0: (PCI Express:2.5GB/s:Width x4) 00:30:48:30:61:16
> 0000:06:00.0: eth0: Intel(R) PRO/1000 Network Connection
> 0000:06:00.0: eth0: MAC: 4, PHY: 5, PBA No: ffffff-0ff
> e1000e 0000:06:00.1: PCI INT B -> GSI 19 (level, low) -> IRQ 19
> e1000e 0000:06:00.1: setting latency timer to 64
> e1000e 0000:06:00.1: irq 94 for MSI/MSI-X
> 0000:06:00.1: eth1: (PCI Express:2.5GB/s:Width x4) 00:30:48:30:61:17
> 0000:06:00.1: eth1: Intel(R) PRO/1000 Network Connection
> 0000:06:00.1: eth1: MAC: 4, PHY: 5, PBA No: ffffff-0ff
> EXT3 FS on sda1, internal journal
> Adding 4096564k swap on /dev/sda2.  Priority:-1 extents:1 across:4096564k
> Adding 5123064k swap on /dev/sdb2.  Priority:-2 extents:1 across:5123064k
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>
> <peter.oruba@amd.com>
> Microcode Update Driver: v2.00 removed.
> warning: process `kudzu' used the deprecated sysctl system call with 1.23.
> process `sysctl' is using deprecated sysctl (syscall)
> net.ipv6.neigh.default.retrans_time; Use net.ipv6.neigh.default.retrans_time_ms
> instead.
> e1000e 0000:06:00.0: irq 95 for MSI/MSI-X
> e1000e 0000:06:00.0: irq 95 for MSI/MSI-X
> ADDRCONF(NETDEV_UP): eth0: link is not ready
> 0000:06:00.0: eth0: Link is Up 1000 Mbps Full Duplex, Flow Control: None
> ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
> warning: `dbus-daemon' uses 32-bit capabilities (legacy support in use)
> eth0: no IPv6 routers present
> 


^ permalink raw reply	[flat|nested] 5+ messages in thread

* RE: [Bugme-new] [Bug 11898] New: mke2fs hang on AIC79 device.
  2008-10-30  8:53 ` [Bugme-new] [Bug 11898] New: mke2fs hang on AIC79 device Andrew Morton
@ 2008-10-30 10:22   ` Shi, Alex
  2008-10-30 14:05     ` James Bottomley
  0 siblings, 1 reply; 5+ messages in thread
From: Shi, Alex @ 2008-10-30 10:22 UTC (permalink / raw)
  To: Andrew Morton
  Cc: bugme-daemon@bugzilla.kernel.org, linux-scsi@vger.kernel.org,
	yanming.zhang@intel.com, Chen, Tim C

[-- Attachment #1: Type: text/plain, Size: 36141 bytes --]

New panic output is attached after adding softlockup.  New found:
1,  "strace mke2fs /dev/sdb1" works well. it just show many write(3, "\377\377...", 4096) =4096 ....
2, when system hang, ping this machine is workable. And keyboard input works but cmd has no output.

BRG
Alex

-----Original Message-----
From: Andrew Morton [mailto:akpm@linux-foundation.org]
Sent: 2008年10月30日 16:54
To: Shi, Alex
Cc: bugme-daemon@bugzilla.kernel.org; linux-scsi@vger.kernel.org
Subject: Re: [Bugme-new] [Bug 11898] New: mke2fs hang on AIC79 device.


(switched to email.  Please respond via emailed reply-to-all, not via the
bugzilla web interface).

On Thu, 30 Oct 2008 01:17:37 -0700 (PDT) bugme-daemon@bugzilla.kernel.org wrote:

> http://bugzilla.kernel.org/show_bug.cgi?id=11898
>
>            Summary: mke2fs hang on AIC79 device.
>            Product: IO/Storage
>            Version: 2.5
>      KernelVersion: 2.6.28-rc1/rc2
>           Platform: All
>         OS/Version: Linux
>               Tree: Mainline
>             Status: NEW
>           Severity: blocking
>           Priority: P1
>          Component: SCSI
>         AssignedTo: linux-scsi@vger.kernel.org
>         ReportedBy: alex.shi@intel.com
>
>
> Latest working kernel version:2.6.27
> Earliest failing kernel version:2.6.28-rc1
> Distribution:RHEL 4.91
> Hardware Environment:AIC79xx
> Software Environment:
> Problem Description:
>
> Steps to reproduce: mke2fs /dev/sdx
>
>
> [root@linux-b03 ~]#  mke2fs /dev/sdb1
> mke2fs 1.39 (29-May-2006)
> Filesystem label=
> OS type: Linux
> Block size=4096 (log=2)
> Fragment size=4096 (log=2)
> 3842720 inodes, 7679996 blocks
> 383999 blocks (5.00%) reserved for the super user
> First data block=0
> Maximum filesystem blocks=4294967296
> 235 block groups
> 32768 blocks per group, 32768 fragments per group
> 16352 inodes per group
> Superblock backups stored on blocks:
>         32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
>         4096000
>
> Writing inode tables: done
> Writing superblocks and filesystem accounting information:
>
> ..... hang ....

Can you please work out where it hung?  Enable the softlockup detector,
nmi watchdog, try to get a sysrq-w or sysrq-t trace, etc?

Thanks.


> lspci :
>
>
> 04:02.0 SCSI storage controller: Adaptec AIC-7902B U320 (rev 10)
>         Subsystem: Super Micro Computer Inc Unknown device 8080
>         Flags: bus master, 66MHz, slow devsel, latency 64, IRQ 16
>         I/O ports at 2400 [disabled] [size=256]
>         Memory at c8200000 (64-bit, non-prefetchable) [size=8K]
>         I/O ports at 2000 [disabled] [size=256]
>         [virtual] Expansion ROM at c2000000 [disabled] [size=512K]
>         Capabilities: <access denied>
>
> 04:02.1 SCSI storage controller: Adaptec AIC-7902B U320 (rev 10)
>         Subsystem: Super Micro Computer Inc Unknown device 8080
>         Flags: bus master, 66MHz, slow devsel, latency 64, IRQ 17
>         I/O ports at 2c00 [disabled] [size=256]
>         Memory at c8202000 (64-bit, non-prefetchable) [size=8K]
>         I/O ports at 2800 [disabled] [size=256]
>         [virtual] Expansion ROM at c2080000 [disabled] [size=512K]
>         Capabilities: <access denied>
>
> dmesg:
>
> 8D0, 0014 (r0 PTLTD )
> ACPI: RSDT BFF631DD, 003C (r1 PTLTD    RSDT    6040000  LTP        0)
> ACPI: FACP BFF68E10, 0074 (r1 INTEL  TUMWATER  6040000 PTL         3)
> ACPI: DSDT BFF64ACF, 4341 (r1  Intel BLAKFORD  6040000 MSFT  100000E)
> ACPI: FACS BFF69FC0, 0040
> ACPI: APIC BFF68E84, 00C8 (r1 PTLTD      APIC    6040000  LTP        0)
> ACPI: MCFG BFF68F4C, 003C (r1 PTLTD    MCFG    6040000  LTP        0)
> ACPI: BOOT BFF68F88, 0028 (r1 PTLTD  $SBFTBL$  6040000  LTP        1)
> ACPI: SPCR BFF68FB0, 0050 (r1 PTLTD  $UCRTBL$  6040000 PTL         1)
> ACPI: SSDT BFF63219, 13EC (r1  PmRef    CpuPm     3000 INTL 20050228)
> ACPI: Local APIC address 0xfee00000
> (7 early reservations) ==> bootmem [0000000000 - 0140000000]
>   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
>   #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
>   #2 [0000200000 - 00006cabc8]    TEXT DATA BSS ==> [0000200000 - 00006cabc8]
>   #3 [0037eba000 - 0037fefe92]          RAMDISK ==> [0037eba000 - 0037fefe92]
>   #4 [000009c800 - 0000100000]    BIOS reserved ==> [000009c800 - 0000100000]
>   #5 [0000008000 - 000000b000]          PGTABLE ==> [0000008000 - 000000b000]
>   #6 [000000b000 - 000000c000]          PGTABLE ==> [000000b000 - 000000c000]
> found SMP MP-table at [ffff8800000f5900] 000f5900
>  [ffffe20000000000-ffffe200045fffff] PMD -> [ffff880028200000-ffff88002c7fffff]
> on node 0
> Zone PFN ranges:
>   DMA      0x00000000 -> 0x00001000
>   DMA32    0x00001000 -> 0x00100000
>   Normal   0x00100000 -> 0x00140000
> Movable zone start PFN for each node
> early_node_map[3] active PFN ranges
>     0: 0x00000000 -> 0x0000009c
>     0: 0x00000100 -> 0x000bff60
>     0: 0x00100000 -> 0x00140000
> On node 0 totalpages: 1048316
>   DMA zone: 56 pages used for memmap
>   DMA zone: 1334 pages reserved
>   DMA zone: 2606 pages, LIFO batch:0
>   DMA32 zone: 14280 pages used for memmap
>   DMA32 zone: 767896 pages, LIFO batch:31
>   Normal zone: 3584 pages used for memmap
>   Normal zone: 258560 pages, LIFO batch:31
>   Movable zone: 0 pages used for memmap
> ACPI: PM-Timer IO Port: 0x1008
> ACPI: Local APIC address 0xfee00000
> ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> ACPI: LAPIC (acpi_id[0x01] lapic_id[0x04] enabled)
> ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
> ACPI: LAPIC (acpi_id[0x03] lapic_id[0x05] enabled)
> ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
> ACPI: LAPIC (acpi_id[0x05] lapic_id[0x06] enabled)
> ACPI: LAPIC (acpi_id[0x06] lapic_id[0x03] enabled)
> ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
> ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
> ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
> ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
> IOAPIC[0]: apic_id 8, version 0, address 0xfec00000, GSI 0-23
> ACPI: IOAPIC (id[0x09] address[0xfec80000] gsi_base[24])
> IOAPIC[1]: apic_id 9, version 0, address 0xfec80000, GSI 24-47
> ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> ACPI: IRQ0 used by override.
> ACPI: IRQ2 used by override.
> ACPI: IRQ9 used by override.
> Using ACPI (MADT) for SMP configuration information
> SMP: Allowing 8 CPUs, 0 hotplug CPUs
> Allocating PCI resources starting at c2000000 (gap: c0000000:20000000)
> PERCPU: Allocating 45056 bytes of per cpu data
> NR_CPUS: 8, nr_cpu_ids: 8, nr_node_ids 1
> Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 1029062
> Kernel command line: ro root=LABEL=/1 profile=2 console=ttyS0,38400
> kernel profiling enabled (shift: 2)
> Initializing CPU#0
> PID hash table entries: 4096 (order: 12, 32768 bytes)
> Fast TSC calibration using PIT
> Detected 2400.210 MHz processor.
> Console: colour VGA+ 80x25
> console [ttyS0] enabled
> Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
> Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
> Checking aperture...
> No AGP bridge found
> Calgary: detecting Calgary via BIOS EBDA area
> Calgary: Unable to locate Rio Grande table in EBDA - bailing!
> PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
> Placing software IO TLB between 0x20000000 - 0x24000000
> Memory: 4039052k/5242880k available (2745k kernel code, 153224k reserved, 1353k
> data, 328k init)
> Calibrating delay loop (skipped), value calculated using timer frequency..
> 4800.42 BogoMIPS (lpj=9600840)
> Mount-cache hash table entries: 256
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 0
> CPU: Processor Core ID: 0
> CPU0: Thermal monitoring handled by SMI
> using mwait in idle threads.
> ACPI: Core revision 20080926
> Parsing all Control Methods:
> Table [DSDT](id 0001) - 421 Objects with 47 Devices 131 Methods 22 Regions
> Parsing all Control Methods:
> Table [SSDT](id 0002) - 43 Objects with 0 Devices 16 Methods 0 Regions
>  tbxface-0596 [00] tb_load_namespace     : ACPI Tables successfully acquired
> evxfevnt-0091 [00] enable                : Transition to ACPI mode successful
> Setting APIC routing to flat
> ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
> CPU0: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> Booting processor 1 APIC 0x4 ip 0x6000
> Initializing CPU#1
> Calibrating delay using timer specific routine.. 4800.39 BogoMIPS (lpj=9600793)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 1
> CPU: Processor Core ID: 0
> CPU1: Thermal monitoring enabled (TM2)
> CPU1: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#1]: passed.
> Booting processor 2 APIC 0x1 ip 0x6000
> Initializing CPU#2
> Calibrating delay using timer specific routine.. 4800.39 BogoMIPS (lpj=9600792)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 0
> CPU: Processor Core ID: 1
> CPU2: Thermal monitoring enabled (TM2)
> CPU2: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#2]: passed.
> Booting processor 3 APIC 0x5 ip 0x6000
> Initializing CPU#3
> Calibrating delay using timer specific routine.. 4800.39 BogoMIPS (lpj=9600792)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 1
> CPU: Processor Core ID: 1
> CPU3: Thermal monitoring enabled (TM2)
> CPU3: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#3]: passed.
> Booting processor 4 APIC 0x2 ip 0x6000
> Initializing CPU#4
> Calibrating delay using timer specific routine.. 4800.36 BogoMIPS (lpj=9600737)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 0
> CPU: Processor Core ID: 2
> CPU4: Thermal monitoring enabled (TM2)
> CPU4: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#4]: passed.
> Booting processor 5 APIC 0x6 ip 0x6000
> Initializing CPU#5
> Calibrating delay using timer specific routine.. 4800.39 BogoMIPS (lpj=9600791)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 1
> CPU: Processor Core ID: 2
> CPU5: Thermal monitoring enabled (TM2)
> CPU5: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#5]: passed.
> Booting processor 6 APIC 0x3 ip 0x6000
> Initializing CPU#6
> Calibrating delay using timer specific routine.. 4800.36 BogoMIPS (lpj=9600728)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 0
> CPU: Processor Core ID: 3
> CPU6: Thermal monitoring enabled (TM2)
> CPU6: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#6]: passed.
> Booting processor 7 APIC 0x7 ip 0x6000
> Initializing CPU#7
> Calibrating delay using timer specific routine.. 4801.13 BogoMIPS (lpj=9602264)
> CPU: L1 I cache: 32K, L1 D cache: 32K
> CPU: L2 cache: 4096K
> CPU: Physical Processor ID: 1
> CPU: Processor Core ID: 3
> CPU7: Thermal monitoring enabled (TM2)
> CPU7: Intel(R) Xeon(R) CPU           X5340  @ 2.40GHz stepping 07
> checking TSC synchronization [CPU#0 -> CPU#7]: passed.
> Brought up 8 CPUs
> Total of 8 processors activated (38403.86 BogoMIPS).
> net_namespace: 888 bytes
> NET: Registered protocol family 16
> ACPI: bus type pci registered
> PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 10
> PCI: MCFG area at e0000000 reserved in E820
> PCI: Using MMCONFIG at e0000000 - e0afffff
> PCI: Using configuration type 1 for base access
> evgpeblk-0957 [00] ev_create_gpe_block   : GPE 00 to 1F [_GPE] 4 regs on int
> 0x9
> ACPI: EC: Look up EC in DSDT
> Completing Region/Field/Buffer/Package
> initialization:.........................................................................
> Initialized 17/22 Regions 0/0 Fields 35/35 Buffers 21/21 Packages (473 nodes)
> Initializing Device/Processor/Thermal objects by executing _INI methods:.
> Executed 1 _INI methods requiring 0 _STA executions (examined 57 objects)
> evgpeblk-1054 [00] ev_initialize_gpe_bloc: Found 9 Wake, Enabled 0 Runtime GPEs
> in this block
> ACPI: Interpreter enabled
> ACPI: (supports S0 S1 S5)
> ACPI: Using IOAPIC for interrupt routing
> ACPI: PCI Root Bridge [PCI0] (0000:00)
> pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:00.0: PME# disabled
> pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:02.0: PME# disabled
> pci 0000:00:04.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:04.0: PME# disabled
> pci 0000:00:06.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:06.0: PME# disabled
> pci 0000:00:08.0: reg 10 64bit mmio: [0xfe700000-0xfe7003ff]
> pci 0000:00:08.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:08.0: PME# disabled
> pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
> pci 0000:00:1c.0: PME# disabled
> pci 0000:00:1d.0: reg 20 io port: [0x1800-0x181f]
> pci 0000:00:1d.1: reg 20 io port: [0x1820-0x183f]
> pci 0000:00:1d.2: reg 20 io port: [0x1840-0x185f]
> pci 0000:00:1d.7: reg 10 32bit mmio: [0xc8000000-0xc80003ff]
> pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
> pci 0000:00:1d.7: PME# disabled
> pci 0000:00:1f.0: Force enabled HPET at 0xfed00000
> pci 0000:00:1f.1: reg 10 io port: [0x00-0x07]
> pci 0000:00:1f.1: reg 14 io port: [0x00-0x03]
> pci 0000:00:1f.1: reg 18 io port: [0x00-0x07]
> pci 0000:00:1f.1: reg 1c io port: [0x00-0x03]
> pci 0000:00:1f.1: reg 20 io port: [0x1860-0x186f]
> pci 0000:00:1f.3: reg 20 io port: [0x1100-0x111f]
> pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:01:00.0: PME# disabled
> pci 0000:01:00.3: PME# supported from D0 D3hot D3cold
> pci 0000:01:00.3: PME# disabled
> pci 0000:00:02.0: bridge io port: [0x2000-0x3fff]
> pci 0000:00:02.0: bridge 32bit mmio: [0xc8100000-0xc83fffff]
> pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:02:00.0: PME# disabled
> pci 0000:02:02.0: PME# supported from D0 D3hot D3cold
> pci 0000:02:02.0: PME# disabled
> pci 0000:01:00.0: bridge io port: [0x2000-0x3fff]
> pci 0000:01:00.0: bridge 32bit mmio: [0xc8200000-0xc83fffff]
> pci 0000:03:00.0: PXH quirk detected; SHPC device MSI disabled
> pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:03:00.0: PME# disabled
> pci 0000:03:00.2: PXH quirk detected; SHPC device MSI disabled
> pci 0000:03:00.2: PME# supported from D0 D3hot D3cold
> pci 0000:03:00.2: PME# disabled
> pci 0000:02:00.0: bridge io port: [0x2000-0x2fff]
> pci 0000:02:00.0: bridge 32bit mmio: [0xc8200000-0xc82fffff]
> pci 0000:04:02.0: reg 10 io port: [0x2400-0x24ff]
> pci 0000:04:02.0: reg 14 64bit mmio: [0xc8200000-0xc8201fff]
> pci 0000:04:02.0: reg 1c io port: [0x2000-0x20ff]
> pci 0000:04:02.0: reg 30 32bit mmio: [0x000000-0x07ffff]
> pci 0000:04:02.1: reg 10 io port: [0x2c00-0x2cff]
> pci 0000:04:02.1: reg 14 64bit mmio: [0xc8202000-0xc8203fff]
> pci 0000:04:02.1: reg 1c io port: [0x2800-0x28ff]
> pci 0000:04:02.1: reg 30 32bit mmio: [0x000000-0x07ffff]
> pci 0000:03:00.0: bridge io port: [0x2000-0x2fff]
> pci 0000:03:00.0: bridge 32bit mmio: [0xc8200000-0xc82fffff]
> pci 0000:06:00.0: reg 10 32bit mmio: [0xc8320000-0xc833ffff]
> pci 0000:06:00.0: reg 14 32bit mmio: [0xc8300000-0xc831ffff]
> pci 0000:06:00.0: reg 18 io port: [0x3000-0x301f]
> pci 0000:06:00.0: reg 30 32bit mmio: [0x000000-0x00ffff]
> pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
> pci 0000:06:00.0: PME# disabled
> pci 0000:06:00.1: reg 10 32bit mmio: [0xc8360000-0xc837ffff]
> pci 0000:06:00.1: reg 14 32bit mmio: [0xc8340000-0xc835ffff]
> pci 0000:06:00.1: reg 18 io port: [0x3020-0x303f]
> pci 0000:06:00.1: reg 30 32bit mmio: [0x000000-0x00ffff]
> pci 0000:06:00.1: PME# supported from D0 D3hot D3cold
> pci 0000:06:00.1: PME# disabled
> pci 0000:02:02.0: bridge io port: [0x3000-0x3fff]
> pci 0000:02:02.0: bridge 32bit mmio: [0xc8300000-0xc83fffff]
> pci 0000:0b:01.0: reg 10 32bit mmio: [0xd0000000-0xd7ffffff]
> pci 0000:0b:01.0: reg 14 io port: [0x4000-0x40ff]
> pci 0000:0b:01.0: reg 18 32bit mmio: [0xc8400000-0xc840ffff]
> pci 0000:0b:01.0: reg 30 32bit mmio: [0x000000-0x01ffff]
> pci 0000:0b:01.0: supports D1 D2
> pci 0000:00:1e.0: transparent bridge
> pci 0000:00:1e.0: bridge io port: [0x4000-0x4fff]
> pci 0000:00:1e.0: bridge 32bit mmio: [0xc8400000-0xc84fffff]
> pci 0000:00:1e.0: bridge 64bit mmio pref: [0xd0000000-0xd7ffffff]
> bus 00 -> node 0
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMD0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMD0.BPD0.PXH0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMD0.BPD0.PXH1._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMD0.BPD2._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P2.BMF3._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P4._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P6._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX0._PRT]
> ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCIB._PRT]
> ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 11 14 15) *9
> ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 7 10 11 14 15)
> ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 10 *11 14 15)
> ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 *10 11 14 15)
> ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.
> ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 6 7 10 11 14 15) *0, disabled.
> ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.
> ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 6 7 10 11 14 15) *0, disabled.
> SCSI subsystem initialized
> PCI: Using ACPI for IRQ routing
> PCI-GART: No AMD northbridge found.
> hpet clockevent registered
> HPET: 3 timers in total, 0 timers will be used for per-cpu timer
> hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
> hpet0: 3 comparators, 64-bit 14.318180 MHz counter
> pnp: PnP ACPI init
> ACPI: bus type pnp registered
> pnp: PnP ACPI: found 13 devices
> ACPI: ACPI bus type pnp unregistered
> system 00:01: ioport range 0x4d0-0x4d1 has been reserved
> system 00:01: ioport range 0x295-0x296 has been reserved
> system 00:01: ioport range 0xca2-0xca3 has been reserved
> system 00:01: ioport range 0xca8-0xcaf has been reserved
> system 00:01: ioport range 0x1000-0x107f has been reserved
> system 00:01: ioport range 0x1180-0x11bf has been reserved
> system 00:01: ioport range 0x800-0x80f has been reserved
> system 00:01: ioport range 0xfe00-0xfe00 has been reserved
> system 00:01: iomem range 0xe0000000-0xefffffff could not be reserved
> system 00:01: iomem range 0xfee00000-0xfee0ffff could not be reserved
> system 00:01: iomem range 0xfec80000-0xfec80fff has been reserved
> system 00:01: iomem range 0xfed1c000-0xfed1ffff has been reserved
> system 00:01: iomem range 0xfe000000-0xfe01ffff has been reserved
> system 00:01: iomem range 0xfe600000-0xfe6fffff has been reserved
> pci 0000:03:00.0: PCI bridge, secondary bus 0000:04
> pci 0000:03:00.0:   IO window: 0x2000-0x2fff
> pci 0000:03:00.0:   MEM window: 0xc8200000-0xc82fffff
> pci 0000:03:00.0:   PREFETCH window: 0x000000c2000000-0x000000c20fffff
> pci 0000:03:00.2: PCI bridge, secondary bus 0000:05
> pci 0000:03:00.2:   IO window: disabled
> pci 0000:03:00.2:   MEM window: disabled
> pci 0000:03:00.2:   PREFETCH window: disabled
> pci 0000:02:00.0: PCI bridge, secondary bus 0000:03
> pci 0000:02:00.0:   IO window: 0x2000-0x2fff
> pci 0000:02:00.0:   MEM window: 0xc8200000-0xc82fffff
> pci 0000:02:00.0:   PREFETCH window: 0x000000c2000000-0x000000c20fffff
> pci 0000:02:02.0: PCI bridge, secondary bus 0000:06
> pci 0000:02:02.0:   IO window: 0x3000-0x3fff
> pci 0000:02:02.0:   MEM window: 0xc8300000-0xc83fffff
> pci 0000:02:02.0:   PREFETCH window: 0x000000c2100000-0x000000c21fffff
> pci 0000:01:00.0: PCI bridge, secondary bus 0000:02
> pci 0000:01:00.0:   IO window: 0x2000-0x3fff
> pci 0000:01:00.0:   MEM window: 0xc8200000-0xc83fffff
> pci 0000:01:00.0:   PREFETCH window: 0x000000c2000000-0x000000c21fffff
> pci 0000:01:00.3: PCI bridge, secondary bus 0000:07
> pci 0000:01:00.3:   IO window: disabled
> pci 0000:01:00.3:   MEM window: disabled
> pci 0000:01:00.3:   PREFETCH window: disabled
> pci 0000:00:02.0: PCI bridge, secondary bus 0000:01
> pci 0000:00:02.0:   IO window: 0x2000-0x3fff
> pci 0000:00:02.0:   MEM window: 0xc8100000-0xc83fffff
> pci 0000:00:02.0:   PREFETCH window: 0x000000c2000000-0x000000c21fffff
> pci 0000:00:04.0: PCI bridge, secondary bus 0000:08
> pci 0000:00:04.0:   IO window: disabled
> pci 0000:00:04.0:   MEM window: disabled
> pci 0000:00:04.0:   PREFETCH window: disabled
> pci 0000:00:06.0: PCI bridge, secondary bus 0000:09
> pci 0000:00:06.0:   IO window: disabled
> pci 0000:00:06.0:   MEM window: disabled
> pci 0000:00:06.0:   PREFETCH window: disabled
> pci 0000:00:1c.0: PCI bridge, secondary bus 0000:0a
> pci 0000:00:1c.0:   IO window: disabled
> pci 0000:00:1c.0:   MEM window: disabled
> pci 0000:00:1c.0:   PREFETCH window: disabled
> pci 0000:00:1e.0: PCI bridge, secondary bus 0000:0b
> pci 0000:00:1e.0:   IO window: 0x4000-0x4fff
> pci 0000:00:1e.0:   MEM window: 0xc8400000-0xc84fffff
> pci 0000:00:1e.0:   PREFETCH window: 0x000000d0000000-0x000000d7ffffff
> pci 0000:00:02.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:00:02.0: setting latency timer to 64
> pci 0000:01:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:01:00.0: setting latency timer to 64
> pci 0000:02:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:02:00.0: setting latency timer to 64
> pci 0000:03:00.0: setting latency timer to 64
> pci 0000:03:00.2: setting latency timer to 64
> pci 0000:02:02.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
> pci 0000:02:02.0: setting latency timer to 64
> pci 0000:01:00.3: setting latency timer to 64
> pci 0000:00:04.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:00:04.0: setting latency timer to 64
> pci 0000:00:06.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> pci 0000:00:06.0: setting latency timer to 64
> pci 0000:00:1c.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
> pci 0000:00:1c.0: setting latency timer to 64
> pci 0000:00:1e.0: setting latency timer to 64
> bus: 00 index 0 io port: [0x00-0xffff]
> bus: 00 index 1 mmio: [0x000000-0xffffffffffffffff]
> bus: 01 index 0 io port: [0x2000-0x3fff]
> bus: 01 index 1 mmio: [0xc8100000-0xc83fffff]
> bus: 01 index 2 mmio: [0xc2000000-0xc21fffff]
> bus: 01 index 3 mmio: [0x0-0x0]
> bus: 02 index 0 io port: [0x2000-0x3fff]
> bus: 02 index 1 mmio: [0xc8200000-0xc83fffff]
> bus: 02 index 2 mmio: [0xc2000000-0xc21fffff]
> bus: 02 index 3 mmio: [0x0-0x0]
> bus: 03 index 0 io port: [0x2000-0x2fff]
> bus: 03 index 1 mmio: [0xc8200000-0xc82fffff]
> bus: 03 index 2 mmio: [0xc2000000-0xc20fffff]
> bus: 03 index 3 mmio: [0x0-0x0]
> bus: 04 index 0 io port: [0x2000-0x2fff]
> bus: 04 index 1 mmio: [0xc8200000-0xc82fffff]
> bus: 04 index 2 mmio: [0xc2000000-0xc20fffff]
> bus: 04 index 3 mmio: [0x0-0x0]
> bus: 05 index 0 mmio: [0x0-0x0]
> bus: 05 index 1 mmio: [0x0-0x0]
> bus: 05 index 2 mmio: [0x0-0x0]
> bus: 05 index 3 mmio: [0x0-0x0]
> bus: 06 index 0 io port: [0x3000-0x3fff]
> bus: 06 index 1 mmio: [0xc8300000-0xc83fffff]
> bus: 06 index 2 mmio: [0xc2100000-0xc21fffff]
> bus: 06 index 3 mmio: [0x0-0x0]
> bus: 07 index 0 mmio: [0x0-0x0]
> bus: 07 index 1 mmio: [0x0-0x0]
> bus: 07 index 2 mmio: [0x0-0x0]
> bus: 07 index 3 mmio: [0x0-0x0]
> bus: 08 index 0 mmio: [0x0-0x0]
> bus: 08 index 1 mmio: [0x0-0x0]
> bus: 08 index 2 mmio: [0x0-0x0]
> bus: 08 index 3 mmio: [0x0-0x0]
> bus: 09 index 0 mmio: [0x0-0x0]
> bus: 09 index 1 mmio: [0x0-0x0]
> bus: 09 index 2 mmio: [0x0-0x0]
> bus: 09 index 3 mmio: [0x0-0x0]
> bus: 0a index 0 mmio: [0x0-0x0]
> bus: 0a index 1 mmio: [0x0-0x0]
> bus: 0a index 2 mmio: [0x0-0x0]
> bus: 0a index 3 mmio: [0x0-0x0]
> bus: 0b index 0 io port: [0x4000-0x4fff]
> bus: 0b index 1 mmio: [0xc8400000-0xc84fffff]
> bus: 0b index 2 mmio: [0xd0000000-0xd7ffffff]
> bus: 0b index 3 io port: [0x00-0xffff]
> bus: 0b index 4 mmio: [0x000000-0xffffffffffffffff]
> NET: Registered protocol family 2
> IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
> TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
> TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
> TCP: Hash tables configured (established 262144 bind 65536)
> TCP reno registered
> NET: Registered protocol family 1
> checking if image is initramfs... it is
> Freeing initrd memory: 1239k freed
> Simple Boot Flag at 0x38 set to 0x1
> HugeTLB registered 2 MB page size, pre-allocated 0 pages
> Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
> msgmni has been set to 7893
> io scheduler noop registered
> io scheduler anticipatory registered (default)
> io scheduler deadline registered
> io scheduler cfq registered
> pci 0000:0b:01.0: Boot video device
> input: Power Button (FF) as /class/input/input0
> ACPI: Power Button (FF) [PWRF]
> input: Power Button (CM) as /class/input/input1
> ACPI: Power Button (CM) [PWRB]
> ACPI: SSDT BFF64605, 0200 (r1  PmRef  Cpu0Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00C6) - 5 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:00: registered as cooling_device0
> ACPI: Processor [CPU0] (supports 8 throttling states)
> ACPI: SSDT BFF64805, 0066 (r1  PmRef  Cpu1Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00C9) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:01: registered as cooling_device1
> ACPI: Processor [CPU1] (supports 8 throttling states)
> ACPI: SSDT BFF6486B, 0066 (r1  PmRef  Cpu2Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00CC) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:02: registered as cooling_device2
> ACPI: Processor [CPU2] (supports 8 throttling states)
> ACPI: SSDT BFF648D1, 0066 (r1  PmRef  Cpu3Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00CF) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:03: registered as cooling_device3
> ACPI: Processor [CPU3] (supports 8 throttling states)
> ACPI: SSDT BFF64937, 0066 (r1  PmRef  CPU4Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00D2) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:04: registered as cooling_device4
> ACPI: Processor [CPU4] (supports 8 throttling states)
> ACPI: SSDT BFF6499D, 0066 (r1  PmRef  CPU5Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00D5) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:05: registered as cooling_device5
> ACPI: Processor [CPU5] (supports 8 throttling states)
> ACPI: SSDT BFF64A03, 0066 (r1  PmRef  Cpu6Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00D8) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:06: registered as cooling_device6
> ACPI: Processor [CPU6] (supports 8 throttling states)
> ACPI: SSDT BFF64A69, 0066 (r1  PmRef  Cpu7Ist     3000 INTL 20050228)
> Parsing all Control Methods:
> Table [SSDT](id 00DB) - 3 Objects with 0 Devices 2 Methods 0 Regions
> processor ACPI0007:07: registered as cooling_device7
> ACPI: Processor [CPU7] (supports 8 throttling states)
> Real Time Clock Driver v1.12ac
> intel_rng: FWH not detected
> Linux agpgart interface v0.103
> Hangcheck: starting hangcheck timer 0.9.0 (tick is 180 seconds, margin is 60
> seconds).
> Hangcheck: Using get_cycles().
> Serial: 8250/16550 driver4 ports, IRQ sharing disabled
> serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> 00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
> 00:0a: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
> Floppy drive(s): fd0 is 1.44M
> FDC 0 is a post-1991 82077
> brd: module loaded
> loop: module loaded
> Intel(R) PRO/1000 Network Driver - version 7.3.20-k3-NAPI
> Copyright (c) 1999-2006 Intel Corporation.
> console [netcon0] enabled
> netconsole: network logging started
> Uniform Multi-Platform E-IDE driver
> piix 0000:00:1f.1: IDE controller (0x8086:0x269e rev 0x09)
> pci 0000:00:1f.1: PCI INT A -> GSI 18 (level, low) -> IRQ 18
> piix 0000:00:1f.1: IDE port disabled
> piix 0000:00:1f.1: not 100% native mode: will probe irqs later
>     ide0: BM-DMA at 0x1860-0x1867
> Probing IDE interface ide0...
> hdb: LITE-ON COMBO SOHC-5236V, ATAPI CD/DVD-ROM drive
> hdb: host max PIO4 wanted PIO255(auto-tune) selected PIO4
> hdb: UDMA/44 mode selected
> ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
> ide_generic: please use "probe_mask=0x3f" module parameter for probing all
> legacy ISA IDE ports
> ide-gd driver 1.18
> ide-cd driver 5.00
> ide-cd: hdb: ATAPI 52X DVD-ROM CD-R/RW drive, 1536kB Cache
> Uniform CD-ROM driver Revision: 3.20
> aic79xx 0000:04:02.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
> scsi0 : Adaptec AIC79XX PCI-X SCSI HBA DRIVER, Rev 3.0
>         <Adaptec AIC7902 Ultra320 SCSI adapter>
>         aic7902: Ultra320 Wide Channel A, SCSI Id=7, PCI-X 67-100MHz, 512 SCBs
> scsi 0:0:6:0: Direct-Access     HITACHI  HUS103073FL3800  SA1B PQ: 0 ANSI: 3
>  target0:0:6: asynchronous
> scsi0:A:6:0: Tagged Queuing enabled.  Depth 32
>  target0:0:6: Beginning Domain Validation
>  target0:0:6: wide asynchronous
>  target0:0:6: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RDSTRM RTI WRFLOW PCOMP
> (6.25 ns, offset 80)
>  target0:0:6: Ending Domain Validation
> scsi 0:0:8:0: Processor         SUPER    GEM359 REV001    1.09 PQ: 0 ANSI: 2
>  target0:0:8: asynchronous
>  target0:0:8: Beginning Domain Validation
>  target0:0:8: Ending Domain Validation
> scsi 0:0:9:0: Direct-Access     SEAGATE  ST336607LC       0007 PQ: 0 ANSI: 3
>  target0:0:9: asynchronous
> scsi0:A:9:0: Tagged Queuing enabled.  Depth 32
>  target0:0:9: Beginning Domain Validation
>  target0:0:9: wide asynchronous
>  target0:0:9: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RDSTRM RTI WRFLOW PCOMP
> (6.25 ns, offset 63)
>  target0:0:9: Ending Domain Validation
> aic79xx 0000:04:02.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
> scsi1 : Adaptec AIC79XX PCI-X SCSI HBA DRIVER, Rev 3.0
>         <Adaptec AIC7902 Ultra320 SCSI adapter>
>         aic7902: Ultra320 Wide Channel B, SCSI Id=7, PCI-X 67-100MHz, 512 SCBs
> Driver 'sd' needs updating - please use bus_type methods
> sd 0:0:6:0: [sda] 143374805 512-byte hardware sectors: (73.4 GB/68.3 GiB)
> sd 0:0:6:0: [sda] Write Protect is off
> sd 0:0:6:0: [sda] Mode Sense: c3 00 10 08
> sd 0:0:6:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and
> FUA
> sd 0:0:6:0: [sda] 143374805 512-byte hardware sectors: (73.4 GB/68.3 GiB)
> sd 0:0:6:0: [sda] Write Protect is off
> sd 0:0:6:0: [sda] Mode Sense: c3 00 10 08
> sd 0:0:6:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and
> FUA
>  sda: sda1 sda2
> sd 0:0:6:0: [sda] Attached SCSI disk
> sd 0:0:9:0: [sdb] 71687372 512-byte hardware sectors: (36.7 GB/34.1 GiB)
> sd 0:0:9:0: [sdb] Write Protect is off
> sd 0:0:9:0: [sdb] Mode Sense: ab 00 10 08
> sd 0:0:9:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and
> FUA
> sd 0:0:9:0: [sdb] 71687372 512-byte hardware sectors: (36.7 GB/34.1 GiB)
> sd 0:0:9:0: [sdb] Write Protect is off
> sd 0:0:9:0: [sdb] Mode Sense: ab 00 10 08
> sd 0:0:9:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and
> FUA
>  sdb: sdb1 sdb2
> sd 0:0:9:0: [sdb] Attached SCSI disk
> PNP: PS/2 Controller [PNP0303:KBC0,PNP0f13:MSE0] at 0x60,0x64 irq 1,12
> serio: i8042 KBD port at 0x60,0x64 irq 1
> serio: i8042 AUX port at 0x60,0x64 irq 12
> mice: PS/2 mouse device common for all mice
> dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
> oprofile: using NMI interrupt.
> TCP cubic registered
> input: AT Translated Set 2 keyboard as /class/input/input2
> NET: Registered protocol family 10
> IPv6 over IPv4 tunneling driver
> NET: Registered protocol family 17
> RPC: Registered udp transport module.
> RPC: Registered tcp transport module.
> Freeing unused kernel memory: 328k freed
> end_request: I/O error, dev fd0, sector 0
> end_request: I/O error, dev fd0, sector 0
> EXT3-fs: INFO: recovery required on readonly filesystem.
> EXT3-fs: write access will be enabled during recovery.
> input: PS/2 Generic Mouse as /class/input/input3
> kjournald starting.  Commit interval 5 seconds
> EXT3-fs: recovery complete.
> EXT3-fs: mounted filesystem with ordered data mode.
> e1000e: Intel(R) PRO/1000 Network Driver - 0.3.3.3-k6
> e1000e: Copyright (c) 1999-2008 Intel Corporation.
> e1000e 0000:06:00.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
> e1000e 0000:06:00.0: setting latency timer to 64
> e1000e 0000:06:00.0: irq 95 for MSI/MSI-X
> 0000:06:00.0: eth0: (PCI Express:2.5GB/s:Width x4) 00:30:48:30:61:16
> 0000:06:00.0: eth0: Intel(R) PRO/1000 Network Connection
> 0000:06:00.0: eth0: MAC: 4, PHY: 5, PBA No: ffffff-0ff
> e1000e 0000:06:00.1: PCI INT B -> GSI 19 (level, low) -> IRQ 19
> e1000e 0000:06:00.1: setting latency timer to 64
> e1000e 0000:06:00.1: irq 94 for MSI/MSI-X
> 0000:06:00.1: eth1: (PCI Express:2.5GB/s:Width x4) 00:30:48:30:61:17
> 0000:06:00.1: eth1: Intel(R) PRO/1000 Network Connection
> 0000:06:00.1: eth1: MAC: 4, PHY: 5, PBA No: ffffff-0ff
> EXT3 FS on sda1, internal journal
> Adding 4096564k swap on /dev/sda2.  Priority:-1 extents:1 across:4096564k
> Adding 5123064k swap on /dev/sdb2.  Priority:-2 extents:1 across:5123064k
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> platform microcode: firmware: requesting intel-ucode/06-0f-07
> Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>
> <peter.oruba@amd.com>
> Microcode Update Driver: v2.00 removed.
> warning: process `kudzu' used the deprecated sysctl system call with 1.23.
> process `sysctl' is using deprecated sysctl (syscall)
> net.ipv6.neigh.default.retrans_time; Use net.ipv6.neigh.default.retrans_time_ms
> instead.
> e1000e 0000:06:00.0: irq 95 for MSI/MSI-X
> e1000e 0000:06:00.0: irq 95 for MSI/MSI-X
> ADDRCONF(NETDEV_UP): eth0: link is not ready
> 0000:06:00.0: eth0: Link is Up 1000 Mbps Full Duplex, Flow Control: None
> ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
> warning: `dbus-daemon' uses 32-bit capabilities (legacy support in use)
> eth0: no IPv6 routers present
>


[-- Attachment #2: panic-output --]
[-- Type: application/octet-stream, Size: 45230 bytes --]

[root@linux-b03 linux-2.6.28-rc1]# 
[root@linux-b03 linux-2.6.28-rc1]# 
[root@linux-b03 linux-2.6.28-rc1]# ls
BUG: soft lockup - CPU#7 stuck for 61s! [events/0:0]
Modules linked in: igb e1000e
Modules linked in: igb e1000e
Call Trace:
 <IRQ>  [<ffffffff803f99eb>] ? scsi_request_fn+0x31a/0x416
 [<ffffffff803435ad>] ? blk_invoke_request_fn+0x79/0x11d
 [<ffffffff80343b21>] ? __blk_run_queue+0x2a/0x2e
 [<ffffffff803f7def>] ? scsi_run_queue+0x2cd/0x2e4
 [<ffffffff803f8452>] ? scsi_next_command+0x3b/0x4c
 [<ffffffff803f86ef>] ? scsi_end_request+0x97/0xa9
 [<ffffffff803f93b0>] ? scsi_io_completion+0x190/0x3a8
 [<ffffffff803f3a9f>] ? scsi_finish_command+0xb6/0xbf
 [<ffffffff803f96c9>] ? scsi_softirq_done+0x101/0x109
 [<ffffffff803476df>] ? blk_done_softirq+0x68/0x79
 [<ffffffff8023de8c>] ? __do_softirq+0x86/0x14f
 [<ffffffff8020c63c>] ? call_softirq+0x1c/0x28
 [<ffffffff8020dd82>] ? do_softirq+0x39/0x77
 [<ffffffff8023de04>] ? irq_exit+0x44/0x46
 [<ffffffff8020de88>] ? do_IRQ+0xc8/0xe8
 [<ffffffff8020b8f6>] ? ret_from_intr+0x0/0xa
 <EOI>  [<ffffffff8021299b>] ? mwait_idle+0x4a/0x4f
 [<ffffffff80209c82>] ? enter_idle+0x27/0x29
 [<ffffffff8020a198>] ? cpu_idle+0x45/0x63
 [<ffffffff804e4d50>] ? start_secondary+0x179/0x17d
BUG: soft lockup - CPU#7 stuck for 61s! [events/0:0]
Modules linked in: igb e1000e
Modules linked in: igb e1000e
Call Trace:
 <IRQ>  [<ffffffff803c27e4>] ? put_device+0x1a/0x1c
 [<ffffffff803f9a2f>] ? scsi_request_fn+0x35e/0x416
 [<ffffffff803435ad>] ? blk_invoke_request_fn+0x79/0x11d
 [<ffffffff80343b21>] ? __blk_run_queue+0x2a/0x2e
 [<ffffffff803f7def>] ? scsi_run_queue+0x2cd/0x2e4
 [<ffffffff803f8452>] ? scsi_next_command+0x3b/0x4c
 [<ffffffff803f86ef>] ? scsi_end_request+0x97/0xa9
 [<ffffffff803f93b0>] ? scsi_io_completion+0x190/0x3a8
 [<ffffffff803f3a9f>] ? scsi_finish_command+0xb6/0xbf
 [<ffffffff803f96c9>] ? scsi_softirq_done+0x101/0x109
 [<ffffffff803476df>] ? blk_done_softirq+0x68/0x79
 [<ffffffff8023de8c>] ? __do_softirq+0x86/0x14f
 [<ffffffff8020c63c>] ? call_softirq+0x1c/0x28
 [<ffffffff8020dd82>] ? do_softirq+0x39/0x77
 [<ffffffff8023de04>] ? irq_exit+0x44/0x46
 [<ffffffff8020de88>] ? do_IRQ+0xc8/0xe8
 [<ffffffff8020b8f6>] ? ret_from_intr+0x0/0xa
 <EOI>  [<ffffffff8021299b>] ? mwait_idle+0x4a/0x4f
 [<ffffffff80209c82>] ? enter_idle+0x27/0x29
 [<ffffffff8020a198>] ? cpu_idle+0x45/0x63
 [<ffffffff804e4d50>] ? start_secondary+0x179/0x17d




[<ffffffff8020b79a>] stub_execve+0x6a/0xc0                                                                                                                  
INFO: task mke2fs:6233 blocked for more than 120 seconds.                                                                                                    
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff8801150559d8 0000000000000082 ffff880115055968 ffffffff804ea776
 ffff88013d5419d0 ffff88013d9987f0 ffff88013d541c10 000000073cc26240
 ffff8801150559e8 ffff88013382ec98 0000000000000292 ffff88002802b788
Call Trace:
 [<ffffffff804ea776>] ? _spin_unlock_irq+0xe/0x11
 [<ffffffff804e8a7f>] io_schedule+0x28/0x34
 [<ffffffff802b196d>] sync_buffer+0x43/0x47
 [<ffffffff804e8d3c>] __wait_on_bit+0x4a/0x7c
 [<ffffffff802b192a>] ? sync_buffer+0x0/0x47
 [<ffffffff802b192a>] ? sync_buffer+0x0/0x47
 [<ffffffff804e8de1>] out_of_line_wait_on_bit+0x73/0x80
 [<ffffffff8024c3b6>] ? wake_bit_function+0x0/0x2f
 [<ffffffff802b1b89>] ? ll_rw_block+0xae/0xee
 [<ffffffff802b18b9>] __wait_on_buffer+0x24/0x26
 [<ffffffff802b2168>] __block_prepare_write+0x37e/0x3c6
 [<ffffffff802b6c1f>] ? blkdev_get_block+0x0/0x51
 [<ffffffff8026ccb2>] ? add_to_page_cache_lru+0x5b/0x63
 [<ffffffff802b2266>] block_write_begin+0x82/0xd2
 [<ffffffff802b678a>] blkdev_write_begin+0x2a/0x2c
 [<ffffffff802b6c1f>] ? blkdev_get_block+0x0/0x51
 [<ffffffff8026d555>] generic_file_buffered_write+0x156/0x62d
 [<ffffffff804ea632>] ? _spin_unlock+0xe/0x10
 [<ffffffff8026df40>] __generic_file_aio_write_nolock+0x35c/0x3c6
 [<ffffffff80274c2a>] ? mark_page_accessed+0x2c/0x3f
 [<ffffffff8026e0af>] generic_file_aio_write_nolock+0x40/0x92
 [<ffffffff8029374d>] do_sync_write+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff804e93fa>] ? __mutex_lock_slowpath+0x1e4/0x1f1
 [<ffffffff80293eff>] vfs_write+0xb3/0x13c
 [<ffffffff802943d7>] sys_write+0x4c/0x74
 [<ffffffff8020b3eb>] system_call_fastpath+0x16/0x1b
INFO: task bash:6234 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a10d928 0000000000000082 0000000000000000 0000000000000000
 ffff88013da53990 ffff88013e8786f0 ffff88013da53bd0 0000000200000000






"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a177ab8 0000000000000086 0000000000000000 0000000000000000
 ffff88013ddbe250 ffff88013e9a6e10 ffff88013ddbe490 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0

=======================


 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6238 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a135ab8 0000000000000086 0000000000000000 0000000000000000
 ffff88013eac8110 ffff88013e9a6e10 ffff88013eac8350 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6239 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a155ab8 0000000000000082 0000000000000000 0000000000000000
 ffff88013eac92b0 ffff88013e9a6e10 ffff88013eac94f0 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6243 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a1d9ab8 0000000000000082 0000000000000000 0000000000000000
 ffff88013cf106f0 ffff88013e9a6e10 ffff88013cf10930 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6244 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a1fbab8 0000000000000086 0000000000000000 0000000000000000
 ffff88013cf11890 ffff88013e9a6e10 ffff88013cf11ad0 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
BUG: soft lockup - CPU#7 stuck for 61s! [events/0:0]
Modules linked in: igb e1000e                                                                                                                                
Modules linked in: igb e1000e                                                                                                                                
Call Trace:                                                                                                                                                  
 <IRQ>  [<ffffffff803f99eb>] ? scsi_request_fn+0x31a/0x416                                                                                                   
 [<ffffffff803435ad>] ? blk_invoke_request_fn+0x79/0x11d                                                                                                     
 [<ffffffff80343b21>] ? __blk_run_queue+0x2a/0x2e                                                                                                            
 [<ffffffff803f7def>] ? scsi_run_queue+0x2cd/0x2e4                                                                                                           
 [<ffffffff803f8452>] ? scsi_next_command+0x3b/0x4c                                                                                                          
 [<ffffffff803f86ef>] ? scsi_end_request+0x97/0xa9                                                                                                           
 [<ffffffff803f93b0>] ? scsi_io_completion+0x190/0x3a8                                                                                                       
 [<ffffffff803f3a9f>] ? scsi_finish_command+0xb6/0xbf                                                                                                        
 [<ffffffff803f96c9>] ? scsi_softirq_done+0x101/0x109                                                                                                        
 [<ffffffff803476df>] ? blk_done_softirq+0x68/0x79                                                                                                           
 [<ffffffff8023de8c>] ? __do_softirq+0x86/0x14f                                                                                                              
 [<ffffffff8020c63c>] ? call_softirq+0x1c/0x28                                                                                                               
 [<ffffffff8020dd82>] ? do_softirq+0x39/0x77                                                                                                                 
 [<ffffffff8023de04>] ? irq_exit+0x44/0x46                                                                                                                   
 [<ffffffff8020de88>] ? do_IRQ+0xc8/0xe8                                                                                                                     
 [<ffffffff8020b8f6>] ? ret_from_intr+0x0/0xa                                                                                                                
 <EOI>  [<ffffffff8021299b>] ? mwait_idle+0x4a/0x4f                                                                                                          
 [<ffffffff80209c82>] ? enter_idle+0x27/0x29                                                                                                                 
 [<ffffffff8020a198>] ? cpu_idle+0x45/0x63                                                                                                                   
 [<ffffffff804e4d50>] ? start_secondary+0x179/0x17d                                                                                                          
INFO: task atd:3309 blocked for more than 120 seconds.                                                                                                       
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88012f9e3d68 0000000000000082 0000000000000000 ffff88013c092dc0
 ffff88013d998210 ffff88013e83ec90 ffff88013d998450 0000000100000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8029fe0a>] vfs_readdir+0x85/0xa4
 [<ffffffff802a008e>] sys_getdents+0x7f/0xc9
 [<ffffffff8020b3eb>] system_call_fastpath+0x16/0x1b
INFO: task sshd:6237 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a133ab8 0000000000000082 0000000000000000 0000000000000000
 ffff88012f96ec90 ffff88013e9a6e10 ffff88012f96eed0 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6240 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.                                                                                    
 ffff88010a177ab8 0000000000000086 0000000000000000 0000000000000000                                                                                         
 ffff88013ddbe250 ffff88013e9a6e10 ffff88013ddbe490 0000000600000296                                                                                         
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000                                                                                         
Call Trace:                                                                                                                                                  
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381                                                                                                          
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d                                                                                                    
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf                                                                                                                
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51                                                                                                        
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88                                                                                                             
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193                                                                                                          
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116                                                                                                                
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac                                                                                                      
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b                                                                                                                
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d                                                                                                    
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32                                                                                                              
 [<ffffffff80294038>] vfs_read+0xb0/0x139                                                                                                                    
 [<ffffffff80297869>] kernel_read+0x3f/0x56                                                                                                                  
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c                                                                                                             
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef                                                                                                               
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9                                                                                                                   
 [<ffffffff80209937>] sys_execve+0x43/0x64                                                                                                                   
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0                                                                                                                  
INFO: task mke2fs:6233 blocked for more than 120 seconds.                                                                                                    
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff8801150559d8 0000000000000082 ffff880115055968 ffffffff804ea776
 ffff88013d5419d0 ffff88013d9987f0 ffff88013d541c10 000000073cc26240
 ffff8801150559e8 ffff88013382ec98 0000000000000292 ffff88002802b788
Call Trace:
 [<ffffffff804ea776>] ? _spin_unlock_irq+0xe/0x11
 [<ffffffff804e8a7f>] io_schedule+0x28/0x34
 [<ffffffff802b196d>] sync_buffer+0x43/0x47
 [<ffffffff804e8d3c>] __wait_on_bit+0x4a/0x7c
 [<ffffffff802b192a>] ? sync_buffer+0x0/0x47
 [<ffffffff802b192a>] ? sync_buffer+0x0/0x47
 [<ffffffff804e8de1>] out_of_line_wait_on_bit+0x73/0x80
 [<ffffffff8024c3b6>] ? wake_bit_function+0x0/0x2f
 [<ffffffff802b1b89>] ? ll_rw_block+0xae/0xee
 [<ffffffff802b18b9>] __wait_on_buffer+0x24/0x26
 [<ffffffff802b2168>] __block_prepare_write+0x37e/0x3c6
 [<ffffffff802b6c1f>] ? blkdev_get_block+0x0/0x51
 [<ffffffff8026ccb2>] ? add_to_page_cache_lru+0x5b/0x63
 [<ffffffff802b2266>] block_write_begin+0x82/0xd2
 [<ffffffff802b678a>] blkdev_write_begin+0x2a/0x2c
 [<ffffffff802b6c1f>] ? blkdev_get_block+0x0/0x51
 [<ffffffff8026d555>] generic_file_buffered_write+0x156/0x62d
 [<ffffffff804ea632>] ? _spin_unlock+0xe/0x10
 [<ffffffff8026df40>] __generic_file_aio_write_nolock+0x35c/0x3c6
 [<ffffffff80274c2a>] ? mark_page_accessed+0x2c/0x3f
 [<ffffffff8026e0af>] generic_file_aio_write_nolock+0x40/0x92
 [<ffffffff8029374d>] do_sync_write+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff804e93fa>] ? __mutex_lock_slowpath+0x1e4/0x1f1
 [<ffffffff80293eff>] vfs_write+0xb3/0x13c
 [<ffffffff802943d7>] sys_write+0x4c/0x74
 [<ffffffff8020b3eb>] system_call_fastpath+0x16/0x1b
INFO: task bash:6234 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a10d928 0000000000000082 0000000000000000 0000000000000000
 ffff88013da53990 ffff88013e8786f0 ffff88013da53bd0 0000000200000000
 00000000000000ff 0000000000000000 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802b192a>] ? sync_buffer+0x0/0x47
 [<ffffffff804e8a7f>] io_schedule+0x28/0x34
 [<ffffffff802b196d>] sync_buffer+0x43/0x47
 [<ffffffff804e8c3c>] __wait_on_bit_lock+0x47/0x7d
 [<ffffffff802b192a>] ? sync_buffer+0x0/0x47
 [<ffffffff804e8ce5>] out_of_line_wait_on_bit_lock+0x73/0x80
 [<ffffffff8024c3b6>] ? wake_bit_function+0x0/0x2f
 [<ffffffff802b1ad9>] __lock_buffer+0x2a/0x2c
 [<ffffffff802ee04e>] do_get_write_access+0x6e/0x43a
 [<ffffffff802b0f66>] ? __getblk+0x39/0x249
 [<ffffffff802ee441>] journal_get_write_access+0x27/0x38
 [<ffffffff802eb27f>] __ext3_journal_get_write_access+0x24/0x4d
 [<ffffffff802df2d4>] ext3_reserve_inode_write+0x42/0x84
 [<ffffffff802df351>] ext3_mark_inode_dirty+0x3b/0x58
 [<ffffffff802e1fe7>] ext3_dirty_inode+0x71/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6241 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a197ab8 0000000000000082 0000000000000000 0000000000000000
 ffff88013d52f810 ffff88013e9a6e10 ffff88013d52fa50 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff8029786
                  INFO: task kjournald:864 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88013d4b3dd0 0000000000000046 0000000000000000 ffffffff8022d68d
 ffff88013d9e9850 ffff88013e9a6e10 ffff88013d9e9a90 0000000600000286
 00000000000000ff 0000000000000286 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff8022d68d>] ? __wake_up_common+0x41/0x75
 [<ffffffff802efa97>] journal_commit_transaction+0xff/0xee4
 [<ffffffff804ea7a0>] ? _spin_lock_irqsave+0x16/0x1e
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80242351>] ? try_to_del_timer_sync+0x60/0x6c
 [<ffffffff802f3892>] kjournald+0xcd/0x21a
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802f37c5>] ? kjournald+0x0/0x21a
 [<ffffffff8024c259>] kthread+0x4e/0x7d
 [<ffffffff8020c2d9>] child_rip+0xa/0x11
 [<ffffffff8024c20b>] ? kthread+0x0/0x7d
 [<ffffffff8020c2cf>] ? child_rip+0x0/0x11
INFO: task syslogd:2775 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88013b0ada58 0000000000000086 ffff88013b0adb00 ffff88013b0adae8
 ffff88013ccc8190 ffff88013dcb73f0 ffff88013ccc83d0 0000000000000296
 ffff88013b0ada28 0000000000000296 0000000000000001 ffff88013b0ada88
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a566a>] file_update_time+0xca/0x10e
 [<ffffffff8026de49>] __generic_file_aio_write_nolock+0x265/0x3c6
 [<ffffffff80254ec2>] ? debug_mutex_free_waiter+0x46/0x4a
 [<ffffffff8026e013>] generic_file_aio_write+0x69/0xc5
 [<ffffffff802dd84f>] ext3_file_write+0x23/0xa1
 [<ffffffff802dd82c>] ? ext3_file_write+0x0/0xa1
 [<ffffffff8029361e>] do_sync_readv_writev+0xe8/0x130
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802a104b>] ? core_sys_select+0x1f6/0x26b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80211c61>] ? read_tsc+0x9/0x1c
 [<ffffffff80353af9>] ? rb_insert_color+0xb9/0xe3
 [<ffffffff80293cd8>] do_readv_writev+0xbd/0x198
 [<ffffffff80293df6>] vfs_writev+0x43/0x4e
 [<ffffffff802941e4>] sys_writev+0x4c/0x75
 [<ffffffff8020b3eb>] system_call_fastpath+0x16/0x1b
INFO: task crond:3127 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff880137d59d68 0000000000000082 0000000000000000 ffff88013d5387c0
 ffff88013cc652f0 ffff88013e8786f0 ffff88013cc65530 0000000200000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8029fe0a>] vfs_readdir+0x85/0xa4
 [<ffffffff802a008e>] sys_getdents+0x7f/0xc9
 [<ffffffff804ea929>] ? error_exit+0x0/0x51
 [<ffffffff8020b3eb>] system_call_fastpath+0x16/0x1b
INFO: task sshd:6235 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a10f9b8 0000000000000086 ffff88013e45b800 00000000006a8002
 ffff88013d5426b0 ffff88013d9e9850 ffff88013d5428f0 00000006000000d5
 ffff88013f4c2110 ffff8801155e8738 0000000000000292 ffff88002802c160
Call Trace:
 [<ffffffff802b192a>] ? sync_buffer+0x0/0x47
 [<ffffffff804e8a7f>] io_schedule+0x28/0x34
 [<ffffffff802b196d>] sync_buffer+0x43/0x47
 [<ffffffff804e8c3c>] __wait_on_bit_lock+0x47/0x7d
 [<ffffffff802b192a>] ? sync_buffer+0x0/0x47
 [<ffffffff804e8ce5>] out_of_line_wait_on_bit_lock+0x73/0x80
 [<ffffffff8024c3b6>] ? wake_bit_function+0x0/0x2f
 [<ffffffff802b1ad9>] __lock_buffer+0x2a/0x2c
 [<ffffffff802ee04e>] do_get_write_access+0x6e/0x43a
 [<ffffffff802b0f66>] ? __getblk+0x39/0x249
 [<ffffffff802ee441>] journal_get_write_access+0x27/0x38
 [<ffffffff802eb27f>] __ext3_journal_get_write_access+0x24/0x4d
 [<ffffffff802df2d4>] ext3_reserve_inode_write+0x42/0x84
 [<ffffffff802df351>] ext3_mark_inode_dirty+0x3b/0x58
 [<ffffffff802e1fe7>] ext3_dirty_inode+0x71/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8029cd9b>] __link_path_walk+0x8f6/0xca1
 [<ffffffff80271a37>] ? get_page_from_freelist+0x36c/0x3e6
 [<ffffffff8029d199>] path_walk+0x53/0x9c
 [<ffffffff8029d340>] do_path_lookup+0x119/0x13b
 [<ffffffff8029df85>] path_lookup_open+0x5f/0xa0
 [<ffffffff8029e217>] do_filp_open+0xa5/0x7c4
 [<ffffffff8027c4c2>] ? handle_mm_fault+0x1d8/0x67e
 [<ffffffff80356b0f>] ? __strncpy_from_user+0x2c/0x56
 [<ffffffff804ea632>] ? _spin_unlock+0xe/0x10
 [<ffffffff802a6454>] ? alloc_fd+0x114/0x123
 [<ffffffff80291fd5>] do_sys_open+0x59/0xe0
 [<ffffffff8029208f>] sys_open+0x20/0x22
 [<ffffffff8020b3eb>] system_call_fastpath+0x16/0x1b
INFO: task sshd:6236 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a111ab8 0000000000000086 0000000000000000 0000000000000000
 ffff88013d543270 ffff88013e9a6e10 ffff88013d5434b0 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6238 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a135ab8 0000000000000086 0000000000000000 0000000000000000
 ffff88013eac8110 ffff88013e9a6e10 ffff88013eac8350 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6239 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a155ab8 0000000000000082 0000000000000000 0000000000000000
 ffff88013eac92b0 ffff88013e9a6e10 ffff88013eac94f0 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6243 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a1d9ab8 0000000000000082 0000000000000000 0000000000000000
 ffff88013cf106f0 ffff88013e9a6e10 ffff88013cf10930 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6244 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a1fbab8 0000000000000086 0000000000000000 0000000000000000
 ffff88013cf11890 ffff88013e9a6e10 ffff88013cf11ad0 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
BUG: soft lockup - CPU#7 stuck for 61s! [events/0:0]
Modules linked in: igb e1000e
Modules linked in: igb e1000e
Call Trace:
 <IRQ>  [<ffffffff803f9a26>] ? scsi_request_fn+0x355/0x416
 [<ffffffff803435ad>] ? blk_invoke_request_fn+0x79/0x11d
 [<ffffffff80343b21>] ? __blk_run_queue+0x2a/0x2e
 [<ffffffff803f7def>] ? scsi_run_queue+0x2cd/0x2e4
 [<ffffffff803f8452>] ? scsi_next_command+0x3b/0x4c
 [<ffffffff803f86ef>] ? scsi_end_request+0x97/0xa9
 [<ffffffff803f93b0>] ? scsi_io_completion+0x190/0x3a8
 [<ffffffff803f3a9f>] ? scsi_finish_command+0xb6/0xbf
 [<ffffffff803f96c9>] ? scsi_softirq_done+0x101/0x109
 [<ffffffff803476df>] ? blk_done_softirq+0x68/0x79
 [<ffffffff8023de8c>] ? __do_softirq+0x86/0x14f
 [<ffffffff8020c63c>] ? call_softirq+0x1c/0x28
 [<ffffffff8020dd82>] ? do_softirq+0x39/0x77
 [<ffffffff8023de04>] ? irq_exit+0x44/0x46
 [<ffffffff8020de88>] ? do_IRQ+0xc8/0xe8
 [<ffffffff8020b8f6>] ? ret_from_intr+0x0/0xa
 <EOI>  [<ffffffff8021299b>] ? mwait_idle+0x4a/0x4f
 [<ffffffff80209c82>] ? enter_idle+0x27/0x29
 [<ffffffff8020a198>] ? cpu_idle+0x45/0x63
 [<ffffffff804e4d50>] ? start_secondary+0x179/0x17d
INFO: task atd:3309 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88012f9e3d68 0000000000000082 0000000000000000 ffff88013c092dc0
 ffff88013d998210 ffff88013e83ec90 ffff88013d998450 0000000100000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff8029fcbb>] ? filldir+0x0/0xca
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8029fe0a>] vfs_readdir+0x85/0xa4
 [<ffffffff802a008e>] sys_getdents+0x7f/0xc9
 [<ffffffff8020b3eb>] system_call_fastpath+0x16/0x1b
INFO: task sshd:6237 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a133ab8 0000000000000082 0000000000000000 0000000000000000
 ffff88012f96ec90 ffff88013e9a6e10 ffff88012f96eed0 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0
INFO: task sshd:6240 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
 ffff88010a177ab8 0000000000000086 0000000000000000 0000000000000000
 ffff88013ddbe250 ffff88013e9a6e10 ffff88013ddbe490 0000000600000296
 00000000000000ff 0000000000000296 0000000000000000 0000000000000000
Call Trace:
 [<ffffffff802ee879>] start_this_handle+0x2e5/0x381
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff802ee9bc>] journal_start+0xa7/0xdf
 [<ffffffff802e71c7>] ext3_journal_start_sb+0x4f/0x51
 [<ffffffff802e1fac>] ext3_dirty_inode+0x36/0x88
 [<ffffffff802ad525>] __mark_inode_dirty+0x38/0x193
 [<ffffffff802a57b8>] touch_atime+0x10a/0x116
 [<ffffffff8026e734>] generic_file_aio_read+0x548/0x5ac
 [<ffffffff80293878>] do_sync_read+0xe7/0x12b
 [<ffffffff8024c379>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff80280008>] ? __vma_link_rb+0x30/0x32
 [<ffffffff80294038>] vfs_read+0xb0/0x139
 [<ffffffff80297869>] kernel_read+0x3f/0x56
 [<ffffffff80297b7e>] ? bprm_mm_init+0x130/0x17c
 [<ffffffff8029796a>] prepare_binprm+0xea/0xef
 [<ffffffff802988d9>] do_execve+0xe4/0x1e9
 [<ffffffff80209937>] sys_execve+0x43/0x64
 [<ffffffff8020b79a>] stub_execve+0x6a/0xc0

                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                                                                                                                                             
                                 

^ permalink raw reply	[flat|nested] 5+ messages in thread

* RE: [Bugme-new] [Bug 11898] New: mke2fs hang on AIC79 device.
  2008-10-30 10:22   ` Shi, Alex
@ 2008-10-30 14:05     ` James Bottomley
  2008-10-31  3:12       ` Shi, Alex
  2008-11-05  1:31       ` Shi, Alex
  0 siblings, 2 replies; 5+ messages in thread
From: James Bottomley @ 2008-10-30 14:05 UTC (permalink / raw)
  To: Shi, Alex
  Cc: Andrew Morton, bugme-daemon@bugzilla.kernel.org,
	linux-scsi@vger.kernel.org, yanming.zhang@intel.com, Chen, Tim C

On Thu, 2008-10-30 at 18:22 +0800, Shi, Alex wrote:
> New panic output is attached after adding softlockup.  New found:
> 1,  "strace mke2fs /dev/sdb1" works well. it just show many write(3, "\377\377...", 4096) =4096 ....
> 2, when system hang, ping this machine is workable. And keyboard input works but cmd has no output.

This doesn't entirely implicate the aic79xx.  The trace shows:

 <IRQ>  [<ffffffff803f99eb>] ? scsi_request_fn+0x31a/0x416
 [<ffffffff803435ad>] ? blk_invoke_request_fn+0x79/0x11d
 [<ffffffff80343b21>] ? __blk_run_queue+0x2a/0x2e
 [<ffffffff803f7def>] ? scsi_run_queue+0x2cd/0x2e4
 [<ffffffff803f8452>] ? scsi_next_command+0x3b/0x4c
 [<ffffffff803f86ef>] ? scsi_end_request+0x97/0xa9
 [<ffffffff803f93b0>] ? scsi_io_completion+0x190/0x3a8
 [<ffffffff803f3a9f>] ? scsi_finish_command+0xb6/0xbf
 [<ffffffff803f96c9>] ? scsi_softirq_done+0x101/0x109
 [<ffffffff803476df>] ? blk_done_softirq+0x68/0x79
 [<ffffffff8023de8c>] ? __do_softirq+0x86/0x14f
 [<ffffffff8020c63c>] ? call_softirq+0x1c/0x28
 [<ffffffff8020dd82>] ? do_softirq+0x39/0x77
 [<ffffffff8023de04>] ? irq_exit+0x44/0x46
 [<ffffffff8020de88>] ? do_IRQ+0xc8/0xe8
 [<ffffffff8020b8f6>] ? ret_from_intr+0x0/0xa
 <EOI>  [<ffffffff8021299b>] ? mwait_idle+0x4a/0x4f
 [<ffffffff80209c82>] ? enter_idle+0x27/0x29
 [<ffffffff8020a198>] ? cpu_idle+0x45/0x63
 [<ffffffff804e4d50>] ? start_secondary+0x179/0x17d

So we locked up somehow in the mid-layer trying to feed a new command
from the softirq.  It would greatly help to know what line in scsi_lib.c

scsi_request_fn+0x31a/0x416

The trace implies SCSI is built in, so 

addr2line -e vmlinux -f scsi_request_fn+0x31a

Should tell us (hoping you build with CONFIG_DEBUG_INFO).

James



^ permalink raw reply	[flat|nested] 5+ messages in thread

* RE: [Bugme-new] [Bug 11898] New: mke2fs hang on AIC79 device.
  2008-10-30 14:05     ` James Bottomley
@ 2008-10-31  3:12       ` Shi, Alex
  2008-11-05  1:31       ` Shi, Alex
  1 sibling, 0 replies; 5+ messages in thread
From: Shi, Alex @ 2008-10-31  3:12 UTC (permalink / raw)
  To: James Bottomley
  Cc: Andrew Morton, bugme-daemon@bugzilla.kernel.org,
	linux-scsi@vger.kernel.org, Zhang, Yanmin, Chen, Tim C,
	Wu, Fengguang, Zhu, Yi

Thanks Yi's help. 
After enable CONFIG_DEBUG_INFO, this bug can not reproduce on 2.6.28-rc1. but it still exists on 28-rc2 kernel. Soft lockup catchs several times lockup. And they are same as the following one. 


BUG: soft lockup - CPU#7 stuck for 61s! [mke2fs:3918]
Modules linked in: e1000e [last unloaded: microcode]
Modules linked in: e1000e [last unloaded: microcode]
Call Trace:
 <IRQ>  [<ffffffff8033f311>] ? blk_invoke_request_fn+0x76/0x11a
 [<ffffffff8033f872>] ? __blk_run_queue+0x2a/0x2e
 [<ffffffff803f2b5a>] ? scsi_run_queue+0x2c7/0x2de
 [<ffffffff803f31b7>] ? scsi_next_command+0x3b/0x4c
 [<ffffffff803f3454>] ? scsi_end_request+0x97/0xa9
 [<ffffffff803f4112>] ? scsi_io_completion+0x190/0x3a8
 [<ffffffff80271930>] ? wb_timer_fn+0x0/0x37
 [<ffffffff803ee889>] ? scsi_finish_command+0xb6/0xbf
 [<ffffffff803f442b>] ? scsi_softirq_done+0x101/0x109
 [<ffffffff80343413>] ? blk_done_softirq+0x68/0x79
 [<ffffffff8023d8bc>] ? __do_softirq+0x86/0x14f
 [<ffffffff8020c62c>] ? call_softirq+0x1c/0x28
 [<ffffffff8020dc21>] ? do_softirq+0x39/0x77
 [<ffffffff8023d834>] ? irq_exit+0x44/0x46
 [<ffffffff8020de65>] ? do_IRQ+0xc8/0xe7
 [<ffffffff8020b8e6>] ? ret_from_intr+0x0/0xa
 <EOI>  [<ffffffff802b402a>] ? blkdev_write_end+0x0/0x3e
 [<ffffffff802aeecb>] ? mark_buffer_dirty+0x14/0x85
 [<ffffffff802aefbc>] ? __block_commit_write+0x80/0xb1
 [<ffffffff802af173>] ? block_write_end+0x51/0x5d
 [<ffffffff802b404a>] ? blkdev_write_end+0x20/0x3e
 [<ffffffff8026b060>] ? iov_iter_copy_from_user_atomic+0x85/0xb3
 [<ffffffff8026c2d0>] ? generic_file_buffered_write+0x1c1/0x628
 [<ffffffff8022eb7b>] ? task_rq_lock+0x40/0x75
 [<ffffffff8023cef9>] ? current_fs_time+0x27/0x2e
 [<ffffffff8026cc41>] ? __generic_file_aio_write_nolock+0x359/0x3c3
 [<ffffffff8026cdb0>] ? generic_file_aio_write_nolock+0x40/0x91
 [<ffffffff80291c35>] ? do_sync_write+0xe7/0x12b
 [<ffffffff8024b982>] ? autoremove_wake_function+0x0/0x3d
 [<ffffffff8039f01c>] ? tty_write+0x211/0x22c
 [<ffffffff803a0f51>] ? n_tty_write+0x0/0x31d
 [<ffffffff802923e7>] ? vfs_write+0xb3/0x13c
 [<ffffffff802928bf>] ? sys_write+0x4c/0x74
 [<ffffffff8020b3db>] ? system_call_fastpath+0x16/0x1b

                                                                           
I do not know what addr2line show a strange output:
Addr2line -e vmlinux -f blk_invoke_request_fn+0x76 | hexdump 
0000000	3f3f 3f0a 3a3f 0a30
0000008

But seems gdb works for this. 
(gdb) list *blk_invoke_request_fn+0x76 
0xffffffff8033f311 is in blk_invoke_request_fn (include/linux/blkdev.h:456).
451     #define QUEUE_FLAG_NONROT      14       /* non-rotational device (SSD) */
452
453     static inline int queue_is_locked(struct request_queue *q)
454     {
455     #ifdef CONFIG_SMP
456             spinlock_t *lock = q->queue_lock;
457             return lock && spin_is_locked(lock);
458     #else
459             return 1;
460     #endif

Alex 


^ permalink raw reply	[flat|nested] 5+ messages in thread

* RE: [Bugme-new] [Bug 11898] New: mke2fs hang on AIC79 device.
  2008-10-30 14:05     ` James Bottomley
  2008-10-31  3:12       ` Shi, Alex
@ 2008-11-05  1:31       ` Shi, Alex
  1 sibling, 0 replies; 5+ messages in thread
From: Shi, Alex @ 2008-11-05  1:31 UTC (permalink / raw)
  To: Shi, Alex, James Bottomley
  Cc: Andrew Morton, bugme-daemon@bugzilla.kernel.org,
	linux-scsi@vger.kernel.org, Zhang, Yanmin, Chen, Tim C,
	Wu, Fengguang, Zhu, Yi

I did bisect for this bug and find the following commit cause this problem.

commit f0c0a376d0fcd4c5579ecf5e95f88387cba85211
Author: Mike Christie <michaelc@cs.wisc.edu>
Date:   Sun Aug 17 15:24:38 2008 -0500

    [SCSI] Add helper code so transport classes/driver can control queueing (v3)
    
    SCSI-ml manages the queueing limits for the device and host, but
    does not do so at the target level. However something something similar
    can come in userful when a driver is transitioning a transport object to
    the the blocked state, becuase at that time we do not want to queue
    io and we do not want the queuecommand to be called again.
    

Alex 


^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2008-11-05  1:31 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
     [not found] <bug-11898-10286@http.bugzilla.kernel.org/>
2008-10-30  8:53 ` [Bugme-new] [Bug 11898] New: mke2fs hang on AIC79 device Andrew Morton
2008-10-30 10:22   ` Shi, Alex
2008-10-30 14:05     ` James Bottomley
2008-10-31  3:12       ` Shi, Alex
2008-11-05  1:31       ` Shi, Alex

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox