* Re: Pls help for LibATA caused kernel temporary hung.
[not found] ` <4C2777D3.1050208@gmail.com>
@ 2010-06-28 7:38 ` Simon Li
2010-06-28 9:02 ` Jeff Garzik
0 siblings, 1 reply; 10+ messages in thread
From: Simon Li @ 2010-06-28 7:38 UTC (permalink / raw)
To: Tejun Heo; +Cc: linux-ide
[-- Attachment #1: Type: text/plain, Size: 6487 bytes --]
Hi, Tejun,
I put some notes for the issue and our application usages as below:
1. One blade server contains 4 sata disks(All Hitachi, 250G).
2. Application access disk paritions via RAW mode and in 7x24 hours load.
3. Application R/W disk unit mostly are 512Kbytes size.
4. Kernel temporary hung occurred frequently in 1~3 times per day, for
some very bad performed blades, above 5+ times a day. Kernel hang
duration sometimes last several seconds, and the longest duration we
observed is 5 minutes, afterwards, the kernel got resumed magicially.
We had further guess for the cause of hung-duration variation,
explained below:
*** In a single disk read operation(as said above, 512K bytes in one
syscall read(...)), if this 512Kbytes range contains two bad sectors,
the far distance of
*** these two bad sectors, the longer kernel hung duration, vice
verse. Following logs illustrated the guess.
Blade 1:
May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: translated ATA
stat/err 0x25/00 to SCSI SK/ASC/ASCQ 0x4/00/00
May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
DeviceFault CorrectedError Error }
May 25 15:55:06 shctc-xq-ems22-me18 kernel: SCSI error : <2 0 0 0>
return code = 0x8000002
May 25 15:55:06 shctc-xq-ems22-me18 kernel: sdc: Current: sense key:
Hardware Error
May 25 15:55:06 shctc-xq-ems22-me18 kernel: Additional sense: No
additional sense information
May 25 15:55:06 shctc-xq-ems22-me18 kernel: end_request: I/O error,
dev sdc, sector 276495150 <<--- First bad sector
encountered
---------- Kernel hung period ---------
May 25 15:59:59 shctc-xq-ems22-me18 kernel: end_request: I/O error,
dev sdc, sector 276496053
May 25 15:59:59 shctc-xq-ems22-me18 kernel: ata3: translated ATA
stat/err 0x25/00 to SCSI SK/ASC/ASCQ 0x4/00/00
May 25 15:59:59 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
DeviceFault CorrectedError Error }
May 25 15:59:59 shctc-xq-ems22-me18 kernel: SCSI error : <2 0 0 0>
return code = 0x8000002
May 25 15:59:59 shctc-xq-ems22-me18 kernel: sdc: Current: sense key:
Hardware Error
May 25 15:59:59 shctc-xq-ems22-me18 kernel: Additional sense: No
additional sense information
May 25 15:59:59 shctc-xq-ems22-me18 kernel: end_request: I/O error,
dev sdc, sector 276496061 <<--- Second bad sector
encountered
The two bad sectors were within one single read(...512Kbytes) syscall.
You can see 911 sectors in between, caused nearly 5 mins kernel hung.
Blade 2:
Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: ata2: translated ATA
stat/err 0x25/00 to SCSI SK/ASC/ASCQ 0x4/00/00
Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
DeviceFault CorrectedError Error }
Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: SCSI error : <1 0 0 0>
return code = 0x8000002
Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: sdb: Current: sense key:
Hardware Error
Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: Additional sense: No
additional sense information
Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: end_request: I/O error,
dev sdb, sector 183410550
Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: ata2: translated ATA
stat/err 0x25/00 to SCSI SK/ASC/ASCQ 0x4/00/00
Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
DeviceFault CorrectedError Error }
Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: SCSI error : <1 0 0 0>
return code = 0x8000002
Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: sdb: Current: sense key:
Hardware Error
Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: Additional sense: No
additional sense information
Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: end_request: I/O error,
dev sdb, sector 183410557 <<--- First bad sector
encountered
Jun 2 10:54:10 shctc-xm-ems21-me18 kernel: ata2: translated ATA
stat/err 0x25/00 to SCSI SK/ASC/ASCQ 0x4/00/00
Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
DeviceFault CorrectedError Error }
Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: SCSI error : <1 0 0 0>
return code = 0x8000002
Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: sdb: Current: sense key:
Hardware Error
Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: Additional sense: No
additional sense information
Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: end_request: I/O error,
dev sdb, sector 183410565 <<--- Second bad sector
encountered
Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: [RSS-RAW] Failed to read
data to buf 0xa036a200 at 0x1383335400 of size 524288 from raw 2 in
14398
The two sectors were also within one single read(...512Kbytes)
syscall, while only 8 sectors in between, caused 10 secs hungs.
5. Attached include sda, sdc's smartctl, hdparm and sys logs, both
drives from the same blade, regretfully, the sys log attached was
mistakenly overwriten and you cann't find logs as above. But these two
drives did occur the issue and exactly print logs in syslog as
above(except that sector number are different), Pls reference above
syslog prints.
6. Kernel version: 2.6.13.2, (gcc version 4.0.0 20050519 (Red Hat 4.0.0-8)).
Thanks in advance for your interest, we really look forward to fixing
this issue.
Regards
Simon
On Mon, Jun 28, 2010 at 12:09 AM, Tejun Heo <htejun@gmail.com> wrote:
>
> Hello,
>
> Please cc linux-ide@vger.kernel.org when you reply.
>
> On 06/27/2010 05:58 PM, Simon Li wrote:
> > Hi, Jun,
>
> My first name happens to be Tejun. :-)
>
> > ===== First time we observed kernel hang =======
> > May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: translated ATA
> > stat/err 0x25/00 to SCSI SK/ASC/ASCQ 0x4/00/00
> > May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
> > DeviceFault CorrectedError Error }
> > May 25 15:55:06 shctc-xq-ems22-me18 kernel: SCSI error : <2 0 0 0>
> > return code = 0x8000002
> > May 25 15:55:06 shctc-xq-ems22-me18 kernel: sdc: Current: sense key:
> > Hardware Error
> > May 25 15:55:06 shctc-xq-ems22-me18 kernel: Additional sense: No
> > additional sense information
> > May 25 15:55:06 shctc-xq-ems22-me18 kernel: end_request: I/O error, dev
> > sdc, sector 276495150
>
> Looks like failing hard disk to me. Can you please do the followings
> when you reply?
>
> * Please compose in plain text. No html.
>
> * Attach full kernel log including the boot and error messages.
> Capturing output of dmesg should do it.
>
> * Attach the output of hdparm -I and smartctl -a on the drive.
>
> --
> tejun
[-- Attachment #2: smartctl_sda.dump --]
[-- Type: application/octet-stream, Size: 8967 bytes --]
smartctl version 5.33 [i686-redhat-linux-gnu] Copyright (C) 2002-4 Bruce Allen
Home page is http://smartmontools.sourceforge.net/
=== START OF INFORMATION SECTION ===
Device Model: Hitachi HCP725025GLA380
Serial Number: GEK230RB2BZHVA
Firmware Version: GM2OA5CA
User Capacity: 250,059,350,016 bytes
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: 8
ATA Standard is: Not recognized. Minor revision code: 0x29
Local Time is: Mon Jun 28 11:44:55 2010 CST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (3981) seconds.
Offline data collection
capabilities: (0x5b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 66) minutes.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000b 100 100 016 Pre-fail Always - 0
2 Throughput_Performance 0x0005 100 100 054 Pre-fail Offline - 0
3 Spin_Up_Time 0x0007 111 111 024 Pre-fail Always - 177 (Average 191)
4 Start_Stop_Count 0x0012 100 100 000 Old_age Always - 807
5 Reallocated_Sector_Ct 0x0033 100 100 005 Pre-fail Always - 5
7 Seek_Error_Rate 0x000b 100 100 067 Pre-fail Always - 0
8 Seek_Time_Performance 0x0005 100 100 020 Pre-fail Offline - 0
9 Power_On_Hours 0x0012 099 099 000 Old_age Always - 10844
10 Spin_Retry_Count 0x0013 100 100 060 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 807
192 Power-Off_Retract_Count 0x0032 099 099 000 Old_age Always - 1231
193 Load_Cycle_Count 0x0012 099 099 000 Old_age Always - 1231
194 Temperature_Celsius 0x0002 187 187 000 Old_age Always - 32 (Lifetime Min/Max 19/40)
196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 5
197 Current_Pending_Sector 0x0022 100 100 000 Old_age Always - 13
198 Offline_Uncorrectable 0x0008 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 0
SMART Error Log Version: 1
ATA Error Count: 212 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.
Error 212 occurred at disk power-on lifetime: 10536 hours (439 days + 0 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 5b 95 3b 43 e6 Error: UNC 91 sectors at LBA = 0x06433b95 = 105069461
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 78 78 3b 43 e0 08 4d+01:51:11.700 READ DMA EXT
25 00 80 70 3b 43 e0 08 4d+01:51:09.400 READ DMA EXT
25 00 80 f0 3a 43 e0 08 4d+01:51:09.400 READ DMA EXT
25 00 80 70 3a 43 e0 08 4d+01:51:09.400 READ DMA EXT
25 00 80 f0 39 43 e0 08 4d+01:51:09.400 READ DMA EXT
Error 211 occurred at disk power-on lifetime: 10536 hours (439 days + 0 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 5b 95 3b 43 e6 Error: UNC 91 sectors at LBA = 0x06433b95 = 105069461
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 80 70 3b 43 e0 08 4d+01:51:09.400 READ DMA EXT
25 00 80 f0 3a 43 e0 08 4d+01:51:09.400 READ DMA EXT
25 00 80 70 3a 43 e0 08 4d+01:51:09.400 READ DMA EXT
25 00 80 f0 39 43 e0 08 4d+01:51:09.400 READ DMA EXT
25 00 80 70 39 43 e0 08 4d+01:51:09.400 READ DMA EXT
Error 210 occurred at disk power-on lifetime: 10536 hours (439 days + 0 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 04 0c 37 43 e6 Error: UNC 4 sectors at LBA = 0x0643370c = 105068300
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 08 08 37 43 e0 08 4d+01:51:07.100 READ DMA EXT
35 00 08 9f aa ea e0 08 4d+01:51:07.100 WRITE DMA EXT
25 00 08 08 37 43 e0 08 4d+01:51:04.800 READ DMA EXT
25 00 08 08 37 43 e0 08 4d+01:51:02.500 READ DMA EXT
35 00 08 a7 93 00 e0 08 4d+01:51:02.500 WRITE DMA EXT
Error 209 occurred at disk power-on lifetime: 10536 hours (439 days + 0 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 04 0c 37 43 e6 Error: UNC 4 sectors at LBA = 0x0643370c = 105068300
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 08 08 37 43 e0 08 4d+01:51:04.800 READ DMA EXT
25 00 08 08 37 43 e0 08 4d+01:51:02.500 READ DMA EXT
35 00 08 a7 93 00 e0 08 4d+01:51:02.500 WRITE DMA EXT
25 00 08 08 37 43 e0 08 4d+01:51:00.200 READ DMA EXT
25 00 08 08 37 43 e0 08 4d+01:50:57.900 READ DMA EXT
Error 208 occurred at disk power-on lifetime: 10536 hours (439 days + 0 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 04 0c 37 43 e6 Error: UNC 4 sectors at LBA = 0x0643370c = 105068300
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 08 08 37 43 e0 08 4d+01:51:02.500 READ DMA EXT
35 00 08 a7 93 00 e0 08 4d+01:51:02.500 WRITE DMA EXT
25 00 08 08 37 43 e0 08 4d+01:51:00.200 READ DMA EXT
25 00 08 08 37 43 e0 08 4d+01:50:57.900 READ DMA EXT
25 00 e8 10 37 43 e0 08 4d+01:50:57.900 READ DMA EXT
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Extended offline Completed: read failure 60% 10559 167118393
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
[-- Attachment #3: smartctl_sdc.dump --]
[-- Type: application/octet-stream, Size: 8846 bytes --]
smartctl version 5.33 [i686-redhat-linux-gnu] Copyright (C) 2002-4 Bruce Allen
Home page is http://smartmontools.sourceforge.net/
=== START OF INFORMATION SECTION ===
Device Model: Hitachi HCP725025GLA380
Serial Number: GEK230RB2BZERA
Firmware Version: GM2OA5CA
User Capacity: 250,059,350,016 bytes
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: 8
ATA Standard is: Not recognized. Minor revision code: 0x29
Local Time is: Mon Jun 28 11:46:03 2010 CST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (3981) seconds.
Offline data collection
capabilities: (0x5b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 66) minutes.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000b 100 100 016 Pre-fail Always - 0
2 Throughput_Performance 0x0005 100 100 054 Pre-fail Offline - 0
3 Spin_Up_Time 0x0007 112 112 024 Pre-fail Always - 176 (Average 189)
4 Start_Stop_Count 0x0012 100 100 000 Old_age Always - 807
5 Reallocated_Sector_Ct 0x0033 100 100 005 Pre-fail Always - 8
7 Seek_Error_Rate 0x000b 100 100 067 Pre-fail Always - 0
8 Seek_Time_Performance 0x0005 100 100 020 Pre-fail Offline - 0
9 Power_On_Hours 0x0012 099 099 000 Old_age Always - 10843
10 Spin_Retry_Count 0x0013 100 100 060 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 807
192 Power-Off_Retract_Count 0x0032 099 099 000 Old_age Always - 1232
193 Load_Cycle_Count 0x0012 099 099 000 Old_age Always - 1232
194 Temperature_Celsius 0x0002 181 181 000 Old_age Always - 33 (Lifetime Min/Max 20/40)
196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 8
197 Current_Pending_Sector 0x0022 100 100 000 Old_age Always - 1
198 Offline_Uncorrectable 0x0008 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 0
SMART Error Log Version: 1
ATA Error Count: 29 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.
Error 29 occurred at disk power-on lifetime: 10513 hours (438 days + 1 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 05 e3 26 99 e5 Error: UNC 5 sectors at LBA = 0x059926e3 = 93923043
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 08 e0 26 99 e0 08 3d+03:59:34.400 READ DMA EXT
35 00 08 a7 c1 ee e0 08 3d+03:59:34.400 WRITE DMA EXT
35 00 08 3f 60 77 e0 08 3d+03:59:34.400 WRITE DMA EXT
25 00 08 e0 26 99 e0 08 3d+03:59:31.900 READ DMA EXT
25 00 08 e0 26 99 e0 08 3d+03:59:29.400 READ DMA EXT
Error 28 occurred at disk power-on lifetime: 10513 hours (438 days + 1 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 05 e3 26 99 e5 Error: UNC 5 sectors at LBA = 0x059926e3 = 93923043
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 08 e0 26 99 e0 08 3d+03:59:31.900 READ DMA EXT
25 00 08 e0 26 99 e0 08 3d+03:59:29.400 READ DMA EXT
35 00 08 a7 c1 ee e0 08 3d+03:59:29.400 WRITE DMA EXT
35 00 08 3f 60 77 e0 08 3d+03:59:29.400 WRITE DMA EXT
25 00 08 e0 26 99 e0 08 3d+03:59:26.900 READ DMA EXT
Error 27 occurred at disk power-on lifetime: 10513 hours (438 days + 1 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 05 e3 26 99 e5 Error: UNC 5 sectors at LBA = 0x059926e3 = 93923043
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 08 e0 26 99 e0 08 3d+03:59:29.400 READ DMA EXT
35 00 08 a7 c1 ee e0 08 3d+03:59:29.400 WRITE DMA EXT
35 00 08 3f 60 77 e0 08 3d+03:59:29.400 WRITE DMA EXT
25 00 08 e0 26 99 e0 08 3d+03:59:26.900 READ DMA EXT
25 00 08 d8 26 99 e0 08 3d+03:59:26.900 READ DMA EXT
Error 26 occurred at disk power-on lifetime: 10513 hours (438 days + 1 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 05 e3 26 99 e5 Error: UNC 5 sectors at LBA = 0x059926e3 = 93923043
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 08 e0 26 99 e0 08 3d+03:59:26.900 READ DMA EXT
25 00 08 d8 26 99 e0 08 3d+03:59:26.900 READ DMA EXT
25 00 08 d0 26 99 e0 08 3d+03:59:26.900 READ DMA EXT
25 00 08 48 28 99 e0 08 3d+03:59:26.900 READ DMA EXT
25 00 b0 98 27 99 e0 08 3d+03:59:26.900 READ DMA EXT
Error 25 occurred at disk power-on lifetime: 10513 hours (438 days + 1 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
40 51 a5 e3 26 99 e5 Error: UNC 165 sectors at LBA = 0x059926e3 = 93923043
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 a8 e0 26 99 e0 08 3d+03:59:24.500 READ DMA EXT
25 00 b0 d8 26 99 e0 08 3d+03:59:22.000 READ DMA EXT
25 00 b8 d0 26 99 e0 08 3d+03:59:19.600 READ DMA EXT
25 00 c0 c8 26 99 e0 08 3d+03:59:17.100 READ DMA EXT
25 00 c8 c0 26 99 e0 08 3d+03:59:14.600 READ DMA EXT
SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
[-- Attachment #4: hdparm_sda.dump --]
[-- Type: application/octet-stream, Size: 2055 bytes --]
/dev/sda:
ATA device, with non-removable media
Model Number: Hitachi HCP725025GLA380
Serial Number: GEK230RB2BZHVA
Firmware Revision: GM2OA5CA
Standards:
Supported: 8 7 6 5
Likely used: 8
Configuration:
Logical max current
cylinders 16383 16383
heads 16 16
sectors/track 63 63
--
CHS current addressable sectors: 16514064
LBA user addressable sectors: 268435455
LBA48 user addressable sectors: 488397168
device size with M = 1024*1024: 238475 MBytes
device size with M = 1000*1000: 250059 MBytes (250 GB)
Capabilities:
LBA, IORDY(can be disabled)
Queue depth: 32
Standby timer values: spec'd by Standard, no device specific minimum
R/W multiple sector transfer: Max = 16 Current = 16
Advanced power management level: unknown setting (0x0000)
Recommended acoustic management value: 128, current value: 254
DMA: mdma0 mdma1 mdma2 udma0 udma1 udma2 udma3 udma4 udma5 *udma6
Cycle time: min=120ns recommended=120ns
PIO: pio0 pio1 pio2 pio3 pio4
Cycle time: no flow control=120ns IORDY flow control=120ns
Commands/features:
Enabled Supported:
* READ BUFFER cmd
* WRITE BUFFER cmd
* Host Protected Area feature set
* Look-ahead
* Write cache
* Power Management feature set
Security Mode feature set
* SMART feature set
* FLUSH CACHE EXT command
* Mandatory FLUSH CACHE command
* Device Configuration Overlay feature set
* 48-bit Address feature set
Automatic Acoustic Management feature set
SET MAX security extension
Address Offset Reserved Area Boot
SET FEATURES subcommand required to spinup after power up
Power-Up In Standby feature set
Advanced Power Management feature set
* DOWNLOAD MICROCODE cmd
* General Purpose Logging feature set
* SMART self-test
* SMART error logging
Security:
Master password revision code = 65534
supported
not enabled
not locked
frozen
not expired: security count
not supported: enhanced erase
92min for SECURITY ERASE UNIT.
Checksum: correct
[-- Attachment #5: hdparm_sdc.dump --]
[-- Type: application/octet-stream, Size: 2055 bytes --]
/dev/sdc:
ATA device, with non-removable media
Model Number: Hitachi HCP725025GLA380
Serial Number: GEK230RB2BZERA
Firmware Revision: GM2OA5CA
Standards:
Supported: 8 7 6 5
Likely used: 8
Configuration:
Logical max current
cylinders 16383 16383
heads 16 16
sectors/track 63 63
--
CHS current addressable sectors: 16514064
LBA user addressable sectors: 268435455
LBA48 user addressable sectors: 488397168
device size with M = 1024*1024: 238475 MBytes
device size with M = 1000*1000: 250059 MBytes (250 GB)
Capabilities:
LBA, IORDY(can be disabled)
Queue depth: 32
Standby timer values: spec'd by Standard, no device specific minimum
R/W multiple sector transfer: Max = 16 Current = 16
Advanced power management level: unknown setting (0x0000)
Recommended acoustic management value: 128, current value: 254
DMA: mdma0 mdma1 mdma2 udma0 udma1 udma2 udma3 udma4 udma5 *udma6
Cycle time: min=120ns recommended=120ns
PIO: pio0 pio1 pio2 pio3 pio4
Cycle time: no flow control=120ns IORDY flow control=120ns
Commands/features:
Enabled Supported:
* READ BUFFER cmd
* WRITE BUFFER cmd
* Host Protected Area feature set
* Look-ahead
* Write cache
* Power Management feature set
Security Mode feature set
* SMART feature set
* FLUSH CACHE EXT command
* Mandatory FLUSH CACHE command
* Device Configuration Overlay feature set
* 48-bit Address feature set
Automatic Acoustic Management feature set
SET MAX security extension
Address Offset Reserved Area Boot
SET FEATURES subcommand required to spinup after power up
Power-Up In Standby feature set
Advanced Power Management feature set
* DOWNLOAD MICROCODE cmd
* General Purpose Logging feature set
* SMART self-test
* SMART error logging
Security:
Master password revision code = 65534
supported
not enabled
not locked
frozen
not expired: security count
not supported: enhanced erase
92min for SECURITY ERASE UNIT.
Checksum: correct
[-- Attachment #6: messages --]
[-- Type: application/octet-stream, Size: 69453 bytes --]
Jun 26 18:20:14 shctc-xq-ems21-me17 syslogd 1.4.1: restart.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Linux version 2.6.13.2_MS3003 (root@Mother-FC4) (gcc version 4.0.0 20050519 (Red Hat 4.0.0-8)) #12 Sun Apr 29 11:45:29 CST 2007
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-provided physical RAM map:
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 0000000000100000 - 00000000320d0000 (usable)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 00000000320d0000 - 00000000320de000 (ACPI data)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 00000000320de000 - 0000000032100000 (ACPI NVS)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: BIOS-e820: 00000000fee00000 - 00000000fef00000 (reserved)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: 0MB HIGHMEM available.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: 800MB LOWMEM available.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: found SMP MP-table at 000ff780
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: DMI present.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Processor #0 15:15 APIC version 16
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x81] disabled)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: HPET id: 0x10de8201 base: 0xfed00000
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Using ACPI for processor (LAPIC) configuration information
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Intel MultiProcessor Specification v1.1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Virtual Wire compatibility mode.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: OEM ID: TEMPLATE Product ID: ETEMPLATE APIC at: 0xFEE00000
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: I/O APIC #1 Version 17 at 0xFEC00000.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Enabling APIC mode: Flat. Using 1 I/O APICs
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Processors: 1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Allocating PCI resources starting at 32100000 (gap: 32100000:adf00000)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Built 1 zonelists
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Kernel command line: root=/dev/ram console=ttyS0,115200
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Initializing CPU#0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: CPU 0 irqstacks, hard=c0560000 soft=c055f000
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PID hash table entries: 4096 (order: 12, 65536 bytes)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Console: colour VGA+ 80x25
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Memory: 773488k/820032k available (3191k kernel code, 45940k reserved, 1077k data, 180k init, 0k highmem)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Checking if this processor honours the WP bit even in supervisor mode... Ok.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 31
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: hpet0: 40ns tick, 3 32-bit timers
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Using HPET for base-timer
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Using HPET for gettimeofday
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Detected 2700.885 MHz processor.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Using hpet for high-res timesource
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Calibrating delay using timer specific routine.. 5403.67 BogoMIPS (lpj=2701838)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Security Framework v1.0.0 initialized
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Capability LSM initialized
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Mount-cache hash table entries: 512
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: CPU: L2 Cache: 512K (64 bytes/line)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Intel machine check architecture supported.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Intel machine check reporting enabled on CPU#0.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: mtrr: v2.0 (20020519)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: CPU: AMD Athlon(tm) Processor LE-1640 stepping 02
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Enabling fast FPU save and restore... done.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Enabling unmasked SIMD FPU exception support... done.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Checking 'hlt' instruction... OK.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: setting ELCR to 0200 (from 0ca0)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: checking if image is initramfs...it isn't (no cpio magic); looks like an initrd
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Freeing initrd memory: 33952k freed
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NET: Registered protocol family 16
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: bus type pci registered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: PCI BIOS revision 3.00 entry at 0xf0031, last bus=7
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Using configuration type 1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: Subsystem revision 20050408
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: Interpreter enabled
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: Using PIC for interrupt routing
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Root Bridge [PCI0] (0000:00)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Probing PCI hardware (bus 00)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: Assume root bridge [\_SB_.PCI0] segment is 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Transparent bridge - 0000:00:06.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LNEA] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LNEB] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LNEC] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LNED] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LUB0] (IRQs *5 7 10 11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LMAD] (IRQs 5 7 *10 11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LUB2] (IRQs 5 *7 10 11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LMAC] (IRQs 5 7 *10 11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LAZA] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LSMB] (IRQs 5 7 *10 11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LPMU] (IRQs 5 7 10 *11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LSA0] (IRQs 5 7 *10 11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LSA1] (IRQs 5 7 10 *11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LATA] (IRQs 5 7 10 11 14) *0, disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LSA2] (IRQs *5 7 10 11 14)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pnp: PnP ACPI init
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pnp: PnP ACPI: found 13 devices
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI subsystem initialized
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: usbcore: registered new driver usbfs
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: usbcore: registered new driver hub
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Using ACPI for IRQ routing
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Sangoma WANPIPE Router v1.1 (c) 1995-2000 Sangoma Technologies Inc.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pnp: 00:08: ioport range 0xca0-0xcaf has been reserved
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pnp: 00:0a: ioport range 0xa00-0xa7f has been reserved
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Ignore bogus resource 6 [0:0] of 0000:01:0a.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Bridge: 0000:00:06.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: IO window: e000-efff
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: MEM window: feb00000-febfffff
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PREFETCH window: f8000000-fbffffff
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Bridge: 0000:00:0a.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: IO window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: MEM window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PREFETCH window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Bridge: 0000:00:0b.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: IO window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: MEM window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PREFETCH window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Bridge: 0000:00:0c.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: IO window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: MEM window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PREFETCH window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Bridge: 0000:00:0d.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: IO window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: MEM window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PREFETCH window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Bridge: 0000:00:0e.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: IO window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: MEM window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PREFETCH window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: Bridge: 0000:00:0f.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: IO window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: MEM window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PREFETCH window: disabled.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: apm: overridden by ACPI.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: audit: initializing netlink socket (disabled)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: audit(1277576369.361:1): initialized
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Total HugeTLB memory allocated, 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: VFS: Disk quotas dquot_6.5.1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: JFS: nTxBlock = 6309, nTxLock = 50478
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SGI XFS with ACLs, security attributes, large block numbers, no debug enabled
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SGI XFS Quota Management subsystem
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Initializing Cryptographic API
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pcie_portdrv_probe->Dev[0376:10de] has invalid IRQ. Check vendor BIOS
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: assign_interrupt_mode Found MSI capability
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pcie_portdrv_probe->Dev[0374:10de] has invalid IRQ. Check vendor BIOS
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: assign_interrupt_mode Found MSI capability
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pcie_portdrv_probe->Dev[0374:10de] has invalid IRQ. Check vendor BIOS
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: assign_interrupt_mode Found MSI capability
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pcie_portdrv_probe->Dev[0378:10de] has invalid IRQ. Check vendor BIOS
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: assign_interrupt_mode Found MSI capability
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pcie_portdrv_probe->Dev[0375:10de] has invalid IRQ. Check vendor BIOS
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: assign_interrupt_mode Found MSI capability
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: pcie_portdrv_probe->Dev[0377:10de] has invalid IRQ. Check vendor BIOS
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: assign_interrupt_mode Found MSI capability
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Real Time Clock Driver v1.12
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: hpet_acpi_add: no address or irqs in _CRS
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Hangcheck: starting hangcheck timer 0.9.0 (tick is 180 seconds, margin is 60 seconds).
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Hangcheck: Using monotonic_clock().
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PNP: PS/2 controller doesn't have AUX irq; using default 0xc
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PNP: PS/2 Controller [PNP0303:PS2K] at 0x60,0x64 irq 112
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 32 ports, IRQ sharing enabled
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: io scheduler noop registered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: io scheduler anticipatory registered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: io scheduler deadline registered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: io scheduler cfq registered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: RAMDISK driver initialized: 16 RAM disks of 204800K size 1024 blocksize
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: loop: loaded (max 8 devices)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LSA0] enabled at IRQ 10
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: setting IRQ 10 as level-triggered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt 0000:00:05.0[A] -> Link [LSA0] -> GSI 10 (level, low) -> IRQ 10
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata1: SATA max UDMA/133 cmd 0xD480 ctl 0xD402 bmdma 0xCC00 irq 10
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata2: SATA max UDMA/133 cmd 0xD080 ctl 0xD002 bmdma 0xCC08 irq 10
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata1: dev 0 ATA-8, max UDMA/133, 488397168 sectors: LBA48
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata1: dev 0 configured for UDMA/133
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: scsi0 : sata_nv
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata2: dev 0 ATA-8, max UDMA/133, 488397168 sectors: LBA48
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata2: dev 0 configured for UDMA/133
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: scsi1 : sata_nv
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Vendor: ATA Model: Hitachi HCP72502 Rev: GM2O
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Type: Direct-Access ANSI SCSI revision: 05
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Vendor: ATA Model: Hitachi HCP72502 Rev: GM2O
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Type: Direct-Access ANSI SCSI revision: 05
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LSA1] enabled at IRQ 11
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: setting IRQ 11 as level-triggered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt 0000:00:05.1[B] -> Link [LSA1] -> GSI 11 (level, low) -> IRQ 11
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata3: SATA max UDMA/133 cmd 0xC880 ctl 0xC802 bmdma 0xC080 irq 11
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata4: SATA max UDMA/133 cmd 0xC480 ctl 0xC402 bmdma 0xC088 irq 11
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata3: dev 0 ATA-8, max UDMA/133, 488397168 sectors: LBA48
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata3: dev 0 configured for UDMA/133
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: scsi2 : sata_nv
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata4: dev 0 ATA-8, max UDMA/133, 488397168 sectors: LBA48
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata4: dev 0 configured for UDMA/133
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: scsi3 : sata_nv
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Vendor: ATA Model: Hitachi HCP72502 Rev: GM2O
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Type: Direct-Access ANSI SCSI revision: 05
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Vendor: ATA Model: Hitachi HCP72502 Rev: GM2O
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Type: Direct-Access ANSI SCSI revision: 05
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LSA2] enabled at IRQ 5
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: setting IRQ 5 as level-triggered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt 0000:00:05.2[C] -> Link [LSA2] -> GSI 5 (level, low) -> IRQ 5
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata5: SATA max UDMA/133 cmd 0xC000 ctl 0xBC02 bmdma 0xB480 irq 5
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata6: SATA max UDMA/133 cmd 0xB880 ctl 0xB802 bmdma 0xB488 irq 5
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata5: no device found (phy stat 00000000)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: scsi4 : sata_nv
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ata6: no device found (phy stat 00000000)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: scsi5 : sata_nv
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sda: 488397168 512-byte hdwr sectors (250059 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sda: drive cache: write back
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sda: 488397168 512-byte hdwr sectors (250059 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sda: drive cache: write back
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: sda: unknown partition table
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdb: 488397168 512-byte hdwr sectors (250059 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdb: drive cache: write back
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdb: 488397168 512-byte hdwr sectors (250059 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdb: drive cache: write back
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: sdb: sdb1 sdb2 sdb3 sdb4
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdc: 488397168 512-byte hdwr sectors (250059 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdc: drive cache: write back
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdc: 488397168 512-byte hdwr sectors (250059 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdc: drive cache: write back
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: sdc: sdc1 sdc2 sdc3 sdc4
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi disk sdc at scsi2, channel 0, id 0, lun 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdd: 488397168 512-byte hdwr sectors (250059 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdd: drive cache: write back
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdd: 488397168 512-byte hdwr sectors (250059 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdd: drive cache: write back
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: sdd: sdd1 sdd2 sdd3 sdd4
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi disk sdd at scsi3, channel 0, id 0, lun 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi generic sg0 at scsi0, channel 0, id 0, lun 0, type 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi generic sg1 at scsi1, channel 0, id 0, lun 0, type 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi generic sg2 at scsi2, channel 0, id 0, lun 0, type 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi generic sg3 at scsi3, channel 0, id 0, lun 0, type 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LUB2] enabled at IRQ 7
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PCI: setting IRQ 7 as level-triggered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt 0000:00:02.1[B] -> Link [LUB2] -> GSI 7 (level, low) -> IRQ 7
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ehci_hcd 0000:00:02.1: nVidia Corporation MCP55 USB Controller
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ehci_hcd 0000:00:02.1: debug port 1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ehci_hcd 0000:00:02.1: new USB bus registered, assigned bus number 1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ehci_hcd 0000:00:02.1: irq 7, io mem 0xfeafac00
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ehci_hcd 0000:00:02.1: park 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ehci_hcd 0000:00:02.1: USB 2.0 initialized, EHCI 1.00, driver 10 Dec 2004
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: hub 1-0:1.0: USB hub found
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: hub 1-0:1.0: 10 ports detected
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LUB0] enabled at IRQ 5
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt 0000:00:02.0[A] -> Link [LUB0] -> GSI 5 (level, low) -> IRQ 5
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ohci_hcd 0000:00:02.0: nVidia Corporation MCP55 USB Controller
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ohci_hcd 0000:00:02.0: new USB bus registered, assigned bus number 2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ohci_hcd 0000:00:02.0: irq 5, io mem 0xfeafb000
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: hub 2-0:1.0: USB hub found
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: hub 2-0:1.0: 10 ports detected
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Initializing USB Mass Storage driver...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: usb 1-7: new high speed USB device using ehci_hcd and address 2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: scsi6 : SCSI emulation for USB Mass Storage devices
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: usbcore: registered new driver usb-storage
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: USB Mass Storage support registered.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: usbcore: registered new driver hiddev
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: usbcore: registered new driver usbhid
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: drivers/usb/input/hid-core.c: v2.01:USB HID core driver
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: mice: PS/2 mouse device common for all mice
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: i2c /dev entries driver
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: md driver 0.90.2 MAX_MD_DEVS=256, MD_SB_DISKS=27
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bitmap version 3.38
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NET: Registered protocol family 2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: TCP bind hash table entries: 65536 (order: 6, 262144 bytes)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: TCP: Hash tables configured (established 131072 bind 65536)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: TCP reno registered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: TCP bic registered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Initializing IPsec netlink socket
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NET: Registered protocol family 1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NET: Registered protocol family 17
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NET: Registered protocol family 15
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Bridge firewalling registered
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NET: Registered protocol family 4
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NET: Registered protocol family 8
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NET: Registered protocol family 20
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: All bugs added by David S. Miller <davem@redhat.com>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCTP: Hash tables configured (established 65536 bind 65536)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Using IPI Shortcut mode
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI wakeup devices:
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: PS2K USB0 USB2 NMAC NMAD P0P1 HDAC BR10 BR11 BR12 BR13 BR14 BR15 NSMB PWRB
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: (supports S0 S1 S3 S4 S5)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: Autodetecting RAID arrays.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: autorun ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: considering sdd3 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdd3 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdd2 has different UUID to sdd3
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdd1 has different UUID to sdd3
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdc3 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdc2 has different UUID to sdd3
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdc1 has different UUID to sdd3
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdb3 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdb2 has different UUID to sdd3
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdb1 has different UUID to sdd3
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: created md2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdb3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdc3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdd3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: running: <sdd3><sdc3><sdb3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: personality 3 is not loaded!
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: do_md_run() returned -22
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: md2 stopped.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdd3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdd3)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdc3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdc3)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdb3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdb3)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: considering sdd2 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdd2 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdd1 has different UUID to sdd2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdc2 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdc1 has different UUID to sdd2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdb2 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdb1 has different UUID to sdd2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: created md1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdb2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdc2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdd2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: running: <sdd2><sdc2><sdb2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: personality 3 is not loaded!
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: do_md_run() returned -22
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: md1 stopped.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdd2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdd2)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdc2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdc2)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdb2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdb2)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: considering sdd1 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdd1 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdc1 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdb1 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: created md0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdb1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdc1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdd1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: running: <sdd1><sdc1><sdb1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: personality 3 is not loaded!
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: do_md_run() returned -22
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: md0 stopped.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdd1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdd1)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdc1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdc1)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: unbind<sdb1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: export_rdev(sdb1)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: ... autorun DONE.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: RAMDISK: Compressed image found at block 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: VFS: Mounted root (ext2 filesystem) readonly.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Freeing unused kernel memory: 180k freed
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Vendor: M-Sys Model: uDiskOnChip Rev: 5.u6
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Type: Direct-Access ANSI SCSI revision: 00
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdg: 998399 512-byte hdwr sectors (511 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: sdg: assuming drive cache: write through
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: SCSI device sdg: 998399 512-byte hdwr sectors (511 MB)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: sdg: assuming drive cache: write through
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: sdg: sdg1 sdg2 sdg3
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi disk sdg at scsi6, channel 0, id 0, lun 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Attached scsi generic sg4 at scsi6, channel 0, id 0, lun 0, type 0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NFORCE-MCP55: IDE controller at PCI slot 0000:00:04.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NFORCE-MCP55: chipset revision 161
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NFORCE-MCP55: not 100% native mode: will probe irqs later
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: NFORCE-MCP55: 0000:00:04.0 (rev a1) UDMA133 controller
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:pio, hdb:pio
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: forcedeth.c: Reverse Engineered nForce ethernet driver. Version 0.56.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LMAC] enabled at IRQ 10
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt 0000:00:08.0[A] -> Link [LMAC] -> GSI 10 (level, low) -> IRQ 10
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: forcedeth: using HIGHDMA
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: eth0: forcedeth.c: subsystem: 010de:cb84 bound to 0000:00:08.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt Link [LMAD] enabled at IRQ 10
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ACPI: PCI Interrupt 0000:00:09.0[A] -> Link [LMAD] -> GSI 10 (level, low) -> IRQ 10
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: forcedeth: using HIGHDMA
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: eth1: forcedeth.c: subsystem: 010de:cb84 bound to 0000:00:09.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: i2c_adapter i2c-0: nForce2 SMBus adapter at 0x2d00
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: i2c_adapter i2c-1: nForce2 SMBus adapter at 0x2e00
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: Autodetecting RAID arrays.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: autorun ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: considering sdb1 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdb1 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdc1 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdd1 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdb2 has different UUID to sdb1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdc2 has different UUID to sdb1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdd2 has different UUID to sdb1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdb3 has different UUID to sdb1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdc3 has different UUID to sdb1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdd3 has different UUID to sdb1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: created md0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdd1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdc1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdb1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: running: <sdb1><sdc1><sdd1>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: raid1 personality registered as nr 3
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: raid1: raid set md0 active with 2 out of 2 mirrors
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: considering sdb2 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdb2 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdc2 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdd2 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdb3 has different UUID to sdb2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdc3 has different UUID to sdb2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: sdd3 has different UUID to sdb2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: created md1
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdd2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdc2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdb2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: running: <sdb2><sdc2><sdd2>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: raid1: raid set md1 active with 2 out of 2 mirrors
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: considering sdb3 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdb3 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdc3 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: adding sdd3 ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: created md2
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdd3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdc3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: bind<sdb3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: running: <sdb3><sdc3><sdd3>
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: raid1: raid set md2 active with 2 out of 2 mirrors
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: md: ... autorun DONE.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: device-mapper: 4.4.0-ioctl (2005-01-12) initialised: dm-devel@redhat.com
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: EXT2-fs warning: mounting unchecked fs, running e2fsck is recommended
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ut_hss driver version:1.0.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: uthss: Detecting device at 0[SMBus nForce2 adapter at 2d00:0],0x2c with COMPANY: 0x41 and VERSTEP: 0x45
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: uthss: Autodetecting device at 0,0x2c ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: ut_hss driver version:1.0.0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: uthss: Detecting device at 1[SMBus nForce2 adapter at 2e00:0],0x2c with COMPANY: 0x41 and VERSTEP: 0x45
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: uthss: Autodetecting device at 1,0x2c ...
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: Ethernet Channel Bonding Driver: v2.6.3 (June 8, 2005)
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: bonding: MII link monitoring set to 100 ms
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: bonding: Warning : no link monitoring support for eth0
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: eth0: no link during initialization.
Jun 26 18:20:14 shctc-xq-ems21-me17 kernel: bonding: bond0: enslaving eth0 as a backup interface with a down link.
Jun 26 18:20:14 shctc-xq-ems21-me17 smartd[1782]: smartd version 5.33 [i686-redhat-linux-gnu] Copyright (C) 2002-4 Bruce Allen
Jun 26 18:20:14 shctc-xq-ems21-me17 smartd[1782]: Home page is http://smartmontools.sourceforge.net/
Jun 26 18:20:14 shctc-xq-ems21-me17 smartd[1782]: Opened configuration file /etc/smartd.conf
Jun 26 18:20:14 shctc-xq-ems21-me17 smartd[1782]: Configuration file /etc/smartd.conf parsed.
Jun 26 18:20:14 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sda, opened
Jun 26 18:20:14 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sda, not found in smartd database.
Jun 26 18:20:15 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sda, is SMART capable. Adding to "monitor" list.
Jun 26 18:20:15 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdb, opened
Jun 26 18:20:15 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdb, not found in smartd database.
Jun 26 18:20:15 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdb, is SMART capable. Adding to "monitor" list.
Jun 26 18:20:15 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdc, opened
Jun 26 18:20:15 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdc, not found in smartd database.
Jun 26 18:20:16 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdc, is SMART capable. Adding to "monitor" list.
Jun 26 18:20:16 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdd, opened
Jun 26 18:20:16 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdd, not found in smartd database.
Jun 26 18:20:16 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdd, is SMART capable. Adding to "monitor" list.
Jun 26 18:20:16 shctc-xq-ems21-me17 smartd[1782]: Monitoring 4 ATA and 0 SCSI devices
Jun 26 18:20:17 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 18:20:17 shctc-xq-ems21-me17 smartd[1782]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 18:20:18 shctc-xq-ems21-me17 smartd[1785]: smartd has fork()ed into background mode. New PID=1785.
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: ntpd 4.2.0a@1.1196-r Sun Jan 8 01:23:13 CST 2006 (1)
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: precision = 1.000 usec
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: Listening on interface wildcard, 0.0.0.0#123
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: Listening on interface lo, 127.0.0.1#123
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: Listening on interface eth1, 10.48.41.74#123
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: Listening on interface bond0, 10.50.47.31#123
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: kernel time sync status 0040
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: frequency initialized 0.000 PPM from /var/lib/ntp/drift
Jun 26 18:20:18 shctc-xq-ems21-me17 xinetd[1793]: xinetd Version 2.3.13 started with libwrap loadavg options compiled in.
Jun 26 18:20:18 shctc-xq-ems21-me17 xinetd[1793]: Started working: 1 available service
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1803]: ntpd exiting on signal 15
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1842]: ntpd 4.2.0a@1.1196-r Sun Jan 8 01:23:13 CST 2006 (1)
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1842]: precision = 1.000 usec
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1842]: Listening on interface wildcard, 0.0.0.0#123
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1842]: Listening on interface lo, 127.0.0.1#123
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1842]: Listening on interface eth1, 10.48.41.74#123
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1842]: Listening on interface bond0, 10.50.47.31#123
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1842]: kernel time sync status 0040
Jun 26 18:20:18 shctc-xq-ems21-me17 ntpd[1842]: frequency initialized 0.000 PPM from /var/lib/ntp/drift
Jun 26 18:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 18:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 19:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2082]: session opened for user root by (uid=0)
Jun 26 19:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2082]: session closed for user root
Jun 26 19:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 19:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 19:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 19:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 20:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2085]: session opened for user root by (uid=0)
Jun 26 20:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2085]: session closed for user root
Jun 26 20:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 20:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 20:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 20:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 21:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2087]: session opened for user root by (uid=0)
Jun 26 21:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2087]: session closed for user root
Jun 26 21:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 21:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 21:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 21:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 22:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2089]: session opened for user root by (uid=0)
Jun 26 22:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2089]: session closed for user root
Jun 26 22:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 22:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 22:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 22:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 23:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2091]: session opened for user root by (uid=0)
Jun 26 23:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2091]: session closed for user root
Jun 26 23:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 23:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 26 23:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 26 23:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 00:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2093]: session opened for user root by (uid=0)
Jun 27 00:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2093]: session closed for user root
Jun 27 00:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 00:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 00:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 00:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 01:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2095]: session opened for user root by (uid=0)
Jun 27 01:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2095]: session closed for user root
Jun 27 01:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 01:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 01:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 01:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 02:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2097]: session opened for user root by (uid=0)
Jun 27 02:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2097]: session closed for user root
Jun 27 02:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 02:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 02:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 02:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 03:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2099]: session opened for user root by (uid=0)
Jun 27 03:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2099]: session closed for user root
Jun 27 03:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 03:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 03:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 03:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 04:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2101]: session opened for user root by (uid=0)
Jun 27 04:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2101]: session closed for user root
Jun 27 04:02:01 shctc-xq-ems21-me17 crond(pam_unix)[2103]: session opened for user root by (uid=0)
Jun 27 04:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 04:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 04:22:01 shctc-xq-ems21-me17 crond(pam_unix)[2143]: session opened for user root by (uid=0)
Jun 27 04:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 04:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 05:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2154]: session opened for user root by (uid=0)
Jun 27 05:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2154]: session closed for user root
Jun 27 05:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 05:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 05:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 05:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 06:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2156]: session opened for user root by (uid=0)
Jun 27 06:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2156]: session closed for user root
Jun 27 06:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 06:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 06:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 06:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 07:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2158]: session opened for user root by (uid=0)
Jun 27 07:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2158]: session closed for user root
Jun 27 07:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 07:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 07:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 07:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 08:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2160]: session opened for user root by (uid=0)
Jun 27 08:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2160]: session closed for user root
Jun 27 08:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 08:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 08:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 08:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 09:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2162]: session opened for user root by (uid=0)
Jun 27 09:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2162]: session closed for user root
Jun 27 09:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 09:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 09:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 09:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 10:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2164]: session opened for user root by (uid=0)
Jun 27 10:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2164]: session closed for user root
Jun 27 10:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 10:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 10:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 10:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 11:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2166]: session opened for user root by (uid=0)
Jun 27 11:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2166]: session closed for user root
Jun 27 11:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 11:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 11:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 11:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 12:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2168]: session opened for user root by (uid=0)
Jun 27 12:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2168]: session closed for user root
Jun 27 12:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 12:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 12:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 12:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 13:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2170]: session opened for user root by (uid=0)
Jun 27 13:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2170]: session closed for user root
Jun 27 13:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 13:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 13:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 13:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 14:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2172]: session opened for user root by (uid=0)
Jun 27 14:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2172]: session closed for user root
Jun 27 14:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 14:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 14:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 14:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 15:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2174]: session opened for user root by (uid=0)
Jun 27 15:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2174]: session closed for user root
Jun 27 15:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 15:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 15:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 15:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 16:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2176]: session opened for user root by (uid=0)
Jun 27 16:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2176]: session closed for user root
Jun 27 16:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 16:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 16:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 16:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 17:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2178]: session opened for user root by (uid=0)
Jun 27 17:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2178]: session closed for user root
Jun 27 17:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 17:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 17:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 17:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 18:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2180]: session opened for user root by (uid=0)
Jun 27 18:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2180]: session closed for user root
Jun 27 18:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 18:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 18:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 18:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 19:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2182]: session opened for user root by (uid=0)
Jun 27 19:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2182]: session closed for user root
Jun 27 19:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 19:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 19:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 19:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 20:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2184]: session opened for user root by (uid=0)
Jun 27 20:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2184]: session closed for user root
Jun 27 20:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 20:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 20:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 20:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 21:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2186]: session opened for user root by (uid=0)
Jun 27 21:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2186]: session closed for user root
Jun 27 21:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 21:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 21:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 21:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 22:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2188]: session opened for user root by (uid=0)
Jun 27 22:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2188]: session closed for user root
Jun 27 22:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 22:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 22:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 22:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 23:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2190]: session opened for user root by (uid=0)
Jun 27 23:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2190]: session closed for user root
Jun 27 23:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 23:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 27 23:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 27 23:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 00:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2192]: session opened for user root by (uid=0)
Jun 28 00:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2192]: session closed for user root
Jun 28 00:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 00:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 00:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 00:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 01:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2194]: session opened for user root by (uid=0)
Jun 28 01:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2194]: session closed for user root
Jun 28 01:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 01:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 01:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 01:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 02:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2196]: session opened for user root by (uid=0)
Jun 28 02:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2196]: session closed for user root
Jun 28 02:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 02:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 02:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 02:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 03:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2198]: session opened for user root by (uid=0)
Jun 28 03:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2198]: session closed for user root
Jun 28 03:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 03:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 03:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 03:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 04:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2200]: session opened for user root by (uid=0)
Jun 28 04:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2200]: session closed for user root
Jun 28 04:02:01 shctc-xq-ems21-me17 crond(pam_unix)[2202]: session opened for user root by (uid=0)
Jun 28 04:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 04:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 04:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 04:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 05:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2242]: session opened for user root by (uid=0)
Jun 28 05:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2242]: session closed for user root
Jun 28 05:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 05:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 05:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 05:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 06:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2244]: session opened for user root by (uid=0)
Jun 28 06:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2244]: session closed for user root
Jun 28 06:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 06:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 06:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 06:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 07:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2246]: session opened for user root by (uid=0)
Jun 28 07:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2246]: session closed for user root
Jun 28 07:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 07:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 07:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 07:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 08:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2248]: session opened for user root by (uid=0)
Jun 28 08:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2248]: session closed for user root
Jun 28 08:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 08:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 08:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 08:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 09:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2250]: session opened for user root by (uid=0)
Jun 28 09:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2250]: session closed for user root
Jun 28 09:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 09:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 09:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 09:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 10:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2252]: session opened for user root by (uid=0)
Jun 28 10:01:02 shctc-xq-ems21-me17 crond(pam_unix)[2252]: session closed for user root
Jun 28 10:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 10:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 10:35:21 shctc-xq-ems21-me17 kernel: eth1: link down.
Jun 28 10:37:55 shctc-xq-ems21-me17 kernel: eth1: link up.
Jun 28 10:38:30 shctc-xq-ems21-me17 sshd(pam_unix)[2258]: session opened for user root by root(uid=0)
Jun 28 10:43:20 shctc-xq-ems21-me17 kernel: eth1: link down.
Jun 28 10:47:16 shctc-xq-ems21-me17 login(pam_unix)[1895]: session opened for user root by (uid=0)
Jun 28 10:47:16 shctc-xq-ems21-me17 -- root[1895]: DIALUP AT ttyS0 BY root
Jun 28 10:47:16 shctc-xq-ems21-me17 -- root[1895]: ROOT LOGIN ON ttyS0
Jun 28 10:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 10:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 10:53:47 shctc-xq-ems21-me17 kernel: eth1: link up.
Jun 28 10:57:04 shctc-xq-ems21-me17 login(pam_unix)[1895]: session closed for user root
Jun 28 10:57:17 shctc-xq-ems21-me17 sshd(pam_unix)[2315]: session opened for user root by root(uid=0)
Jun 28 11:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2356]: session opened for user root by (uid=0)
Jun 28 11:01:01 shctc-xq-ems21-me17 crond(pam_unix)[2356]: session closed for user root
Jun 28 11:03:31 shctc-xq-ems21-me17 kernel: eth1: link down.
Jun 28 11:04:04 shctc-xq-ems21-me17 login(pam_unix)[2310]: session opened for user root by (uid=0)
Jun 28 11:04:05 shctc-xq-ems21-me17 -- root[2310]: DIALUP AT ttyS0 BY root
Jun 28 11:04:05 shctc-xq-ems21-me17 -- root[2310]: ROOT LOGIN ON ttyS0
Jun 28 11:04:36 shctc-xq-ems21-me17 kernel: eth1: link up.
Jun 28 11:05:21 shctc-xq-ems21-me17 kernel: eth1: link down.
Jun 28 11:05:39 shctc-xq-ems21-me17 kernel: eth1: link up.
Jun 28 11:10:13 shctc-xq-ems21-me17 sshd(pam_unix)[2406]: session opened for user root by root(uid=0)
Jun 28 11:20:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 11:20:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 11:50:18 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sda, 13 Currently unreadable (pending) sectors
Jun 28 11:50:19 shctc-xq-ems21-me17 smartd[1785]: Device: /dev/sdc, 1 Currently unreadable (pending) sectors
Jun 28 11:50:21 shctc-xq-ems21-me17 sshd(pam_unix)[2474]: session opened for user root by (uid=0)
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
2010-06-28 7:38 ` Pls help for LibATA caused kernel temporary hung Simon Li
@ 2010-06-28 9:02 ` Jeff Garzik
2010-06-28 9:09 ` Simon Li
0 siblings, 1 reply; 10+ messages in thread
From: Jeff Garzik @ 2010-06-28 9:02 UTC (permalink / raw)
To: Simon Li; +Cc: Tejun Heo, linux-ide
On 06/28/2010 03:38 AM, Simon Li wrote:
> May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
> DeviceFault CorrectedError Error }
> May 25 15:59:59 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
> DeviceFault CorrectedError Error }
> Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
> DeviceFault CorrectedError Error }
> Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
> DeviceFault CorrectedError Error }
> Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
> DeviceFault CorrectedError Error }
Your hardware is returning errors, which libata is dutifully reporting...
Jeff
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
2010-06-28 9:02 ` Jeff Garzik
@ 2010-06-28 9:09 ` Simon Li
2010-06-29 1:36 ` Marek Vasut
2010-06-29 5:11 ` Robert Hancock
0 siblings, 2 replies; 10+ messages in thread
From: Simon Li @ 2010-06-28 9:09 UTC (permalink / raw)
To: Jeff Garzik; +Cc: Tejun Heo, linux-ide
We don't expect kernel goes to temporary hung, any ideas for the fix?
On Mon, Jun 28, 2010 at 5:02 PM, Jeff Garzik <jeff@garzik.org> wrote:
> On 06/28/2010 03:38 AM, Simon Li wrote:
>>
>> May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
>> DeviceFault CorrectedError Error }
>
>> May 25 15:59:59 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
>> DeviceFault CorrectedError Error }
>
>> Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>> DeviceFault CorrectedError Error }
>
>> Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>> DeviceFault CorrectedError Error }
>
>> Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>> DeviceFault CorrectedError Error }
>
> Your hardware is returning errors, which libata is dutifully reporting...
>
> Jeff
>
>
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
2010-06-28 9:09 ` Simon Li
@ 2010-06-29 1:36 ` Marek Vasut
2010-06-29 5:11 ` Robert Hancock
1 sibling, 0 replies; 10+ messages in thread
From: Marek Vasut @ 2010-06-29 1:36 UTC (permalink / raw)
To: Simon Li; +Cc: Jeff Garzik, Tejun Heo, linux-ide
Dne Po 28. června 2010 11:09:10 Simon Li napsal(a):
> We don't expect kernel goes to temporary hung, any ideas for the fix?
Fix the hardware ?
>
> On Mon, Jun 28, 2010 at 5:02 PM, Jeff Garzik <jeff@garzik.org> wrote:
> > On 06/28/2010 03:38 AM, Simon Li wrote:
> >> May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
> >> DeviceFault CorrectedError Error }
> >>
> >> May 25 15:59:59 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
> >> DeviceFault CorrectedError Error }
> >>
> >> Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
> >> DeviceFault CorrectedError Error }
> >>
> >> Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
> >> DeviceFault CorrectedError Error }
> >>
> >> Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
> >> DeviceFault CorrectedError Error }
> >
> > Your hardware is returning errors, which libata is dutifully reporting...
> >
> > Jeff
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ide" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
2010-06-28 9:09 ` Simon Li
2010-06-29 1:36 ` Marek Vasut
@ 2010-06-29 5:11 ` Robert Hancock
2010-06-29 7:10 ` Simon Li
1 sibling, 1 reply; 10+ messages in thread
From: Robert Hancock @ 2010-06-29 5:11 UTC (permalink / raw)
To: Simon Li; +Cc: Jeff Garzik, Tejun Heo, linux-ide
On 06/28/2010 03:09 AM, Simon Li wrote:
> We don't expect kernel goes to temporary hung, any ideas for the fix?
It depends what you mean by hanging. Usually if a drive is stuck trying
to read a bad sector it will take quite a while before it gives up, and
during that period all disk access is stalled. The kernel normally
retries several times as well. If a bunch of applications are needing to
access the disk, they'll appear to be hung up during this process.
>
>
> On Mon, Jun 28, 2010 at 5:02 PM, Jeff Garzik<jeff@garzik.org> wrote:
>> On 06/28/2010 03:38 AM, Simon Li wrote:
>>>
>>> May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
>>> DeviceFault CorrectedError Error }
>>
>>> May 25 15:59:59 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
>>> DeviceFault CorrectedError Error }
>>
>>> Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>>> DeviceFault CorrectedError Error }
>>
>>> Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>>> DeviceFault CorrectedError Error }
>>
>>> Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>>> DeviceFault CorrectedError Error }
>>
>> Your hardware is returning errors, which libata is dutifully reporting...
>>
>> Jeff
>>
>>
>>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ide" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
2010-06-29 5:11 ` Robert Hancock
@ 2010-06-29 7:10 ` Simon Li
2010-06-29 7:20 ` Tejun Heo
0 siblings, 1 reply; 10+ messages in thread
From: Simon Li @ 2010-06-29 7:10 UTC (permalink / raw)
To: Robert Hancock; +Cc: Jeff Garzik, Tejun Heo, linux-ide
We observed that all the processes on the blade are totally stuck,
though only one process is actually accessing the disks, other
processes are mostly CPU-consuming applications.
On Tue, Jun 29, 2010 at 1:11 PM, Robert Hancock <hancockrwd@gmail.com> wrote:
> On 06/28/2010 03:09 AM, Simon Li wrote:
>>
>> We don't expect kernel goes to temporary hung, any ideas for the fix?
>
> It depends what you mean by hanging. Usually if a drive is stuck trying to
> read a bad sector it will take quite a while before it gives up, and during
> that period all disk access is stalled. The kernel normally retries several
> times as well. If a bunch of applications are needing to access the disk,
> they'll appear to be hung up during this process.
>
>>
>>
>> On Mon, Jun 28, 2010 at 5:02 PM, Jeff Garzik<jeff@garzik.org> wrote:
>>>
>>> On 06/28/2010 03:38 AM, Simon Li wrote:
>>>>
>>>> May 25 15:55:06 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
>>>> DeviceFault CorrectedError Error }
>>>
>>>> May 25 15:59:59 shctc-xq-ems22-me18 kernel: ata3: status=0x25 {
>>>> DeviceFault CorrectedError Error }
>>>
>>>> Jun 2 10:54:06 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>>>> DeviceFault CorrectedError Error }
>>>
>>>> Jun 2 10:54:08 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>>>> DeviceFault CorrectedError Error }
>>>
>>>> Jun 2 10:54:18 shctc-xm-ems21-me18 kernel: ata2: status=0x25 {
>>>> DeviceFault CorrectedError Error }
>>>
>>> Your hardware is returning errors, which libata is dutifully reporting...
>>>
>>> Jeff
>>>
>>>
>>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-ide" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>
>
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
2010-06-29 7:10 ` Simon Li
@ 2010-06-29 7:20 ` Tejun Heo
2010-06-29 7:27 ` Simon Li
0 siblings, 1 reply; 10+ messages in thread
From: Tejun Heo @ 2010-06-29 7:20 UTC (permalink / raw)
To: Simon Li; +Cc: Robert Hancock, Jeff Garzik, linux-ide
Hello, Simon.
On 06/29/2010 09:10 AM, Simon Li wrote:
> We observed that all the processes on the blade are totally stuck,
> though only one process is actually accessing the disks, other
> processes are mostly CPU-consuming applications.
Can you please turn on printk timestamp and attach the dmesg output
_after_ such failure? I think there are two possibilities. The
kernel could be generating too many messages to slow serial console,
or the it might as well be that all processes got stuck on IO. It's
really difficult to figure out what's going on without more specific
information. What does "stuck" mean? Does it mean all of them are in
iowait or is the kernel just stuck inside kernel?
Thanks.
--
tejun
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
2010-06-29 7:20 ` Tejun Heo
@ 2010-06-29 7:27 ` Simon Li
2010-06-29 7:29 ` Tejun Heo
0 siblings, 1 reply; 10+ messages in thread
From: Simon Li @ 2010-06-29 7:27 UTC (permalink / raw)
To: Tejun Heo; +Cc: Robert Hancock, Jeff Garzik, linux-ide
"stuck" here I mean, the kernel stuck inside kernel, so applications
got stuck as well...
On Tue, Jun 29, 2010 at 3:20 PM, Tejun Heo <htejun@gmail.com> wrote:
> Hello, Simon.
>
> On 06/29/2010 09:10 AM, Simon Li wrote:
>> We observed that all the processes on the blade are totally stuck,
>> though only one process is actually accessing the disks, other
>> processes are mostly CPU-consuming applications.
>
> Can you please turn on printk timestamp and attach the dmesg output
> _after_ such failure? I think there are two possibilities. The
> kernel could be generating too many messages to slow serial console,
> or the it might as well be that all processes got stuck on IO. It's
> really difficult to figure out what's going on without more specific
> information. What does "stuck" mean? Does it mean all of them are in
> iowait or is the kernel just stuck inside kernel?
>
> Thanks.
>
> --
> tejun
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
2010-06-29 7:27 ` Simon Li
@ 2010-06-29 7:29 ` Tejun Heo
[not found] ` <AANLkTinYbtr1qBLibK7wYizCDq8V0HwFu01NUr-f_KfR@mail.gmail.com>
0 siblings, 1 reply; 10+ messages in thread
From: Tejun Heo @ 2010-06-29 7:29 UTC (permalink / raw)
To: Simon Li; +Cc: Robert Hancock, Jeff Garzik, linux-ide
On 06/29/2010 09:27 AM, Simon Li wrote:
> "stuck" here I mean, the kernel stuck inside kernel, so applications
> got stuck as well...
How did you determine that? Come on. Give us some data.
--
tejun
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Pls help for LibATA caused kernel temporary hung.
[not found] ` <AANLkTinYbtr1qBLibK7wYizCDq8V0HwFu01NUr-f_KfR@mail.gmail.com>
@ 2010-06-30 0:38 ` Robert Hancock
0 siblings, 0 replies; 10+ messages in thread
From: Robert Hancock @ 2010-06-30 0:38 UTC (permalink / raw)
To: Simon Li; +Cc: Tejun Heo, Jeff Garzik, linux-ide
On Tue, Jun 29, 2010 at 4:13 AM, Simon Li <simon.jiyou@gmail.com> wrote:
> We have one process(Streaming server) R/W disks, and another process
> is a pure monitoring process of the streaming server, periodicially
> collecting aliveness info from the streaming process. At the time of
> _"I called kernel temporary hung"_, the streaming process "looks"
> entering into stuck as no more logs prints(usually, there are dozens
> of logs prints in each second), this also exactly happened to the
> monitoring process, and the sys log as well. At the time of _"kernel
> hung resumed"_, the two process suddenly came back to run(Ye, observed
> from log printings) and running as usual.
>
> A full syslog attached, you can do _grep_ "[RSS-RAW] Failed to read",
> the results indicate "kernel hung" frequently occurred during those
> read() syscalls.
If the process or syslog is writing its logs to disk, then eventually
after the kernel decides that too much data has been queued up to be
written to disk, those processes trying to write will block until some
of the data can be written out. If all disk I/O is stalled, then a lot
of things can more or less grind to a halt. The kernel is not hung,
but userspace may be effectively hung.
>
>
> On Tue, Jun 29, 2010 at 3:29 PM, Tejun Heo <htejun@gmail.com> wrote:
>> On 06/29/2010 09:27 AM, Simon Li wrote:
>>> "stuck" here I mean, the kernel stuck inside kernel, so applications
>>> got stuck as well...
>>
>> How did you determine that? Come on. Give us some data.
>>
>> --
>> tejun
>>
>
^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2010-06-30 0:38 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <AANLkTinbQHdo40Drqc5Ydur5lCrAktHHDig45HDrC6s1@mail.gmail.com>
[not found] ` <4C2777D3.1050208@gmail.com>
2010-06-28 7:38 ` Pls help for LibATA caused kernel temporary hung Simon Li
2010-06-28 9:02 ` Jeff Garzik
2010-06-28 9:09 ` Simon Li
2010-06-29 1:36 ` Marek Vasut
2010-06-29 5:11 ` Robert Hancock
2010-06-29 7:10 ` Simon Li
2010-06-29 7:20 ` Tejun Heo
2010-06-29 7:27 ` Simon Li
2010-06-29 7:29 ` Tejun Heo
[not found] ` <AANLkTinYbtr1qBLibK7wYizCDq8V0HwFu01NUr-f_KfR@mail.gmail.com>
2010-06-30 0:38 ` Robert Hancock
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.