* Strange block/scsi/workqueue issue @ 2011-04-11 14:56 Steven Whitehouse 2011-04-11 17:18 ` Tejun Heo 0 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-11 14:56 UTC (permalink / raw) To: linux-kernel, Jens Axboe, Tejun Heo Hi, Sometime around the -rc1 time (I'm not sure exactly, but it seemed to start around then) my test box stopped booting. Lacking a serial console I didn't get around to looking further before I went on holiday, but since the problem is still there in the latest Linus' tree, I've been looking again today. My original problem was that the messages were scrolling off the screen before I could read them. Using a video camera to try and capture them was unsuccessful. Today I used a serial console, and magically it seemed that the initial boot issue had gone away - so I guess there is at least an element of timing dependence. However, not very long after boot, I got the attached messages. These look suspiciously similar (bearing in mind I could only see the last few lines) to the messages I was getting with the boot issue. I should also say that the box was idle aside from the usual f14 start up tasks, so there was not much I/O going on at the time. Is the workqueue by any chance trying to wait synchronously for itself to finish? Steve. INFO: task kworker/2:1:382 blocked for more than 120 seconds. "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/2:1 D ffff8800cb5d2500 4528 382 2 0x00000000 ffff8800c88d5880 0000000000000086 00000000001d2500 ffff8800c88d57c8 0000000000000086 ffff8800c88d5fd8 ffff8800c92d8b80 ffff8800c88d5fd8 ffff8800c88d4000 ffff8800c88d4000 ffff8800c88d4000 ffff8800c88d5fd8 Call Trace: [<ffffffff8107fdea>] ? finish_task_switch+0x3a/0x110 [<ffffffff8167ebe6>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8107fdea>] ? finish_task_switch+0x3a/0x110 [<ffffffff8167b8e5>] schedule_timeout+0x295/0x310 [<ffffffff816826b9>] ? sub_preempt_count+0xa9/0xe0 [<ffffffff8167a650>] wait_for_common+0x120/0x170 [<ffffffff810898c0>] ? try_to_wake_up+0x360/0x360 [<ffffffff8167a748>] wait_for_completion+0x18/0x20 [<ffffffff810aba4c>] wait_on_cpu_work+0xec/0x100 [<ffffffff810aa460>] ? do_work_for_cpu+0x30/0x30 [<ffffffff810abb3b>] wait_on_work+0xdb/0x150 [<ffffffff810aba60>] ? wait_on_cpu_work+0x100/0x100 [<ffffffff810abc33>] __cancel_work_timer+0x83/0x130 [<ffffffff810abced>] cancel_delayed_work_sync+0xd/0x10 [<ffffffff813b24b4>] blk_sync_queue+0x24/0x50 [<ffffffff813b24ef>] blk_cleanup_queue+0xf/0x60 [<ffffffff81479a89>] scsi_free_queue+0x9/0x10 [<ffffffff8147d30b>] scsi_device_dev_release_usercontext+0xeb/0x140 [<ffffffff810cbd5d>] ? trace_hardirqs_on_caller+0x14d/0x190 [<ffffffff8147d220>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 [<ffffffff8147d1f7>] scsi_device_dev_release+0x17/0x20 [<ffffffff814609f2>] device_release+0x22/0x90 [<ffffffff8167ef98>] ? retint_restore_args+0x13/0x13 [<ffffffff813c8165>] kobject_release+0x45/0x90 [<ffffffff813c8120>] ? kobject_del+0x40/0x40 [<ffffffff813c9767>] kref_put+0x37/0x70 [<ffffffff813c8027>] kobject_put+0x27/0x60 [<ffffffff81460822>] put_device+0x12/0x20 [<ffffffff81478bd9>] scsi_request_fn+0xb9/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff81687064>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ebe6>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167ef98>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff81687060>] ? gs_change+0x13/0x13 INFO: lockdep is turned off. INFO: task kworker/2:1:382 blocked for more than 120 seconds. "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/2:1 D ffff8800cb5d2500 4528 382 2 0x00000000 ffff8800c88d5880 0000000000000086 00000000001d2500 ffff8800c88d57c8 0000000000000086 ffff8800c88d5fd8 ffff8800c92d8b80 ffff8800c88d5fd8 ffff8800c88d4000 ffff8800c88d4000 ffff8800c88d4000 ffff8800c88d5fd8 Call Trace: [<ffffffff8107fdea>] ? finish_task_switch+0x3a/0x110 [<ffffffff8167ebe6>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8107fdea>] ? finish_task_switch+0x3a/0x110 [<ffffffff8167b8e5>] schedule_timeout+0x295/0x310 [<ffffffff816826b9>] ? sub_preempt_count+0xa9/0xe0 [<ffffffff8167a650>] wait_for_common+0x120/0x170 [<ffffffff810898c0>] ? try_to_wake_up+0x360/0x360 [<ffffffff8167a748>] wait_for_completion+0x18/0x20 [<ffffffff810aba4c>] wait_on_cpu_work+0xec/0x100 [<ffffffff810aa460>] ? do_work_for_cpu+0x30/0x30 [<ffffffff810abb3b>] wait_on_work+0xdb/0x150 [<ffffffff810aba60>] ? wait_on_cpu_work+0x100/0x100 [<ffffffff810abc33>] __cancel_work_timer+0x83/0x130 [<ffffffff810abced>] cancel_delayed_work_sync+0xd/0x10 [<ffffffff813b24b4>] blk_sync_queue+0x24/0x50 [<ffffffff813b24ef>] blk_cleanup_queue+0xf/0x60 [<ffffffff81479a89>] scsi_free_queue+0x9/0x10 [<ffffffff8147d30b>] scsi_device_dev_release_usercontext+0xeb/0x140 [<ffffffff810cbd5d>] ? trace_hardirqs_on_caller+0x14d/0x190 [<ffffffff8147d220>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 [<ffffffff8147d1f7>] scsi_device_dev_release+0x17/0x20 [<ffffffff814609f2>] device_release+0x22/0x90 [<ffffffff8167ef98>] ? retint_restore_args+0x13/0x13 [<ffffffff813c8165>] kobject_release+0x45/0x90 [<ffffffff813c8120>] ? kobject_del+0x40/0x40 [<ffffffff813c9767>] kref_put+0x37/0x70 [<ffffffff813c8027>] kobject_put+0x27/0x60 [<ffffffff81460822>] put_device+0x12/0x20 [<ffffffff81478bd9>] scsi_request_fn+0xb9/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff81687064>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ebe6>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167ef98>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff81687060>] ? gs_change+0x13/0x13 INFO: lockdep is turned off. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-11 14:56 Strange block/scsi/workqueue issue Steven Whitehouse @ 2011-04-11 17:18 ` Tejun Heo 2011-04-11 17:29 ` Jens Axboe ` (2 more replies) 0 siblings, 3 replies; 39+ messages in thread From: Tejun Heo @ 2011-04-11 17:18 UTC (permalink / raw) To: Steven Whitehouse; +Cc: linux-kernel, Jens Axboe, James Bottomley Hello, (cc'ing James. The original message is http://lkml.org/lkml/2011/4/11/175 ) Please read from the bottom up. On Mon, Apr 11, 2011 at 03:56:03PM +0100, Steven Whitehouse wrote: > [<ffffffff8167b8e5>] schedule_timeout+0x295/0x310 > [<ffffffff8167a650>] wait_for_common+0x120/0x170 > [<ffffffff8167a748>] wait_for_completion+0x18/0x20 > [<ffffffff810aba4c>] wait_on_cpu_work+0xec/0x100 > [<ffffffff810abb3b>] wait_on_work+0xdb/0x150 > [<ffffffff810abc33>] __cancel_work_timer+0x83/0x130 > [<ffffffff810abced>] cancel_delayed_work_sync+0xd/0x10 4. which in turn tries to sync cancel q->delay_work. Oops, deadlock. > [<ffffffff813b24b4>] blk_sync_queue+0x24/0x50 3. and calls into blk_sync_queue() > [<ffffffff813b24ef>] blk_cleanup_queue+0xf/0x60 > [<ffffffff81479a89>] scsi_free_queue+0x9/0x10 > [<ffffffff8147d30b>] scsi_device_dev_release_usercontext+0xeb/0x140 > [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 2. It triggers SCSI device release > [<ffffffff8147d1f7>] scsi_device_dev_release+0x17/0x20 > [<ffffffff814609f2>] device_release+0x22/0x90 > [<ffffffff813c8165>] kobject_release+0x45/0x90 > [<ffffffff813c9767>] kref_put+0x37/0x70 > [<ffffffff813c8027>] kobject_put+0x27/0x60 > [<ffffffff81460822>] put_device+0x12/0x20 > [<ffffffff81478bd9>] scsi_request_fn+0xb9/0x4a0 > [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 > [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 1. Workqueue starting execution of q->delay_work and scsi_request_fn() is run from there. > [<ffffffff810aa9c7>] process_one_work+0x197/0x520 > [<ffffffff810acfec>] worker_thread+0x15c/0x330 > [<ffffffff810b1f16>] kthread+0xa6/0xb0 > [<ffffffff81687064>] kernel_thread_helper+0x4/0x10 So, q->delay_work ends up waiting for itself. I'd like to blame SCSI (as it also fits my agenda to kill execute_in_process_context ;-) for diving all the way into blk_cleanup_queue() directly from request_fn. Does the following patch fix the problem? Thanks. Subject: scsi: don't use execute_in_process_context() SCSI is the only subsystem which uses execute_in_process_context() and its use is racy against module unload. ie. the reap work is not properly flushed and could still be running after the scsi module is unloaded. Although execute_in_process_context() can be more efficient when the caller already has a context, in this case, the call paths are quite cold and the difference is practically meaningless. With commit c8efcc25 (workqueue: allow chained queueing during destruction), the race condition can easily be fixed by using a dedicated workqueue and destroying it on module unload. Create and use scsi_wq instead of execute_in_process_context(). * scsi_device->ew is replaced with release_work. scsi_target->ew is replaced with reap_work. * Both works are initialized with the respective release/reap function during device/target init. scsi_target_reap_usercontext() is moved upwards to avoid needing forward declaration. * scsi_alloc_target() now explicitly flushes the reap_work of the found dying target before putting it instead of depending on flush_scheduled_work(). For more info on the issues, please read the following thread. http://thread.gmane.org/gmane.linux.scsi/62923 Signed-off-by: Tejun Heo <tj@kernel.org> --- drivers/scsi/scsi.c | 15 +++++++++++++-- drivers/scsi/scsi_scan.c | 26 +++++++++++++------------- drivers/scsi/scsi_sysfs.c | 8 +++++--- include/scsi/scsi_device.h | 6 ++++-- 4 files changed, 35 insertions(+), 20 deletions(-) Index: work/drivers/scsi/scsi_scan.c =================================================================== --- work.orig/drivers/scsi/scsi_scan.c +++ work/drivers/scsi/scsi_scan.c @@ -362,6 +362,16 @@ int scsi_is_target_device(const struct d } EXPORT_SYMBOL(scsi_is_target_device); +static void scsi_target_reap_usercontext(struct work_struct *work) +{ + struct scsi_target *starget = + container_of(work, struct scsi_target, reap_work); + + transport_remove_device(&starget->dev); + device_del(&starget->dev); + scsi_target_destroy(starget); +} + static struct scsi_target *__scsi_find_target(struct device *parent, int channel, uint id) { @@ -427,6 +437,7 @@ static struct scsi_target *scsi_alloc_ta starget->state = STARGET_CREATED; starget->scsi_level = SCSI_2; starget->max_target_blocked = SCSI_DEFAULT_TARGET_BLOCKED; + INIT_WORK(&starget->reap_work, scsi_target_reap_usercontext); retry: spin_lock_irqsave(shost->host_lock, flags); @@ -462,21 +473,11 @@ static struct scsi_target *scsi_alloc_ta } /* Unfortunately, we found a dying target; need to * wait until it's dead before we can get a new one */ + flush_work(&found_target->reap_work); put_device(&found_target->dev); - flush_scheduled_work(); goto retry; } -static void scsi_target_reap_usercontext(struct work_struct *work) -{ - struct scsi_target *starget = - container_of(work, struct scsi_target, ew.work); - - transport_remove_device(&starget->dev); - device_del(&starget->dev); - scsi_target_destroy(starget); -} - /** * scsi_target_reap - check to see if target is in use and destroy if not * @starget: target to be checked @@ -507,8 +508,7 @@ void scsi_target_reap(struct scsi_target if (state == STARGET_CREATED) scsi_target_destroy(starget); else - execute_in_process_context(scsi_target_reap_usercontext, - &starget->ew); + queue_work(scsi_wq, &starget->reap_work); } /** Index: work/drivers/scsi/scsi_sysfs.c =================================================================== --- work.orig/drivers/scsi/scsi_sysfs.c +++ work/drivers/scsi/scsi_sysfs.c @@ -300,7 +300,7 @@ static void scsi_device_dev_release_user struct list_head *this, *tmp; unsigned long flags; - sdev = container_of(work, struct scsi_device, ew.work); + sdev = container_of(work, struct scsi_device, release_work); parent = sdev->sdev_gendev.parent; starget = to_scsi_target(parent); @@ -343,8 +343,8 @@ static void scsi_device_dev_release_user static void scsi_device_dev_release(struct device *dev) { struct scsi_device *sdp = to_scsi_device(dev); - execute_in_process_context(scsi_device_dev_release_usercontext, - &sdp->ew); + + queue_work(scsi_wq, &sdp->release_work); } static struct class sdev_class = { @@ -1069,6 +1069,8 @@ void scsi_sysfs_device_initialize(struct dev_set_name(&sdev->sdev_dev, "%d:%d:%d:%d", sdev->host->host_no, sdev->channel, sdev->id, sdev->lun); sdev->scsi_level = starget->scsi_level; + INIT_WORK(&sdev->release_work, scsi_device_dev_release_usercontext); + transport_setup_device(&sdev->sdev_gendev); spin_lock_irqsave(shost->host_lock, flags); list_add_tail(&sdev->same_target_siblings, &starget->devices); Index: work/include/scsi/scsi_device.h =================================================================== --- work.orig/include/scsi/scsi_device.h +++ work/include/scsi/scsi_device.h @@ -168,7 +168,7 @@ struct scsi_device { struct device sdev_gendev, sdev_dev; - struct execute_work ew; /* used to get process context on put */ + struct work_struct release_work; /* for process context on put */ struct scsi_dh_data *scsi_dh_data; enum scsi_device_state sdev_state; @@ -259,7 +259,7 @@ struct scsi_target { #define SCSI_DEFAULT_TARGET_BLOCKED 3 char scsi_level; - struct execute_work ew; + struct work_struct reap_work; enum scsi_target_state state; void *hostdata; /* available to low-level driver */ unsigned long starget_data[0]; /* for the transport */ @@ -277,6 +277,8 @@ static inline struct scsi_target *scsi_t #define starget_printk(prefix, starget, fmt, a...) \ dev_printk(prefix, &(starget)->dev, fmt, ##a) +extern struct workqueue_struct *scsi_wq; + extern struct scsi_device *__scsi_add_device(struct Scsi_Host *, uint, uint, uint, void *hostdata); extern int scsi_add_device(struct Scsi_Host *host, uint channel, Index: work/drivers/scsi/scsi.c =================================================================== --- work.orig/drivers/scsi/scsi.c +++ work/drivers/scsi/scsi.c @@ -70,6 +70,11 @@ #define CREATE_TRACE_POINTS #include <trace/events/scsi.h> +/* + * Utility multithreaded workqueue for SCSI. + */ +struct workqueue_struct *scsi_wq; + static void scsi_done(struct scsi_cmnd *cmd); /* @@ -1306,11 +1311,14 @@ MODULE_PARM_DESC(scsi_logging_level, "a static int __init init_scsi(void) { - int error; + int error = -ENOMEM; + scsi_wq = alloc_workqueue("scsi", 0, 0); + if (!scsi_wq) + return error; error = scsi_init_queue(); if (error) - return error; + goto cleanup_wq; error = scsi_init_procfs(); if (error) goto cleanup_queue; @@ -1342,6 +1350,8 @@ cleanup_procfs: scsi_exit_procfs(); cleanup_queue: scsi_exit_queue(); +cleanup_wq: + destroy_workqueue(scsi_wq); printk(KERN_ERR "SCSI subsystem failed to initialize, error = %d\n", -error); return error; @@ -1356,6 +1366,7 @@ static void __exit exit_scsi(void) scsi_exit_devinfo(); scsi_exit_procfs(); scsi_exit_queue(); + destroy_workqueue(scsi_wq); } subsys_initcall(init_scsi); ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-11 17:18 ` Tejun Heo @ 2011-04-11 17:29 ` Jens Axboe 2011-04-11 17:52 ` Steven Whitehouse 2011-04-12 0:47 ` James Bottomley 2 siblings, 0 replies; 39+ messages in thread From: Jens Axboe @ 2011-04-11 17:29 UTC (permalink / raw) To: Tejun Heo Cc: Steven Whitehouse, linux-kernel@vger.kernel.org, James Bottomley On 2011-04-11 19:18, Tejun Heo wrote: > Hello, > > (cc'ing James. The original message is http://lkml.org/lkml/2011/4/11/175 ) > > Please read from the bottom up. > > On Mon, Apr 11, 2011 at 03:56:03PM +0100, Steven Whitehouse wrote: >> [<ffffffff8167b8e5>] schedule_timeout+0x295/0x310 >> [<ffffffff8167a650>] wait_for_common+0x120/0x170 >> [<ffffffff8167a748>] wait_for_completion+0x18/0x20 >> [<ffffffff810aba4c>] wait_on_cpu_work+0xec/0x100 >> [<ffffffff810abb3b>] wait_on_work+0xdb/0x150 >> [<ffffffff810abc33>] __cancel_work_timer+0x83/0x130 >> [<ffffffff810abced>] cancel_delayed_work_sync+0xd/0x10 > > 4. which in turn tries to sync cancel q->delay_work. Oops, deadlock. > >> [<ffffffff813b24b4>] blk_sync_queue+0x24/0x50 > > 3. and calls into blk_sync_queue() > >> [<ffffffff813b24ef>] blk_cleanup_queue+0xf/0x60 >> [<ffffffff81479a89>] scsi_free_queue+0x9/0x10 >> [<ffffffff8147d30b>] scsi_device_dev_release_usercontext+0xeb/0x140 >> [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 > > 2. It triggers SCSI device release > >> [<ffffffff8147d1f7>] scsi_device_dev_release+0x17/0x20 >> [<ffffffff814609f2>] device_release+0x22/0x90 >> [<ffffffff813c8165>] kobject_release+0x45/0x90 >> [<ffffffff813c9767>] kref_put+0x37/0x70 >> [<ffffffff813c8027>] kobject_put+0x27/0x60 >> [<ffffffff81460822>] put_device+0x12/0x20 >> [<ffffffff81478bd9>] scsi_request_fn+0xb9/0x4a0 >> [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 >> [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 > > 1. Workqueue starting execution of q->delay_work and scsi_request_fn() > is run from there. > >> [<ffffffff810aa9c7>] process_one_work+0x197/0x520 >> [<ffffffff810acfec>] worker_thread+0x15c/0x330 >> [<ffffffff810b1f16>] kthread+0xa6/0xb0 >> [<ffffffff81687064>] kernel_thread_helper+0x4/0x10 > > So, q->delay_work ends up waiting for itself. I'd like to blame SCSI > (as it also fits my agenda to kill execute_in_process_context ;-) for > diving all the way into blk_cleanup_queue() directly from request_fn. > > Does the following patch fix the problem? Thanks, that looks a lot saner. This is/was a time bomb waiting to blow up. -- Jens Axboe ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-11 17:18 ` Tejun Heo 2011-04-11 17:29 ` Jens Axboe @ 2011-04-11 17:52 ` Steven Whitehouse 2011-04-12 0:14 ` Tejun Heo 2011-04-12 0:47 ` James Bottomley 2 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-11 17:52 UTC (permalink / raw) To: Tejun Heo; +Cc: linux-kernel, Jens Axboe, James Bottomley Hi, On Tue, 2011-04-12 at 02:18 +0900, Tejun Heo wrote: > Hello, > > (cc'ing James. The original message is http://lkml.org/lkml/2011/4/11/175 ) > > Please read from the bottom up. > > On Mon, Apr 11, 2011 at 03:56:03PM +0100, Steven Whitehouse wrote: > > [<ffffffff8167b8e5>] schedule_timeout+0x295/0x310 > > [<ffffffff8167a650>] wait_for_common+0x120/0x170 > > [<ffffffff8167a748>] wait_for_completion+0x18/0x20 > > [<ffffffff810aba4c>] wait_on_cpu_work+0xec/0x100 > > [<ffffffff810abb3b>] wait_on_work+0xdb/0x150 > > [<ffffffff810abc33>] __cancel_work_timer+0x83/0x130 > > [<ffffffff810abced>] cancel_delayed_work_sync+0xd/0x10 > > 4. which in turn tries to sync cancel q->delay_work. Oops, deadlock. > > > [<ffffffff813b24b4>] blk_sync_queue+0x24/0x50 > > 3. and calls into blk_sync_queue() > > > [<ffffffff813b24ef>] blk_cleanup_queue+0xf/0x60 > > [<ffffffff81479a89>] scsi_free_queue+0x9/0x10 > > [<ffffffff8147d30b>] scsi_device_dev_release_usercontext+0xeb/0x140 > > [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 > > 2. It triggers SCSI device release > > > [<ffffffff8147d1f7>] scsi_device_dev_release+0x17/0x20 > > [<ffffffff814609f2>] device_release+0x22/0x90 > > [<ffffffff813c8165>] kobject_release+0x45/0x90 > > [<ffffffff813c9767>] kref_put+0x37/0x70 > > [<ffffffff813c8027>] kobject_put+0x27/0x60 > > [<ffffffff81460822>] put_device+0x12/0x20 > > [<ffffffff81478bd9>] scsi_request_fn+0xb9/0x4a0 > > [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 > > [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 > > 1. Workqueue starting execution of q->delay_work and scsi_request_fn() > is run from there. > > > [<ffffffff810aa9c7>] process_one_work+0x197/0x520 > > [<ffffffff810acfec>] worker_thread+0x15c/0x330 > > [<ffffffff810b1f16>] kthread+0xa6/0xb0 > > [<ffffffff81687064>] kernel_thread_helper+0x4/0x10 > > So, q->delay_work ends up waiting for itself. I'd like to blame SCSI > (as it also fits my agenda to kill execute_in_process_context ;-) for > diving all the way into blk_cleanup_queue() directly from request_fn. > > Does the following patch fix the problem? > Unfortunately not: scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 ------------[ cut here ]------------ ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 12, comm: kworker/2:0 Not tainted 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a94b ]--- Steve. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-11 17:52 ` Steven Whitehouse @ 2011-04-12 0:14 ` Tejun Heo 2011-04-12 8:49 ` Steven Whitehouse 0 siblings, 1 reply; 39+ messages in thread From: Tejun Heo @ 2011-04-12 0:14 UTC (permalink / raw) To: Steven Whitehouse; +Cc: linux-kernel, Jens Axboe, James Bottomley Hello, On Mon, Apr 11, 2011 at 06:52:10PM +0100, Steven Whitehouse wrote: > WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() > Hardware name: PowerEdge R710 > Modules linked in: > Pid: 12, comm: kworker/2:0 Not tainted 2.6.39-rc2+ #188 > Call Trace: > [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 > [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 > [<ffffffff813c97cd>] kref_get+0x2d/0x30 > [<ffffffff813c81ca>] kobject_get+0x1a/0x30 > [<ffffffff814607f4>] get_device+0x14/0x20 > [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 > [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 > [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 > [<ffffffff810aa9c7>] process_one_work+0x197/0x520 > [<ffffffff810acfec>] worker_thread+0x15c/0x330 > [<ffffffff810b1f16>] kthread+0xa6/0xb0 > [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 > ---[ end trace 3681e9da2630a94b ]--- Hmm, it could be that the root cause of the problem is premature/double put of scsi_device. Without the patch, it makes scsi_request_fn() call into device destruction path prematurely triggering deadlock while after the patch, the deadlock is gone but the ref count reaches zero prematurely triggering kref warning on the next request. The problem doesn't seem widespread so something about the setup is peculiar. Steven, can you please detail the setup (and steps needed to trigger the problem) and attach the full boot log? James, any ideas? Thanks. -- tejun ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 0:14 ` Tejun Heo @ 2011-04-12 8:49 ` Steven Whitehouse 0 siblings, 0 replies; 39+ messages in thread From: Steven Whitehouse @ 2011-04-12 8:49 UTC (permalink / raw) To: Tejun Heo; +Cc: linux-kernel, Jens Axboe, James Bottomley [-- Attachment #1: Type: text/plain, Size: 2108 bytes --] Hi, On Tue, 2011-04-12 at 09:14 +0900, Tejun Heo wrote: > Hello, > > On Mon, Apr 11, 2011 at 06:52:10PM +0100, Steven Whitehouse wrote: > > WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() > > Hardware name: PowerEdge R710 > > Modules linked in: > > Pid: 12, comm: kworker/2:0 Not tainted 2.6.39-rc2+ #188 > > Call Trace: > > [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 > > [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 > > [<ffffffff813c97cd>] kref_get+0x2d/0x30 > > [<ffffffff813c81ca>] kobject_get+0x1a/0x30 > > [<ffffffff814607f4>] get_device+0x14/0x20 > > [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 > > [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 > > [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 > > [<ffffffff810aa9c7>] process_one_work+0x197/0x520 > > [<ffffffff810acfec>] worker_thread+0x15c/0x330 > > [<ffffffff810b1f16>] kthread+0xa6/0xb0 > > [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 > > ---[ end trace 3681e9da2630a94b ]--- > > Hmm, it could be that the root cause of the problem is > premature/double put of scsi_device. Without the patch, it makes > scsi_request_fn() call into device destruction path prematurely > triggering deadlock while after the patch, the deadlock is gone but > the ref count reaches zero prematurely triggering kref warning on the > next request. > > The problem doesn't seem widespread so something about the setup is > peculiar. Steven, can you please detail the setup (and steps needed > to trigger the problem) and attach the full boot log? James, any > ideas? > > Thanks. > The hardware is as follows: Dell R710 server with two 2GHz 4-core CPUs Two 146G SAS disks with hardware mirroring as root/OS disk Two 300G SAS disks with hardware mirroring as GFS2 test disk (note: not mounted during boot process) 12G RAM (boots with mem=4G since I was originally running tests with lower memory, but I don't think the memory size affects this at all) I've attached the boot log from testing your patch, yesterday. If you want the boot logs including James' patch or the original boot log, I can send those too, Steve. [-- Warning: decoded text below may be mangled, UTF-8 assumed --] [-- Attachment #2: tejun.txt --] [-- Type: text/plain; name="tejun.txt"; charset="UTF-8", Size: 164472 bytes --] Initializing cgroup subsys cpuset Initializing cgroup subsys cpu Linux version 2.6.39-rc2+ (root@chywoon) (gcc version 4.5.1 20100924 (Red Hat 4.5.1-4) (GCC) ) #188 SMP PREEMPT Mon Apr 11 18:13:35 BST 2011 Command line: ro root=/dev/mapper/VolGroup-lv_root rhgb console=ttyS0,115200n8 console=tty0 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us mem=4G BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 00000000000a0000 (usable) BIOS-e820: 0000000000100000 - 00000000cf669000 (usable) BIOS-e820: 00000000cf669000 - 00000000cf67f000 (reserved) BIOS-e820: 00000000cf67f000 - 00000000cf6be000 (ACPI data) BIOS-e820: 00000000cf6be000 - 00000000d0000000 (reserved) BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) BIOS-e820: 00000000fe000000 - 0000000100000000 (reserved) BIOS-e820: 0000000100000000 - 0000000330000000 (usable) NX (Execute Disable) protection: active user-defined physical RAM map: user: 0000000000000000 - 00000000000a0000 (usable) user: 0000000000100000 - 00000000cf669000 (usable) user: 00000000cf669000 - 00000000cf67f000 (reserved) user: 00000000cf67f000 - 00000000cf6be000 (ACPI data) user: 00000000cf6be000 - 00000000d0000000 (reserved) user: 00000000e0000000 - 00000000f0000000 (reserved) user: 00000000fe000000 - 0000000100000000 (reserved) DMI 2.6 present. No AGP bridge found last_pfn = 0xcf669 max_arch_pfn = 0x400000000 x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 found SMP MP-table at [ffff8800000fe710] fe710 init_memory_mapping: 0000000000000000-00000000cf669000 RAMDISK: 3768b000 - 37ff0000 ACPI: RSDP 00000000000f0a90 00024 (v02 DELL ) ACPI: XSDT 00000000000f0b94 0009C (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: FACP 00000000cf6a3f9c 000F4 (v03 DELL PE_SC3 00000001 DELL 00000001) ACPI: DSDT 00000000cf67f000 03D5A (v01 DELL PE_SC3 00000001 INTL 20050624) ACPI: FACS 00000000cf6a6000 00040 ACPI: APIC 00000000cf6a3478 0015E (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SPCR 00000000cf6a35d8 00050 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: HPET 00000000cf6a362c 00038 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: DMAR 00000000cf6a3668 001B0 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: MCFG 00000000cf6a38c4 0003C (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: WD__ 00000000cf6a3904 00134 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SLIC 00000000cf6a3a3c 00024 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: ERST 00000000cf682edc 00270 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: HEST 00000000cf68314c 003A8 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: BERT 00000000cf682d5c 00030 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: EINJ 00000000cf682d8c 00150 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SRAT 00000000cf6a3bc0 00370 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: TCPA 00000000cf6a3f34 00064 (v02 DELL PE_SC3 00000001 DELL 00000001) ACPI: SSDT 00000000cf6a7000 01DEC (v01 INTEL PPM RCM 80000001 INTL 20061109) SRAT: PXM 1 -> APIC 0x10 -> Node 0 SRAT: PXM 2 -> APIC 0x00 -> Node 1 SRAT: PXM 1 -> APIC 0x12 -> Node 0 SRAT: PXM 2 -> APIC 0x02 -> Node 1 SRAT: PXM 1 -> APIC 0x14 -> Node 0 SRAT: PXM 2 -> APIC 0x04 -> Node 1 SRAT: PXM 1 -> APIC 0x16 -> Node 0 SRAT: PXM 2 -> APIC 0x06 -> Node 1 SRAT: Node 1 PXM 2 0-d0000000 SRAT: Node 1 PXM 2 100000000-1b0000000 SRAT: Node 0 PXM 1 1b0000000-330000000 NUMA: Node 1 [0,cf669000) + [100000000,1b0000000) -> [0,cf669000) NUMA: nodes only cover 0MB of your 3317MB e820 RAM. Not used. No NUMA configuration found Faking a node at 0000000000000000-00000000cf669000 Initmem setup node 0 0000000000000000-00000000cf669000 NODE_DATA [00000000cf65e000 - 00000000cf662fff] Zone PFN ranges: DMA 0x00000010 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal empty Movable zone start PFN for each node early_node_map[2] active PFN ranges 0: 0x00000010 -> 0x000000a0 0: 0x00000100 -> 0x000cf669 ACPI: PM-Timer IO Port: 0x808 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32]) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Using ACPI (MADT) for SMP configuration information ACPI: HPET id: 0x8086a301 base: 0xfed00000 SMP: Allowing 8 CPUs, 0 hotplug CPUs Allocating PCI resources starting at d0000000 (gap: d0000000:10000000) Booting paravirtualized kernel on bare hardware setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 PERCPU: Embedded 475 pages/cpu @ffff8800cb000000 s1913872 r8192 d23536 u2097152 Built 1 zonelists in Node order, mobility grouping on. Total pages: 837782 Policy zone: DMA32 Kernel command line: ro root=/dev/mapper/VolGroup-lv_root rhgb console=ttyS0,115200n8 console=tty0 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us mem=4G PID hash table entries: 4096 (order: 3, 32768 bytes) Checking aperture... No AGP bridge found Memory: 3300120k/3398052k available (6695k kernel code, 448k absent, 97484k reserved, 6535k data, 2572k init) Preemptable hierarchical RCU implementation. RCU debugfs-based tracing is enabled. NR_IRQS:512 Extended CMOS year: 2000 Console: colour VGA+ 80x25 console [tty0] enabled console [ttyS0] enabled Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar ... MAX_LOCKDEP_SUBCLASSES: 8 ... MAX_LOCK_DEPTH: 48 ... MAX_LOCKDEP_KEYS: 8191 ... CLASSHASH_SIZE: 4096 ... MAX_LOCKDEP_ENTRIES: 16384 ... MAX_LOCKDEP_CHAINS: 32768 ... CHAINHASH_SIZE: 16384 memory used by lock dependency info: 6367 kB per task-struct memory footprint: 2688 bytes allocated 27262976 bytes of page_cgroup please try 'cgroup_disable=memory' option if you don't want memory cgroups Fast TSC calibration using PIT Detected 1994.782 MHz processor. Calibrating delay loop (skipped), value calculated using timer frequency.. 3989.56 BogoMIPS (lpj=1994782) pid_max: default: 32768 minimum: 301 Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) Mount-cache hash table entries: 256 Initializing cgroup subsys ns ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup. Initializing cgroup subsys cpuacct Initializing cgroup subsys memory Initializing cgroup subsys freezer Initializing cgroup subsys net_cls Initializing cgroup subsys perf_event CPU: Physical Processor ID: 1 CPU: Processor Core ID: 0 mce: CPU supports 9 MCE banks CPU0: Thermal monitoring enabled (TM1) using mwait in idle threads. Freeing SMP alternatives: 24k freed ACPI: Core revision 20110316 Setting APIC routing to flat ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 CPU0: Intel(R) Xeon(R) CPU E5504 @ 2.00GHz stepping 05 Performance Events: PEBS fmt1+, Nehalem events, Intel PMU driver. ... version: 3 ... bit width: 48 ... generic registers: 4 ... value mask: 0000ffffffffffff ... max period: 000000007fffffff ... fixed-purpose events: 3 ... event mask: 000000070000000f lockdep: fixing up alternatives. Booting Node 0, Processors #1 lockdep: fixing up alternatives. #2 lockdep: fixing up alternatives. #3 lockdep: fixing up alternatives. #4 lockdep: fixing up alternatives. #5 lockdep: fixing up alternatives. #6 lockdep: fixing up alternatives. #7 Ok. Brought up 8 CPUs Total of 8 processors activated (31915.21 BogoMIPS). kworker/u:0 used greatest stack depth: 4808 bytes left print_constraints: dummy: NET: Registered protocol family 16 ACPI FADT declares the system doesn't support PCIe ASPM, so disable it ACPI: bus type pci registered dca service started, version 1.12.1 PCI: Using configuration type 1 for base access bio: create slab <bio-0> at 0 [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored ACPI: Interpreter enabled ACPI: (supports S0 S5) ACPI: Using IOAPIC for interrupt routing PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) pci_root PNP0A08:00: host bridge window [io 0x0000-0x0cf7] pci_root PNP0A08:00: host bridge window [io 0x0d00-0xffff] pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff] pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xfdffffff] pci_root PNP0A08:00: host bridge window [mem 0xfed40000-0xfed44fff] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f) pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f) pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f) pci 0000:00:01.0: PCI bridge to [bus 01-01] pci 0000:00:03.0: PCI bridge to [bus 02-02] pci 0000:00:04.0: PCI bridge to [bus 03-03] pci 0000:00:05.0: PCI bridge to [bus 04-04] pci 0000:00:06.0: PCI bridge to [bus 05-05] pci 0000:00:07.0: PCI bridge to [bus 06-06] pci 0000:00:09.0: PCI bridge to [bus 07-07] pci 0000:00:1e.0: PCI bridge to [bus 08-08] (subtractive decode) ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15) ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15) ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15) ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15) ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15) vgaarb: device added: PCI:0000:08:03.0,decodes=io+mem,owns=io+mem,locks=none vgaarb: loaded SCSI subsystem initialized usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb PCI: Using ACPI for IRQ routing HPET: 4 timers in total, 0 timers will be used for per-cpu timer Switching to clocksource hpet Switched to NOHz mode on CPU #0 Switched to NOHz mode on CPU #2 Switched to NOHz mode on CPU #6 Switched to NOHz mode on CPU #4 Switched to NOHz mode on CPU #3 Switched to NOHz mode on CPU #7 Switched to NOHz mode on CPU #1 Switched to NOHz mode on CPU #5 pnp: PnP ACPI init ACPI: bus type pnp registered system 00:07: [io 0x0800-0x087f] has been reserved system 00:07: [io 0x0880-0x08ff] has been reserved system 00:07: [io 0x0900-0x091f] has been reserved system 00:07: [io 0x0920-0x0923] has been reserved system 00:07: [io 0x0924] has been reserved system 00:07: [io 0x0c00-0x0c7f] has been reserved system 00:07: [io 0x0ca0-0x0ca7] has been reserved system 00:07: [io 0x0ca9-0x0cab] has been reserved system 00:07: [io 0x0cad-0x0caf] has been reserved system 00:08: [io 0x0ca8] has been reserved system 00:08: [io 0x0cac] has been reserved system 00:09: [mem 0xe0000000-0xefffffff] has been reserved system 00:0b: [mem 0xfed90000-0xfed91fff] has been reserved pnp: PnP ACPI: found 12 devices ACPI: ACPI bus type pnp unregistered pci 0000:00:01.0: PCI bridge to [bus 01-01] pci 0000:00:01.0: bridge window [io disabled] pci 0000:00:01.0: bridge window [mem 0xd6000000-0xd9ffffff] pci 0000:00:01.0: bridge window [mem pref disabled] pci 0000:00:03.0: PCI bridge to [bus 02-02] pci 0000:00:03.0: bridge window [io disabled] pci 0000:00:03.0: bridge window [mem 0xda000000-0xddffffff] pci 0000:00:03.0: bridge window [mem pref disabled] pci 0000:00:04.0: PCI bridge to [bus 03-03] pci 0000:00:04.0: bridge window [io 0xf000-0xffff] pci 0000:00:04.0: bridge window [mem 0xdf100000-0xdf1fffff] pci 0000:00:04.0: bridge window [mem pref disabled] pci 0000:00:05.0: PCI bridge to [bus 04-04] pci 0000:00:05.0: bridge window [io disabled] pci 0000:00:05.0: bridge window [mem disabled] pci 0000:00:05.0: bridge window [mem pref disabled] pci 0000:00:06.0: PCI bridge to [bus 05-05] pci 0000:00:06.0: bridge window [io disabled] pci 0000:00:06.0: bridge window [mem disabled] pci 0000:00:06.0: bridge window [mem pref disabled] pci 0000:00:07.0: PCI bridge to [bus 06-06] pci 0000:00:07.0: bridge window [io disabled] pci 0000:00:07.0: bridge window [mem disabled] pci 0000:00:07.0: bridge window [mem pref disabled] pci 0000:00:09.0: PCI bridge to [bus 07-07] pci 0000:00:09.0: bridge window [io disabled] pci 0000:00:09.0: bridge window [mem disabled] pci 0000:00:09.0: bridge window [mem pref disabled] pci 0000:08:03.0: BAR 6: assigned [mem 0xde000000-0xde00ffff pref] pci 0000:00:1e.0: PCI bridge to [bus 08-08] pci 0000:00:1e.0: bridge window [io disabled] pci 0000:00:1e.0: bridge window [mem 0xde000000-0xdeffffff] pci 0000:00:1e.0: bridge window [mem 0xd5800000-0xd5ffffff 64bit pref] pci 0000:00:01.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:03.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:04.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:05.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:06.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:07.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:09.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 NET: Registered protocol family 2 IP route cache hash table entries: 131072 (order: 8, 1048576 bytes) TCP established hash table entries: 524288 (order: 11, 8388608 bytes) TCP bind hash table entries: 65536 (order: 10, 5242880 bytes) TCP: Hash tables configured (established 524288 bind 65536) TCP reno registered UDP hash table entries: 2048 (order: 6, 393216 bytes) UDP-Lite hash table entries: 2048 (order: 6, 393216 bytes) NET: Registered protocol family 1 RPC: Registered udp transport module. RPC: Registered tcp transport module. RPC: Registered tcp NFSv4.1 backchannel transport module. Trying to unpack rootfs image as initramfs... Freeing initrd memory: 9620k freed Intel AES-NI instructions are not detected. audit: initializing netlink socket (disabled) type=2000 audit(1302542567.544:1): initialized HugeTLB registered 2 MB page size, pre-allocated 0 pages VFS: Disk quotas dquot_6.5.2 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) OCFS2 1.5.0 ocfs2: Registered cluster interface o2cb OCFS2 DLMFS 1.5.0 OCFS2 User DLM kernel interface loaded OCFS2 Node Manager 1.5.0 OCFS2 DLM 1.5.0 msgmni has been set to 6464 Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254) io scheduler noop registered io scheduler deadline registered io scheduler cfq registered (default) input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 ACPI: Power Button [PWRF] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled ÿserial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Real Time Clock Driver v1.12b Linux agpgart interface v0.103 brd: module loaded megasas: 00.00.05.34-rc1 Thu. Feb. 24 17:00:00 PDT 2011 megasas: 0x1000:0x0060:0x1028:0x1f0c: bus 3:slot 0:func 0 megaraid_sas 0000:03:00.0: PCI INT A -> GSI 33 (level, low) -> IRQ 33 megasas: FW now in Ready state megasas_init_mfi: fw_support_ieee=0 megasas: INIT adapter done scsi0 : LSI SAS based MegaRAID driver scsi 0:0:0:0: Direct-Access SEAGATE ST3146356SS HS0A PQ: 0 ANSI: 5 scsi 0:0:1:0: Direct-Access SEAGATE ST3146356SS HS0A PQ: 0 ANSI: 5 scsi 0:0:2:0: Direct-Access SEAGATE ST3300656SS HS0A PQ: 0 ANSI: 5 scsi 0:0:3:0: Direct-Access SEAGATE ST3300656SS HS0A PQ: 0 ANSI: 5 Refined TSC clocksource calibration: 1994.999 MHz. Switching to clocksource tsc scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 ------------[ cut here ]------------ ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 12, comm: kworker/2:0 Not tainted 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a94b ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 700, comm: kworker/1:3 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a94c ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 701, comm: kworker/1:4 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a94d ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 702, comm: kworker/1:5 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a94e ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a94f ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a950 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a951 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a952 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a953 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a954 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a955 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a956 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a957 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a958 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a959 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a95a ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a95b ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a95c ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a95d ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a95e ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a95f ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a960 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a961 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a962 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a963 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a964 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a965 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a966 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a967 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a968 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a969 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a96a ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a96b ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a96c ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a96d ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a96e ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a96f ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a970 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a971 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a972 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a973 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a974 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a975 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a976 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a977 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a978 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a979 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a97a ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a97b ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a97c ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a97d ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a97e ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a97f ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a980 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a981 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 703, comm: kworker/1:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a982 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 702, comm: kworker/1:5 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a983 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 699, comm: kworker/1:2 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a984 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 701, comm: kworker/1:4 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a985 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 700, comm: kworker/1:3 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a986 ]--- WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 387, comm: kworker/7:1 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a987 ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c88b3010->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 387, comm: kworker/7:1 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7703>] __list_del_entry+0x63/0xd0 [<ffffffff813d7781>] list_del+0x11/0x40 [<ffffffff8147d36d>] scsi_device_dev_release_usercontext+0x4d/0x140 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff8147d320>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a988 ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c88b3020->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 387, comm: kworker/7:1 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7703>] __list_del_entry+0x63/0xd0 [<ffffffff813d7781>] list_del+0x11/0x40 [<ffffffff8147d377>] scsi_device_dev_release_usercontext+0x57/0x140 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff8147d320>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a989 ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c88b3090->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 387, comm: kworker/7:1 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7703>] __list_del_entry+0x63/0xd0 [<ffffffff813d7781>] list_del+0x11/0x40 [<ffffffff8147d384>] scsi_device_dev_release_usercontext+0x64/0x140 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff8147d320>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a98a ]--- ------------[ cut here ]------------ ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 4, comm: kworker/0:0 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a98b ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 707, comm: kworker/0:2 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a98c ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 710, comm: kworker/0:5 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a98d ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a98e ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a98f ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a990 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a991 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a992 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a993 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a994 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a995 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a996 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a997 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a998 ]--- sd 0:2:0:0: [sda] 285474816 512-byte logical blocks: (146 GB/136 GiB) ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a999 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a99a ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a99b ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a99c ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a99d ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a99e ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a99f ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a0 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a1 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a2 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a3 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a4 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a5 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a6 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a7 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a8 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9a9 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9aa ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9ab ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 711, comm: kworker/0:6 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9ac ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 710, comm: kworker/0:5 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9ad ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 708, comm: kworker/0:3 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9ae ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 709, comm: kworker/0:4 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9af ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 4, comm: kworker/0:0 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9b0 ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 707, comm: kworker/0:2 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9b1 ]--- WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 15, comm: kworker/3:0 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c97cd>] kref_get+0x2d/0x30 [<ffffffff813c81ca>] kobject_get+0x1a/0x30 [<ffffffff814607f4>] get_device+0x14/0x20 [<ffffffff81478b57>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b1f40>] ? blk_make_request+0x90/0x90 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9b2 ]--- TARGET_CORE[0]: Loading Generic Kernel Storage Engine: v4.0.0-rc7-ml on Linux/x86_64 on 2.6.39-rc2+ sd 0:2:1:0: [sdb] 584843264 512-byte logical blocks: (299 GB/278 GiB) ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800379e9010->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 15, comm: kworker/3:0 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7703>] __list_del_entry+0x63/0xd0 [<ffffffff813d7781>] list_del+0x11/0x40 [<ffffffff8147d36d>] scsi_device_dev_release_usercontext+0x4d/0x140 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff8147d320>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9b3 ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800379e9020->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 15, comm: kworker/3:0 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7703>] __list_del_entry+0x63/0xd0 [<ffffffff813d7781>] list_del+0x11/0x40 [<ffffffff8147d377>] scsi_device_dev_release_usercontext+0x57/0x140 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff8147d320>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9b4 ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800379e9090->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 15, comm: kworker/3:0 Tainted: G W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7703>] __list_del_entry+0x63/0xd0 [<ffffffff813d7781>] list_del+0x11/0x40 [<ffffffff8147d384>] scsi_device_dev_release_usercontext+0x64/0x140 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff8147d320>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace 3681e9da2630a9b5 ]--- sd 0:2:0:0: [sda] Write Protect is off sd 0:2:1:0: [sdb] Write Protect is off sd 0:2:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA TARGET_CORE[0]: Initialized ConfigFS Fabric Infrastructure: v4.0.0-rc7-ml on Linux/x86_64 on 2.6.39-rc2+ sdb: unknown partition table TCM: Registered subsystem plugin: rd_dr struct module: (null) TCM: Registered subsystem plugin: rd_mcp struct module: (null) sda: sda1 sda2 sda3 sda4 < sda5 > sd 0:2:1:0: [sdb] Attached SCSI disk CORE_HBA[0] - TCM Ramdisk HBA Driver v4.0 on Generic Target Core Stack v4.0.0-rc7-ml CORE_HBA[0] - Attached Ramdisk HBA: 0 to Generic Target Core TCQ Depth: 256 MaxSectors: 1024 sd 0:2:0:0: [sda] Attached SCSI disk CORE_HBA[0] - Attached HBA to Generic Target Core RAMDISK: Referencing Page Count: 8 CORE_RD[0] - Built Ramdisk Device ID: 0 space of 8 pages in 1 tables rd_dr: Using SPC_PASSTHROUGH, no reservation emulation rd_dr: Using SPC_ALUA_PASSTHROUGH, no ALUA emulation Vendor: LIO-ORG Model: RAMDISK-DR Revision: 4.0 Type: Direct-Access ANSI SCSI revision: 05 CORE_RD[0] - Added TCM DIRECT Ramdisk Device ID: 0 of 8 pages in 1 tables, 32768 total bytes TCM: Registered subsystem plugin: iblock struct module: (null) TCM: Registered subsystem plugin: fileio struct module: (null) TCM: Registered subsystem plugin: pscsi struct module: (null) e1000e: Intel(R) PRO/1000 Network Driver - 1.3.10-k2 e1000e: Copyright(c) 1999 - 2011 Intel Corporation. i8042: PNP: No PS/2 controller found. Probing ports directly. serio: i8042 KBD port at 0x60,0x64 irq 1 serio: i8042 AUX port at 0x60,0x64 irq 12 mousedev: PS/2 mouse device common for all mice device-mapper: uevent: version 1.0.3 ------------[ cut here ]------------ kernel BUG at mm/slab.c:3058! invalid opcode: 0000 [#1] PREEMPT SMP last sysfs file: CPU 0 Modules linked in: Pid: 1, comm: swapper Tainted: G W 2.6.39-rc2+ #188 Dell Inc. PowerEdge R710/0N047H RIP: 0010:[<ffffffff8116f9e4>] [<ffffffff8116f9e4>] cache_alloc_refill+0x274/0x290 RSP: 0018:ffff8800c90a1b70 EFLAGS: 00010046 RAX: dead000000200200 RBX: ffff8800cf000200 RCX: 0000000000000070 RDX: ffff8800c56ea000 RSI: ffff8800cf002080 RDI: ffff8800c88b8000 RBP: ffff8800c90a1bd0 R08: ffff8800c56ea000 R09: 0000000000000000 R10: 0000000000000032 R11: 000000000000003c R12: ffff8800cf01b000 R13: ffff8800cf002080 R14: ffff8800c88b8000 R15: 0000000000000002 FS: 0000000000000000(0000) GS:ffff8800cb000000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 0000000000000000 CR3: 0000000001c33000 CR4: 00000000000006f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process swapper (pid: 1, threadinfo ffff8800c90a0000, task ffff8800c909e040) Stack: 0000000000000010 ffff8800cf0020c0 000412d0c90a1ba0 ffff8800cf0020a0 ffff8800cf002090 0000000200000286 ffff8800c90a1bd0 ffff8800cf000200 000000000000000a 0000000000000000 00000000000000d0 00000000000000d0 Call Trace: [<ffffffff81170579>] __kmalloc_track_caller+0x239/0x280 [<ffffffff811f491c>] ? sysfs_new_dirent+0x10c/0x120 [<ffffffff81140290>] kstrdup+0x40/0x70 [<ffffffff811f491c>] sysfs_new_dirent+0x10c/0x120 [<ffffffff81682739>] ? sub_preempt_count+0xa9/0xe0 [<ffffffff811f5683>] sysfs_do_create_link+0x93/0x220 [<ffffffff813d0560>] ? sprintf+0x40/0x50 [<ffffffff811f581e>] sysfs_create_link+0xe/0x10 [<ffffffff81461a07>] device_add+0x227/0x600 [<ffffffff813d6f08>] ? __raw_spin_lock_init+0x38/0x70 [<ffffffff81461df9>] device_register+0x19/0x20 [<ffffffff81461eeb>] device_create_vargs+0xeb/0x110 [<ffffffff81456c54>] ? misc_register+0x24/0x130 [<ffffffff81ef3e42>] ? md_init+0x14d/0x14d [<ffffffff81461f3c>] device_create+0x2c/0x30 [<ffffffff81ef3e42>] ? md_init+0x14d/0x14d [<ffffffff81456cba>] misc_register+0x8a/0x130 [<ffffffff81ef4093>] dm_interface_init+0x65/0xb1 [<ffffffff81ef3e5a>] dm_init+0x18/0x46 [<ffffffff810002bf>] do_one_initcall+0x3f/0x1a0 [<ffffffff81ec1e28>] kernel_init+0xde/0x163 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff81ec1d4a>] ? start_kernel+0x4ca/0x4ca [<ffffffff816870e0>] ? gs_change+0x13/0x13 Code: 48 89 df e8 9f fa ff ff 41 89 c5 e8 d7 7b 26 00 45 85 ed 89 c0 4c 8b 24 c3 74 12 41 83 3c 24 00 0f 84 af fd ff ff e9 5b ff ff ff <0f> 0b 31 c0 41 83 3c 24 00 0f 85 4c ff ff ff e9 61 ff ff ff 0f RIP [<ffffffff8116f9e4>] cache_alloc_refill+0x274/0x290 RSP <ffff8800c90a1b70> ---[ end trace 3681e9da2630a9b6 ]--- note: swapper[1] exited with preempt_count 1 swapper used greatest stack depth: 3768 bytes left Kernel panic - not syncing: Attempted to kill init! Pid: 1, comm: swapper Tainted: G D W 2.6.39-rc2+ #188 Call Trace: [<ffffffff8167a336>] panic+0x96/0x1ab [<ffffffff81093d3b>] do_exit+0x83b/0x900 [<ffffffff816800b7>] oops_end+0x97/0xd0 [<ffffffff81040766>] die+0x56/0x90 [<ffffffff8167f754>] do_trap+0xc4/0x170 [<ffffffff8103dc56>] do_invalid_op+0xa6/0xc0 [<ffffffff8116f9e4>] ? cache_alloc_refill+0x274/0x290 [<ffffffff813d1d4d>] ? trace_hardirqs_off_thunk+0x3a/0x3c [<ffffffff8167f048>] ? restore_args+0x30/0x30 [<ffffffff81686f5b>] invalid_op+0x1b/0x20 [<ffffffff8116f9e4>] ? cache_alloc_refill+0x274/0x290 [<ffffffff81170579>] __kmalloc_track_caller+0x239/0x280 [<ffffffff811f491c>] ? sysfs_new_dirent+0x10c/0x120 [<ffffffff81140290>] kstrdup+0x40/0x70 [<ffffffff811f491c>] sysfs_new_dirent+0x10c/0x120 [<ffffffff81682739>] ? sub_preempt_count+0xa9/0xe0 [<ffffffff811f5683>] sysfs_do_create_link+0x93/0x220 [<ffffffff813d0560>] ? sprintf+0x40/0x50 [<ffffffff811f581e>] sysfs_create_link+0xe/0x10 [<ffffffff81461a07>] device_add+0x227/0x600 [<ffffffff813d6f08>] ? __raw_spin_lock_init+0x38/0x70 [<ffffffff81461df9>] device_register+0x19/0x20 [<ffffffff81461eeb>] device_create_vargs+0xeb/0x110 [<ffffffff81456c54>] ? misc_register+0x24/0x130 [<ffffffff81ef3e42>] ? md_init+0x14d/0x14d [<ffffffff81461f3c>] device_create+0x2c/0x30 [<ffffffff81ef3e42>] ? md_init+0x14d/0x14d [<ffffffff81456cba>] misc_register+0x8a/0x130 [<ffffffff81ef4093>] dm_interface_init+0x65/0xb1 [<ffffffff81ef3e5a>] dm_init+0x18/0x46 [<ffffffff810002bf>] do_one_initcall+0x3f/0x1a0 [<ffffffff81ec1e28>] kernel_init+0xde/0x163 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff81ec1d4a>] ? start_kernel+0x4ca/0x4ca [<ffffffff816870e0>] ? gs_change+0x13/0x13 ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-11 17:18 ` Tejun Heo 2011-04-11 17:29 ` Jens Axboe 2011-04-11 17:52 ` Steven Whitehouse @ 2011-04-12 0:47 ` James Bottomley 2011-04-12 2:51 ` Tejun Heo 2 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 0:47 UTC (permalink / raw) To: Tejun Heo; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 02:18 +0900, Tejun Heo wrote: > Hello, > > (cc'ing James. The original message is http://lkml.org/lkml/2011/4/11/175 ) > > Please read from the bottom up. > > On Mon, Apr 11, 2011 at 03:56:03PM +0100, Steven Whitehouse wrote: > > [<ffffffff8167b8e5>] schedule_timeout+0x295/0x310 > > [<ffffffff8167a650>] wait_for_common+0x120/0x170 > > [<ffffffff8167a748>] wait_for_completion+0x18/0x20 > > [<ffffffff810aba4c>] wait_on_cpu_work+0xec/0x100 > > [<ffffffff810abb3b>] wait_on_work+0xdb/0x150 > > [<ffffffff810abc33>] __cancel_work_timer+0x83/0x130 > > [<ffffffff810abced>] cancel_delayed_work_sync+0xd/0x10 > > 4. which in turn tries to sync cancel q->delay_work. Oops, deadlock. > > > [<ffffffff813b24b4>] blk_sync_queue+0x24/0x50 > > 3. and calls into blk_sync_queue() > > > [<ffffffff813b24ef>] blk_cleanup_queue+0xf/0x60 > > [<ffffffff81479a89>] scsi_free_queue+0x9/0x10 > > [<ffffffff8147d30b>] scsi_device_dev_release_usercontext+0xeb/0x140 > > [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 > > 2. It triggers SCSI device release > > > [<ffffffff8147d1f7>] scsi_device_dev_release+0x17/0x20 > > [<ffffffff814609f2>] device_release+0x22/0x90 > > [<ffffffff813c8165>] kobject_release+0x45/0x90 > > [<ffffffff813c9767>] kref_put+0x37/0x70 > > [<ffffffff813c8027>] kobject_put+0x27/0x60 > > [<ffffffff81460822>] put_device+0x12/0x20 > > [<ffffffff81478bd9>] scsi_request_fn+0xb9/0x4a0 > > [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 > > [<ffffffff813b1f66>] blk_delay_work+0x26/0x40 > > 1. Workqueue starting execution of q->delay_work and scsi_request_fn() > is run from there. > > > [<ffffffff810aa9c7>] process_one_work+0x197/0x520 > > [<ffffffff810acfec>] worker_thread+0x15c/0x330 > > [<ffffffff810b1f16>] kthread+0xa6/0xb0 > > [<ffffffff81687064>] kernel_thread_helper+0x4/0x10 > > So, q->delay_work ends up waiting for itself. I'd like to blame SCSI > (as it also fits my agenda to kill execute_in_process_context ;-) for > diving all the way into blk_cleanup_queue() directly from request_fn. Actually, I don't think it's anything to do with the user process stuff. The problem seems to be that the block delay function ends up being the last user of the SCSI device, so it does the final put of the sdev when it's finished processing. This will trigger queue destruction (blk_cleanup_queue) and so on with your analysis. The problem seems to be that with the new workqueue changes, the queue itself may no longer be the last holder of a reference on the sdev because the queue destruction is in the sdev release function and a queue cannot now be destroyed from its own delayed work. This is a bit contrary to the principles SCSI was using, which was that we drive queue lifetime from the sdev, not vice versa. The obvious fix seems to be to move queue destruction earlier, but I'm loth to do that because it will get us back into the old situation where we no longer have a queue to do the teardown work. How about moving the blk_sync_queue() call out of blk_cleanup_queue()? Since that's the direct cause of this. James ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 0:47 ` James Bottomley @ 2011-04-12 2:51 ` Tejun Heo 2011-04-12 4:49 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Tejun Heo @ 2011-04-12 2:51 UTC (permalink / raw) To: James Bottomley; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe Hello, James. On Mon, Apr 11, 2011 at 07:47:56PM -0500, James Bottomley wrote: > Actually, I don't think it's anything to do with the user process stuff. > The problem seems to be that the block delay function ends up being the > last user of the SCSI device, so it does the final put of the sdev when > it's finished processing. This will trigger queue destruction > (blk_cleanup_queue) and so on with your analysis. Hmm... this I can understand. > The problem seems to be that with the new workqueue changes, the queue > itself may no longer be the last holder of a reference on the sdev > because the queue destruction is in the sdev release function and a > queue cannot now be destroyed from its own delayed work. This is a bit > contrary to the principles SCSI was using, which was that we drive queue > lifetime from the sdev, not vice versa. But confused here. Why does it make any difference whether the release operation is in the request_fn context or not? What makes SCSI refcounting different from others? Thanks. -- tejun ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 2:51 ` Tejun Heo @ 2011-04-12 4:49 ` James Bottomley 2011-04-12 5:02 ` James Bottomley 2011-04-12 5:15 ` Tejun Heo 0 siblings, 2 replies; 39+ messages in thread From: James Bottomley @ 2011-04-12 4:49 UTC (permalink / raw) To: Tejun Heo; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 11:51 +0900, Tejun Heo wrote: > Hello, James. > > On Mon, Apr 11, 2011 at 07:47:56PM -0500, James Bottomley wrote: > > Actually, I don't think it's anything to do with the user process stuff. > > The problem seems to be that the block delay function ends up being the > > last user of the SCSI device, so it does the final put of the sdev when > > it's finished processing. This will trigger queue destruction > > (blk_cleanup_queue) and so on with your analysis. > > Hmm... this I can understand. > > > The problem seems to be that with the new workqueue changes, the queue > > itself may no longer be the last holder of a reference on the sdev > > because the queue destruction is in the sdev release function and a > > queue cannot now be destroyed from its own delayed work. This is a bit > > contrary to the principles SCSI was using, which was that we drive queue > > lifetime from the sdev, not vice versa. > > But confused here. Why does it make any difference whether the > release operation is in the request_fn context or not? What makes > SCSI refcounting different from others? I didn't say it did. SCSI refcounting is fairly standard. The problem isn't really anything to do with SCSI ... it's the way block queue destruction must now be called. The block queue destruction includes a synchronous flush of the work queue. That means it can't be called from the executing workqueue without deadlocking. The last put of a SCSI device destroys the queue. This now means that the last put of the SCSI device can't be in the block delay work path. However, as the device shuts down that can very well wind up happening if blk_delay_queue() ends up being called as the device is dying. The entangled deadlock seems to have been introduced by commit 3cca6dc1c81e2407928dc4c6105252146fd3924f prior to that, there was no synchronous cancel in the destroy path. A fix might be to shunt more stuff off to workqueues, but that's producing a more complex system which would be prone to entanglements that would be even harder to spot. Perhaps a better solution is just not to use sync cancellations in block? As long as the work in the queue holds a queue ref, they can be done asynchronously. James ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 4:49 ` James Bottomley @ 2011-04-12 5:02 ` James Bottomley 2011-04-12 8:42 ` Steven Whitehouse 2011-04-12 5:15 ` Tejun Heo 1 sibling, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 5:02 UTC (permalink / raw) To: Tejun Heo; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe On Mon, 2011-04-11 at 23:49 -0500, James Bottomley wrote: > The entangled deadlock seems to have been introduced by commit > 3cca6dc1c81e2407928dc4c6105252146fd3924f prior to that, there was no > synchronous cancel in the destroy path. > > A fix might be to shunt more stuff off to workqueues, but that's > producing a more complex system which would be prone to entanglements > that would be even harder to spot. > > Perhaps a better solution is just not to use sync cancellations in > block? As long as the work in the queue holds a queue ref, they can be > done asynchronously. So this is a possible implementation, does this fix the problem? (compile tested only). James --- diff --git a/block/blk-core.c b/block/blk-core.c index 90f22cc..f600f88 100644 --- a/block/blk-core.c +++ b/block/blk-core.c @@ -219,6 +219,7 @@ static void blk_delay_work(struct work_struct *work) spin_lock_irq(q->queue_lock); __blk_run_queue(q, false); spin_unlock_irq(q->queue_lock); + blk_put_queue(q); } /** @@ -233,7 +234,8 @@ static void blk_delay_work(struct work_struct *work) */ void blk_delay_queue(struct request_queue *q, unsigned long msecs) { - schedule_delayed_work(&q->delay_work, msecs_to_jiffies(msecs)); + if (!blk_get_queue(q)) + schedule_delayed_work(&q->delay_work, msecs_to_jiffies(msecs)); } EXPORT_SYMBOL(blk_delay_queue); @@ -271,7 +273,8 @@ EXPORT_SYMBOL(blk_start_queue); **/ void blk_stop_queue(struct request_queue *q) { - __cancel_delayed_work(&q->delay_work); + if (__cancel_delayed_work(&q->delay_work)) + blk_put_queue(q); queue_flag_set(QUEUE_FLAG_STOPPED, q); } EXPORT_SYMBOL(blk_stop_queue); @@ -297,7 +300,8 @@ EXPORT_SYMBOL(blk_stop_queue); void blk_sync_queue(struct request_queue *q) { del_timer_sync(&q->timeout); - cancel_delayed_work_sync(&q->delay_work); + if (__cancel_delayed_work(&q->delay_work)) + blk_put_queue(q); queue_sync_plugs(q); } EXPORT_SYMBOL(blk_sync_queue); ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 5:02 ` James Bottomley @ 2011-04-12 8:42 ` Steven Whitehouse 2011-04-12 13:42 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-12 8:42 UTC (permalink / raw) To: James Bottomley; +Cc: Tejun Heo, linux-kernel, Jens Axboe Hi, On Tue, 2011-04-12 at 00:02 -0500, James Bottomley wrote: > On Mon, 2011-04-11 at 23:49 -0500, James Bottomley wrote: > > The entangled deadlock seems to have been introduced by commit > > 3cca6dc1c81e2407928dc4c6105252146fd3924f prior to that, there was no > > synchronous cancel in the destroy path. > > > > A fix might be to shunt more stuff off to workqueues, but that's > > producing a more complex system which would be prone to entanglements > > that would be even harder to spot. > > > > Perhaps a better solution is just not to use sync cancellations in > > block? As long as the work in the queue holds a queue ref, they can be > > done asynchronously. > > So this is a possible implementation, does this fix the problem? > (compile tested only). > > James > > --- > > diff --git a/block/blk-core.c b/block/blk-core.c > index 90f22cc..f600f88 100644 > --- a/block/blk-core.c > +++ b/block/blk-core.c > @@ -219,6 +219,7 @@ static void blk_delay_work(struct work_struct *work) > spin_lock_irq(q->queue_lock); > __blk_run_queue(q, false); > spin_unlock_irq(q->queue_lock); > + blk_put_queue(q); > } > > /** > @@ -233,7 +234,8 @@ static void blk_delay_work(struct work_struct *work) > */ > void blk_delay_queue(struct request_queue *q, unsigned long msecs) > { > - schedule_delayed_work(&q->delay_work, msecs_to_jiffies(msecs)); > + if (!blk_get_queue(q)) > + schedule_delayed_work(&q->delay_work, msecs_to_jiffies(msecs)); > } > EXPORT_SYMBOL(blk_delay_queue); > > @@ -271,7 +273,8 @@ EXPORT_SYMBOL(blk_start_queue); > **/ > void blk_stop_queue(struct request_queue *q) > { > - __cancel_delayed_work(&q->delay_work); > + if (__cancel_delayed_work(&q->delay_work)) > + blk_put_queue(q); > queue_flag_set(QUEUE_FLAG_STOPPED, q); > } > EXPORT_SYMBOL(blk_stop_queue); > @@ -297,7 +300,8 @@ EXPORT_SYMBOL(blk_stop_queue); > void blk_sync_queue(struct request_queue *q) > { > del_timer_sync(&q->timeout); > - cancel_delayed_work_sync(&q->delay_work); > + if (__cancel_delayed_work(&q->delay_work)) > + blk_put_queue(q); > queue_sync_plugs(q); > } > EXPORT_SYMBOL(blk_sync_queue); > > Just done a couple of tests, with the following results: #1. Including Tejun's patch: scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 18, comm: kworker/4:0 Not tainted 2.6.39-rc2+ #189 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c983d>] kref_get+0x2d/0x30 [<ffffffff813c823a>] kobject_get+0x1a/0x30 [<ffffffff81460864>] get_device+0x14/0x20 [<ffffffff81478bc7>] scsi_request_fn+0x37/0x4a0 [<ffffffff813aff2a>] __blk_run_queue+0x6a/0x110 [<ffffffff813b2481>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b2450>] ? blk_alloc_queue+0x10/0x10 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff81687164>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ecd6>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f098>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff81687160>] ? gs_change+0x13/0x13 ---[ end trace c35781f847a41f31 ]--- #2 On its own: scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 BUG: unable to handle kernel NULL pointer dereference at 0000000000000008 IP: [<ffffffff810ab4d3>] __queue_work+0x403/0x460 PGD 0 Oops: 0000 [#1] PREEMPT SMP last sysfs file: CPU 0 Modules linked in: Pid: 3, comm: ksoftirqd/0 Not tainted 2.6.39-rc2+ #190 Dell Inc. PowerEdge R710/0N047H RIP: 0010:[<ffffffff810ab4d3>] [<ffffffff810ab4d3>] __queue_work+0x403/0x460 RSP: 0018:ffff8800c90abb20 EFLAGS: 00010046 RAX: 0000000000000000 RBX: ffff8800c56a8c58 RCX: ffff8800c56a8c60 RDX: ffff8800c56a8c60 RSI: 0000000000000000 RDI: ffff8800cb00e388 RBP: ffff8800c90abb70 R08: 0000000000000900 R09: 0000000000000000 R10: 0000000000000001 R11: 0000000000000001 R12: ffff8800cb00e340 R13: 0000000000000000 R14: ffff8800cb1d6700 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff8800cb000000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 0000000000000008 CR3: 0000000001c33000 CR4: 00000000000006f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process ksoftirqd/0 (pid: 3, threadinfo ffff8800c90aa000, task ffff8800c90a80c0) Stack: ffff8800c90abb90 0000000000000086 0000000000000000 0000000000000086 ffff8800c90a80c0 ffff8800c92ebe00 ffff8800c56a8c58 ffff8800c88bac28 ffff8800c90abc30 ffff8800c565c080 ffff8800c90abb80 ffffffff810ab59d Call Trace: [<ffffffff810ab59d>] queue_work_on+0x1d/0x30 [<ffffffff810ac749>] queue_work+0x29/0x60 [<ffffffff810ac865>] queue_delayed_work+0x25/0x30 [<ffffffff813aff75>] __blk_run_queue+0xb5/0x110 [<ffffffff813b04ed>] blk_run_queue+0x2d/0x50 [<ffffffff8147715a>] scsi_run_queue+0xea/0x3f0 [<ffffffff814710cf>] ? __scsi_put_command+0x5f/0xa0 [<ffffffff814793cd>] scsi_next_command+0x3d/0x60 [<ffffffff81479602>] scsi_io_completion+0x1b2/0x630 [<ffffffff81470cd7>] scsi_finish_command+0xc7/0x130 [<ffffffff8147936f>] scsi_softirq_done+0x13f/0x160 [<ffffffff813b8252>] blk_done_softirq+0xa2/0xc0 [<ffffffff810970ac>] __do_softirq+0xdc/0x290 [<ffffffff81097395>] run_ksoftirqd+0x135/0x250 [<ffffffff81097260>] ? __do_softirq+0x290/0x290 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec56>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 Code: 8b 44 24 48 49 8d 7c 24 48 48 83 e8 08 31 f6 eb 27 0f 1f 80 00 00 00 00 48 8b 00 49 89 c0 41 80 e0 00 a8 04 48 89 f0 49 0f 45 c0 8b 40 08 f6 00 10 74 14 48 8d 41 f8 48 8b 48 08 48 8d 50 08 RIP [<ffffffff810ab4d3>] __queue_work+0x403/0x460 RSP <ffff8800c90abb20> CR2: 0000000000000008 ---[ end trace 52fce2e9afb9bf59 ]--- Kernel panic - not syncing: Fatal exception in interrupt These are both on the same base kernel as yesterday (i.e. Linus tree from this time yesterday morning) plus a few GFS2 patches, but they only affect the GFS2 module which is not loaded. I don't do anything special to trigger the problem - it happens of its own accord during normal boot. The initscripts are those from f14. Steve. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 8:42 ` Steven Whitehouse @ 2011-04-12 13:42 ` James Bottomley 2011-04-12 14:06 ` Steven Whitehouse 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 13:42 UTC (permalink / raw) To: Steven Whitehouse; +Cc: Tejun Heo, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 09:42 +0100, Steven Whitehouse wrote: > #2 On its own: Right, that's how it's supposed to be applied > scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 > scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 > scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 > BUG: unable to handle kernel NULL pointer dereference at 0000000000000008 > IP: [<ffffffff810ab4d3>] __queue_work+0x403/0x460 > PGD 0 > Oops: 0000 [#1] PREEMPT SMP > last sysfs file: > CPU 0 > Modules linked in: > > Pid: 3, comm: ksoftirqd/0 Not tainted 2.6.39-rc2+ #190 Dell Inc. PowerEdge R710/0N047H > RIP: 0010:[<ffffffff810ab4d3>] [<ffffffff810ab4d3>] __queue_work+0x403/0x460 > RSP: 0018:ffff8800c90abb20 EFLAGS: 00010046 > RAX: 0000000000000000 RBX: ffff8800c56a8c58 RCX: ffff8800c56a8c60 > RDX: ffff8800c56a8c60 RSI: 0000000000000000 RDI: ffff8800cb00e388 > RBP: ffff8800c90abb70 R08: 0000000000000900 R09: 0000000000000000 > R10: 0000000000000001 R11: 0000000000000001 R12: ffff8800cb00e340 > R13: 0000000000000000 R14: ffff8800cb1d6700 R15: 0000000000000000 > FS: 0000000000000000(0000) GS:ffff8800cb000000(0000) knlGS:0000000000000000 > CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b > CR2: 0000000000000008 CR3: 0000000001c33000 CR4: 00000000000006f0 > DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 > DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 > Process ksoftirqd/0 (pid: 3, threadinfo ffff8800c90aa000, task ffff8800c90a80c0) > Stack: > ffff8800c90abb90 0000000000000086 0000000000000000 0000000000000086 > ffff8800c90a80c0 ffff8800c92ebe00 ffff8800c56a8c58 ffff8800c88bac28 > ffff8800c90abc30 ffff8800c565c080 ffff8800c90abb80 ffffffff810ab59d > Call Trace: > [<ffffffff810ab59d>] queue_work_on+0x1d/0x30 > [<ffffffff810ac749>] queue_work+0x29/0x60 > [<ffffffff810ac865>] queue_delayed_work+0x25/0x30 > [<ffffffff813aff75>] __blk_run_queue+0xb5/0x110 OK, this is because the patch is incomplete ... it needs an additional reference which I missed in run queue ... can you apply the update patch below on top? Actually, there are probably more places I missed, sigh. > [<ffffffff813b04ed>] blk_run_queue+0x2d/0x50 > [<ffffffff8147715a>] scsi_run_queue+0xea/0x3f0 > [<ffffffff814710cf>] ? __scsi_put_command+0x5f/0xa0 > [<ffffffff814793cd>] scsi_next_command+0x3d/0x60 > [<ffffffff81479602>] scsi_io_completion+0x1b2/0x630 > [<ffffffff81470cd7>] scsi_finish_command+0xc7/0x130 > [<ffffffff8147936f>] scsi_softirq_done+0x13f/0x160 > [<ffffffff813b8252>] blk_done_softirq+0xa2/0xc0 > [<ffffffff810970ac>] __do_softirq+0xdc/0x290 > [<ffffffff81097395>] run_ksoftirqd+0x135/0x250 > [<ffffffff81097260>] ? __do_softirq+0x290/0x290 > [<ffffffff810b1f16>] kthread+0xa6/0xb0 > [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 > [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 > [<ffffffff8167ec56>] ? _raw_spin_unlock_irq+0x46/0x70 > [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 > [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 > [<ffffffff816870e0>] ? gs_change+0x13/0x13 > Code: 8b 44 24 48 49 8d 7c 24 48 48 83 e8 08 31 f6 eb 27 0f 1f 80 00 00 00 00 48 8b 00 49 89 c0 41 80 e0 00 a8 04 48 89 f0 49 0f 45 c0 > 8b 40 08 f6 00 10 74 14 48 8d 41 f8 48 8b 48 08 48 8d 50 08 > RIP [<ffffffff810ab4d3>] __queue_work+0x403/0x460 > RSP <ffff8800c90abb20> > CR2: 0000000000000008 > ---[ end trace 52fce2e9afb9bf59 ]--- > Kernel panic - not syncing: Fatal exception in interrupt > > These are both on the same base kernel as yesterday (i.e. Linus tree > from this time yesterday morning) plus a few GFS2 patches, but they > only affect the GFS2 module which is not loaded. > > I don't do anything special to trigger the problem - it happens of its > own accord during normal boot. The initscripts are those from f14. That's useful ... at least it's not hard to reproduce ... it's just I don't see anything like this in my boot sequence. James --- Index: linux-2.6/block/blk-core.c =================================================================== --- linux-2.6.orig/block/blk-core.c +++ linux-2.6/block/blk-core.c @@ -328,7 +328,7 @@ void __blk_run_queue(struct request_queu if (!force_kblockd && !queue_flag_test_and_set(QUEUE_FLAG_REENTER, q)) { q->request_fn(q); queue_flag_clear(QUEUE_FLAG_REENTER, q); - } else + } else if (!blk_get_queue(q)) queue_delayed_work(kblockd_workqueue, &q->delay_work, 0); } EXPORT_SYMBOL(__blk_run_queue); ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 13:42 ` James Bottomley @ 2011-04-12 14:06 ` Steven Whitehouse 2011-04-12 15:14 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-12 14:06 UTC (permalink / raw) To: James Bottomley; +Cc: Tejun Heo, linux-kernel, Jens Axboe [-- Attachment #1: Type: text/plain, Size: 5047 bytes --] Hi, On Tue, 2011-04-12 at 08:42 -0500, James Bottomley wrote: > On Tue, 2011-04-12 at 09:42 +0100, Steven Whitehouse wrote: > > #2 On its own: > > Right, that's how it's supposed to be applied > > > scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 > > scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 > > scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 > > BUG: unable to handle kernel NULL pointer dereference at 0000000000000008 > > IP: [<ffffffff810ab4d3>] __queue_work+0x403/0x460 > > PGD 0 > > Oops: 0000 [#1] PREEMPT SMP > > last sysfs file: > > CPU 0 > > Modules linked in: > > > > Pid: 3, comm: ksoftirqd/0 Not tainted 2.6.39-rc2+ #190 Dell Inc. PowerEdge R710/0N047H > > RIP: 0010:[<ffffffff810ab4d3>] [<ffffffff810ab4d3>] __queue_work+0x403/0x460 > > RSP: 0018:ffff8800c90abb20 EFLAGS: 00010046 > > RAX: 0000000000000000 RBX: ffff8800c56a8c58 RCX: ffff8800c56a8c60 > > RDX: ffff8800c56a8c60 RSI: 0000000000000000 RDI: ffff8800cb00e388 > > RBP: ffff8800c90abb70 R08: 0000000000000900 R09: 0000000000000000 > > R10: 0000000000000001 R11: 0000000000000001 R12: ffff8800cb00e340 > > R13: 0000000000000000 R14: ffff8800cb1d6700 R15: 0000000000000000 > > FS: 0000000000000000(0000) GS:ffff8800cb000000(0000) knlGS:0000000000000000 > > CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b > > CR2: 0000000000000008 CR3: 0000000001c33000 CR4: 00000000000006f0 > > DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 > > DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 > > Process ksoftirqd/0 (pid: 3, threadinfo ffff8800c90aa000, task ffff8800c90a80c0) > > Stack: > > ffff8800c90abb90 0000000000000086 0000000000000000 0000000000000086 > > ffff8800c90a80c0 ffff8800c92ebe00 ffff8800c56a8c58 ffff8800c88bac28 > > ffff8800c90abc30 ffff8800c565c080 ffff8800c90abb80 ffffffff810ab59d > > Call Trace: > > [<ffffffff810ab59d>] queue_work_on+0x1d/0x30 > > [<ffffffff810ac749>] queue_work+0x29/0x60 > > [<ffffffff810ac865>] queue_delayed_work+0x25/0x30 > > [<ffffffff813aff75>] __blk_run_queue+0xb5/0x110 > > OK, this is because the patch is incomplete ... it needs an additional > reference which I missed in run queue ... can you apply the update patch > below on top? > > Actually, there are probably more places I missed, sigh. > > > [<ffffffff813b04ed>] blk_run_queue+0x2d/0x50 > > [<ffffffff8147715a>] scsi_run_queue+0xea/0x3f0 > > [<ffffffff814710cf>] ? __scsi_put_command+0x5f/0xa0 > > [<ffffffff814793cd>] scsi_next_command+0x3d/0x60 > > [<ffffffff81479602>] scsi_io_completion+0x1b2/0x630 > > [<ffffffff81470cd7>] scsi_finish_command+0xc7/0x130 > > [<ffffffff8147936f>] scsi_softirq_done+0x13f/0x160 > > [<ffffffff813b8252>] blk_done_softirq+0xa2/0xc0 > > [<ffffffff810970ac>] __do_softirq+0xdc/0x290 > > [<ffffffff81097395>] run_ksoftirqd+0x135/0x250 > > [<ffffffff81097260>] ? __do_softirq+0x290/0x290 > > [<ffffffff810b1f16>] kthread+0xa6/0xb0 > > [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 > > [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 > > [<ffffffff8167ec56>] ? _raw_spin_unlock_irq+0x46/0x70 > > [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 > > [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 > > [<ffffffff816870e0>] ? gs_change+0x13/0x13 > > Code: 8b 44 24 48 49 8d 7c 24 48 48 83 e8 08 31 f6 eb 27 0f 1f 80 00 00 00 00 48 8b 00 49 89 c0 41 80 e0 00 a8 04 48 89 f0 49 0f 45 c0 > > 8b 40 08 f6 00 10 74 14 48 8d 41 f8 48 8b 48 08 48 8d 50 08 > > RIP [<ffffffff810ab4d3>] __queue_work+0x403/0x460 > > RSP <ffff8800c90abb20> > > CR2: 0000000000000008 > > ---[ end trace 52fce2e9afb9bf59 ]--- > > Kernel panic - not syncing: Fatal exception in interrupt > > > > These are both on the same base kernel as yesterday (i.e. Linus tree > > from this time yesterday morning) plus a few GFS2 patches, but they > > only affect the GFS2 module which is not loaded. > > > > I don't do anything special to trigger the problem - it happens of its > > own accord during normal boot. The initscripts are those from f14. > > That's useful ... at least it's not hard to reproduce ... it's just I > don't see anything like this in my boot sequence. > > James > > --- > > Index: linux-2.6/block/blk-core.c > =================================================================== > --- linux-2.6.orig/block/blk-core.c > +++ linux-2.6/block/blk-core.c > @@ -328,7 +328,7 @@ void __blk_run_queue(struct request_queu > if (!force_kblockd && !queue_flag_test_and_set(QUEUE_FLAG_REENTER, q)) { > q->request_fn(q); > queue_flag_clear(QUEUE_FLAG_REENTER, q); > - } else > + } else if (!blk_get_queue(q)) > queue_delayed_work(kblockd_workqueue, &q->delay_work, 0); > } > EXPORT_SYMBOL(__blk_run_queue); > > Messages attached - getting closer I think, but still not quite there. It is very odd that so far (at least I've seen no other reports) that I seem to be the only one who hits this. I wonder what is different about my kernel/hardware... Steve. [-- Warning: decoded text below may be mangled, UTF-8 assumed --] [-- Attachment #2: james3.txt --] [-- Type: text/plain; name="james3.txt"; charset="UTF-8", Size: 27080 bytes --] Initializing cgroup subsys cpuset Initializing cgroup subsys cpu Linux version 2.6.39-rc2+ (root@chywoon) (gcc version 4.5.1 20100924 (Red Hat 4.5.1-4) (GCC) ) #192 SMP PREEMPT Tue Apr 12 14:29:39 BST 2011 Command line: ro root=/dev/mapper/VolGroup-lv_root rhgb console=ttyS0,115200n8 console=tty0 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us mem=4G BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 00000000000a0000 (usable) BIOS-e820: 0000000000100000 - 00000000cf669000 (usable) BIOS-e820: 00000000cf669000 - 00000000cf67f000 (reserved) BIOS-e820: 00000000cf67f000 - 00000000cf6be000 (ACPI data) BIOS-e820: 00000000cf6be000 - 00000000d0000000 (reserved) BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) BIOS-e820: 00000000fe000000 - 0000000100000000 (reserved) BIOS-e820: 0000000100000000 - 0000000330000000 (usable) NX (Execute Disable) protection: active user-defined physical RAM map: user: 0000000000000000 - 00000000000a0000 (usable) user: 0000000000100000 - 00000000cf669000 (usable) user: 00000000cf669000 - 00000000cf67f000 (reserved) user: 00000000cf67f000 - 00000000cf6be000 (ACPI data) user: 00000000cf6be000 - 00000000d0000000 (reserved) user: 00000000e0000000 - 00000000f0000000 (reserved) user: 00000000fe000000 - 0000000100000000 (reserved) DMI 2.6 present. No AGP bridge found last_pfn = 0xcf669 max_arch_pfn = 0x400000000 x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 found SMP MP-table at [ffff8800000fe710] fe710 init_memory_mapping: 0000000000000000-00000000cf669000 RAMDISK: 3768b000 - 37ff0000 ACPI: RSDP 00000000000f0a90 00024 (v02 DELL ) ACPI: XSDT 00000000000f0b94 0009C (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: FACP 00000000cf6a3f9c 000F4 (v03 DELL PE_SC3 00000001 DELL 00000001) ACPI: DSDT 00000000cf67f000 03D5A (v01 DELL PE_SC3 00000001 INTL 20050624) ACPI: FACS 00000000cf6a6000 00040 ACPI: APIC 00000000cf6a3478 0015E (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SPCR 00000000cf6a35d8 00050 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: HPET 00000000cf6a362c 00038 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: DMAR 00000000cf6a3668 001B0 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: MCFG 00000000cf6a38c4 0003C (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: WD__ 00000000cf6a3904 00134 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SLIC 00000000cf6a3a3c 00024 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: ERST 00000000cf682edc 00270 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: HEST 00000000cf68314c 003A8 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: BERT 00000000cf682d5c 00030 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: EINJ 00000000cf682d8c 00150 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SRAT 00000000cf6a3bc0 00370 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: TCPA 00000000cf6a3f34 00064 (v02 DELL PE_SC3 00000001 DELL 00000001) ACPI: SSDT 00000000cf6a7000 01DEC (v01 INTEL PPM RCM 80000001 INTL 20061109) SRAT: PXM 1 -> APIC 0x10 -> Node 0 SRAT: PXM 2 -> APIC 0x00 -> Node 1 SRAT: PXM 1 -> APIC 0x12 -> Node 0 SRAT: PXM 2 -> APIC 0x02 -> Node 1 SRAT: PXM 1 -> APIC 0x14 -> Node 0 SRAT: PXM 2 -> APIC 0x04 -> Node 1 SRAT: PXM 1 -> APIC 0x16 -> Node 0 SRAT: PXM 2 -> APIC 0x06 -> Node 1 SRAT: Node 1 PXM 2 0-d0000000 SRAT: Node 1 PXM 2 100000000-1b0000000 SRAT: Node 0 PXM 1 1b0000000-330000000 NUMA: Node 1 [0,cf669000) + [100000000,1b0000000) -> [0,cf669000) NUMA: nodes only cover 0MB of your 3317MB e820 RAM. Not used. No NUMA configuration found Faking a node at 0000000000000000-00000000cf669000 Initmem setup node 0 0000000000000000-00000000cf669000 NODE_DATA [00000000cf65e000 - 00000000cf662fff] Zone PFN ranges: DMA 0x00000010 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal empty Movable zone start PFN for each node early_node_map[2] active PFN ranges 0: 0x00000010 -> 0x000000a0 0: 0x00000100 -> 0x000cf669 ACPI: PM-Timer IO Port: 0x808 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32]) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Using ACPI (MADT) for SMP configuration information ACPI: HPET id: 0x8086a301 base: 0xfed00000 SMP: Allowing 8 CPUs, 0 hotplug CPUs Allocating PCI resources starting at d0000000 (gap: d0000000:10000000) Booting paravirtualized kernel on bare hardware setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 PERCPU: Embedded 475 pages/cpu @ffff8800cb000000 s1913872 r8192 d23536 u2097152 Built 1 zonelists in Node order, mobility grouping on. Total pages: 837782 Policy zone: DMA32 Kernel command line: ro root=/dev/mapper/VolGroup-lv_root rhgb console=ttyS0,115200n8 console=tty0 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us mem=4G PID hash table entries: 4096 (order: 3, 32768 bytes) Checking aperture... No AGP bridge found Memory: 3300120k/3398052k available (6695k kernel code, 448k absent, 97484k reserved, 6535k data, 2572k init) Preemptable hierarchical RCU implementation. RCU debugfs-based tracing is enabled. NR_IRQS:512 Extended CMOS year: 2000 Console: colour VGA+ 80x25 console [tty0] enabled console [ttyS0] enabled Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar ... MAX_LOCKDEP_SUBCLASSES: 8 ... MAX_LOCK_DEPTH: 48 ... MAX_LOCKDEP_KEYS: 8191 ... CLASSHASH_SIZE: 4096 ... MAX_LOCKDEP_ENTRIES: 16384 ... MAX_LOCKDEP_CHAINS: 32768 ... CHAINHASH_SIZE: 16384 memory used by lock dependency info: 6367 kB per task-struct memory footprint: 2688 bytes allocated 27262976 bytes of page_cgroup please try 'cgroup_disable=memory' option if you don't want memory cgroups Fast TSC calibration using PIT Detected 1994.697 MHz processor. Calibrating delay loop (skipped), value calculated using timer frequency.. 3989.39 BogoMIPS (lpj=1994697) pid_max: default: 32768 minimum: 301 Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) Mount-cache hash table entries: 256 Initializing cgroup subsys ns ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup. Initializing cgroup subsys cpuacct Initializing cgroup subsys memory Initializing cgroup subsys freezer Initializing cgroup subsys net_cls Initializing cgroup subsys perf_event CPU: Physical Processor ID: 1 CPU: Processor Core ID: 0 mce: CPU supports 9 MCE banks CPU0: Thermal monitoring enabled (TM1) using mwait in idle threads. Freeing SMP alternatives: 24k freed ACPI: Core revision 20110316 Setting APIC routing to flat ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 CPU0: Intel(R) Xeon(R) CPU E5504 @ 2.00GHz stepping 05 Performance Events: PEBS fmt1+, Nehalem events, Intel PMU driver. ... version: 3 ... bit width: 48 ... generic registers: 4 ... value mask: 0000ffffffffffff ... max period: 000000007fffffff ... fixed-purpose events: 3 ... event mask: 000000070000000f lockdep: fixing up alternatives. Booting Node 0, Processors #1 lockdep: fixing up alternatives. #2 lockdep: fixing up alternatives. #3 lockdep: fixing up alternatives. #4 lockdep: fixing up alternatives. #5 lockdep: fixing up alternatives. #6 lockdep: fixing up alternatives. #7 Ok. Brought up 8 CPUs Total of 8 processors activated (31915.11 BogoMIPS). kworker/u:0 used greatest stack depth: 4808 bytes left print_constraints: dummy: NET: Registered protocol family 16 ACPI FADT declares the system doesn't support PCIe ASPM, so disable it ACPI: bus type pci registered dca service started, version 1.12.1 PCI: Using configuration type 1 for base access bio: create slab <bio-0> at 0 [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored ACPI: Interpreter enabled ACPI: (supports S0 S5) ACPI: Using IOAPIC for interrupt routing PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) pci_root PNP0A08:00: host bridge window [io 0x0000-0x0cf7] pci_root PNP0A08:00: host bridge window [io 0x0d00-0xffff] pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff] pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xfdffffff] pci_root PNP0A08:00: host bridge window [mem 0xfed40000-0xfed44fff] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f) pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f) pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f) pci 0000:00:01.0: PCI bridge to [bus 01-01] pci 0000:00:03.0: PCI bridge to [bus 02-02] pci 0000:00:04.0: PCI bridge to [bus 03-03] pci 0000:00:05.0: PCI bridge to [bus 04-04] pci 0000:00:06.0: PCI bridge to [bus 05-05] pci 0000:00:07.0: PCI bridge to [bus 06-06] pci 0000:00:09.0: PCI bridge to [bus 07-07] pci 0000:00:1e.0: PCI bridge to [bus 08-08] (subtractive decode) ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15) ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15) ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15) ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15) ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15) vgaarb: device added: PCI:0000:08:03.0,decodes=io+mem,owns=io+mem,locks=none vgaarb: loaded SCSI subsystem initialized usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb PCI: Using ACPI for IRQ routing HPET: 4 timers in total, 0 timers will be used for per-cpu timer Switching to clocksource hpet Switched to NOHz mode on CPU #0 Switched to NOHz mode on CPU #2 Switched to NOHz mode on CPU #6 Switched to NOHz mode on CPU #4 Switched to NOHz mode on CPU #1 Switched to NOHz mode on CPU #3 Switched to NOHz mode on CPU #5 Switched to NOHz mode on CPU #7 pnp: PnP ACPI init ACPI: bus type pnp registered system 00:07: [io 0x0800-0x087f] has been reserved system 00:07: [io 0x0880-0x08ff] has been reserved system 00:07: [io 0x0900-0x091f] has been reserved system 00:07: [io 0x0920-0x0923] has been reserved system 00:07: [io 0x0924] has been reserved system 00:07: [io 0x0c00-0x0c7f] has been reserved system 00:07: [io 0x0ca0-0x0ca7] has been reserved system 00:07: [io 0x0ca9-0x0cab] has been reserved system 00:07: [io 0x0cad-0x0caf] has been reserved system 00:08: [io 0x0ca8] has been reserved system 00:08: [io 0x0cac] has been reserved system 00:09: [mem 0xe0000000-0xefffffff] has been reserved system 00:0b: [mem 0xfed90000-0xfed91fff] has been reserved pnp: PnP ACPI: found 12 devices ACPI: ACPI bus type pnp unregistered pci 0000:00:01.0: PCI bridge to [bus 01-01] pci 0000:00:01.0: bridge window [io disabled] pci 0000:00:01.0: bridge window [mem 0xd6000000-0xd9ffffff] pci 0000:00:01.0: bridge window [mem pref disabled] pci 0000:00:03.0: PCI bridge to [bus 02-02] pci 0000:00:03.0: bridge window [io disabled] pci 0000:00:03.0: bridge window [mem 0xda000000-0xddffffff] pci 0000:00:03.0: bridge window [mem pref disabled] pci 0000:00:04.0: PCI bridge to [bus 03-03] pci 0000:00:04.0: bridge window [io 0xf000-0xffff] pci 0000:00:04.0: bridge window [mem 0xdf100000-0xdf1fffff] pci 0000:00:04.0: bridge window [mem pref disabled] pci 0000:00:05.0: PCI bridge to [bus 04-04] pci 0000:00:05.0: bridge window [io disabled] pci 0000:00:05.0: bridge window [mem disabled] pci 0000:00:05.0: bridge window [mem pref disabled] pci 0000:00:06.0: PCI bridge to [bus 05-05] pci 0000:00:06.0: bridge window [io disabled] pci 0000:00:06.0: bridge window [mem disabled] pci 0000:00:06.0: bridge window [mem pref disabled] pci 0000:00:07.0: PCI bridge to [bus 06-06] pci 0000:00:07.0: bridge window [io disabled] pci 0000:00:07.0: bridge window [mem disabled] pci 0000:00:07.0: bridge window [mem pref disabled] pci 0000:00:09.0: PCI bridge to [bus 07-07] pci 0000:00:09.0: bridge window [io disabled] pci 0000:00:09.0: bridge window [mem disabled] pci 0000:00:09.0: bridge window [mem pref disabled] pci 0000:08:03.0: BAR 6: assigned [mem 0xde000000-0xde00ffff pref] pci 0000:00:1e.0: PCI bridge to [bus 08-08] pci 0000:00:1e.0: bridge window [io disabled] pci 0000:00:1e.0: bridge window [mem 0xde000000-0xdeffffff] pci 0000:00:1e.0: bridge window [mem 0xd5800000-0xd5ffffff 64bit pref] pci 0000:00:01.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:03.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:04.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:05.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:06.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:07.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:09.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 NET: Registered protocol family 2 IP route cache hash table entries: 131072 (order: 8, 1048576 bytes) TCP established hash table entries: 524288 (order: 11, 8388608 bytes) TCP bind hash table entries: 65536 (order: 10, 5242880 bytes) TCP: Hash tables configured (established 524288 bind 65536) TCP reno registered UDP hash table entries: 2048 (order: 6, 393216 bytes) UDP-Lite hash table entries: 2048 (order: 6, 393216 bytes) NET: Registered protocol family 1 RPC: Registered udp transport module. RPC: Registered tcp transport module. RPC: Registered tcp NFSv4.1 backchannel transport module. Trying to unpack rootfs image as initramfs... Freeing initrd memory: 9620k freed Intel AES-NI instructions are not detected. audit: initializing netlink socket (disabled) type=2000 audit(1302615472.549:1): initialized HugeTLB registered 2 MB page size, pre-allocated 0 pages VFS: Disk quotas dquot_6.5.2 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) OCFS2 1.5.0 ocfs2: Registered cluster interface o2cb OCFS2 DLMFS 1.5.0 OCFS2 User DLM kernel interface loaded OCFS2 Node Manager 1.5.0 OCFS2 DLM 1.5.0 msgmni has been set to 6464 Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254) io scheduler noop registered io scheduler deadline registered io scheduler cfq registered (default) input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 ACPI: Power Button [PWRF] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled ÿserial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Real Time Clock Driver v1.12b Linux agpgart interface v0.103 brd: module loaded megasas: 00.00.05.34-rc1 Thu. Feb. 24 17:00:00 PDT 2011 megasas: 0x1000:0x0060:0x1028:0x1f0c: bus 3:slot 0:func 0 megaraid_sas 0000:03:00.0: PCI INT A -> GSI 33 (level, low) -> IRQ 33 megasas: FW now in Ready state megasas_init_mfi: fw_support_ieee=0 megasas: INIT adapter done scsi0 : LSI SAS based MegaRAID driver scsi 0:0:0:0: Direct-Access SEAGATE ST3146356SS HS0A PQ: 0 ANSI: 5 scsi 0:0:1:0: Direct-Access SEAGATE ST3146356SS HS0A PQ: 0 ANSI: 5 scsi 0:0:2:0: Direct-Access SEAGATE ST3300656SS HS0A PQ: 0 ANSI: 5 scsi 0:0:3:0: Direct-Access SEAGATE ST3300656SS HS0A PQ: 0 ANSI: 5 Refined TSC clocksource calibration: 1994.999 MHz. Switching to clocksource tsc scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue BUG: unable to handle kernel scsi: killing requests for dead queue NULL pointer dereference at 0000000000000028 IP: [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 PGD 0 Oops: 0000 [#1] PREEMPT SMP last sysfs file: CPU 1 Modules linked in: Pid: 243, comm: kblockd Not tainted 2.6.39-rc2+ #192 Dell Inc. PowerEdge R710/0N047H RIP: 0010:[<ffffffff813b34ed>] [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 RSP: 0000:ffff8800c880dc70 EFLAGS: 00010046 RAX: 0000000000000000 RBX: ffff88003799cad0 RCX: 0000000000000000 RDX: ffff8800c9398540 RSI: 0000000000000000 RDI: ffff88003799cad0 RBP: ffff8800c880dcb0 R08: 0000000000000002 R09: 0000000000000001 R10: 0000000000000001 R11: 0000000000000001 R12: ffff88003799cad0 R13: ffff8800cb3d6700 R14: ffff8800c880c000 R15: ffff8800c880dfd8 FS: 0000000000000000(0000) GS:ffff8800cb200000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 0000000000000028 CR3: 0000000001c33000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process kblockd (pid: 243, threadinfo ffff8800c880c000, task ffff8800c9398540) Stack: ffff8800c880dc80 ffff8800c9398540 ffff8800c880dc90 0000000000000000 ffff88003799cad0 ffff8800cb3d6700 ffff8800cb20e340 ffff8800c880dd90 ffff8800c880dd10 ffffffff81479025 000000013799cc18 0000000000000000 Call Trace: [<ffffffff81479025>] scsi_request_fn+0x475/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810acba9>] rescuer_thread+0x189/0x230 [<ffffffff810aca20>] ? worker_rebind_fn+0xd0/0xd0 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec76>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 Code: 4e 1c 49 8b 46 10 a8 08 0f 84 65 ff ff ff e8 7b 7f 2c 00 e9 5b ff ff ff 66 0f 1f 44 00 00 49 8b 44 24 18 31 f6 48 8b 00 4c 89 e7 <ff> 50 28 85 c0 0f 85 f4 fe ff ff 45 31 ed e9 70 ff ff ff 45 31 RIP [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 RSP <ffff8800c880dc70> CR2: 0000000000000028 general protection fault: 0000 [#2] ---[ end trace a091be4488bf08a6 ]--- note: kblockd[243] exited with preempt_count 1 sd 0:2:0:0: [sda] 285474816 512-byte logical blocks: (146 GB/136 GiB) kblockd used greatest stack depth: 4520 bytes left sd 0:2:1:0: [sdb] 584843264 512-byte logical blocks: (299 GB/278 GiB) PREEMPT SMP last sysfs file: CPU 3 Modules linked in: Pid: 705, comm: kworker/3:5 Tainted: G D 2.6.39-rc2+ #192 Dell Inc. PowerEdge R710/0N047H RIP: 0010:[<ffffffff813b34ed>] [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 RSP: 0018:ffff8800379b1c90 EFLAGS: 00010046 RAX: 7375622f40646461 RBX: ffff8800379b2c10 RCX: 0000000000000000 RDX: 0000000000002b2a RSI: 0000000000000000 RDI: ffff8800379b2c10 RBP: ffff8800379b1cd0 R08: 0000000000000002 R09: 0000000000000001 R10: 0000000000000001 R11: 0000000000000000 R12: ffff8800379b2c10 R13: ffff8800cb7d6700 R14: ffff8800379b0000 R15: ffff8800379b1fd8 FS: 0000000000000000(0000) GS:ffff8800cb600000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 0000000000000000 CR3: 0000000001c33000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process kworker/3:5 (pid: 705, threadinfo ffff8800379b0000, task ffff8800c5728040) Stack: ffff8800379b1ca0 ffff8800379b3188 0000000000000086 0000000000000000 ffff8800379b2c10 ffff8800cb7d6700 ffff8800cb60e340 ffff8800379b1db0 ffff8800379b1d30 ffffffff81479025 00000000379b2d58 ffff8800379b3188 Call Trace: [<ffffffff81479025>] scsi_request_fn+0x475/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec76>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 Code: 4e 1c 49 8b 46 10 a8 08 0f 84 65 ff ff ff e8 7b 7f 2c 00 e9 5b ff ff ff 66 0f 1f 44 00 00 49 8b 44 24 18 31 f6 48 8b 00 4c 89 e7 <ff> 50 28 85 c0 0f 85 f4 fe ff ff 45 31 ed e9 70 ff ff ff 45 31 RIP [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 RSP <ffff8800379b1c90> ---[ end trace a091be4488bf08a7 ]--- note: kworker/3:5[705] exited with preempt_count 1 TARGET_CORE[0]: Loading Generic Kernel Storage Engine: v4.0.0-rc7-ml on Linux/x86_64 on 2.6.39-rc2+ BUG: unable to handle kernel paging request at fffffffffffffff8 IP: [<ffffffff810b220b>] kthread_data+0xb/0x20 PGD 1c35067 PUD 1c36067 PMD 0 Oops: 0000 [#3] PREEMPT SMP last sysfs file: CPU 3 Modules linked in: Pid: 705, comm: kworker/3:5 Tainted: G D 2.6.39-rc2+ #192 Dell Inc. PowerEdge R710/0N047H RIP: 0010:[<ffffffff810b220b>] [<ffffffff810b220b>] kthread_data+0xb/0x20 RSP: 0018:ffff8800379b1948 EFLAGS: 00010092 RAX: 0000000000000000 RBX: 0000000000000003 RCX: ffff8800379b1fd8 RDX: ffff8800c5728040 RSI: 0000000000000003 RDI: ffff8800c5728040 RBP: ffff8800379b1948 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000001 R11: 0000000000000000 R12: ffff8800c57282e8 R13: 0000000000000003 R14: 0000000000000003 R15: ffff8800379b1b20 FS: 0000000000000000(0000) GS:ffff8800cb600000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: fffffffffffffff8 CR3: 0000000001c33000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process kworker/3:5 (pid: 705, threadinfo ffff8800379b0000, task ffff8800c5728040) Stack: ffff8800379b1968 ffffffff810ada50 ffff8800cb7d2500 ffff8800cb7d2500 ffff8800379b1ab8 ffffffff8167ade9 0000000000000000 ffff8800c5728040 0000000000000000 ffff8800379b1fd8 ffff8800c5728040 ffff8800379b1fd8 Call Trace: [<ffffffff810ada50>] wq_worker_sleeping+0x10/0xa0 [<ffffffff8167ade9>] schedule+0x609/0xa40 [<ffffffff81091d14>] ? release_task+0x14/0x400 [<ffffffff813d7206>] ? do_raw_spin_unlock+0x76/0xd0 [<ffffffff81093b04>] do_exit+0x604/0x900 [<ffffffff81091694>] ? kmsg_dump+0x104/0x140 [<ffffffff816800b7>] oops_end+0x97/0xd0 [<ffffffff81040766>] die+0x56/0x90 [<ffffffff8167f962>] do_general_protection+0x162/0x190 [<ffffffff8167f048>] ? restore_args+0x30/0x30 [<ffffffff8167f225>] general_protection+0x25/0x30 [<ffffffff813b34ed>] ? blk_peek_request+0x1ad/0x220 [<ffffffff81479025>] scsi_request_fn+0x475/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec76>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 Code: d8 fc ff 48 8b 85 28 ff ff ff 48 81 c4 e0 00 00 00 5b 41 5c c9 c3 66 2e 0f 1f 84 00 00 00 00 00 55 48 8b 87 50 02 00 00 48 89 e5 8b 40 f8 c9 c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 RIP [<ffffffff810b220b>] kthread_data+0xb/0x20 RSP <ffff8800379b1948> CR2: fffffffffffffff8 ---[ end trace a091be4488bf08a8 ]--- Fixing recursive fault but reboot is needed! ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 14:06 ` Steven Whitehouse @ 2011-04-12 15:14 ` James Bottomley 2011-04-12 16:04 ` Steven Whitehouse 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 15:14 UTC (permalink / raw) To: Steven Whitehouse; +Cc: Tejun Heo, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 15:06 +0100, Steven Whitehouse wrote: > Messages attached - getting closer I think, but still not quite there. > It is very odd that so far (at least I've seen no other reports) that I > seem to be the only one who hits this. I wonder what is different about > my kernel/hardware... > csi: killing requests for dead queue > scsi: killing requests for dead queue > BUG: unable to handle kernel scsi: killing requests for dead queue > NULL pointer dereference at 0000000000000028 > IP: [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 Hmm, I don't see where this is ... it's a null pointer deref offset by 0x28 bytes ... but I can't see where ... can you resolve this to a line? James ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 15:14 ` James Bottomley @ 2011-04-12 16:04 ` Steven Whitehouse 2011-04-12 16:27 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-12 16:04 UTC (permalink / raw) To: James Bottomley; +Cc: Tejun Heo, linux-kernel, Jens Axboe [-- Attachment #1: Type: text/plain, Size: 2639 bytes --] Hi, On Tue, 2011-04-12 at 10:14 -0500, James Bottomley wrote: > On Tue, 2011-04-12 at 15:06 +0100, Steven Whitehouse wrote: > > Messages attached - getting closer I think, but still not quite there. > > It is very odd that so far (at least I've seen no other reports) that I > > seem to be the only one who hits this. I wonder what is different about > > my kernel/hardware... > > > > csi: killing requests for dead queue > > scsi: killing requests for dead queue > > BUG: unable to handle kernel scsi: killing requests for dead queue > > NULL pointer dereference at 0000000000000028 > > IP: [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 > > Hmm, I don't see where this is ... it's a null pointer deref offset by > 0x28 bytes ... but I can't see where ... can you resolve this to a line? > > James > > So assuming I've calculated this correctly, it should be just about.... /home/steve/linux-2.6/include/linux/rcupdate.h:677 6de8: a8 08 test $0x8,%al 6dea: 0f 84 65 ff ff ff je 6d55 <blk_peek_request+0xf5> 6df0: e8 00 00 00 00 callq 6df5 <blk_peek_request+0x195> 6df1: R_X86_64_PC32 preempt_schedule-0x4 6df5: e9 5b ff ff ff jmpq 6d55 <blk_peek_request+0xf5> 6dfa: 66 0f 1f 44 00 00 nopw 0x0(%rax,%rax,1) __elv_next_request(): /home/steve/linux-2.6/block/blk.h:65 if (!list_empty(&q->queue_head)) { rq = list_entry_rq(q->queue_head.next); return rq; } if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) 6e00: 49 8b 44 24 18 mov 0x18(%r12),%rax 6e05: 31 f6 xor %esi,%esi 6e07: 48 8b 00 mov (%rax),%rax 6e0a: 4c 89 e7 mov %r12,%rdi <---- here! 6e0d: ff 50 28 callq *0x28(%rax) 6e10: 85 c0 test %eax,%eax 6e12: 0f 85 f4 fe ff ff jne 6d0c <blk_peek_request+0xac> 6e18: 45 31 ed xor %r13d,%r13d 6e1b: e9 70 ff ff ff jmpq 6d90 <blk_peek_request+0x130> blk_peek_request(): /home/steve/linux-2.6/block/blk-core.c:1912 * so that we don't add it again */ The offset I got was 6e0d, but I guess thats the start of the following instruction by the time the fault is logged. Also I've attached my current .config just in case that might be a help is reproducing it, Steve. [-- Attachment #2: test.config --] [-- Type: text/x-mpsub, Size: 87254 bytes --] # # Automatically generated make config: don't edit # Linux/x86_64 2.6.39-rc2 Kernel Configuration # Mon Apr 11 12:51:00 2011 # CONFIG_64BIT=y # CONFIG_X86_32 is not set CONFIG_X86_64=y CONFIG_X86=y CONFIG_INSTRUCTION_DECODER=y CONFIG_OUTPUT_FORMAT="elf64-x86-64" CONFIG_ARCH_DEFCONFIG="arch/x86/configs/x86_64_defconfig" CONFIG_GENERIC_CMOS_UPDATE=y CONFIG_CLOCKSOURCE_WATCHDOG=y CONFIG_GENERIC_CLOCKEVENTS=y CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y CONFIG_LOCKDEP_SUPPORT=y CONFIG_STACKTRACE_SUPPORT=y CONFIG_HAVE_LATENCYTOP_SUPPORT=y CONFIG_MMU=y CONFIG_ZONE_DMA=y CONFIG_NEED_DMA_MAP_STATE=y CONFIG_NEED_SG_DMA_LENGTH=y CONFIG_GENERIC_ISA_DMA=y CONFIG_GENERIC_IOMAP=y CONFIG_GENERIC_BUG=y CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y CONFIG_GENERIC_HWEIGHT=y CONFIG_GENERIC_GPIO=y CONFIG_ARCH_MAY_HAVE_PC_FDC=y # CONFIG_RWSEM_GENERIC_SPINLOCK is not set CONFIG_RWSEM_XCHGADD_ALGORITHM=y CONFIG_ARCH_HAS_CPU_IDLE_WAIT=y CONFIG_GENERIC_CALIBRATE_DELAY=y CONFIG_GENERIC_TIME_VSYSCALL=y CONFIG_ARCH_HAS_CPU_RELAX=y CONFIG_ARCH_HAS_DEFAULT_IDLE=y CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y CONFIG_HAVE_SETUP_PER_CPU_AREA=y CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y CONFIG_HAVE_CPUMASK_OF_CPU_MAP=y CONFIG_ARCH_HIBERNATION_POSSIBLE=y CONFIG_ARCH_SUSPEND_POSSIBLE=y CONFIG_ZONE_DMA32=y CONFIG_ARCH_POPULATES_NODE_MAP=y CONFIG_AUDIT_ARCH=y CONFIG_ARCH_SUPPORTS_OPTIMIZED_INLINING=y CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y CONFIG_X86_64_SMP=y CONFIG_X86_HT=y CONFIG_ARCH_HWEIGHT_CFLAGS="-fcall-saved-rdi -fcall-saved-rsi -fcall-saved-rdx -fcall-saved-rcx -fcall-saved-r8 -fcall-saved-r9 -fcall-saved-r10 -fcall-saved-r11" # CONFIG_KTIME_SCALAR is not set CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config" CONFIG_CONSTRUCTORS=y CONFIG_HAVE_IRQ_WORK=y CONFIG_IRQ_WORK=y # # General setup # CONFIG_EXPERIMENTAL=y CONFIG_INIT_ENV_ARG_LIMIT=32 CONFIG_CROSS_COMPILE="" CONFIG_LOCALVERSION="" # CONFIG_LOCALVERSION_AUTO is not set CONFIG_HAVE_KERNEL_GZIP=y CONFIG_HAVE_KERNEL_BZIP2=y CONFIG_HAVE_KERNEL_LZMA=y CONFIG_HAVE_KERNEL_XZ=y CONFIG_HAVE_KERNEL_LZO=y CONFIG_KERNEL_GZIP=y # CONFIG_KERNEL_BZIP2 is not set # CONFIG_KERNEL_LZMA is not set # CONFIG_KERNEL_XZ is not set # CONFIG_KERNEL_LZO is not set CONFIG_SWAP=y CONFIG_SYSVIPC=y CONFIG_SYSVIPC_SYSCTL=y CONFIG_POSIX_MQUEUE=y CONFIG_POSIX_MQUEUE_SYSCTL=y CONFIG_BSD_PROCESS_ACCT=y # CONFIG_BSD_PROCESS_ACCT_V3 is not set CONFIG_FHANDLE=y # CONFIG_TASKSTATS is not set CONFIG_AUDIT=y CONFIG_AUDITSYSCALL=y CONFIG_AUDIT_WATCH=y CONFIG_AUDIT_TREE=y CONFIG_HAVE_GENERIC_HARDIRQS=y # # IRQ subsystem # CONFIG_GENERIC_HARDIRQS=y CONFIG_HAVE_SPARSE_IRQ=y CONFIG_GENERIC_IRQ_PROBE=y CONFIG_GENERIC_IRQ_SHOW=y CONFIG_GENERIC_PENDING_IRQ=y CONFIG_IRQ_FORCED_THREADING=y # CONFIG_SPARSE_IRQ is not set # # RCU Subsystem # CONFIG_TREE_PREEMPT_RCU=y CONFIG_PREEMPT_RCU=y CONFIG_RCU_TRACE=y CONFIG_RCU_FANOUT=64 # CONFIG_RCU_FANOUT_EXACT is not set CONFIG_TREE_RCU_TRACE=y # CONFIG_IKCONFIG is not set CONFIG_LOG_BUF_SHIFT=17 CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y CONFIG_CGROUPS=y # CONFIG_CGROUP_DEBUG is not set CONFIG_CGROUP_NS=y CONFIG_CGROUP_FREEZER=y # CONFIG_CGROUP_DEVICE is not set CONFIG_CPUSETS=y CONFIG_PROC_PID_CPUSET=y CONFIG_CGROUP_CPUACCT=y CONFIG_RESOURCE_COUNTERS=y CONFIG_CGROUP_MEM_RES_CTLR=y CONFIG_CGROUP_MEM_RES_CTLR_SWAP=y CONFIG_CGROUP_MEM_RES_CTLR_SWAP_ENABLED=y CONFIG_CGROUP_PERF=y CONFIG_CGROUP_SCHED=y CONFIG_FAIR_GROUP_SCHED=y CONFIG_RT_GROUP_SCHED=y # CONFIG_BLK_CGROUP is not set CONFIG_NAMESPACES=y # CONFIG_UTS_NS is not set # CONFIG_IPC_NS is not set # CONFIG_USER_NS is not set # CONFIG_PID_NS is not set # CONFIG_NET_NS is not set CONFIG_SCHED_AUTOGROUP=y CONFIG_MM_OWNER=y # CONFIG_SYSFS_DEPRECATED is not set CONFIG_RELAY=y CONFIG_BLK_DEV_INITRD=y CONFIG_INITRAMFS_SOURCE="" CONFIG_RD_GZIP=y CONFIG_RD_BZIP2=y CONFIG_RD_LZMA=y CONFIG_RD_XZ=y CONFIG_RD_LZO=y # CONFIG_CC_OPTIMIZE_FOR_SIZE is not set CONFIG_SYSCTL=y CONFIG_ANON_INODES=y # CONFIG_EXPERT is not set # CONFIG_EMBEDDED is not set CONFIG_UID16=y CONFIG_SYSCTL_SYSCALL=y CONFIG_KALLSYMS=y CONFIG_KALLSYMS_ALL=y CONFIG_KALLSYMS_EXTRA_PASS=y CONFIG_HOTPLUG=y CONFIG_PRINTK=y CONFIG_BUG=y CONFIG_ELF_CORE=y CONFIG_PCSPKR_PLATFORM=y CONFIG_BASE_FULL=y CONFIG_FUTEX=y CONFIG_EPOLL=y CONFIG_SIGNALFD=y CONFIG_TIMERFD=y CONFIG_EVENTFD=y CONFIG_SHMEM=y CONFIG_AIO=y CONFIG_HAVE_PERF_EVENTS=y # # Kernel Performance Events And Counters # CONFIG_PERF_EVENTS=y CONFIG_PERF_COUNTERS=y # CONFIG_DEBUG_PERF_USE_VMALLOC is not set CONFIG_VM_EVENT_COUNTERS=y CONFIG_PCI_QUIRKS=y CONFIG_COMPAT_BRK=y CONFIG_SLAB=y # CONFIG_SLUB is not set CONFIG_PROFILING=y CONFIG_TRACEPOINTS=y CONFIG_OPROFILE=m # CONFIG_OPROFILE_EVENT_MULTIPLEX is not set CONFIG_HAVE_OPROFILE=y CONFIG_KPROBES=y CONFIG_JUMP_LABEL=y CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y CONFIG_KRETPROBES=y CONFIG_USER_RETURN_NOTIFIER=y CONFIG_HAVE_IOREMAP_PROT=y CONFIG_HAVE_KPROBES=y CONFIG_HAVE_KRETPROBES=y CONFIG_HAVE_OPTPROBES=y CONFIG_HAVE_ARCH_TRACEHOOK=y CONFIG_HAVE_DMA_ATTRS=y CONFIG_USE_GENERIC_SMP_HELPERS=y CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y CONFIG_HAVE_DMA_API_DEBUG=y CONFIG_HAVE_HW_BREAKPOINT=y CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y CONFIG_HAVE_USER_RETURN_NOTIFIER=y CONFIG_HAVE_PERF_EVENTS_NMI=y CONFIG_HAVE_ARCH_JUMP_LABEL=y # # GCOV-based kernel profiling # # CONFIG_GCOV_KERNEL is not set # CONFIG_HAVE_GENERIC_DMA_COHERENT is not set CONFIG_SLABINFO=y CONFIG_RT_MUTEXES=y CONFIG_BASE_SMALL=0 CONFIG_MODULES=y CONFIG_MODULE_FORCE_LOAD=y CONFIG_MODULE_UNLOAD=y # CONFIG_MODULE_FORCE_UNLOAD is not set CONFIG_MODVERSIONS=y # CONFIG_MODULE_SRCVERSION_ALL is not set CONFIG_STOP_MACHINE=y CONFIG_BLOCK=y CONFIG_BLK_DEV_BSG=y CONFIG_BLK_DEV_INTEGRITY=y CONFIG_BLOCK_COMPAT=y # # IO Schedulers # CONFIG_IOSCHED_NOOP=y CONFIG_IOSCHED_DEADLINE=y CONFIG_IOSCHED_CFQ=y # CONFIG_DEFAULT_DEADLINE is not set CONFIG_DEFAULT_CFQ=y # CONFIG_DEFAULT_NOOP is not set CONFIG_DEFAULT_IOSCHED="cfq" CONFIG_PREEMPT_NOTIFIERS=y # CONFIG_INLINE_SPIN_TRYLOCK is not set # CONFIG_INLINE_SPIN_TRYLOCK_BH is not set # CONFIG_INLINE_SPIN_LOCK is not set # CONFIG_INLINE_SPIN_LOCK_BH is not set # CONFIG_INLINE_SPIN_LOCK_IRQ is not set # CONFIG_INLINE_SPIN_LOCK_IRQSAVE is not set # CONFIG_INLINE_SPIN_UNLOCK is not set # CONFIG_INLINE_SPIN_UNLOCK_BH is not set # CONFIG_INLINE_SPIN_UNLOCK_IRQ is not set # CONFIG_INLINE_SPIN_UNLOCK_IRQRESTORE is not set # CONFIG_INLINE_READ_TRYLOCK is not set # CONFIG_INLINE_READ_LOCK is not set # CONFIG_INLINE_READ_LOCK_BH is not set # CONFIG_INLINE_READ_LOCK_IRQ is not set # CONFIG_INLINE_READ_LOCK_IRQSAVE is not set # CONFIG_INLINE_READ_UNLOCK is not set # CONFIG_INLINE_READ_UNLOCK_BH is not set # CONFIG_INLINE_READ_UNLOCK_IRQ is not set # CONFIG_INLINE_READ_UNLOCK_IRQRESTORE is not set # CONFIG_INLINE_WRITE_TRYLOCK is not set # CONFIG_INLINE_WRITE_LOCK is not set # CONFIG_INLINE_WRITE_LOCK_BH is not set # CONFIG_INLINE_WRITE_LOCK_IRQ is not set # CONFIG_INLINE_WRITE_LOCK_IRQSAVE is not set # CONFIG_INLINE_WRITE_UNLOCK is not set # CONFIG_INLINE_WRITE_UNLOCK_BH is not set # CONFIG_INLINE_WRITE_UNLOCK_IRQ is not set # CONFIG_INLINE_WRITE_UNLOCK_IRQRESTORE is not set # CONFIG_MUTEX_SPIN_ON_OWNER is not set CONFIG_FREEZER=y # # Processor type and features # CONFIG_TICK_ONESHOT=y CONFIG_NO_HZ=y CONFIG_HIGH_RES_TIMERS=y CONFIG_GENERIC_CLOCKEVENTS_BUILD=y CONFIG_SMP=y CONFIG_X86_MPPARSE=y # CONFIG_X86_EXTENDED_PLATFORM is not set CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y CONFIG_SCHED_OMIT_FRAME_POINTER=y CONFIG_PARAVIRT_GUEST=y # CONFIG_XEN is not set # CONFIG_XEN_PRIVILEGED_GUEST is not set CONFIG_KVM_CLOCK=y CONFIG_KVM_GUEST=y CONFIG_PARAVIRT=y CONFIG_PARAVIRT_SPINLOCKS=y CONFIG_PARAVIRT_CLOCK=y CONFIG_PARAVIRT_DEBUG=y CONFIG_NO_BOOTMEM=y # CONFIG_MEMTEST is not set # CONFIG_MK8 is not set # CONFIG_MPSC is not set CONFIG_MCORE2=y # CONFIG_MATOM is not set # CONFIG_GENERIC_CPU is not set CONFIG_X86_INTERNODE_CACHE_SHIFT=7 CONFIG_X86_CMPXCHG=y CONFIG_CMPXCHG_LOCAL=y CONFIG_X86_L1_CACHE_SHIFT=6 CONFIG_X86_XADD=y CONFIG_X86_WP_WORKS_OK=y CONFIG_X86_INTEL_USERCOPY=y CONFIG_X86_USE_PPRO_CHECKSUM=y CONFIG_X86_P6_NOP=y CONFIG_X86_TSC=y CONFIG_X86_CMPXCHG64=y CONFIG_X86_CMOV=y CONFIG_X86_MINIMUM_CPU_FAMILY=64 CONFIG_X86_DEBUGCTLMSR=y CONFIG_CPU_SUP_INTEL=y CONFIG_CPU_SUP_AMD=y CONFIG_CPU_SUP_CENTAUR=y CONFIG_HPET_TIMER=y CONFIG_HPET_EMULATE_RTC=y CONFIG_DMI=y CONFIG_GART_IOMMU=y CONFIG_CALGARY_IOMMU=y CONFIG_CALGARY_IOMMU_ENABLED_BY_DEFAULT=y # CONFIG_AMD_IOMMU is not set CONFIG_SWIOTLB=y CONFIG_IOMMU_HELPER=y # CONFIG_IOMMU_API is not set # CONFIG_MAXSMP is not set CONFIG_NR_CPUS=8 CONFIG_SCHED_SMT=y CONFIG_SCHED_MC=y # CONFIG_IRQ_TIME_ACCOUNTING is not set # CONFIG_PREEMPT_NONE is not set # CONFIG_PREEMPT_VOLUNTARY is not set CONFIG_PREEMPT=y CONFIG_X86_LOCAL_APIC=y CONFIG_X86_IO_APIC=y # CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS is not set CONFIG_X86_MCE=y CONFIG_X86_MCE_INTEL=y CONFIG_X86_MCE_AMD=y CONFIG_X86_MCE_THRESHOLD=y # CONFIG_X86_MCE_INJECT is not set CONFIG_X86_THERMAL_VECTOR=y # CONFIG_I8K is not set CONFIG_MICROCODE=m CONFIG_MICROCODE_INTEL=y # CONFIG_MICROCODE_AMD is not set CONFIG_MICROCODE_OLD_INTERFACE=y CONFIG_X86_MSR=y CONFIG_X86_CPUID=y CONFIG_ARCH_PHYS_ADDR_T_64BIT=y CONFIG_ARCH_DMA_ADDR_T_64BIT=y CONFIG_DIRECT_GBPAGES=y CONFIG_NUMA=y CONFIG_AMD_NUMA=y CONFIG_X86_64_ACPI_NUMA=y CONFIG_NODES_SPAN_OTHER_NODES=y # CONFIG_NUMA_EMU is not set CONFIG_NODES_SHIFT=6 CONFIG_ARCH_PROC_KCORE_TEXT=y CONFIG_ARCH_SPARSEMEM_DEFAULT=y CONFIG_ARCH_SPARSEMEM_ENABLE=y CONFIG_ARCH_SELECT_MEMORY_MODEL=y CONFIG_ILLEGAL_POINTER_VALUE=0xdead000000000000 CONFIG_SELECT_MEMORY_MODEL=y CONFIG_SPARSEMEM_MANUAL=y CONFIG_SPARSEMEM=y CONFIG_NEED_MULTIPLE_NODES=y CONFIG_HAVE_MEMORY_PRESENT=y CONFIG_SPARSEMEM_EXTREME=y CONFIG_SPARSEMEM_VMEMMAP_ENABLE=y CONFIG_SPARSEMEM_ALLOC_MEM_MAP_TOGETHER=y # CONFIG_SPARSEMEM_VMEMMAP is not set CONFIG_HAVE_MEMBLOCK=y # CONFIG_MEMORY_HOTPLUG is not set CONFIG_PAGEFLAGS_EXTENDED=y CONFIG_SPLIT_PTLOCK_CPUS=999999 CONFIG_COMPACTION=y CONFIG_MIGRATION=y CONFIG_PHYS_ADDR_T_64BIT=y CONFIG_ZONE_DMA_FLAG=1 CONFIG_BOUNCE=y CONFIG_VIRT_TO_BUS=y CONFIG_MMU_NOTIFIER=y CONFIG_KSM=y CONFIG_DEFAULT_MMAP_MIN_ADDR=65536 CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=y CONFIG_MEMORY_FAILURE=y # CONFIG_HWPOISON_INJECT is not set CONFIG_TRANSPARENT_HUGEPAGE=y CONFIG_TRANSPARENT_HUGEPAGE_ALWAYS=y # CONFIG_TRANSPARENT_HUGEPAGE_MADVISE is not set # CONFIG_X86_CHECK_BIOS_CORRUPTION is not set CONFIG_X86_RESERVE_LOW=64 CONFIG_MTRR=y # CONFIG_MTRR_SANITIZER is not set CONFIG_X86_PAT=y CONFIG_ARCH_USES_PG_UNCACHED=y # CONFIG_EFI is not set CONFIG_SECCOMP=y # CONFIG_CC_STACKPROTECTOR is not set # CONFIG_HZ_100 is not set # CONFIG_HZ_250 is not set # CONFIG_HZ_300 is not set CONFIG_HZ_1000=y CONFIG_HZ=1000 CONFIG_SCHED_HRTICK=y # CONFIG_KEXEC is not set # CONFIG_CRASH_DUMP is not set CONFIG_PHYSICAL_START=0x1000000 # CONFIG_RELOCATABLE is not set CONFIG_PHYSICAL_ALIGN=0x1000000 # CONFIG_HOTPLUG_CPU is not set CONFIG_COMPAT_VDSO=y # CONFIG_CMDLINE_BOOL is not set CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y CONFIG_HAVE_ARCH_EARLY_PFN_TO_NID=y CONFIG_USE_PERCPU_NUMA_NODE_ID=y # # Power management and ACPI options # # CONFIG_SUSPEND is not set # CONFIG_HIBERNATION is not set # CONFIG_PM_RUNTIME is not set CONFIG_ACPI=y # CONFIG_ACPI_PROCFS is not set # CONFIG_ACPI_PROCFS_POWER is not set # CONFIG_ACPI_POWER_METER is not set # CONFIG_ACPI_EC_DEBUGFS is not set CONFIG_ACPI_PROC_EVENT=y CONFIG_ACPI_AC=y CONFIG_ACPI_BATTERY=y CONFIG_ACPI_BUTTON=y # CONFIG_ACPI_VIDEO is not set CONFIG_ACPI_FAN=y # CONFIG_ACPI_DOCK is not set CONFIG_ACPI_PROCESSOR=y # CONFIG_ACPI_IPMI is not set # CONFIG_ACPI_PROCESSOR_AGGREGATOR is not set CONFIG_ACPI_THERMAL=y CONFIG_ACPI_NUMA=y # CONFIG_ACPI_CUSTOM_DSDT is not set CONFIG_ACPI_BLACKLIST_YEAR=0 # CONFIG_ACPI_DEBUG is not set # CONFIG_ACPI_PCI_SLOT is not set CONFIG_X86_PM_TIMER=y # CONFIG_ACPI_CONTAINER is not set # CONFIG_ACPI_SBS is not set # CONFIG_ACPI_HED is not set # CONFIG_ACPI_APEI is not set # CONFIG_SFI is not set # # CPU Frequency scaling # # CONFIG_CPU_FREQ is not set CONFIG_CPU_IDLE=y CONFIG_CPU_IDLE_GOV_LADDER=y CONFIG_CPU_IDLE_GOV_MENU=y CONFIG_INTEL_IDLE=y # # Memory power savings # CONFIG_I7300_IDLE_IOAT_CHANNEL=y CONFIG_I7300_IDLE=y # # Bus options (PCI etc.) # CONFIG_PCI=y CONFIG_PCI_DIRECT=y # CONFIG_PCI_MMCONFIG is not set CONFIG_PCI_DOMAINS=y # CONFIG_PCI_CNB20LE_QUIRK is not set # CONFIG_DMAR is not set # CONFIG_INTR_REMAP is not set CONFIG_PCIEPORTBUS=y CONFIG_PCIEAER=y CONFIG_PCIE_ECRC=y # CONFIG_PCIEAER_INJECT is not set CONFIG_PCIEASPM=y # CONFIG_PCIEASPM_DEBUG is not set CONFIG_ARCH_SUPPORTS_MSI=y CONFIG_PCI_MSI=y CONFIG_PCI_DEBUG=y # CONFIG_PCI_STUB is not set CONFIG_HT_IRQ=y CONFIG_PCI_IOV=y CONFIG_PCI_IOAPIC=y CONFIG_ISA_DMA_API=y CONFIG_AMD_NB=y CONFIG_PCCARD=m CONFIG_PCMCIA=m CONFIG_PCMCIA_LOAD_CIS=y CONFIG_CARDBUS=y # # PC-card bridges # CONFIG_YENTA=m CONFIG_YENTA_O2=y CONFIG_YENTA_RICOH=y CONFIG_YENTA_TI=y CONFIG_YENTA_ENE_TUNE=y CONFIG_YENTA_TOSHIBA=y CONFIG_PD6729=m CONFIG_I82092=m CONFIG_PCCARD_NONSTATIC=y # CONFIG_HOTPLUG_PCI is not set # CONFIG_RAPIDIO is not set # # Executable file formats / Emulations # CONFIG_BINFMT_ELF=y CONFIG_COMPAT_BINFMT_ELF=y # CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS is not set # CONFIG_HAVE_AOUT is not set CONFIG_BINFMT_MISC=y CONFIG_IA32_EMULATION=y # CONFIG_IA32_AOUT is not set CONFIG_COMPAT=y CONFIG_COMPAT_FOR_U64_ALIGNMENT=y CONFIG_SYSVIPC_COMPAT=y CONFIG_KEYS_COMPAT=y CONFIG_HAVE_TEXT_POKE_SMP=y CONFIG_NET=y # # Networking options # CONFIG_PACKET=m CONFIG_UNIX=y CONFIG_XFRM=y CONFIG_XFRM_USER=y CONFIG_XFRM_SUB_POLICY=y CONFIG_XFRM_MIGRATE=y # CONFIG_XFRM_STATISTICS is not set CONFIG_XFRM_IPCOMP=m CONFIG_NET_KEY=m # CONFIG_NET_KEY_MIGRATE is not set CONFIG_INET=y CONFIG_IP_MULTICAST=y CONFIG_IP_ADVANCED_ROUTER=y CONFIG_IP_FIB_TRIE_STATS=y CONFIG_IP_MULTIPLE_TABLES=y CONFIG_IP_ROUTE_MULTIPATH=y CONFIG_IP_ROUTE_VERBOSE=y CONFIG_IP_ROUTE_CLASSID=y CONFIG_IP_PNP=y # CONFIG_IP_PNP_DHCP is not set # CONFIG_IP_PNP_BOOTP is not set # CONFIG_IP_PNP_RARP is not set CONFIG_NET_IPIP=m CONFIG_NET_IPGRE_DEMUX=y CONFIG_NET_IPGRE=m CONFIG_NET_IPGRE_BROADCAST=y CONFIG_IP_MROUTE=y CONFIG_IP_MROUTE_MULTIPLE_TABLES=y CONFIG_IP_PIMSM_V1=y CONFIG_IP_PIMSM_V2=y # CONFIG_ARPD is not set CONFIG_SYN_COOKIES=y CONFIG_INET_AH=m CONFIG_INET_ESP=m CONFIG_INET_IPCOMP=m CONFIG_INET_XFRM_TUNNEL=m CONFIG_INET_TUNNEL=m CONFIG_INET_XFRM_MODE_TRANSPORT=y CONFIG_INET_XFRM_MODE_TUNNEL=y CONFIG_INET_XFRM_MODE_BEET=y CONFIG_INET_LRO=y CONFIG_INET_DIAG=y CONFIG_INET_TCP_DIAG=y CONFIG_TCP_CONG_ADVANCED=y CONFIG_TCP_CONG_BIC=m CONFIG_TCP_CONG_CUBIC=y CONFIG_TCP_CONG_WESTWOOD=m CONFIG_TCP_CONG_HTCP=m # CONFIG_TCP_CONG_HSTCP is not set # CONFIG_TCP_CONG_HYBLA is not set # CONFIG_TCP_CONG_VEGAS is not set # CONFIG_TCP_CONG_SCALABLE is not set # CONFIG_TCP_CONG_LP is not set # CONFIG_TCP_CONG_VENO is not set # CONFIG_TCP_CONG_YEAH is not set # CONFIG_TCP_CONG_ILLINOIS is not set CONFIG_DEFAULT_CUBIC=y # CONFIG_DEFAULT_RENO is not set CONFIG_DEFAULT_TCP_CONG="cubic" # CONFIG_TCP_MD5SIG is not set CONFIG_IPV6=m CONFIG_IPV6_PRIVACY=y CONFIG_IPV6_ROUTER_PREF=y CONFIG_IPV6_ROUTE_INFO=y CONFIG_IPV6_OPTIMISTIC_DAD=y CONFIG_INET6_AH=m CONFIG_INET6_ESP=m CONFIG_INET6_IPCOMP=m # CONFIG_IPV6_MIP6 is not set CONFIG_INET6_XFRM_TUNNEL=m CONFIG_INET6_TUNNEL=m CONFIG_INET6_XFRM_MODE_TRANSPORT=m CONFIG_INET6_XFRM_MODE_TUNNEL=m CONFIG_INET6_XFRM_MODE_BEET=m CONFIG_INET6_XFRM_MODE_ROUTEOPTIMIZATION=m CONFIG_IPV6_SIT=m # CONFIG_IPV6_SIT_6RD is not set CONFIG_IPV6_NDISC_NODETYPE=y CONFIG_IPV6_TUNNEL=m CONFIG_IPV6_MULTIPLE_TABLES=y CONFIG_IPV6_SUBTREES=y CONFIG_IPV6_MROUTE=y CONFIG_IPV6_MROUTE_MULTIPLE_TABLES=y CONFIG_IPV6_PIMSM_V2=y CONFIG_NETWORK_SECMARK=y CONFIG_NETWORK_PHY_TIMESTAMPING=y CONFIG_NETFILTER=y # CONFIG_NETFILTER_DEBUG is not set CONFIG_NETFILTER_ADVANCED=y CONFIG_BRIDGE_NETFILTER=y # # Core Netfilter Configuration # CONFIG_NETFILTER_NETLINK=y CONFIG_NETFILTER_NETLINK_QUEUE=y CONFIG_NETFILTER_NETLINK_LOG=y # CONFIG_NF_CONNTRACK is not set CONFIG_NETFILTER_XTABLES=m # # Xtables combined modules # CONFIG_NETFILTER_XT_MARK=m # # Xtables targets # # CONFIG_NETFILTER_XT_TARGET_AUDIT is not set CONFIG_NETFILTER_XT_TARGET_CLASSIFY=m CONFIG_NETFILTER_XT_TARGET_IDLETIMER=m CONFIG_NETFILTER_XT_TARGET_LED=m CONFIG_NETFILTER_XT_TARGET_MARK=m CONFIG_NETFILTER_XT_TARGET_NFLOG=m CONFIG_NETFILTER_XT_TARGET_NFQUEUE=m CONFIG_NETFILTER_XT_TARGET_RATEEST=m CONFIG_NETFILTER_XT_TARGET_TEE=m CONFIG_NETFILTER_XT_TARGET_SECMARK=m CONFIG_NETFILTER_XT_TARGET_TCPMSS=m # # Xtables matches # # CONFIG_NETFILTER_XT_MATCH_ADDRTYPE is not set CONFIG_NETFILTER_XT_MATCH_COMMENT=m CONFIG_NETFILTER_XT_MATCH_CPU=m CONFIG_NETFILTER_XT_MATCH_DCCP=m # CONFIG_NETFILTER_XT_MATCH_DEVGROUP is not set CONFIG_NETFILTER_XT_MATCH_DSCP=m CONFIG_NETFILTER_XT_MATCH_ESP=m CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=m CONFIG_NETFILTER_XT_MATCH_HL=m CONFIG_NETFILTER_XT_MATCH_IPRANGE=m CONFIG_NETFILTER_XT_MATCH_LENGTH=m CONFIG_NETFILTER_XT_MATCH_LIMIT=m CONFIG_NETFILTER_XT_MATCH_MAC=m CONFIG_NETFILTER_XT_MATCH_MARK=m CONFIG_NETFILTER_XT_MATCH_MULTIPORT=m # CONFIG_NETFILTER_XT_MATCH_OSF is not set CONFIG_NETFILTER_XT_MATCH_OWNER=m CONFIG_NETFILTER_XT_MATCH_POLICY=m CONFIG_NETFILTER_XT_MATCH_PHYSDEV=m CONFIG_NETFILTER_XT_MATCH_PKTTYPE=m CONFIG_NETFILTER_XT_MATCH_QUOTA=m CONFIG_NETFILTER_XT_MATCH_RATEEST=m CONFIG_NETFILTER_XT_MATCH_REALM=m CONFIG_NETFILTER_XT_MATCH_RECENT=m CONFIG_NETFILTER_XT_MATCH_SCTP=m CONFIG_NETFILTER_XT_MATCH_STATISTIC=m CONFIG_NETFILTER_XT_MATCH_STRING=m CONFIG_NETFILTER_XT_MATCH_TCPMSS=m CONFIG_NETFILTER_XT_MATCH_TIME=m CONFIG_NETFILTER_XT_MATCH_U32=m # CONFIG_IP_SET is not set # CONFIG_IP_VS is not set # # IP: Netfilter Configuration # # CONFIG_NF_DEFRAG_IPV4 is not set CONFIG_IP_NF_QUEUE=m # CONFIG_IP_NF_IPTABLES is not set # CONFIG_IP_NF_ARPTABLES is not set # # IPv6: Netfilter Configuration # # CONFIG_NF_DEFRAG_IPV6 is not set # CONFIG_IP6_NF_QUEUE is not set # CONFIG_IP6_NF_IPTABLES is not set # # DECnet: Netfilter Configuration # # CONFIG_DECNET_NF_GRABULATOR is not set CONFIG_BRIDGE_NF_EBTABLES=m CONFIG_BRIDGE_EBT_BROUTE=m CONFIG_BRIDGE_EBT_T_FILTER=m CONFIG_BRIDGE_EBT_T_NAT=m CONFIG_BRIDGE_EBT_802_3=m CONFIG_BRIDGE_EBT_AMONG=m CONFIG_BRIDGE_EBT_ARP=m CONFIG_BRIDGE_EBT_IP=m CONFIG_BRIDGE_EBT_IP6=m CONFIG_BRIDGE_EBT_LIMIT=m CONFIG_BRIDGE_EBT_MARK=m CONFIG_BRIDGE_EBT_PKTTYPE=m CONFIG_BRIDGE_EBT_STP=m CONFIG_BRIDGE_EBT_VLAN=m CONFIG_BRIDGE_EBT_ARPREPLY=m CONFIG_BRIDGE_EBT_DNAT=m CONFIG_BRIDGE_EBT_MARK_T=m CONFIG_BRIDGE_EBT_REDIRECT=m CONFIG_BRIDGE_EBT_SNAT=m CONFIG_BRIDGE_EBT_LOG=m CONFIG_BRIDGE_EBT_ULOG=m CONFIG_BRIDGE_EBT_NFLOG=m # CONFIG_IP_DCCP is not set CONFIG_IP_SCTP=m CONFIG_NET_SCTPPROBE=m # CONFIG_SCTP_DBG_MSG is not set # CONFIG_SCTP_DBG_OBJCNT is not set # CONFIG_SCTP_HMAC_NONE is not set # CONFIG_SCTP_HMAC_SHA1 is not set CONFIG_SCTP_HMAC_MD5=y CONFIG_RDS=y CONFIG_RDS_TCP=y # CONFIG_RDS_DEBUG is not set # CONFIG_TIPC is not set # CONFIG_ATM is not set CONFIG_L2TP=m CONFIG_L2TP_DEBUGFS=m CONFIG_L2TP_V3=y CONFIG_L2TP_IP=m CONFIG_L2TP_ETH=m CONFIG_STP=m CONFIG_GARP=m CONFIG_BRIDGE=m CONFIG_BRIDGE_IGMP_SNOOPING=y # CONFIG_NET_DSA is not set CONFIG_VLAN_8021Q=m CONFIG_VLAN_8021Q_GVRP=y CONFIG_DECNET=m CONFIG_DECNET_ROUTER=y CONFIG_LLC=y # CONFIG_LLC2 is not set CONFIG_IPX=m # CONFIG_IPX_INTERN is not set CONFIG_ATALK=m CONFIG_DEV_APPLETALK=m CONFIG_IPDDP=m CONFIG_IPDDP_ENCAP=y CONFIG_IPDDP_DECAP=y # CONFIG_X25 is not set # CONFIG_LAPB is not set # CONFIG_ECONET is not set # CONFIG_WAN_ROUTER is not set # CONFIG_PHONET is not set # CONFIG_IEEE802154 is not set CONFIG_NET_SCHED=y # # Queueing/Scheduling # CONFIG_NET_SCH_CBQ=m CONFIG_NET_SCH_HTB=m CONFIG_NET_SCH_HFSC=m CONFIG_NET_SCH_PRIO=y CONFIG_NET_SCH_MULTIQ=y CONFIG_NET_SCH_RED=m # CONFIG_NET_SCH_SFB is not set CONFIG_NET_SCH_SFQ=m CONFIG_NET_SCH_TEQL=m CONFIG_NET_SCH_TBF=m CONFIG_NET_SCH_GRED=m CONFIG_NET_SCH_DSMARK=m CONFIG_NET_SCH_NETEM=m CONFIG_NET_SCH_DRR=m # CONFIG_NET_SCH_MQPRIO is not set # CONFIG_NET_SCH_CHOKE is not set CONFIG_NET_SCH_INGRESS=m # # Classification # CONFIG_NET_CLS=y CONFIG_NET_CLS_BASIC=m CONFIG_NET_CLS_TCINDEX=m CONFIG_NET_CLS_ROUTE4=m CONFIG_NET_CLS_FW=m CONFIG_NET_CLS_U32=m CONFIG_CLS_U32_PERF=y CONFIG_CLS_U32_MARK=y CONFIG_NET_CLS_RSVP=m CONFIG_NET_CLS_RSVP6=m # CONFIG_NET_CLS_FLOW is not set CONFIG_NET_CLS_CGROUP=y CONFIG_NET_EMATCH=y CONFIG_NET_EMATCH_STACK=32 CONFIG_NET_EMATCH_CMP=m CONFIG_NET_EMATCH_NBYTE=m CONFIG_NET_EMATCH_U32=m CONFIG_NET_EMATCH_META=m # CONFIG_NET_EMATCH_TEXT is not set CONFIG_NET_CLS_ACT=y CONFIG_NET_ACT_POLICE=y CONFIG_NET_ACT_GACT=y CONFIG_GACT_PROB=y CONFIG_NET_ACT_MIRRED=y CONFIG_NET_ACT_NAT=y CONFIG_NET_ACT_PEDIT=y # CONFIG_NET_ACT_SIMP is not set # CONFIG_NET_ACT_SKBEDIT is not set # CONFIG_NET_ACT_CSUM is not set CONFIG_NET_CLS_IND=y CONFIG_NET_SCH_FIFO=y CONFIG_DCB=y CONFIG_DNS_RESOLVER=y # CONFIG_BATMAN_ADV is not set CONFIG_RPS=y CONFIG_RFS_ACCEL=y CONFIG_XPS=y # # Network testing # # CONFIG_NET_PKTGEN is not set CONFIG_NET_TCPPROBE=m CONFIG_NET_DROP_MONITOR=y # CONFIG_HAMRADIO is not set # CONFIG_CAN is not set CONFIG_IRDA=m # # IrDA protocols # CONFIG_IRLAN=m CONFIG_IRNET=m CONFIG_IRCOMM=m # CONFIG_IRDA_ULTRA is not set # # IrDA options # CONFIG_IRDA_CACHE_LAST_LSAP=y CONFIG_IRDA_FAST_RR=y # CONFIG_IRDA_DEBUG is not set # # Infrared-port device drivers # # # SIR device drivers # CONFIG_IRTTY_SIR=m # # Dongle support # CONFIG_DONGLE=y CONFIG_ESI_DONGLE=m CONFIG_ACTISYS_DONGLE=m CONFIG_TEKRAM_DONGLE=m # CONFIG_TOIM3232_DONGLE is not set CONFIG_LITELINK_DONGLE=m CONFIG_MA600_DONGLE=m CONFIG_GIRBIL_DONGLE=m CONFIG_MCP2120_DONGLE=m CONFIG_OLD_BELKIN_DONGLE=m CONFIG_ACT200L_DONGLE=m # CONFIG_KINGSUN_DONGLE is not set # CONFIG_KSDAZZLE_DONGLE is not set # CONFIG_KS959_DONGLE is not set # # FIR device drivers # CONFIG_USB_IRDA=m CONFIG_SIGMATEL_FIR=m CONFIG_NSC_FIR=m CONFIG_WINBOND_FIR=m CONFIG_SMC_IRCC_FIR=m CONFIG_ALI_FIR=m CONFIG_VLSI_FIR=m CONFIG_VIA_FIR=m # CONFIG_MCS_FIR is not set CONFIG_BT=m # CONFIG_BT_L2CAP is not set # CONFIG_BT_SCO is not set # # Bluetooth device drivers # # CONFIG_BT_HCIBTUSB is not set CONFIG_BT_HCIUART=m CONFIG_BT_HCIUART_H4=y CONFIG_BT_HCIUART_BCSP=y # CONFIG_BT_HCIUART_ATH3K is not set # CONFIG_BT_HCIUART_LL is not set CONFIG_BT_HCIBCM203X=m CONFIG_BT_HCIBPA10X=m CONFIG_BT_HCIBFUSB=m CONFIG_BT_HCIDTL1=m CONFIG_BT_HCIBT3C=m CONFIG_BT_HCIBLUECARD=m CONFIG_BT_HCIBTUART=m CONFIG_BT_HCIVHCI=m CONFIG_BT_MRVL=m # CONFIG_BT_WILINK is not set CONFIG_AF_RXRPC=y # CONFIG_AF_RXRPC_DEBUG is not set CONFIG_RXKAD=y CONFIG_FIB_RULES=y # CONFIG_WIRELESS is not set # CONFIG_WIMAX is not set CONFIG_RFKILL=y CONFIG_RFKILL_LEDS=y CONFIG_RFKILL_INPUT=y # CONFIG_NET_9P is not set # CONFIG_CAIF is not set # CONFIG_CEPH_LIB is not set # # Device Drivers # # # Generic Driver Options # CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug" # CONFIG_DEVTMPFS is not set CONFIG_STANDALONE=y CONFIG_PREVENT_FIRMWARE_BUILD=y CONFIG_FW_LOADER=y # CONFIG_FIRMWARE_IN_KERNEL is not set CONFIG_EXTRA_FIRMWARE="" # CONFIG_DEBUG_DRIVER is not set # CONFIG_DEBUG_DEVRES is not set # CONFIG_SYS_HYPERVISOR is not set CONFIG_ARCH_NO_SYSDEV_OPS=y CONFIG_CONNECTOR=m CONFIG_MTD=m # CONFIG_MTD_DEBUG is not set # CONFIG_MTD_TESTS is not set CONFIG_MTD_PARTITIONS=y CONFIG_MTD_REDBOOT_PARTS=m CONFIG_MTD_REDBOOT_DIRECTORY_BLOCK=-1 # CONFIG_MTD_REDBOOT_PARTS_UNALLOCATED is not set # CONFIG_MTD_REDBOOT_PARTS_READONLY is not set # CONFIG_MTD_AR7_PARTS is not set # # User Modules And Translation Layers # CONFIG_MTD_CHAR=m CONFIG_MTD_BLKDEVS=m CONFIG_MTD_BLOCK=m CONFIG_MTD_BLOCK_RO=m CONFIG_FTL=m CONFIG_NFTL=m CONFIG_NFTL_RW=y CONFIG_INFTL=m # CONFIG_RFD_FTL is not set # CONFIG_SSFDC is not set CONFIG_SM_FTL=m # CONFIG_MTD_OOPS is not set # CONFIG_MTD_SWAP is not set # # RAM/ROM/Flash chip drivers # CONFIG_MTD_CFI=m CONFIG_MTD_JEDECPROBE=m CONFIG_MTD_GEN_PROBE=m # CONFIG_MTD_CFI_ADV_OPTIONS is not set CONFIG_MTD_MAP_BANK_WIDTH_1=y CONFIG_MTD_MAP_BANK_WIDTH_2=y CONFIG_MTD_MAP_BANK_WIDTH_4=y # CONFIG_MTD_MAP_BANK_WIDTH_8 is not set # CONFIG_MTD_MAP_BANK_WIDTH_16 is not set # CONFIG_MTD_MAP_BANK_WIDTH_32 is not set CONFIG_MTD_CFI_I1=y CONFIG_MTD_CFI_I2=y # CONFIG_MTD_CFI_I4 is not set # CONFIG_MTD_CFI_I8 is not set CONFIG_MTD_CFI_INTELEXT=m CONFIG_MTD_CFI_AMDSTD=m CONFIG_MTD_CFI_STAA=m CONFIG_MTD_CFI_UTIL=m CONFIG_MTD_RAM=m CONFIG_MTD_ROM=m CONFIG_MTD_ABSENT=m # # Mapping drivers for chip access # CONFIG_MTD_COMPLEX_MAPPINGS=y # CONFIG_MTD_PHYSMAP is not set # CONFIG_MTD_SC520CDP is not set CONFIG_MTD_NETSC520=m CONFIG_MTD_TS5500=m CONFIG_MTD_SBC_GXX=m # CONFIG_MTD_AMD76XROM is not set # CONFIG_MTD_ICHXROM is not set # CONFIG_MTD_ESB2ROM is not set # CONFIG_MTD_CK804XROM is not set CONFIG_MTD_SCB2_FLASH=m # CONFIG_MTD_NETtel is not set # CONFIG_MTD_L440GX is not set CONFIG_MTD_PCI=m CONFIG_MTD_PCMCIA=m # CONFIG_MTD_PCMCIA_ANONYMOUS is not set CONFIG_MTD_GPIO_ADDR=m # CONFIG_MTD_INTEL_VR_NOR is not set # CONFIG_MTD_PLATRAM is not set # CONFIG_MTD_LATCH_ADDR is not set # # Self-contained MTD device drivers # CONFIG_MTD_PMC551=m # CONFIG_MTD_PMC551_BUGFIX is not set # CONFIG_MTD_PMC551_DEBUG is not set # CONFIG_MTD_DATAFLASH is not set # CONFIG_MTD_M25P80 is not set # CONFIG_MTD_SST25L is not set # CONFIG_MTD_SLRAM is not set # CONFIG_MTD_PHRAM is not set CONFIG_MTD_MTDRAM=m CONFIG_MTDRAM_TOTAL_SIZE=4096 CONFIG_MTDRAM_ERASE_SIZE=128 CONFIG_MTD_BLOCK2MTD=m # # Disk-On-Chip Device Drivers # CONFIG_MTD_DOC2000=m # CONFIG_MTD_DOC2001 is not set CONFIG_MTD_DOC2001PLUS=m CONFIG_MTD_DOCPROBE=m CONFIG_MTD_DOCECC=m # CONFIG_MTD_DOCPROBE_ADVANCED is not set CONFIG_MTD_DOCPROBE_ADDRESS=0 CONFIG_MTD_NAND_ECC=m # CONFIG_MTD_NAND_ECC_SMC is not set CONFIG_MTD_NAND=m # CONFIG_MTD_NAND_VERIFY_WRITE is not set CONFIG_MTD_NAND_BCH=m CONFIG_MTD_NAND_ECC_BCH=y # CONFIG_MTD_SM_COMMON is not set # CONFIG_MTD_NAND_MUSEUM_IDS is not set # CONFIG_MTD_NAND_DENALI is not set CONFIG_MTD_NAND_IDS=m # CONFIG_MTD_NAND_RICOH is not set # CONFIG_MTD_NAND_DISKONCHIP is not set # CONFIG_MTD_NAND_CAFE is not set # CONFIG_MTD_NAND_NANDSIM is not set # CONFIG_MTD_NAND_PLATFORM is not set # CONFIG_MTD_ALAUDA is not set # CONFIG_MTD_ONENAND is not set # # LPDDR flash memory drivers # # CONFIG_MTD_LPDDR is not set CONFIG_MTD_UBI=m CONFIG_MTD_UBI_WL_THRESHOLD=4096 CONFIG_MTD_UBI_BEB_RESERVE=1 CONFIG_MTD_UBI_GLUEBI=m # CONFIG_MTD_UBI_DEBUG is not set # CONFIG_PARPORT is not set CONFIG_PNP=y CONFIG_PNP_DEBUG_MESSAGES=y # # Protocols # CONFIG_PNPACPI=y CONFIG_BLK_DEV=y CONFIG_BLK_DEV_FD=m CONFIG_BLK_CPQ_DA=m CONFIG_BLK_CPQ_CISS_DA=m CONFIG_CISS_SCSI_TAPE=y CONFIG_BLK_DEV_DAC960=m CONFIG_BLK_DEV_UMEM=m # CONFIG_BLK_DEV_COW_COMMON is not set CONFIG_BLK_DEV_LOOP=m CONFIG_BLK_DEV_CRYPTOLOOP=m # CONFIG_BLK_DEV_DRBD is not set CONFIG_BLK_DEV_NBD=m CONFIG_BLK_DEV_SX8=m # CONFIG_BLK_DEV_UB is not set CONFIG_BLK_DEV_RAM=y CONFIG_BLK_DEV_RAM_COUNT=16 CONFIG_BLK_DEV_RAM_SIZE=16384 # CONFIG_BLK_DEV_XIP is not set CONFIG_CDROM_PKTCDVD=m CONFIG_CDROM_PKTCDVD_BUFFERS=8 # CONFIG_CDROM_PKTCDVD_WCACHE is not set CONFIG_ATA_OVER_ETH=m # CONFIG_VIRTIO_BLK is not set # CONFIG_BLK_DEV_HD is not set # CONFIG_BLK_DEV_RBD is not set # CONFIG_SENSORS_LIS3LV02D is not set CONFIG_MISC_DEVICES=y # CONFIG_AD525X_DPOT is not set # CONFIG_IBM_ASM is not set # CONFIG_PHANTOM is not set # CONFIG_SGI_IOC4 is not set # CONFIG_TIFM_CORE is not set # CONFIG_ICS932S401 is not set # CONFIG_ENCLOSURE_SERVICES is not set # CONFIG_CS5535_MFGPT is not set # CONFIG_HP_ILO is not set # CONFIG_APDS9802ALS is not set # CONFIG_ISL29003 is not set # CONFIG_ISL29020 is not set # CONFIG_SENSORS_TSL2550 is not set # CONFIG_SENSORS_BH1780 is not set # CONFIG_SENSORS_BH1770 is not set # CONFIG_SENSORS_APDS990X is not set # CONFIG_HMC6352 is not set # CONFIG_DS1682 is not set # CONFIG_TI_DAC7512 is not set # CONFIG_VMWARE_BALLOON is not set # CONFIG_BMP085 is not set # CONFIG_PCH_PHUB is not set # CONFIG_C2PORT is not set # # EEPROM support # CONFIG_EEPROM_AT24=y # CONFIG_EEPROM_AT25 is not set CONFIG_EEPROM_LEGACY=y # CONFIG_EEPROM_MAX6875 is not set # CONFIG_EEPROM_93CX6 is not set # CONFIG_CB710_CORE is not set # # Texas Instruments shared transport line discipline # CONFIG_TI_ST=y # CONFIG_SENSORS_LIS3_I2C is not set CONFIG_HAVE_IDE=y CONFIG_IDE=m # # Please see Documentation/ide/ide.txt for help/info on IDE drives # CONFIG_IDE_XFER_MODE=y CONFIG_IDE_TIMINGS=y CONFIG_IDE_ATAPI=y # CONFIG_BLK_DEV_IDE_SATA is not set CONFIG_IDE_GD=m CONFIG_IDE_GD_ATA=y CONFIG_IDE_GD_ATAPI=y CONFIG_BLK_DEV_IDECS=m # CONFIG_BLK_DEV_DELKIN is not set CONFIG_BLK_DEV_IDECD=m CONFIG_BLK_DEV_IDECD_VERBOSE_ERRORS=y # CONFIG_BLK_DEV_IDETAPE is not set # CONFIG_BLK_DEV_IDEACPI is not set # CONFIG_IDE_TASK_IOCTL is not set CONFIG_IDE_PROC_FS=y # # IDE chipset support/bugfixes # CONFIG_IDE_GENERIC=m CONFIG_BLK_DEV_PLATFORM=m CONFIG_BLK_DEV_CMD640=m CONFIG_BLK_DEV_CMD640_ENHANCED=y # CONFIG_BLK_DEV_IDEPNP is not set CONFIG_BLK_DEV_IDEDMA_SFF=y # # PCI IDE chipsets support # CONFIG_BLK_DEV_IDEPCI=y # CONFIG_BLK_DEV_OFFBOARD is not set CONFIG_BLK_DEV_GENERIC=m # CONFIG_BLK_DEV_OPTI621 is not set CONFIG_BLK_DEV_RZ1000=m CONFIG_BLK_DEV_IDEDMA_PCI=y CONFIG_BLK_DEV_AEC62XX=m CONFIG_BLK_DEV_ALI15X3=m CONFIG_BLK_DEV_AMD74XX=m CONFIG_BLK_DEV_ATIIXP=m CONFIG_BLK_DEV_CMD64X=m CONFIG_BLK_DEV_TRIFLEX=m CONFIG_BLK_DEV_CS5520=m CONFIG_BLK_DEV_CS5530=m CONFIG_BLK_DEV_HPT366=m # CONFIG_BLK_DEV_JMICRON is not set # CONFIG_BLK_DEV_SC1200 is not set CONFIG_BLK_DEV_PIIX=m # CONFIG_BLK_DEV_IT8172 is not set # CONFIG_BLK_DEV_IT8213 is not set CONFIG_BLK_DEV_IT821X=m # CONFIG_BLK_DEV_NS87415 is not set CONFIG_BLK_DEV_PDC202XX_OLD=m CONFIG_BLK_DEV_PDC202XX_NEW=m CONFIG_BLK_DEV_SVWKS=m CONFIG_BLK_DEV_SIIMAGE=m CONFIG_BLK_DEV_SIS5513=m CONFIG_BLK_DEV_SLC90E66=m # CONFIG_BLK_DEV_TRM290 is not set CONFIG_BLK_DEV_VIA82CXXX=m # CONFIG_BLK_DEV_TC86C001 is not set CONFIG_BLK_DEV_IDEDMA=y # # SCSI device support # CONFIG_SCSI_MOD=y CONFIG_RAID_ATTRS=y CONFIG_SCSI=y CONFIG_SCSI_DMA=y # CONFIG_SCSI_TGT is not set CONFIG_SCSI_NETLINK=y CONFIG_SCSI_PROC_FS=y # # SCSI support type (disk, tape, CD-ROM) # CONFIG_BLK_DEV_SD=y CONFIG_CHR_DEV_ST=m CONFIG_CHR_DEV_OSST=m CONFIG_BLK_DEV_SR=m CONFIG_BLK_DEV_SR_VENDOR=y CONFIG_CHR_DEV_SG=m # CONFIG_CHR_DEV_SCH is not set CONFIG_SCSI_MULTI_LUN=y CONFIG_SCSI_CONSTANTS=y CONFIG_SCSI_LOGGING=y # CONFIG_SCSI_SCAN_ASYNC is not set CONFIG_SCSI_WAIT_SCAN=m # # SCSI Transports # CONFIG_SCSI_SPI_ATTRS=m CONFIG_SCSI_FC_ATTRS=y CONFIG_SCSI_ISCSI_ATTRS=m # CONFIG_SCSI_SAS_ATTRS is not set # CONFIG_SCSI_SAS_LIBSAS is not set CONFIG_SCSI_SRP_ATTRS=y CONFIG_SCSI_LOWLEVEL=y CONFIG_ISCSI_TCP=m CONFIG_ISCSI_BOOT_SYSFS=y # CONFIG_SCSI_CXGB3_ISCSI is not set # CONFIG_SCSI_CXGB4_ISCSI is not set # CONFIG_SCSI_BNX2_ISCSI is not set # CONFIG_SCSI_BNX2X_FCOE is not set # CONFIG_BE2ISCSI is not set # CONFIG_BLK_DEV_3W_XXXX_RAID is not set # CONFIG_SCSI_HPSA is not set # CONFIG_SCSI_3W_9XXX is not set # CONFIG_SCSI_3W_SAS is not set # CONFIG_SCSI_ACARD is not set CONFIG_SCSI_AACRAID=m CONFIG_SCSI_AIC7XXX=m CONFIG_AIC7XXX_CMDS_PER_DEVICE=4 CONFIG_AIC7XXX_RESET_DELAY_MS=15000 # CONFIG_AIC7XXX_DEBUG_ENABLE is not set CONFIG_AIC7XXX_DEBUG_MASK=0 # CONFIG_AIC7XXX_REG_PRETTY_PRINT is not set CONFIG_SCSI_AIC7XXX_OLD=m CONFIG_SCSI_AIC79XX=m CONFIG_AIC79XX_CMDS_PER_DEVICE=4 CONFIG_AIC79XX_RESET_DELAY_MS=15000 # CONFIG_AIC79XX_DEBUG_ENABLE is not set CONFIG_AIC79XX_DEBUG_MASK=0 # CONFIG_AIC79XX_REG_PRETTY_PRINT is not set # CONFIG_SCSI_AIC94XX is not set # CONFIG_SCSI_MVSAS is not set # CONFIG_SCSI_DPT_I2O is not set # CONFIG_SCSI_ADVANSYS is not set # CONFIG_SCSI_ARCMSR is not set CONFIG_MEGARAID_NEWGEN=y CONFIG_MEGARAID_MM=m CONFIG_MEGARAID_MAILBOX=m CONFIG_MEGARAID_LEGACY=y CONFIG_MEGARAID_SAS=y # CONFIG_SCSI_MPT2SAS is not set # CONFIG_SCSI_HPTIOP is not set CONFIG_SCSI_BUSLOGIC=y # CONFIG_VMWARE_PVSCSI is not set CONFIG_LIBFC=y CONFIG_LIBFCOE=y # CONFIG_FCOE is not set # CONFIG_FCOE_FNIC is not set # CONFIG_SCSI_DMX3191D is not set # CONFIG_SCSI_EATA is not set # CONFIG_SCSI_FUTURE_DOMAIN is not set CONFIG_SCSI_GDTH=m CONFIG_SCSI_IPS=m CONFIG_SCSI_INITIO=m CONFIG_SCSI_INIA100=m # CONFIG_SCSI_STEX is not set CONFIG_SCSI_SYM53C8XX_2=m CONFIG_SCSI_SYM53C8XX_DMA_ADDRESSING_MODE=1 CONFIG_SCSI_SYM53C8XX_DEFAULT_TAGS=16 CONFIG_SCSI_SYM53C8XX_MAX_TAGS=64 CONFIG_SCSI_SYM53C8XX_MMIO=y # CONFIG_SCSI_IPR is not set CONFIG_SCSI_QLOGIC_1280=m # CONFIG_SCSI_QLA_FC is not set # CONFIG_SCSI_QLA_ISCSI is not set CONFIG_SCSI_LPFC=m # CONFIG_SCSI_LPFC_DEBUG_FS is not set # CONFIG_SCSI_DC395x is not set CONFIG_SCSI_DC390T=m # CONFIG_SCSI_DEBUG is not set # CONFIG_SCSI_PMCRAID is not set # CONFIG_SCSI_PM8001 is not set # CONFIG_SCSI_SRP is not set # CONFIG_SCSI_BFA_FC is not set # CONFIG_SCSI_LOWLEVEL_PCMCIA is not set # CONFIG_SCSI_DH is not set # CONFIG_SCSI_OSD_INITIATOR is not set CONFIG_ATA=m # CONFIG_ATA_NONSTANDARD is not set CONFIG_ATA_VERBOSE_ERROR=y CONFIG_ATA_ACPI=y CONFIG_SATA_PMP=y # # Controllers with non-SFF native interface # CONFIG_SATA_AHCI=m # CONFIG_SATA_AHCI_PLATFORM is not set # CONFIG_SATA_INIC162X is not set # CONFIG_SATA_ACARD_AHCI is not set CONFIG_SATA_SIL24=m CONFIG_ATA_SFF=y # # SFF controllers with custom DMA interface # # CONFIG_PDC_ADMA is not set # CONFIG_SATA_QSTOR is not set # CONFIG_SATA_SX4 is not set CONFIG_ATA_BMDMA=y # # SATA SFF controllers with BMDMA # CONFIG_ATA_PIIX=m # CONFIG_SATA_MV is not set # CONFIG_SATA_NV is not set # CONFIG_SATA_PROMISE is not set # CONFIG_SATA_SIL is not set # CONFIG_SATA_SIS is not set # CONFIG_SATA_SVW is not set # CONFIG_SATA_ULI is not set # CONFIG_SATA_VIA is not set # CONFIG_SATA_VITESSE is not set # # PATA SFF controllers with BMDMA # # CONFIG_PATA_ALI is not set # CONFIG_PATA_AMD is not set # CONFIG_PATA_ARASAN_CF is not set # CONFIG_PATA_ARTOP is not set # CONFIG_PATA_ATIIXP is not set # CONFIG_PATA_ATP867X is not set # CONFIG_PATA_CMD64X is not set # CONFIG_PATA_CS5520 is not set # CONFIG_PATA_CS5530 is not set # CONFIG_PATA_CS5536 is not set # CONFIG_PATA_CYPRESS is not set # CONFIG_PATA_EFAR is not set # CONFIG_PATA_HPT366 is not set # CONFIG_PATA_HPT37X is not set # CONFIG_PATA_HPT3X2N is not set # CONFIG_PATA_HPT3X3 is not set # CONFIG_PATA_IT8213 is not set # CONFIG_PATA_IT821X is not set # CONFIG_PATA_JMICRON is not set # CONFIG_PATA_MARVELL is not set # CONFIG_PATA_NETCELL is not set # CONFIG_PATA_NINJA32 is not set # CONFIG_PATA_NS87415 is not set # CONFIG_PATA_OLDPIIX is not set # CONFIG_PATA_OPTIDMA is not set # CONFIG_PATA_PDC2027X is not set # CONFIG_PATA_PDC_OLD is not set # CONFIG_PATA_RADISYS is not set # CONFIG_PATA_RDC is not set # CONFIG_PATA_SC1200 is not set # CONFIG_PATA_SCH is not set # CONFIG_PATA_SERVERWORKS is not set # CONFIG_PATA_SIL680 is not set # CONFIG_PATA_SIS is not set # CONFIG_PATA_TOSHIBA is not set # CONFIG_PATA_TRIFLEX is not set # CONFIG_PATA_VIA is not set # CONFIG_PATA_WINBOND is not set # # PIO-only SFF controllers # # CONFIG_PATA_CMD640_PCI is not set # CONFIG_PATA_MPIIX is not set # CONFIG_PATA_NS87410 is not set # CONFIG_PATA_OPTI is not set # CONFIG_PATA_PCMCIA is not set # CONFIG_PATA_RZ1000 is not set # # Generic fallback / legacy drivers # # CONFIG_PATA_ACPI is not set # CONFIG_ATA_GENERIC is not set # CONFIG_PATA_LEGACY is not set CONFIG_MD=y CONFIG_BLK_DEV_MD=y CONFIG_MD_AUTODETECT=y CONFIG_MD_LINEAR=m CONFIG_MD_RAID0=m CONFIG_MD_RAID1=m CONFIG_MD_RAID10=m # CONFIG_MD_RAID456 is not set CONFIG_MD_MULTIPATH=m CONFIG_MD_FAULTY=m CONFIG_BLK_DEV_DM=y # CONFIG_DM_DEBUG is not set CONFIG_DM_CRYPT=m CONFIG_DM_SNAPSHOT=m CONFIG_DM_MIRROR=m # CONFIG_DM_RAID is not set CONFIG_DM_LOG_USERSPACE=m CONFIG_DM_ZERO=m CONFIG_DM_MULTIPATH=m CONFIG_DM_MULTIPATH_QL=m CONFIG_DM_MULTIPATH_ST=m # CONFIG_DM_DELAY is not set CONFIG_DM_UEVENT=y CONFIG_DM_FLAKEY=y CONFIG_TARGET_CORE=y CONFIG_TCM_IBLOCK=y CONFIG_TCM_FILEIO=y CONFIG_TCM_PSCSI=y CONFIG_LOOPBACK_TARGET=m CONFIG_LOOPBACK_TARGET_CDB_DEBUG=y # CONFIG_FUSION is not set # # IEEE 1394 (FireWire) support # # CONFIG_FIREWIRE is not set # CONFIG_FIREWIRE_NOSY is not set # CONFIG_I2O is not set # CONFIG_MACINTOSH_DRIVERS is not set CONFIG_NETDEVICES=y CONFIG_IFB=y CONFIG_DUMMY=m CONFIG_BONDING=m CONFIG_MACVLAN=y # CONFIG_MACVTAP is not set CONFIG_EQUALIZER=m CONFIG_TUN=m CONFIG_VETH=m # CONFIG_NET_SB1000 is not set # CONFIG_ARCNET is not set CONFIG_MII=m CONFIG_PHYLIB=m # # MII PHY device drivers # CONFIG_MARVELL_PHY=m CONFIG_DAVICOM_PHY=m CONFIG_QSEMI_PHY=m CONFIG_LXT_PHY=m CONFIG_CICADA_PHY=m CONFIG_VITESSE_PHY=m CONFIG_SMSC_PHY=m CONFIG_BROADCOM_PHY=m # CONFIG_BCM63XX_PHY is not set CONFIG_ICPLUS_PHY=m CONFIG_REALTEK_PHY=m # CONFIG_NATIONAL_PHY is not set # CONFIG_STE10XP is not set # CONFIG_LSI_ET1011C_PHY is not set # CONFIG_MICREL_PHY is not set CONFIG_MDIO_BITBANG=m # CONFIG_MDIO_GPIO is not set CONFIG_NET_ETHERNET=y CONFIG_HAPPYMEAL=m CONFIG_SUNGEM=m # CONFIG_CASSINI is not set CONFIG_NET_VENDOR_3COM=y CONFIG_VORTEX=m CONFIG_TYPHOON=m # CONFIG_ENC28J60 is not set # CONFIG_ETHOC is not set # CONFIG_DNET is not set CONFIG_NET_TULIP=y CONFIG_DE2104X=m CONFIG_DE2104X_DSL=0 CONFIG_TULIP=m # CONFIG_TULIP_MWI is not set CONFIG_TULIP_MMIO=y # CONFIG_TULIP_NAPI is not set CONFIG_DE4X5=m CONFIG_WINBOND_840=m CONFIG_DM9102=m # CONFIG_ULI526X is not set CONFIG_PCMCIA_XIRCOM=m # CONFIG_HP100 is not set # CONFIG_IBM_NEW_EMAC_ZMII is not set # CONFIG_IBM_NEW_EMAC_RGMII is not set # CONFIG_IBM_NEW_EMAC_TAH is not set # CONFIG_IBM_NEW_EMAC_EMAC4 is not set # CONFIG_IBM_NEW_EMAC_NO_FLOW_CTRL is not set # CONFIG_IBM_NEW_EMAC_MAL_CLR_ICINTSTAT is not set # CONFIG_IBM_NEW_EMAC_MAL_COMMON_ERR is not set CONFIG_NET_PCI=y CONFIG_PCNET32=m CONFIG_AMD8111_ETH=m CONFIG_ADAPTEC_STARFIRE=m # CONFIG_KSZ884X_PCI is not set CONFIG_B44=m CONFIG_B44_PCI_AUTOSELECT=y CONFIG_B44_PCICORE_AUTOSELECT=y CONFIG_B44_PCI=y # CONFIG_FORCEDETH is not set CONFIG_E100=m CONFIG_FEALNX=m CONFIG_NATSEMI=m CONFIG_NE2K_PCI=m CONFIG_8139CP=m CONFIG_8139TOO=m CONFIG_8139TOO_PIO=y # CONFIG_8139TOO_TUNE_TWISTER is not set CONFIG_8139TOO_8129=y # CONFIG_8139_OLD_RX_RESET is not set # CONFIG_R6040 is not set CONFIG_SIS900=m CONFIG_EPIC100=m # CONFIG_SMSC9420 is not set CONFIG_SUNDANCE=m # CONFIG_SUNDANCE_MMIO is not set CONFIG_TLAN=m # CONFIG_KS8842 is not set # CONFIG_KS8851 is not set # CONFIG_KS8851_MLL is not set CONFIG_VIA_RHINE=m CONFIG_VIA_RHINE_MMIO=y # CONFIG_SC92031 is not set # CONFIG_ATL2 is not set CONFIG_NETDEV_1000=y CONFIG_ACENIC=m # CONFIG_ACENIC_OMIT_TIGON_I is not set CONFIG_DL2K=m CONFIG_E1000=m CONFIG_E1000E=y # CONFIG_IP1000 is not set # CONFIG_IGB is not set # CONFIG_IGBVF is not set CONFIG_NS83820=m CONFIG_HAMACHI=m CONFIG_YELLOWFIN=m CONFIG_R8169=m # CONFIG_SIS190 is not set # CONFIG_SKGE is not set # CONFIG_SKY2 is not set CONFIG_VIA_VELOCITY=m CONFIG_TIGON3=m CONFIG_BNX2=m # CONFIG_CNIC is not set # CONFIG_QLA3XXX is not set # CONFIG_ATL1 is not set CONFIG_ATL1E=m # CONFIG_ATL1C is not set # CONFIG_JME is not set # CONFIG_STMMAC_ETH is not set # CONFIG_PCH_GBE is not set CONFIG_NETDEV_10000=y # CONFIG_CHELSIO_T1 is not set # CONFIG_CHELSIO_T3 is not set # CONFIG_CHELSIO_T4 is not set # CONFIG_CHELSIO_T4VF is not set # CONFIG_ENIC is not set # CONFIG_IXGBE is not set # CONFIG_IXGBEVF is not set CONFIG_IXGB=m CONFIG_S2IO=m # CONFIG_VXGE is not set # CONFIG_MYRI10GE is not set # CONFIG_NETXEN_NIC is not set # CONFIG_NIU is not set # CONFIG_MLX4_EN is not set # CONFIG_MLX4_CORE is not set # CONFIG_TEHUTI is not set # CONFIG_BNX2X is not set # CONFIG_QLCNIC is not set # CONFIG_QLGE is not set # CONFIG_BNA is not set # CONFIG_SFC is not set # CONFIG_BE2NET is not set CONFIG_TR=y CONFIG_IBMOL=m CONFIG_3C359=m CONFIG_TMS380TR=m CONFIG_TMSPCI=m CONFIG_ABYSS=m # CONFIG_WLAN is not set # # Enable WiMAX (Networking options) to see the WiMAX drivers # # # USB Network Adapters # CONFIG_USB_CATC=m # CONFIG_USB_KAWETH is not set CONFIG_USB_PEGASUS=m CONFIG_USB_RTL8150=m CONFIG_USB_USBNET=m CONFIG_USB_NET_AX8817X=m CONFIG_USB_NET_CDCETHER=m # CONFIG_USB_NET_CDC_EEM is not set CONFIG_USB_NET_CDC_NCM=m # CONFIG_USB_NET_DM9601 is not set # CONFIG_USB_NET_SMSC75XX is not set # CONFIG_USB_NET_SMSC95XX is not set # CONFIG_USB_NET_GL620A is not set CONFIG_USB_NET_NET1080=m # CONFIG_USB_NET_PLUSB is not set # CONFIG_USB_NET_MCS7830 is not set # CONFIG_USB_NET_RNDIS_HOST is not set # CONFIG_USB_NET_CDC_SUBSET is not set CONFIG_USB_NET_ZAURUS=m # CONFIG_USB_NET_CX82310_ETH is not set # CONFIG_USB_HSO is not set # CONFIG_USB_NET_INT51X1 is not set # CONFIG_USB_IPHETH is not set # CONFIG_USB_SIERRA_NET is not set # CONFIG_USB_VL600 is not set CONFIG_NET_PCMCIA=y CONFIG_PCMCIA_3C589=m CONFIG_PCMCIA_3C574=m CONFIG_PCMCIA_FMVJ18X=m CONFIG_PCMCIA_PCNET=m CONFIG_PCMCIA_NMCLAN=m CONFIG_PCMCIA_SMC91C92=m CONFIG_PCMCIA_XIRC2PS=m CONFIG_PCMCIA_AXNET=m # CONFIG_PCMCIA_IBMTR is not set # CONFIG_WAN is not set # # CAIF transport drivers # CONFIG_FDDI=y # CONFIG_DEFXX is not set CONFIG_SKFP=m # CONFIG_HIPPI is not set CONFIG_PPP=m CONFIG_PPP_MULTILINK=y CONFIG_PPP_FILTER=y CONFIG_PPP_ASYNC=m CONFIG_PPP_SYNC_TTY=m CONFIG_PPP_DEFLATE=m # CONFIG_PPP_BSDCOMP is not set # CONFIG_PPP_MPPE is not set CONFIG_PPPOE=m # CONFIG_PPTP is not set CONFIG_PPPOL2TP=m CONFIG_SLIP=m CONFIG_SLIP_COMPRESSED=y CONFIG_SLHC=m CONFIG_SLIP_SMART=y # CONFIG_SLIP_MODE_SLIP6 is not set CONFIG_NET_FC=y CONFIG_NETCONSOLE=m # CONFIG_NETCONSOLE_DYNAMIC is not set CONFIG_NETPOLL=y CONFIG_NETPOLL_TRAP=y CONFIG_NET_POLL_CONTROLLER=y # CONFIG_VIRTIO_NET is not set # CONFIG_VMXNET3 is not set # CONFIG_ISDN is not set # CONFIG_PHONE is not set # # Input device support # CONFIG_INPUT=y CONFIG_INPUT_FF_MEMLESS=y CONFIG_INPUT_POLLDEV=y CONFIG_INPUT_SPARSEKMAP=y # # Userland interfaces # CONFIG_INPUT_MOUSEDEV=y # CONFIG_INPUT_MOUSEDEV_PSAUX is not set CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024 CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768 CONFIG_INPUT_JOYDEV=m CONFIG_INPUT_EVDEV=y # CONFIG_INPUT_EVBUG is not set # # Input Device Drivers # CONFIG_INPUT_KEYBOARD=y # CONFIG_KEYBOARD_ADP5588 is not set CONFIG_KEYBOARD_ATKBD=y # CONFIG_KEYBOARD_QT1070 is not set CONFIG_KEYBOARD_QT2160=y # CONFIG_KEYBOARD_LKKBD is not set # CONFIG_KEYBOARD_GPIO is not set # CONFIG_KEYBOARD_GPIO_POLLED is not set # CONFIG_KEYBOARD_TCA6416 is not set # CONFIG_KEYBOARD_MATRIX is not set # CONFIG_KEYBOARD_LM8323 is not set # CONFIG_KEYBOARD_MAX7359 is not set # CONFIG_KEYBOARD_MCS is not set # CONFIG_KEYBOARD_NEWTON is not set # CONFIG_KEYBOARD_OPENCORES is not set # CONFIG_KEYBOARD_STOWAWAY is not set # CONFIG_KEYBOARD_SUNKBD is not set # CONFIG_KEYBOARD_XTKBD is not set CONFIG_INPUT_MOUSE=y CONFIG_MOUSE_PS2=y CONFIG_MOUSE_PS2_ALPS=y CONFIG_MOUSE_PS2_LOGIPS2PP=y CONFIG_MOUSE_PS2_SYNAPTICS=y CONFIG_MOUSE_PS2_LIFEBOOK=y CONFIG_MOUSE_PS2_TRACKPOINT=y # CONFIG_MOUSE_PS2_ELANTECH is not set # CONFIG_MOUSE_PS2_SENTELIC is not set # CONFIG_MOUSE_PS2_TOUCHKIT is not set CONFIG_MOUSE_SERIAL=m # CONFIG_MOUSE_APPLETOUCH is not set # CONFIG_MOUSE_BCM5974 is not set CONFIG_MOUSE_VSXXXAA=m # CONFIG_MOUSE_GPIO is not set # CONFIG_MOUSE_SYNAPTICS_I2C is not set CONFIG_INPUT_JOYSTICK=y CONFIG_JOYSTICK_ANALOG=m CONFIG_JOYSTICK_A3D=m CONFIG_JOYSTICK_ADI=m CONFIG_JOYSTICK_COBRA=m CONFIG_JOYSTICK_GF2K=m CONFIG_JOYSTICK_GRIP=m CONFIG_JOYSTICK_GRIP_MP=m CONFIG_JOYSTICK_GUILLEMOT=m CONFIG_JOYSTICK_INTERACT=m CONFIG_JOYSTICK_SIDEWINDER=m CONFIG_JOYSTICK_TMDC=m CONFIG_JOYSTICK_IFORCE=m CONFIG_JOYSTICK_IFORCE_USB=y CONFIG_JOYSTICK_IFORCE_232=y CONFIG_JOYSTICK_WARRIOR=m CONFIG_JOYSTICK_MAGELLAN=m CONFIG_JOYSTICK_SPACEORB=m CONFIG_JOYSTICK_SPACEBALL=m CONFIG_JOYSTICK_STINGER=m CONFIG_JOYSTICK_TWIDJOY=m # CONFIG_JOYSTICK_ZHENHUA is not set # CONFIG_JOYSTICK_AS5011 is not set CONFIG_JOYSTICK_JOYDUMP=m # CONFIG_JOYSTICK_XPAD is not set # CONFIG_INPUT_TABLET is not set CONFIG_INPUT_TOUCHSCREEN=y # CONFIG_TOUCHSCREEN_ADS7846 is not set # CONFIG_TOUCHSCREEN_AD7877 is not set # CONFIG_TOUCHSCREEN_AD7879 is not set # CONFIG_TOUCHSCREEN_ATMEL_MXT is not set # CONFIG_TOUCHSCREEN_BU21013 is not set # CONFIG_TOUCHSCREEN_CY8CTMG110 is not set # CONFIG_TOUCHSCREEN_DYNAPRO is not set # CONFIG_TOUCHSCREEN_HAMPSHIRE is not set # CONFIG_TOUCHSCREEN_EETI is not set # CONFIG_TOUCHSCREEN_FUJITSU is not set CONFIG_TOUCHSCREEN_GUNZE=m CONFIG_TOUCHSCREEN_ELO=m # CONFIG_TOUCHSCREEN_WACOM_W8001 is not set # CONFIG_TOUCHSCREEN_MCS5000 is not set CONFIG_TOUCHSCREEN_MTOUCH=m # CONFIG_TOUCHSCREEN_INEXIO is not set CONFIG_TOUCHSCREEN_MK712=m # CONFIG_TOUCHSCREEN_PENMOUNT is not set # CONFIG_TOUCHSCREEN_TOUCHRIGHT is not set # CONFIG_TOUCHSCREEN_TOUCHWIN is not set # CONFIG_TOUCHSCREEN_WM97XX is not set # CONFIG_TOUCHSCREEN_USB_COMPOSITE is not set # CONFIG_TOUCHSCREEN_TOUCHIT213 is not set # CONFIG_TOUCHSCREEN_TSC2005 is not set # CONFIG_TOUCHSCREEN_TSC2007 is not set # CONFIG_TOUCHSCREEN_ST1232 is not set # CONFIG_TOUCHSCREEN_TPS6507X is not set CONFIG_INPUT_MISC=y # CONFIG_INPUT_AD714X is not set CONFIG_INPUT_PCSPKR=m # CONFIG_INPUT_APANEL is not set # CONFIG_INPUT_ATLAS_BTNS is not set # CONFIG_INPUT_ATI_REMOTE is not set # CONFIG_INPUT_ATI_REMOTE2 is not set # CONFIG_INPUT_KEYSPAN_REMOTE is not set # CONFIG_INPUT_POWERMATE is not set # CONFIG_INPUT_YEALINK is not set # CONFIG_INPUT_CM109 is not set CONFIG_INPUT_UINPUT=m # CONFIG_INPUT_PCF8574 is not set # CONFIG_INPUT_GPIO_ROTARY_ENCODER is not set # CONFIG_INPUT_ADXL34X is not set # CONFIG_INPUT_CMA3000 is not set # # Hardware I/O ports # CONFIG_SERIO=y CONFIG_SERIO_I8042=y CONFIG_SERIO_SERPORT=y # CONFIG_SERIO_CT82C710 is not set # CONFIG_SERIO_PCIPS2 is not set CONFIG_SERIO_LIBPS2=y # CONFIG_SERIO_RAW is not set # CONFIG_SERIO_ALTERA_PS2 is not set # CONFIG_SERIO_PS2MULT is not set CONFIG_GAMEPORT=m CONFIG_GAMEPORT_NS558=m CONFIG_GAMEPORT_L4=m CONFIG_GAMEPORT_EMU10K1=m CONFIG_GAMEPORT_FM801=m # # Character devices # CONFIG_VT=y CONFIG_CONSOLE_TRANSLATIONS=y CONFIG_VT_CONSOLE=y CONFIG_HW_CONSOLE=y CONFIG_VT_HW_CONSOLE_BINDING=y CONFIG_UNIX98_PTYS=y # CONFIG_DEVPTS_MULTIPLE_INSTANCES is not set # CONFIG_LEGACY_PTYS is not set CONFIG_SERIAL_NONSTANDARD=y CONFIG_ROCKETPORT=m # CONFIG_CYCLADES is not set # CONFIG_MOXA_INTELLIO is not set # CONFIG_MOXA_SMARTIO is not set # CONFIG_SYNCLINK is not set # CONFIG_SYNCLINKMP is not set # CONFIG_SYNCLINK_GT is not set # CONFIG_NOZOMI is not set # CONFIG_ISI is not set CONFIG_N_HDLC=m # CONFIG_N_GSM is not set CONFIG_DEVKMEM=y CONFIG_STALDRV=y # # Serial drivers # CONFIG_SERIAL_8250=y CONFIG_SERIAL_8250_CONSOLE=y CONFIG_FIX_EARLYCON_MEM=y CONFIG_SERIAL_8250_PCI=y CONFIG_SERIAL_8250_PNP=y CONFIG_SERIAL_8250_CS=m CONFIG_SERIAL_8250_NR_UARTS=32 CONFIG_SERIAL_8250_RUNTIME_UARTS=4 CONFIG_SERIAL_8250_EXTENDED=y CONFIG_SERIAL_8250_MANY_PORTS=y CONFIG_SERIAL_8250_SHARE_IRQ=y CONFIG_SERIAL_8250_DETECT_IRQ=y CONFIG_SERIAL_8250_RSA=y # # Non-8250 serial port support # # CONFIG_SERIAL_MAX3100 is not set # CONFIG_SERIAL_MAX3107 is not set # CONFIG_SERIAL_MFD_HSU is not set CONFIG_SERIAL_CORE=y CONFIG_SERIAL_CORE_CONSOLE=y # CONFIG_SERIAL_JSM is not set # CONFIG_SERIAL_TIMBERDALE is not set # CONFIG_SERIAL_ALTERA_JTAGUART is not set # CONFIG_SERIAL_ALTERA_UART is not set # CONFIG_SERIAL_IFX6X60 is not set # CONFIG_SERIAL_PCH_UART is not set # CONFIG_VIRTIO_CONSOLE is not set CONFIG_IPMI_HANDLER=m # CONFIG_IPMI_PANIC_EVENT is not set CONFIG_IPMI_DEVICE_INTERFACE=m CONFIG_IPMI_SI=m CONFIG_IPMI_WATCHDOG=m CONFIG_IPMI_POWEROFF=m CONFIG_HW_RANDOM=m # CONFIG_HW_RANDOM_TIMERIOMEM is not set CONFIG_HW_RANDOM_INTEL=m CONFIG_HW_RANDOM_AMD=m CONFIG_HW_RANDOM_VIA=m # CONFIG_HW_RANDOM_VIRTIO is not set # CONFIG_NVRAM is not set CONFIG_RTC=y CONFIG_R3964=m # CONFIG_APPLICOM is not set # # PCMCIA character devices # # CONFIG_SYNCLINK_CS is not set # CONFIG_CARDMAN_4000 is not set # CONFIG_CARDMAN_4040 is not set # CONFIG_IPWIRELESS is not set CONFIG_MWAVE=m # CONFIG_RAW_DRIVER is not set # CONFIG_HPET is not set CONFIG_HANGCHECK_TIMER=m # CONFIG_TCG_TPM is not set # CONFIG_TELCLOCK is not set CONFIG_DEVPORT=y CONFIG_RAMOOPS=y CONFIG_I2C=y CONFIG_I2C_BOARDINFO=y CONFIG_I2C_COMPAT=y CONFIG_I2C_CHARDEV=m CONFIG_I2C_MUX=y # # Multiplexer I2C Chip support # # CONFIG_I2C_MUX_GPIO is not set # CONFIG_I2C_MUX_PCA9541 is not set CONFIG_I2C_MUX_PCA954x=y CONFIG_I2C_HELPER_AUTO=y CONFIG_I2C_ALGOBIT=m # # I2C Hardware Bus support # # # PC SMBus host controller drivers # # CONFIG_I2C_ALI1535 is not set # CONFIG_I2C_ALI1563 is not set # CONFIG_I2C_ALI15X3 is not set # CONFIG_I2C_AMD756 is not set CONFIG_I2C_AMD8111=m # CONFIG_I2C_I801 is not set # CONFIG_I2C_ISCH is not set # CONFIG_I2C_PIIX4 is not set CONFIG_I2C_NFORCE2=m # CONFIG_I2C_NFORCE2_S4985 is not set # CONFIG_I2C_SIS5595 is not set # CONFIG_I2C_SIS630 is not set CONFIG_I2C_SIS96X=m CONFIG_I2C_VIA=m CONFIG_I2C_VIAPRO=m # # ACPI drivers # # CONFIG_I2C_SCMI is not set # # I2C system bus drivers (mostly embedded / system-on-chip) # # CONFIG_I2C_GPIO is not set CONFIG_I2C_INTEL_MID=y # CONFIG_I2C_OCORES is not set # CONFIG_I2C_PCA_PLATFORM is not set # CONFIG_I2C_PXA_PCI is not set # CONFIG_I2C_SIMTEC is not set # CONFIG_I2C_XILINX is not set # CONFIG_I2C_EG20T is not set # # External I2C/SMBus adapter drivers # # CONFIG_I2C_DIOLAN_U2C is not set # CONFIG_I2C_PARPORT_LIGHT is not set # CONFIG_I2C_TAOS_EVM is not set # CONFIG_I2C_TINY_USB is not set # # Other I2C/SMBus bus drivers # CONFIG_I2C_STUB=m # CONFIG_I2C_DEBUG_CORE is not set # CONFIG_I2C_DEBUG_ALGO is not set # CONFIG_I2C_DEBUG_BUS is not set CONFIG_SPI=y # CONFIG_SPI_DEBUG is not set CONFIG_SPI_MASTER=y # # SPI Master Controller Drivers # # CONFIG_SPI_ALTERA is not set # CONFIG_SPI_BITBANG is not set # CONFIG_SPI_GPIO is not set # CONFIG_SPI_OC_TINY is not set # CONFIG_SPI_PXA2XX_PCI is not set # CONFIG_SPI_TOPCLIFF_PCH is not set # CONFIG_SPI_XILINX is not set # CONFIG_SPI_DESIGNWARE is not set # # SPI Protocol Masters # # CONFIG_SPI_SPIDEV is not set # CONFIG_SPI_TLE62X0 is not set # # PPS support # CONFIG_PPS=m # CONFIG_PPS_DEBUG is not set # # PPS clients support # # CONFIG_PPS_CLIENT_KTIMER is not set # CONFIG_PPS_CLIENT_LDISC is not set # # PPS generators support # CONFIG_ARCH_WANT_OPTIONAL_GPIOLIB=y CONFIG_GPIOLIB=y # CONFIG_DEBUG_GPIO is not set # CONFIG_GPIO_SYSFS is not set CONFIG_GPIO_MAX730X=m # # Memory mapped GPIO expanders: # CONFIG_GPIO_BASIC_MMIO=m # CONFIG_GPIO_IT8761E is not set # CONFIG_GPIO_SCH is not set # CONFIG_GPIO_VX855 is not set # # I2C GPIO expanders: # # CONFIG_GPIO_MAX7300 is not set CONFIG_GPIO_MAX732X=m CONFIG_GPIO_PCA953X=m # CONFIG_GPIO_PCF857X is not set CONFIG_GPIO_SX150X=y # CONFIG_GPIO_ADP5588 is not set # # PCI GPIO expanders: # # CONFIG_GPIO_CS5535 is not set # CONFIG_GPIO_BT8XX is not set # CONFIG_GPIO_LANGWELL is not set # CONFIG_GPIO_PCH is not set # CONFIG_GPIO_ML_IOH is not set # CONFIG_GPIO_RDC321X is not set # # SPI GPIO expanders: # CONFIG_GPIO_MAX7301=m CONFIG_GPIO_MCP23S08=m # CONFIG_GPIO_MC33880 is not set # CONFIG_GPIO_74X164 is not set # # AC97 GPIO expanders: # # # MODULbus GPIO expanders: # CONFIG_W1=m CONFIG_W1_CON=y # # 1-wire Bus Masters # # CONFIG_W1_MASTER_MATROX is not set # CONFIG_W1_MASTER_DS2490 is not set # CONFIG_W1_MASTER_DS2482 is not set # CONFIG_W1_MASTER_GPIO is not set # # 1-wire Slaves # # CONFIG_W1_SLAVE_THERM is not set # CONFIG_W1_SLAVE_SMEM is not set # CONFIG_W1_SLAVE_DS2423 is not set # CONFIG_W1_SLAVE_DS2431 is not set # CONFIG_W1_SLAVE_DS2433 is not set # CONFIG_W1_SLAVE_DS2760 is not set # CONFIG_W1_SLAVE_BQ27000 is not set CONFIG_POWER_SUPPLY=y # CONFIG_POWER_SUPPLY_DEBUG is not set # CONFIG_PDA_POWER is not set # CONFIG_TEST_POWER is not set # CONFIG_BATTERY_DS2782 is not set # CONFIG_BATTERY_BQ20Z75 is not set # CONFIG_BATTERY_BQ27x00 is not set # CONFIG_BATTERY_MAX17040 is not set # CONFIG_BATTERY_MAX17042 is not set # CONFIG_CHARGER_GPIO is not set CONFIG_HWMON=m CONFIG_HWMON_VID=m # CONFIG_HWMON_DEBUG_CHIP is not set # # Native drivers # # CONFIG_SENSORS_ABITUGURU is not set # CONFIG_SENSORS_ABITUGURU3 is not set # CONFIG_SENSORS_AD7414 is not set # CONFIG_SENSORS_AD7418 is not set # CONFIG_SENSORS_ADCXX is not set CONFIG_SENSORS_ADM1021=m CONFIG_SENSORS_ADM1025=m CONFIG_SENSORS_ADM1026=m # CONFIG_SENSORS_ADM1029 is not set CONFIG_SENSORS_ADM1031=m # CONFIG_SENSORS_ADM9240 is not set # CONFIG_SENSORS_ADT7411 is not set # CONFIG_SENSORS_ADT7462 is not set # CONFIG_SENSORS_ADT7470 is not set # CONFIG_SENSORS_ADT7475 is not set # CONFIG_SENSORS_ASC7621 is not set # CONFIG_SENSORS_K8TEMP is not set # CONFIG_SENSORS_K10TEMP is not set CONFIG_SENSORS_ASB100=m # CONFIG_SENSORS_ATXP1 is not set # CONFIG_SENSORS_DS620 is not set CONFIG_SENSORS_DS1621=m CONFIG_SENSORS_I5K_AMB=m # CONFIG_SENSORS_F71805F is not set # CONFIG_SENSORS_F71882FG is not set # CONFIG_SENSORS_F75375S is not set # CONFIG_SENSORS_FSCHMD is not set # CONFIG_SENSORS_G760A is not set CONFIG_SENSORS_GL518SM=m CONFIG_SENSORS_GL520SM=m # CONFIG_SENSORS_GPIO_FAN is not set CONFIG_SENSORS_CORETEMP=m CONFIG_SENSORS_PKGTEMP=m # CONFIG_SENSORS_IBMAEM is not set # CONFIG_SENSORS_IBMPEX is not set CONFIG_SENSORS_IT87=m # CONFIG_SENSORS_JC42 is not set # CONFIG_SENSORS_LINEAGE is not set CONFIG_SENSORS_LM63=m # CONFIG_SENSORS_LM70 is not set # CONFIG_SENSORS_LM73 is not set CONFIG_SENSORS_LM75=m CONFIG_SENSORS_LM77=m CONFIG_SENSORS_LM78=m CONFIG_SENSORS_LM80=m CONFIG_SENSORS_LM83=m CONFIG_SENSORS_LM85=m CONFIG_SENSORS_LM87=m CONFIG_SENSORS_LM90=m CONFIG_SENSORS_LM92=m # CONFIG_SENSORS_LM93 is not set # CONFIG_SENSORS_LTC4151 is not set # CONFIG_SENSORS_LTC4215 is not set # CONFIG_SENSORS_LTC4245 is not set # CONFIG_SENSORS_LTC4261 is not set # CONFIG_SENSORS_LM95241 is not set # CONFIG_SENSORS_MAX1111 is not set CONFIG_SENSORS_MAX1619=m # CONFIG_SENSORS_MAX6639 is not set # CONFIG_SENSORS_MAX6650 is not set CONFIG_SENSORS_PC87360=m # CONFIG_SENSORS_PC87427 is not set CONFIG_SENSORS_PCF8591=m # CONFIG_PMBUS is not set # CONFIG_SENSORS_SHT15 is not set # CONFIG_SENSORS_SHT21 is not set CONFIG_SENSORS_SIS5595=m # CONFIG_SENSORS_SMM665 is not set # CONFIG_SENSORS_DME1737 is not set # CONFIG_SENSORS_EMC1403 is not set # CONFIG_SENSORS_EMC2103 is not set CONFIG_SENSORS_SMSC47M1=m # CONFIG_SENSORS_SMSC47M192 is not set CONFIG_SENSORS_SMSC47B397=m # CONFIG_SENSORS_SCH5627 is not set # CONFIG_SENSORS_ADS1015 is not set # CONFIG_SENSORS_ADS7828 is not set # CONFIG_SENSORS_ADS7871 is not set # CONFIG_SENSORS_AMC6821 is not set # CONFIG_SENSORS_THMC50 is not set # CONFIG_SENSORS_TMP102 is not set # CONFIG_SENSORS_TMP401 is not set # CONFIG_SENSORS_TMP421 is not set # CONFIG_SENSORS_VIA_CPUTEMP is not set CONFIG_SENSORS_VIA686A=m # CONFIG_SENSORS_VT1211 is not set # CONFIG_SENSORS_VT8231 is not set CONFIG_SENSORS_W83781D=m # CONFIG_SENSORS_W83791D is not set # CONFIG_SENSORS_W83792D is not set # CONFIG_SENSORS_W83793 is not set # CONFIG_SENSORS_W83795 is not set CONFIG_SENSORS_W83L785TS=m # CONFIG_SENSORS_W83L786NG is not set CONFIG_SENSORS_W83627HF=m # CONFIG_SENSORS_W83627EHF is not set # CONFIG_SENSORS_APPLESMC is not set # # ACPI drivers # # CONFIG_SENSORS_ATK0110 is not set CONFIG_THERMAL=y CONFIG_WATCHDOG=y # CONFIG_WATCHDOG_NOWAYOUT is not set # # Watchdog Device Drivers # CONFIG_SOFT_WATCHDOG=m CONFIG_ACQUIRE_WDT=m CONFIG_ADVANTECH_WDT=m CONFIG_ALIM1535_WDT=m CONFIG_ALIM7101_WDT=m # CONFIG_F71808E_WDT is not set # CONFIG_SP5100_TCO is not set CONFIG_SC520_WDT=m # CONFIG_SBC_FITPC2_WATCHDOG is not set CONFIG_EUROTECH_WDT=m CONFIG_IB700_WDT=m # CONFIG_IBMASR is not set CONFIG_WAFER_WDT=m # CONFIG_I6300ESB_WDT is not set # CONFIG_ITCO_WDT is not set # CONFIG_IT8712F_WDT is not set # CONFIG_IT87_WDT is not set # CONFIG_HP_WATCHDOG is not set CONFIG_SC1200_WDT=m # CONFIG_PC87413_WDT is not set # CONFIG_NV_TCO is not set # CONFIG_60XX_WDT is not set # CONFIG_SBC8360_WDT is not set CONFIG_CPU5_WDT=m # CONFIG_SMSC_SCH311X_WDT is not set # CONFIG_SMSC37B787_WDT is not set CONFIG_W83627HF_WDT=m # CONFIG_W83697HF_WDT is not set # CONFIG_W83697UG_WDT is not set CONFIG_W83877F_WDT=m # CONFIG_W83977F_WDT is not set CONFIG_MACHZ_WDT=m # CONFIG_SBC_EPX_C3_WATCHDOG is not set # # PCI-based Watchdog Cards # CONFIG_PCIPCWATCHDOG=m CONFIG_WDTPCI=m # # USB-based Watchdog Cards # CONFIG_USBPCWATCHDOG=m CONFIG_SSB_POSSIBLE=y # # Sonics Silicon Backplane # CONFIG_SSB=m CONFIG_SSB_SPROM=y CONFIG_SSB_PCIHOST_POSSIBLE=y CONFIG_SSB_PCIHOST=y # CONFIG_SSB_B43_PCI_BRIDGE is not set CONFIG_SSB_PCMCIAHOST_POSSIBLE=y # CONFIG_SSB_PCMCIAHOST is not set # CONFIG_SSB_DEBUG is not set CONFIG_SSB_DRIVER_PCICORE_POSSIBLE=y CONFIG_SSB_DRIVER_PCICORE=y CONFIG_MFD_SUPPORT=y # CONFIG_MFD_CORE is not set # CONFIG_MFD_88PM860X is not set # CONFIG_MFD_SM501 is not set # CONFIG_HTC_PASIC3 is not set # CONFIG_HTC_I2CPLD is not set # CONFIG_UCB1400_CORE is not set # CONFIG_TPS6105X is not set # CONFIG_TPS65010 is not set # CONFIG_TPS6507X is not set # CONFIG_TWL4030_CORE is not set # CONFIG_MFD_STMPE is not set # CONFIG_MFD_TC3589X is not set # CONFIG_MFD_TMIO is not set # CONFIG_PMIC_DA903X is not set # CONFIG_PMIC_ADP5520 is not set # CONFIG_MFD_MAX8925 is not set # CONFIG_MFD_MAX8997 is not set # CONFIG_MFD_MAX8998 is not set # CONFIG_MFD_WM8400 is not set # CONFIG_MFD_WM831X_I2C is not set # CONFIG_MFD_WM831X_SPI is not set # CONFIG_MFD_WM8350_I2C is not set # CONFIG_MFD_WM8994 is not set # CONFIG_MFD_PCF50633 is not set # CONFIG_MFD_MC13XXX is not set # CONFIG_ABX500_CORE is not set # CONFIG_EZX_PCAP is not set # CONFIG_MFD_CS5535 is not set # CONFIG_MFD_TIMBERDALE is not set # CONFIG_LPC_SCH is not set # CONFIG_MFD_RDC321X is not set # CONFIG_MFD_JANZ_CMODIO is not set # CONFIG_MFD_TPS6586X is not set # CONFIG_MFD_VX855 is not set # CONFIG_MFD_WL1273_CORE is not set CONFIG_REGULATOR=y # CONFIG_REGULATOR_DEBUG is not set # CONFIG_REGULATOR_DUMMY is not set CONFIG_REGULATOR_FIXED_VOLTAGE=m CONFIG_REGULATOR_VIRTUAL_CONSUMER=m # CONFIG_REGULATOR_USERSPACE_CONSUMER is not set CONFIG_REGULATOR_BQ24022=m # CONFIG_REGULATOR_MAX1586 is not set # CONFIG_REGULATOR_MAX8649 is not set # CONFIG_REGULATOR_MAX8660 is not set # CONFIG_REGULATOR_MAX8952 is not set # CONFIG_REGULATOR_LP3971 is not set # CONFIG_REGULATOR_LP3972 is not set # CONFIG_REGULATOR_TPS65023 is not set # CONFIG_REGULATOR_TPS6507X is not set # CONFIG_REGULATOR_ISL6271A is not set # CONFIG_REGULATOR_AD5398 is not set # CONFIG_REGULATOR_TPS6524X is not set # CONFIG_MEDIA_SUPPORT is not set # # Graphics support # CONFIG_AGP=y CONFIG_AGP_AMD64=y CONFIG_AGP_INTEL=y # CONFIG_AGP_SIS is not set # CONFIG_AGP_VIA is not set CONFIG_VGA_ARB=y CONFIG_VGA_ARB_MAX_GPUS=16 # CONFIG_VGA_SWITCHEROO is not set # CONFIG_DRM is not set # CONFIG_STUB_POULSBO is not set # CONFIG_VGASTATE is not set CONFIG_VIDEO_OUTPUT_CONTROL=m CONFIG_FB=m # CONFIG_FIRMWARE_EDID is not set # CONFIG_FB_DDC is not set # CONFIG_FB_BOOT_VESA_SUPPORT is not set # CONFIG_FB_CFB_FILLRECT is not set # CONFIG_FB_CFB_COPYAREA is not set # CONFIG_FB_CFB_IMAGEBLIT is not set # CONFIG_FB_CFB_REV_PIXELS_IN_BYTE is not set # CONFIG_FB_SYS_FILLRECT is not set # CONFIG_FB_SYS_COPYAREA is not set # CONFIG_FB_SYS_IMAGEBLIT is not set # CONFIG_FB_FOREIGN_ENDIAN is not set # CONFIG_FB_SYS_FOPS is not set # CONFIG_FB_WMT_GE_ROPS is not set # CONFIG_FB_SVGALIB is not set # CONFIG_FB_MACMODES is not set # CONFIG_FB_BACKLIGHT is not set # CONFIG_FB_MODE_HELPERS is not set # CONFIG_FB_TILEBLITTING is not set # # Frame buffer hardware drivers # # CONFIG_FB_CIRRUS is not set # CONFIG_FB_PM2 is not set # CONFIG_FB_CYBER2000 is not set # CONFIG_FB_ARC is not set # CONFIG_FB_VGA16 is not set # CONFIG_FB_UVESA is not set # CONFIG_FB_N411 is not set # CONFIG_FB_HGA is not set # CONFIG_FB_S1D13XXX is not set # CONFIG_FB_NVIDIA is not set # CONFIG_FB_RIVA is not set # CONFIG_FB_LE80578 is not set # CONFIG_FB_MATROX is not set # CONFIG_FB_RADEON is not set # CONFIG_FB_ATY128 is not set # CONFIG_FB_ATY is not set # CONFIG_FB_S3 is not set # CONFIG_FB_SAVAGE is not set # CONFIG_FB_SIS is not set # CONFIG_FB_VIA is not set # CONFIG_FB_NEOMAGIC is not set # CONFIG_FB_KYRO is not set # CONFIG_FB_3DFX is not set # CONFIG_FB_VOODOO1 is not set # CONFIG_FB_VT8623 is not set # CONFIG_FB_TRIDENT is not set # CONFIG_FB_ARK is not set # CONFIG_FB_PM3 is not set # CONFIG_FB_CARMINE is not set # CONFIG_FB_GEODE is not set # CONFIG_FB_UDL is not set # CONFIG_FB_VIRTUAL is not set # CONFIG_FB_METRONOME is not set # CONFIG_FB_MB862XX is not set # CONFIG_FB_BROADSHEET is not set CONFIG_BACKLIGHT_LCD_SUPPORT=y CONFIG_LCD_CLASS_DEVICE=m # CONFIG_LCD_L4F00242T03 is not set # CONFIG_LCD_LMS283GF05 is not set # CONFIG_LCD_LTV350QV is not set # CONFIG_LCD_TDO24M is not set # CONFIG_LCD_VGG2432A4 is not set # CONFIG_LCD_PLATFORM is not set # CONFIG_LCD_S6E63M0 is not set # CONFIG_LCD_LD9040 is not set CONFIG_BACKLIGHT_CLASS_DEVICE=y CONFIG_BACKLIGHT_GENERIC=y # CONFIG_BACKLIGHT_PROGEAR is not set # CONFIG_BACKLIGHT_APPLE is not set # CONFIG_BACKLIGHT_SAHARA is not set # CONFIG_BACKLIGHT_ADP8860 is not set # # Display device support # CONFIG_DISPLAY_SUPPORT=y # # Display hardware drivers # # # Console display driver support # CONFIG_VGA_CONSOLE=y CONFIG_VGACON_SOFT_SCROLLBACK=y CONFIG_VGACON_SOFT_SCROLLBACK_SIZE=64 CONFIG_DUMMY_CONSOLE=y CONFIG_FRAMEBUFFER_CONSOLE=m # CONFIG_FRAMEBUFFER_CONSOLE_DETECT_PRIMARY is not set # CONFIG_FRAMEBUFFER_CONSOLE_ROTATION is not set # CONFIG_FONTS is not set CONFIG_FONT_8x8=y CONFIG_FONT_8x16=y # CONFIG_LOGO is not set CONFIG_SOUND=m CONFIG_SOUND_OSS_CORE=y CONFIG_SOUND_OSS_CORE_PRECLAIM=y CONFIG_SND=m CONFIG_SND_TIMER=m CONFIG_SND_PCM=m CONFIG_SND_HWDEP=m CONFIG_SND_RAWMIDI=m CONFIG_SND_SEQUENCER=m CONFIG_SND_SEQ_DUMMY=m CONFIG_SND_OSSEMUL=y CONFIG_SND_MIXER_OSS=m CONFIG_SND_PCM_OSS=m CONFIG_SND_PCM_OSS_PLUGINS=y CONFIG_SND_SEQUENCER_OSS=y # CONFIG_SND_HRTIMER is not set CONFIG_SND_RTCTIMER=m CONFIG_SND_SEQ_RTCTIMER_DEFAULT=y CONFIG_SND_DYNAMIC_MINORS=y CONFIG_SND_SUPPORT_OLD_API=y CONFIG_SND_VERBOSE_PROCFS=y # CONFIG_SND_VERBOSE_PRINTK is not set # CONFIG_SND_DEBUG is not set CONFIG_SND_VMASTER=y CONFIG_SND_DMA_SGBUF=y CONFIG_SND_RAWMIDI_SEQ=m CONFIG_SND_OPL3_LIB_SEQ=m # CONFIG_SND_OPL4_LIB_SEQ is not set # CONFIG_SND_SBAWE_SEQ is not set CONFIG_SND_EMU10K1_SEQ=m CONFIG_SND_MPU401_UART=m CONFIG_SND_OPL3_LIB=m CONFIG_SND_VX_LIB=m CONFIG_SND_AC97_CODEC=m CONFIG_SND_DRIVERS=y # CONFIG_SND_PCSP is not set CONFIG_SND_DUMMY=m # CONFIG_SND_ALOOP is not set CONFIG_SND_VIRMIDI=m CONFIG_SND_MTPAV=m # CONFIG_SND_SERIAL_U16550 is not set CONFIG_SND_MPU401=m # CONFIG_SND_AC97_POWER_SAVE is not set CONFIG_SND_SB_COMMON=m CONFIG_SND_PCI=y # CONFIG_SND_AD1889 is not set # CONFIG_SND_ALS300 is not set CONFIG_SND_ALS4000=m CONFIG_SND_ALI5451=m # CONFIG_SND_ASIHPI is not set CONFIG_SND_ATIIXP=m CONFIG_SND_ATIIXP_MODEM=m CONFIG_SND_AU8810=m CONFIG_SND_AU8820=m CONFIG_SND_AU8830=m # CONFIG_SND_AW2 is not set CONFIG_SND_AZT3328=m CONFIG_SND_BT87X=m # CONFIG_SND_BT87X_OVERCLOCK is not set CONFIG_SND_CA0106=m CONFIG_SND_CMIPCI=m # CONFIG_SND_OXYGEN is not set CONFIG_SND_CS4281=m CONFIG_SND_CS46XX=m CONFIG_SND_CS46XX_NEW_DSP=y # CONFIG_SND_CS5530 is not set # CONFIG_SND_CS5535AUDIO is not set # CONFIG_SND_CTXFI is not set # CONFIG_SND_DARLA20 is not set # CONFIG_SND_GINA20 is not set # CONFIG_SND_LAYLA20 is not set # CONFIG_SND_DARLA24 is not set # CONFIG_SND_GINA24 is not set # CONFIG_SND_LAYLA24 is not set # CONFIG_SND_MONA is not set # CONFIG_SND_MIA is not set # CONFIG_SND_ECHO3G is not set # CONFIG_SND_INDIGO is not set # CONFIG_SND_INDIGOIO is not set # CONFIG_SND_INDIGODJ is not set # CONFIG_SND_INDIGOIOX is not set # CONFIG_SND_INDIGODJX is not set CONFIG_SND_EMU10K1=m CONFIG_SND_EMU10K1X=m CONFIG_SND_ENS1370=m CONFIG_SND_ENS1371=m CONFIG_SND_ES1938=m CONFIG_SND_ES1968=m # CONFIG_SND_ES1968_INPUT is not set CONFIG_SND_FM801=m CONFIG_SND_HDA_INTEL=m # CONFIG_SND_HDA_HWDEP is not set # CONFIG_SND_HDA_INPUT_BEEP is not set # CONFIG_SND_HDA_INPUT_JACK is not set # CONFIG_SND_HDA_PATCH_LOADER is not set # CONFIG_SND_HDA_CODEC_REALTEK is not set # CONFIG_SND_HDA_CODEC_ANALOG is not set # CONFIG_SND_HDA_CODEC_SIGMATEL is not set # CONFIG_SND_HDA_CODEC_VIA is not set CONFIG_SND_HDA_CODEC_HDMI=y CONFIG_SND_HDA_CODEC_CIRRUS=y # CONFIG_SND_HDA_CODEC_CONEXANT is not set CONFIG_SND_HDA_CODEC_CA0110=y # CONFIG_SND_HDA_CODEC_CMEDIA is not set # CONFIG_SND_HDA_CODEC_SI3054 is not set # CONFIG_SND_HDA_GENERIC is not set # CONFIG_SND_HDA_POWER_SAVE is not set CONFIG_SND_HDSP=m # CONFIG_SND_HDSPM is not set CONFIG_SND_ICE1712=m CONFIG_SND_ICE1724=m CONFIG_SND_INTEL8X0=m CONFIG_SND_INTEL8X0M=m CONFIG_SND_KORG1212=m # CONFIG_SND_LX6464ES is not set CONFIG_SND_MAESTRO3=m # CONFIG_SND_MAESTRO3_INPUT is not set CONFIG_SND_MIXART=m CONFIG_SND_NM256=m # CONFIG_SND_PCXHR is not set # CONFIG_SND_RIPTIDE is not set CONFIG_SND_RME32=m CONFIG_SND_RME96=m CONFIG_SND_RME9652=m CONFIG_SND_SONICVIBES=m CONFIG_SND_TRIDENT=m CONFIG_SND_VIA82XX=m CONFIG_SND_VIA82XX_MODEM=m # CONFIG_SND_VIRTUOSO is not set CONFIG_SND_VX222=m CONFIG_SND_YMFPCI=m CONFIG_SND_SPI=y # CONFIG_SND_USB is not set # CONFIG_SND_PCMCIA is not set # CONFIG_SND_SOC is not set # CONFIG_SOUND_PRIME is not set CONFIG_AC97_BUS=m CONFIG_HID_SUPPORT=y CONFIG_HID=y CONFIG_HIDRAW=y # # USB Input Devices # CONFIG_USB_HID=y CONFIG_HID_PID=y CONFIG_USB_HIDDEV=y # # Special HID drivers # # CONFIG_HID_3M_PCT is not set CONFIG_HID_A4TECH=y # CONFIG_HID_ACRUX is not set CONFIG_HID_APPLE=y CONFIG_HID_BELKIN=y # CONFIG_HID_CANDO is not set CONFIG_HID_CHERRY=y CONFIG_HID_CHICONY=y # CONFIG_HID_PRODIKEYS is not set CONFIG_HID_CYPRESS=y CONFIG_HID_DRAGONRISE=y # CONFIG_DRAGONRISE_FF is not set # CONFIG_HID_EMS_FF is not set CONFIG_HID_EZKEY=y # CONFIG_HID_KEYTOUCH is not set CONFIG_HID_KYE=y # CONFIG_HID_UCLOGIC is not set # CONFIG_HID_WALTOP is not set CONFIG_HID_GYRATION=y CONFIG_HID_TWINHAN=y CONFIG_HID_KENSINGTON=y # CONFIG_HID_LCPOWER is not set CONFIG_HID_LOGITECH=y # CONFIG_LOGITECH_FF is not set # CONFIG_LOGIRUMBLEPAD2_FF is not set # CONFIG_LOGIG940_FF is not set # CONFIG_LOGIWII_FF is not set CONFIG_HID_MICROSOFT=y # CONFIG_HID_MOSART is not set CONFIG_HID_MONTEREY=y # CONFIG_HID_MULTITOUCH is not set CONFIG_HID_NTRIG=y CONFIG_HID_ORTEK=y CONFIG_HID_PANTHERLORD=y # CONFIG_PANTHERLORD_FF is not set CONFIG_HID_PETALYNX=y # CONFIG_HID_PICOLCD is not set # CONFIG_HID_QUANTA is not set # CONFIG_HID_ROCCAT is not set # CONFIG_HID_ROCCAT_ARVO is not set # CONFIG_HID_ROCCAT_KONE is not set # CONFIG_HID_ROCCAT_KONEPLUS is not set # CONFIG_HID_ROCCAT_KOVAPLUS is not set # CONFIG_HID_ROCCAT_PYRA is not set CONFIG_HID_SAMSUNG=y CONFIG_HID_SONY=y # CONFIG_HID_STANTUM is not set CONFIG_HID_SUNPLUS=y CONFIG_HID_GREENASIA=y # CONFIG_GREENASIA_FF is not set CONFIG_HID_SMARTJOYPLUS=y # CONFIG_SMARTJOYPLUS_FF is not set CONFIG_HID_TOPSEED=y CONFIG_HID_THRUSTMASTER=y # CONFIG_THRUSTMASTER_FF is not set CONFIG_HID_ZEROPLUS=y # CONFIG_ZEROPLUS_FF is not set # CONFIG_HID_ZYDACRON is not set CONFIG_USB_SUPPORT=y CONFIG_USB_ARCH_HAS_HCD=y CONFIG_USB_ARCH_HAS_OHCI=y CONFIG_USB_ARCH_HAS_EHCI=y CONFIG_USB=y # CONFIG_USB_DEBUG is not set # CONFIG_USB_ANNOUNCE_NEW_DEVICES is not set # # Miscellaneous USB options # # CONFIG_USB_DEVICEFS is not set CONFIG_USB_DEVICE_CLASS=y # CONFIG_USB_DYNAMIC_MINORS is not set CONFIG_USB_MON=m # CONFIG_USB_WUSB is not set # CONFIG_USB_WUSB_CBAF is not set # # USB Host Controller Drivers # CONFIG_USB_C67X00_HCD=m # CONFIG_USB_XHCI_HCD is not set CONFIG_USB_EHCI_HCD=m CONFIG_USB_EHCI_ROOT_HUB_TT=y CONFIG_USB_EHCI_TT_NEWSCHED=y CONFIG_USB_OXU210HP_HCD=m CONFIG_USB_ISP116X_HCD=m CONFIG_USB_ISP1760_HCD=m # CONFIG_USB_ISP1362_HCD is not set CONFIG_USB_OHCI_HCD=m CONFIG_USB_OHCI_HCD_SSB=y # CONFIG_USB_OHCI_BIG_ENDIAN_DESC is not set # CONFIG_USB_OHCI_BIG_ENDIAN_MMIO is not set CONFIG_USB_OHCI_LITTLE_ENDIAN=y CONFIG_USB_UHCI_HCD=m CONFIG_USB_SL811_HCD=m CONFIG_USB_SL811_CS=m CONFIG_USB_R8A66597_HCD=m # CONFIG_USB_WHCI_HCD is not set # CONFIG_USB_HWA_HCD is not set # # USB Device Class drivers # CONFIG_USB_ACM=m CONFIG_USB_PRINTER=m # CONFIG_USB_WDM is not set CONFIG_USB_TMC=m # # NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may # # # also be needed; see USB_STORAGE Help for more info # CONFIG_USB_STORAGE=m # CONFIG_USB_STORAGE_DEBUG is not set # CONFIG_USB_STORAGE_REALTEK is not set CONFIG_USB_STORAGE_DATAFAB=m CONFIG_USB_STORAGE_FREECOM=m CONFIG_USB_STORAGE_ISD200=m CONFIG_USB_STORAGE_USBAT=m CONFIG_USB_STORAGE_SDDR09=m CONFIG_USB_STORAGE_SDDR55=m CONFIG_USB_STORAGE_JUMPSHOT=m # CONFIG_USB_STORAGE_ALAUDA is not set # CONFIG_USB_STORAGE_ONETOUCH is not set # CONFIG_USB_STORAGE_KARMA is not set # CONFIG_USB_STORAGE_CYPRESS_ATACB is not set # CONFIG_USB_STORAGE_ENE_UB6250 is not set # CONFIG_USB_UAS is not set # CONFIG_USB_LIBUSUAL is not set # # USB Imaging devices # CONFIG_USB_MDC800=m CONFIG_USB_MICROTEK=m # # USB port drivers # CONFIG_USB_SERIAL=m CONFIG_USB_EZUSB=y CONFIG_USB_SERIAL_GENERIC=y # CONFIG_USB_SERIAL_AIRCABLE is not set # CONFIG_USB_SERIAL_ARK3116 is not set CONFIG_USB_SERIAL_BELKIN=m # CONFIG_USB_SERIAL_CH341 is not set # CONFIG_USB_SERIAL_WHITEHEAT is not set CONFIG_USB_SERIAL_DIGI_ACCELEPORT=m # CONFIG_USB_SERIAL_CP210X is not set CONFIG_USB_SERIAL_CYPRESS_M8=m CONFIG_USB_SERIAL_EMPEG=m CONFIG_USB_SERIAL_FTDI_SIO=m # CONFIG_USB_SERIAL_FUNSOFT is not set CONFIG_USB_SERIAL_VISOR=m CONFIG_USB_SERIAL_IPAQ=m CONFIG_USB_SERIAL_IR=m CONFIG_USB_SERIAL_EDGEPORT=m CONFIG_USB_SERIAL_EDGEPORT_TI=m CONFIG_USB_SERIAL_GARMIN=m CONFIG_USB_SERIAL_IPW=m # CONFIG_USB_SERIAL_IUU is not set CONFIG_USB_SERIAL_KEYSPAN_PDA=m CONFIG_USB_SERIAL_KEYSPAN=m CONFIG_USB_SERIAL_KLSI=m CONFIG_USB_SERIAL_KOBIL_SCT=m CONFIG_USB_SERIAL_MCT_U232=m # CONFIG_USB_SERIAL_MOS7720 is not set # CONFIG_USB_SERIAL_MOS7840 is not set # CONFIG_USB_SERIAL_MOTOROLA is not set # CONFIG_USB_SERIAL_NAVMAN is not set CONFIG_USB_SERIAL_PL2303=m # CONFIG_USB_SERIAL_OTI6858 is not set # CONFIG_USB_SERIAL_QCAUX is not set # CONFIG_USB_SERIAL_QUALCOMM is not set # CONFIG_USB_SERIAL_SPCP8X5 is not set CONFIG_USB_SERIAL_HP4X=m CONFIG_USB_SERIAL_SAFE=m CONFIG_USB_SERIAL_SAFE_PADDED=y # CONFIG_USB_SERIAL_SAMBA is not set # CONFIG_USB_SERIAL_SIEMENS_MPI is not set # CONFIG_USB_SERIAL_SIERRAWIRELESS is not set # CONFIG_USB_SERIAL_SYMBOL is not set CONFIG_USB_SERIAL_TI=m CONFIG_USB_SERIAL_CYBERJACK=m CONFIG_USB_SERIAL_XIRCOM=m # CONFIG_USB_SERIAL_OPTION is not set CONFIG_USB_SERIAL_OMNINET=m # CONFIG_USB_SERIAL_OPTICON is not set # CONFIG_USB_SERIAL_VIVOPAY_SERIAL is not set # CONFIG_USB_SERIAL_ZIO is not set # CONFIG_USB_SERIAL_SSU100 is not set # CONFIG_USB_SERIAL_DEBUG is not set # # USB Miscellaneous drivers # CONFIG_USB_EMI62=m # CONFIG_USB_EMI26 is not set # CONFIG_USB_ADUTUX is not set # CONFIG_USB_SEVSEG is not set CONFIG_USB_RIO500=m CONFIG_USB_LEGOTOWER=m CONFIG_USB_LCD=m CONFIG_USB_LED=m # CONFIG_USB_CYPRESS_CY7C63 is not set # CONFIG_USB_CYTHERM is not set CONFIG_USB_IDMOUSE=m # CONFIG_USB_FTDI_ELAN is not set # CONFIG_USB_APPLEDISPLAY is not set CONFIG_USB_SISUSBVGA=m # CONFIG_USB_SISUSBVGA_CON is not set # CONFIG_USB_LD is not set # CONFIG_USB_TRANCEVIBRATOR is not set # CONFIG_USB_IOWARRIOR is not set # CONFIG_USB_TEST is not set # CONFIG_USB_ISIGHTFW is not set # CONFIG_USB_YUREX is not set # CONFIG_USB_GADGET is not set # # OTG and related infrastructure # # CONFIG_USB_GPIO_VBUS is not set # CONFIG_NOP_USB_XCEIV is not set # CONFIG_UWB is not set # CONFIG_MMC is not set # CONFIG_MEMSTICK is not set CONFIG_NEW_LEDS=y CONFIG_LEDS_CLASS=y # # LED drivers # # CONFIG_LEDS_LM3530 is not set # CONFIG_LEDS_ALIX2 is not set # CONFIG_LEDS_PCA9532 is not set # CONFIG_LEDS_GPIO is not set # CONFIG_LEDS_LP3944 is not set # CONFIG_LEDS_LP5521 is not set # CONFIG_LEDS_LP5523 is not set # CONFIG_LEDS_CLEVO_MAIL is not set # CONFIG_LEDS_PCA955X is not set # CONFIG_LEDS_DAC124S085 is not set # CONFIG_LEDS_REGULATOR is not set # CONFIG_LEDS_BD2802 is not set # CONFIG_LEDS_INTEL_SS4200 is not set # CONFIG_LEDS_LT3593 is not set CONFIG_LEDS_TRIGGERS=y # # LED Triggers # CONFIG_LEDS_TRIGGER_TIMER=y CONFIG_LEDS_TRIGGER_IDE_DISK=y CONFIG_LEDS_TRIGGER_HEARTBEAT=y # CONFIG_LEDS_TRIGGER_BACKLIGHT is not set # CONFIG_LEDS_TRIGGER_GPIO is not set CONFIG_LEDS_TRIGGER_DEFAULT_ON=y # # iptables trigger is under Netfilter config (LED target) # # CONFIG_NFC_DEVICES is not set # CONFIG_ACCESSIBILITY is not set # CONFIG_INFINIBAND is not set CONFIG_EDAC=y # # Reporting subsystems # # CONFIG_EDAC_DEBUG is not set CONFIG_EDAC_DECODE_MCE=y # CONFIG_EDAC_MCE_INJ is not set CONFIG_EDAC_MM_EDAC=y CONFIG_EDAC_MCE=y # CONFIG_EDAC_AMD64 is not set # CONFIG_EDAC_E752X is not set # CONFIG_EDAC_I82975X is not set # CONFIG_EDAC_I3000 is not set # CONFIG_EDAC_I3200 is not set # CONFIG_EDAC_X38 is not set # CONFIG_EDAC_I5400 is not set CONFIG_EDAC_I7CORE=y # CONFIG_EDAC_I5000 is not set # CONFIG_EDAC_I5100 is not set # CONFIG_EDAC_I7300 is not set # CONFIG_RTC_CLASS is not set CONFIG_DMADEVICES=y # CONFIG_DMADEVICES_DEBUG is not set # # DMA Devices # # CONFIG_INTEL_MID_DMAC is not set CONFIG_INTEL_IOATDMA=y # CONFIG_TIMB_DMA is not set # CONFIG_PCH_DMA is not set CONFIG_DMA_ENGINE=y # # DMA Clients # CONFIG_NET_DMA=y CONFIG_ASYNC_TX_DMA=y # CONFIG_DMATEST is not set CONFIG_DCA=y # CONFIG_AUXDISPLAY is not set # CONFIG_UIO is not set # CONFIG_STAGING is not set # CONFIG_SAMSUNG_LAPTOP is not set CONFIG_X86_PLATFORM_DEVICES=y # CONFIG_ASUS_LAPTOP is not set # CONFIG_DELL_LAPTOP is not set # CONFIG_FUJITSU_LAPTOP is not set # CONFIG_HP_ACCEL is not set # CONFIG_MSI_LAPTOP is not set # CONFIG_PANASONIC_LAPTOP is not set # CONFIG_COMPAL_LAPTOP is not set # CONFIG_SONY_LAPTOP is not set # CONFIG_IDEAPAD_LAPTOP is not set # CONFIG_THINKPAD_ACPI is not set # CONFIG_SENSORS_HDAPS is not set # CONFIG_INTEL_MENLOW is not set # CONFIG_ACPI_WMI is not set # CONFIG_ACPI_ASUS is not set # CONFIG_TOPSTAR_LAPTOP is not set # CONFIG_ACPI_TOSHIBA is not set # CONFIG_TOSHIBA_BT_RFKILL is not set # CONFIG_ACPI_CMPC is not set # CONFIG_INTEL_IPS is not set # CONFIG_IBM_RTL is not set # CONFIG_XO15_EBOOK is not set # # Firmware Drivers # CONFIG_EDD=y # CONFIG_EDD_OFF is not set CONFIG_FIRMWARE_MEMMAP=y CONFIG_DELL_RBU=m CONFIG_DCDBAS=y CONFIG_DMIID=y # CONFIG_DMI_SYSFS is not set # CONFIG_ISCSI_IBFT_FIND is not set # CONFIG_SIGMA is not set # # File systems # CONFIG_EXT2_FS=m CONFIG_EXT2_FS_XATTR=y CONFIG_EXT2_FS_POSIX_ACL=y CONFIG_EXT2_FS_SECURITY=y # CONFIG_EXT2_FS_XIP is not set CONFIG_EXT3_FS=m CONFIG_EXT3_DEFAULTS_TO_ORDERED=y CONFIG_EXT3_FS_XATTR=y CONFIG_EXT3_FS_POSIX_ACL=y CONFIG_EXT3_FS_SECURITY=y CONFIG_EXT4_FS=y CONFIG_EXT4_FS_XATTR=y CONFIG_EXT4_FS_POSIX_ACL=y CONFIG_EXT4_FS_SECURITY=y # CONFIG_EXT4_DEBUG is not set CONFIG_JBD=m # CONFIG_JBD_DEBUG is not set CONFIG_JBD2=y CONFIG_JBD2_DEBUG=y CONFIG_FS_MBCACHE=y # CONFIG_REISERFS_FS is not set # CONFIG_JFS_FS is not set CONFIG_XFS_FS=m CONFIG_XFS_QUOTA=y CONFIG_XFS_POSIX_ACL=y CONFIG_XFS_RT=y CONFIG_XFS_DEBUG=y CONFIG_GFS2_FS=m CONFIG_GFS2_FS_LOCKING_DLM=y CONFIG_OCFS2_FS=y CONFIG_OCFS2_FS_O2CB=y CONFIG_OCFS2_FS_USERSPACE_CLUSTER=m CONFIG_OCFS2_FS_STATS=y CONFIG_OCFS2_DEBUG_MASKLOG=y # CONFIG_OCFS2_DEBUG_FS is not set # CONFIG_BTRFS_FS is not set # CONFIG_NILFS2_FS is not set CONFIG_FS_POSIX_ACL=y CONFIG_EXPORTFS=y CONFIG_FILE_LOCKING=y CONFIG_FSNOTIFY=y CONFIG_DNOTIFY=y CONFIG_INOTIFY_USER=y CONFIG_FANOTIFY=y CONFIG_QUOTA=y CONFIG_QUOTA_NETLINK_INTERFACE=y CONFIG_PRINT_QUOTA_WARNING=y CONFIG_QUOTA_DEBUG=y CONFIG_QUOTA_TREE=y # CONFIG_QFMT_V1 is not set CONFIG_QFMT_V2=y CONFIG_QUOTACTL=y CONFIG_QUOTACTL_COMPAT=y CONFIG_AUTOFS4_FS=m # CONFIG_FUSE_FS is not set CONFIG_GENERIC_ACL=y # # Caches # CONFIG_FSCACHE=m CONFIG_FSCACHE_STATS=y CONFIG_FSCACHE_HISTOGRAM=y # CONFIG_FSCACHE_DEBUG is not set CONFIG_FSCACHE_OBJECT_LIST=y CONFIG_CACHEFILES=m # CONFIG_CACHEFILES_DEBUG is not set CONFIG_CACHEFILES_HISTOGRAM=y # # CD-ROM/DVD Filesystems # CONFIG_ISO9660_FS=y CONFIG_JOLIET=y CONFIG_ZISOFS=y CONFIG_UDF_FS=m CONFIG_UDF_NLS=y # # DOS/FAT/NT Filesystems # # CONFIG_MSDOS_FS is not set # CONFIG_VFAT_FS is not set # CONFIG_NTFS_FS is not set # # Pseudo filesystems # CONFIG_PROC_FS=y CONFIG_PROC_KCORE=y CONFIG_PROC_SYSCTL=y CONFIG_PROC_PAGE_MONITOR=y CONFIG_SYSFS=y CONFIG_TMPFS=y CONFIG_TMPFS_POSIX_ACL=y CONFIG_HUGETLBFS=y CONFIG_HUGETLB_PAGE=y CONFIG_CONFIGFS_FS=y CONFIG_MISC_FILESYSTEMS=y # CONFIG_ADFS_FS is not set # CONFIG_AFFS_FS is not set # CONFIG_ECRYPT_FS is not set # CONFIG_HFS_FS is not set # CONFIG_HFSPLUS_FS is not set # CONFIG_BEFS_FS is not set # CONFIG_BFS_FS is not set # CONFIG_EFS_FS is not set # CONFIG_JFFS2_FS is not set # CONFIG_UBIFS_FS is not set # CONFIG_LOGFS is not set # CONFIG_CRAMFS is not set # CONFIG_SQUASHFS is not set # CONFIG_VXFS_FS is not set CONFIG_MINIX_FS=m # CONFIG_OMFS_FS is not set # CONFIG_QNX4FS_FS is not set CONFIG_ROMFS_FS=m CONFIG_ROMFS_BACKED_BY_BLOCK=y # CONFIG_ROMFS_BACKED_BY_MTD is not set # CONFIG_ROMFS_BACKED_BY_BOTH is not set CONFIG_ROMFS_ON_BLOCK=y # CONFIG_PSTORE is not set # CONFIG_SYSV_FS is not set # CONFIG_UFS_FS is not set CONFIG_NETWORK_FILESYSTEMS=y CONFIG_NFS_FS=y CONFIG_NFS_V3=y CONFIG_NFS_V3_ACL=y CONFIG_NFS_V4=y # CONFIG_NFS_V4_1 is not set CONFIG_ROOT_NFS=y # CONFIG_NFS_USE_LEGACY_DNS is not set CONFIG_NFS_USE_KERNEL_DNS=y # CONFIG_NFS_USE_NEW_IDMAPPER is not set CONFIG_NFSD=m # CONFIG_NFSD_DEPRECATED is not set CONFIG_NFSD_V2_ACL=y CONFIG_NFSD_V3=y CONFIG_NFSD_V3_ACL=y CONFIG_NFSD_V4=y CONFIG_LOCKD=y CONFIG_LOCKD_V4=y CONFIG_NFS_ACL_SUPPORT=y CONFIG_NFS_COMMON=y CONFIG_SUNRPC=y CONFIG_SUNRPC_GSS=y CONFIG_RPCSEC_GSS_KRB5=y # CONFIG_CEPH_FS is not set # CONFIG_CIFS is not set # CONFIG_NCP_FS is not set # CONFIG_CODA_FS is not set # CONFIG_AFS_FS is not set # # Partition Types # CONFIG_PARTITION_ADVANCED=y # CONFIG_ACORN_PARTITION is not set CONFIG_OSF_PARTITION=y # CONFIG_AMIGA_PARTITION is not set # CONFIG_ATARI_PARTITION is not set CONFIG_MAC_PARTITION=y CONFIG_MSDOS_PARTITION=y CONFIG_BSD_DISKLABEL=y CONFIG_MINIX_SUBPARTITION=y CONFIG_SOLARIS_X86_PARTITION=y CONFIG_UNIXWARE_DISKLABEL=y # CONFIG_LDM_PARTITION is not set CONFIG_SGI_PARTITION=y # CONFIG_ULTRIX_PARTITION is not set CONFIG_SUN_PARTITION=y # CONFIG_KARMA_PARTITION is not set CONFIG_EFI_PARTITION=y CONFIG_SYSV68_PARTITION=y CONFIG_NLS=y CONFIG_NLS_DEFAULT="utf8" CONFIG_NLS_CODEPAGE_437=y CONFIG_NLS_CODEPAGE_737=m CONFIG_NLS_CODEPAGE_775=m CONFIG_NLS_CODEPAGE_850=m CONFIG_NLS_CODEPAGE_852=m CONFIG_NLS_CODEPAGE_855=m CONFIG_NLS_CODEPAGE_857=m CONFIG_NLS_CODEPAGE_860=m CONFIG_NLS_CODEPAGE_861=m CONFIG_NLS_CODEPAGE_862=m CONFIG_NLS_CODEPAGE_863=m CONFIG_NLS_CODEPAGE_864=m CONFIG_NLS_CODEPAGE_865=m CONFIG_NLS_CODEPAGE_866=m CONFIG_NLS_CODEPAGE_869=m CONFIG_NLS_CODEPAGE_936=m CONFIG_NLS_CODEPAGE_950=m CONFIG_NLS_CODEPAGE_932=m CONFIG_NLS_CODEPAGE_949=m CONFIG_NLS_CODEPAGE_874=m CONFIG_NLS_ISO8859_8=m CONFIG_NLS_CODEPAGE_1250=m CONFIG_NLS_CODEPAGE_1251=m CONFIG_NLS_ASCII=y CONFIG_NLS_ISO8859_1=m CONFIG_NLS_ISO8859_2=m CONFIG_NLS_ISO8859_3=m CONFIG_NLS_ISO8859_4=m CONFIG_NLS_ISO8859_5=m CONFIG_NLS_ISO8859_6=m CONFIG_NLS_ISO8859_7=m CONFIG_NLS_ISO8859_9=m CONFIG_NLS_ISO8859_13=m CONFIG_NLS_ISO8859_14=m CONFIG_NLS_ISO8859_15=m CONFIG_NLS_KOI8_R=m CONFIG_NLS_KOI8_U=m CONFIG_NLS_UTF8=m CONFIG_DLM=m CONFIG_DLM_DEBUG=y # # Kernel hacking # CONFIG_TRACE_IRQFLAGS_SUPPORT=y # CONFIG_PRINTK_TIME is not set CONFIG_DEFAULT_MESSAGE_LOGLEVEL=4 CONFIG_ENABLE_WARN_DEPRECATED=y CONFIG_ENABLE_MUST_CHECK=y CONFIG_FRAME_WARN=2048 CONFIG_MAGIC_SYSRQ=y # CONFIG_STRIP_ASM_SYMS is not set CONFIG_UNUSED_SYMBOLS=y CONFIG_DEBUG_FS=y # CONFIG_HEADERS_CHECK is not set # CONFIG_DEBUG_SECTION_MISMATCH is not set CONFIG_DEBUG_KERNEL=y # CONFIG_DEBUG_SHIRQ is not set # CONFIG_LOCKUP_DETECTOR is not set # CONFIG_HARDLOCKUP_DETECTOR is not set CONFIG_DETECT_HUNG_TASK=y # CONFIG_BOOTPARAM_HUNG_TASK_PANIC is not set CONFIG_BOOTPARAM_HUNG_TASK_PANIC_VALUE=0 CONFIG_SCHED_DEBUG=y # CONFIG_SCHEDSTATS is not set # CONFIG_TIMER_STATS is not set # CONFIG_DEBUG_OBJECTS is not set # CONFIG_DEBUG_SLAB is not set # CONFIG_DEBUG_KMEMLEAK is not set CONFIG_DEBUG_PREEMPT=y # CONFIG_DEBUG_RT_MUTEXES is not set # CONFIG_RT_MUTEX_TESTER is not set CONFIG_DEBUG_SPINLOCK=y CONFIG_DEBUG_MUTEXES=y CONFIG_DEBUG_LOCK_ALLOC=y CONFIG_PROVE_LOCKING=y # CONFIG_PROVE_RCU is not set # CONFIG_SPARSE_RCU_POINTER is not set CONFIG_LOCKDEP=y CONFIG_LOCK_STAT=y # CONFIG_DEBUG_LOCKDEP is not set CONFIG_TRACE_IRQFLAGS=y CONFIG_DEBUG_SPINLOCK_SLEEP=y # CONFIG_DEBUG_LOCKING_API_SELFTESTS is not set CONFIG_STACKTRACE=y # CONFIG_DEBUG_KOBJECT is not set CONFIG_DEBUG_BUGVERBOSE=y CONFIG_DEBUG_INFO=y # CONFIG_DEBUG_INFO_REDUCED is not set CONFIG_DEBUG_VM=y # CONFIG_DEBUG_VIRTUAL is not set CONFIG_DEBUG_WRITECOUNT=y CONFIG_DEBUG_MEMORY_INIT=y CONFIG_DEBUG_LIST=y CONFIG_TEST_LIST_SORT=y CONFIG_DEBUG_SG=y CONFIG_DEBUG_NOTIFIERS=y # CONFIG_DEBUG_CREDENTIALS is not set CONFIG_ARCH_WANT_FRAME_POINTERS=y CONFIG_FRAME_POINTER=y # CONFIG_BOOT_PRINTK_DELAY is not set # CONFIG_RCU_TORTURE_TEST is not set CONFIG_RCU_CPU_STALL_DETECTOR=y CONFIG_RCU_CPU_STALL_TIMEOUT=60 CONFIG_RCU_CPU_STALL_DETECTOR_RUNNABLE=y CONFIG_RCU_CPU_STALL_VERBOSE=y # CONFIG_KPROBES_SANITY_TEST is not set # CONFIG_BACKTRACE_SELF_TEST is not set # CONFIG_DEBUG_BLOCK_EXT_DEVT is not set # CONFIG_DEBUG_FORCE_WEAK_PER_CPU is not set # CONFIG_LKDTM is not set # CONFIG_FAULT_INJECTION is not set # CONFIG_LATENCYTOP is not set CONFIG_SYSCTL_SYSCALL_CHECK=y # CONFIG_DEBUG_PAGEALLOC is not set CONFIG_USER_STACKTRACE_SUPPORT=y CONFIG_NOP_TRACER=y CONFIG_HAVE_FUNCTION_TRACER=y CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y CONFIG_HAVE_FUNCTION_GRAPH_FP_TEST=y CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y CONFIG_HAVE_DYNAMIC_FTRACE=y CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y CONFIG_HAVE_SYSCALL_TRACEPOINTS=y CONFIG_HAVE_C_RECORDMCOUNT=y CONFIG_TRACER_MAX_TRACE=y CONFIG_RING_BUFFER=y CONFIG_EVENT_TRACING=y # CONFIG_EVENT_POWER_TRACING_DEPRECATED is not set CONFIG_CONTEXT_SWITCH_TRACER=y CONFIG_RING_BUFFER_ALLOW_SWAP=y CONFIG_TRACING=y CONFIG_GENERIC_TRACER=y CONFIG_TRACING_SUPPORT=y CONFIG_FTRACE=y # CONFIG_FUNCTION_TRACER is not set # CONFIG_IRQSOFF_TRACER is not set CONFIG_PREEMPT_TRACER=y CONFIG_SCHED_TRACER=y CONFIG_FTRACE_SYSCALLS=y CONFIG_BRANCH_PROFILE_NONE=y # CONFIG_PROFILE_ANNOTATED_BRANCHES is not set # CONFIG_PROFILE_ALL_BRANCHES is not set # CONFIG_STACK_TRACER is not set CONFIG_BLK_DEV_IO_TRACE=y CONFIG_KPROBE_EVENT=y # CONFIG_FTRACE_STARTUP_TEST is not set # CONFIG_MMIOTRACE is not set # CONFIG_RING_BUFFER_BENCHMARK is not set # CONFIG_PROVIDE_OHCI1394_DMA_INIT is not set # CONFIG_DYNAMIC_DEBUG is not set # CONFIG_DMA_API_DEBUG is not set # CONFIG_ATOMIC64_SELFTEST is not set # CONFIG_SAMPLES is not set CONFIG_HAVE_ARCH_KGDB=y # CONFIG_KGDB is not set CONFIG_HAVE_ARCH_KMEMCHECK=y # CONFIG_KMEMCHECK is not set # CONFIG_TEST_KSTRTOX is not set # CONFIG_STRICT_DEVMEM is not set CONFIG_X86_VERBOSE_BOOTUP=y CONFIG_EARLY_PRINTK=y # CONFIG_EARLY_PRINTK_DBGP is not set CONFIG_DEBUG_STACKOVERFLOW=y CONFIG_DEBUG_STACK_USAGE=y # CONFIG_DEBUG_PER_CPU_MAPS is not set # CONFIG_X86_PTDUMP is not set CONFIG_DEBUG_RODATA=y # CONFIG_DEBUG_RODATA_TEST is not set CONFIG_DEBUG_SET_MODULE_RONX=y # CONFIG_DEBUG_NX_TEST is not set # CONFIG_IOMMU_DEBUG is not set # CONFIG_IOMMU_STRESS is not set CONFIG_HAVE_MMIOTRACE_SUPPORT=y # CONFIG_X86_DECODER_SELFTEST is not set CONFIG_IO_DELAY_TYPE_0X80=0 CONFIG_IO_DELAY_TYPE_0XED=1 CONFIG_IO_DELAY_TYPE_UDELAY=2 CONFIG_IO_DELAY_TYPE_NONE=3 # CONFIG_IO_DELAY_0X80 is not set CONFIG_IO_DELAY_0XED=y # CONFIG_IO_DELAY_UDELAY is not set # CONFIG_IO_DELAY_NONE is not set CONFIG_DEFAULT_IO_DELAY_TYPE=1 # CONFIG_DEBUG_BOOT_PARAMS is not set # CONFIG_CPA_DEBUG is not set # CONFIG_OPTIMIZE_INLINING is not set # CONFIG_DEBUG_STRICT_USER_COPY_CHECKS is not set # # Security options # CONFIG_KEYS=y CONFIG_KEYS_DEBUG_PROC_KEYS=y # CONFIG_SECURITY_DMESG_RESTRICT is not set # CONFIG_SECURITY is not set # CONFIG_SECURITYFS is not set CONFIG_DEFAULT_SECURITY_DAC=y CONFIG_DEFAULT_SECURITY="" CONFIG_ASYNC_TX_DISABLE_PQ_VAL_DMA=y CONFIG_ASYNC_TX_DISABLE_XOR_VAL_DMA=y CONFIG_CRYPTO=y # # Crypto core or helper # CONFIG_CRYPTO_ALGAPI=y CONFIG_CRYPTO_ALGAPI2=y CONFIG_CRYPTO_AEAD=y CONFIG_CRYPTO_AEAD2=y CONFIG_CRYPTO_BLKCIPHER=y CONFIG_CRYPTO_BLKCIPHER2=y CONFIG_CRYPTO_HASH=y CONFIG_CRYPTO_HASH2=y CONFIG_CRYPTO_RNG=y CONFIG_CRYPTO_RNG2=y CONFIG_CRYPTO_PCOMP=m CONFIG_CRYPTO_PCOMP2=y CONFIG_CRYPTO_MANAGER=y CONFIG_CRYPTO_MANAGER2=y CONFIG_CRYPTO_MANAGER_DISABLE_TESTS=y # CONFIG_CRYPTO_GF128MUL is not set CONFIG_CRYPTO_NULL=m # CONFIG_CRYPTO_PCRYPT is not set CONFIG_CRYPTO_WORKQUEUE=y CONFIG_CRYPTO_CRYPTD=y CONFIG_CRYPTO_AUTHENC=m # CONFIG_CRYPTO_TEST is not set # # Authenticated Encryption with Associated Data # # CONFIG_CRYPTO_CCM is not set # CONFIG_CRYPTO_GCM is not set CONFIG_CRYPTO_SEQIV=y # # Block modes # CONFIG_CRYPTO_CBC=y # CONFIG_CRYPTO_CTR is not set CONFIG_CRYPTO_CTS=y CONFIG_CRYPTO_ECB=y # CONFIG_CRYPTO_LRW is not set CONFIG_CRYPTO_PCBC=y # CONFIG_CRYPTO_XTS is not set CONFIG_CRYPTO_FPU=y # # Hash modes # CONFIG_CRYPTO_HMAC=m # CONFIG_CRYPTO_XCBC is not set CONFIG_CRYPTO_VMAC=m # # Digest # CONFIG_CRYPTO_CRC32C=y CONFIG_CRYPTO_CRC32C_INTEL=y # CONFIG_CRYPTO_GHASH is not set CONFIG_CRYPTO_MD4=m CONFIG_CRYPTO_MD5=y CONFIG_CRYPTO_MICHAEL_MIC=y CONFIG_CRYPTO_RMD128=m CONFIG_CRYPTO_RMD160=m CONFIG_CRYPTO_RMD256=m CONFIG_CRYPTO_RMD320=m CONFIG_CRYPTO_SHA1=m CONFIG_CRYPTO_SHA256=m CONFIG_CRYPTO_SHA512=m CONFIG_CRYPTO_TGR192=m CONFIG_CRYPTO_WP512=m CONFIG_CRYPTO_GHASH_CLMUL_NI_INTEL=m # # Ciphers # CONFIG_CRYPTO_AES=y CONFIG_CRYPTO_AES_X86_64=y CONFIG_CRYPTO_AES_NI_INTEL=y CONFIG_CRYPTO_ANUBIS=m CONFIG_CRYPTO_ARC4=y CONFIG_CRYPTO_BLOWFISH=m # CONFIG_CRYPTO_CAMELLIA is not set CONFIG_CRYPTO_CAST5=m CONFIG_CRYPTO_CAST6=m CONFIG_CRYPTO_DES=y CONFIG_CRYPTO_FCRYPT=y CONFIG_CRYPTO_KHAZAD=m # CONFIG_CRYPTO_SALSA20 is not set # CONFIG_CRYPTO_SALSA20_X86_64 is not set # CONFIG_CRYPTO_SEED is not set CONFIG_CRYPTO_SERPENT=m CONFIG_CRYPTO_TEA=m CONFIG_CRYPTO_TWOFISH=m CONFIG_CRYPTO_TWOFISH_COMMON=m # CONFIG_CRYPTO_TWOFISH_X86_64 is not set # # Compression # CONFIG_CRYPTO_DEFLATE=m CONFIG_CRYPTO_ZLIB=m # CONFIG_CRYPTO_LZO is not set # # Random Number Generation # CONFIG_CRYPTO_ANSI_CPRNG=y # CONFIG_CRYPTO_USER_API_HASH is not set # CONFIG_CRYPTO_USER_API_SKCIPHER is not set # CONFIG_CRYPTO_HW is not set CONFIG_HAVE_KVM=y CONFIG_HAVE_KVM_IRQCHIP=y CONFIG_HAVE_KVM_EVENTFD=y CONFIG_KVM_APIC_ARCHITECTURE=y CONFIG_KVM_MMIO=y CONFIG_KVM_ASYNC_PF=y CONFIG_VIRTUALIZATION=y CONFIG_KVM=y CONFIG_KVM_INTEL=y # CONFIG_KVM_AMD is not set # CONFIG_KVM_MMU_AUDIT is not set # CONFIG_VHOST_NET is not set CONFIG_VIRTIO=y CONFIG_VIRTIO_RING=y CONFIG_VIRTIO_PCI=y CONFIG_VIRTIO_BALLOON=y CONFIG_BINARY_PRINTF=y # # Library routines # CONFIG_BITREVERSE=y CONFIG_GENERIC_FIND_FIRST_BIT=y CONFIG_GENERIC_FIND_NEXT_BIT=y CONFIG_GENERIC_FIND_LAST_BIT=y CONFIG_CRC_CCITT=m CONFIG_CRC16=y CONFIG_CRC_T10DIF=y CONFIG_CRC_ITU_T=m CONFIG_CRC32=y CONFIG_CRC7=m CONFIG_LIBCRC32C=y CONFIG_ZLIB_INFLATE=y CONFIG_ZLIB_DEFLATE=m CONFIG_LZO_DECOMPRESS=y CONFIG_XZ_DEC=y CONFIG_XZ_DEC_X86=y CONFIG_XZ_DEC_POWERPC=y CONFIG_XZ_DEC_IA64=y CONFIG_XZ_DEC_ARM=y CONFIG_XZ_DEC_ARMTHUMB=y CONFIG_XZ_DEC_SPARC=y CONFIG_XZ_DEC_BCJ=y # CONFIG_XZ_DEC_TEST is not set CONFIG_DECOMPRESS_GZIP=y CONFIG_DECOMPRESS_BZIP2=y CONFIG_DECOMPRESS_LZMA=y CONFIG_DECOMPRESS_XZ=y CONFIG_DECOMPRESS_LZO=y CONFIG_BCH=m CONFIG_TEXTSEARCH=y CONFIG_TEXTSEARCH_KMP=m CONFIG_TEXTSEARCH_BM=m CONFIG_TEXTSEARCH_FSM=m CONFIG_HAS_IOMEM=y CONFIG_HAS_IOPORT=y CONFIG_HAS_DMA=y CONFIG_CPU_RMAP=y CONFIG_NLATTR=y # CONFIG_AVERAGE is not set ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 16:04 ` Steven Whitehouse @ 2011-04-12 16:27 ` James Bottomley 2011-04-12 16:51 ` Steven Whitehouse 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 16:27 UTC (permalink / raw) To: Steven Whitehouse; +Cc: Tejun Heo, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 17:04 +0100, Steven Whitehouse wrote: > Hi, > > On Tue, 2011-04-12 at 10:14 -0500, James Bottomley wrote: > > On Tue, 2011-04-12 at 15:06 +0100, Steven Whitehouse wrote: > > > Messages attached - getting closer I think, but still not quite there. > > > It is very odd that so far (at least I've seen no other reports) that I > > > seem to be the only one who hits this. I wonder what is different about > > > my kernel/hardware... > > > > > > > csi: killing requests for dead queue > > > scsi: killing requests for dead queue > > > BUG: unable to handle kernel scsi: killing requests for dead queue > > > NULL pointer dereference at 0000000000000028 > > > IP: [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 > > > > Hmm, I don't see where this is ... it's a null pointer deref offset by > > 0x28 bytes ... but I can't see where ... can you resolve this to a line? > > > > James > > > > > > So assuming I've calculated this correctly, it should be just about.... > > /home/steve/linux-2.6/include/linux/rcupdate.h:677 > 6de8: a8 08 test $0x8,%al > 6dea: 0f 84 65 ff ff ff je 6d55 <blk_peek_request+0xf5> > 6df0: e8 00 00 00 00 callq 6df5 <blk_peek_request+0x195> > 6df1: R_X86_64_PC32 preempt_schedule-0x4 > 6df5: e9 5b ff ff ff jmpq 6d55 <blk_peek_request+0xf5> > 6dfa: 66 0f 1f 44 00 00 nopw 0x0(%rax,%rax,1) > __elv_next_request(): > /home/steve/linux-2.6/block/blk.h:65 > if (!list_empty(&q->queue_head)) { > rq = list_entry_rq(q->queue_head.next); > return rq; > } > > if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) > 6e00: 49 8b 44 24 18 mov 0x18(%r12),%rax > 6e05: 31 f6 xor %esi,%esi > 6e07: 48 8b 00 mov (%rax),%rax > 6e0a: 4c 89 e7 mov %r12,%rdi <---- here! > 6e0d: ff 50 28 callq *0x28(%rax) > 6e10: 85 c0 test %eax,%eax > 6e12: 0f 85 f4 fe ff ff jne 6d0c <blk_peek_request+0xac> > 6e18: 45 31 ed xor %r13d,%r13d > 6e1b: e9 70 ff ff ff jmpq 6d90 <blk_peek_request+0x130> > blk_peek_request(): > /home/steve/linux-2.6/block/blk-core.c:1912 > * so that we don't add it again > */ > > The offset I got was 6e0d, but I guess thats the start of the following instruction > by the time the fault is logged. Also I've attached my current .config just in case > that might be a help is reproducing it, Good work! it's simpler if you compile with -g ... then the gdb line command will just tell you all of this. However, it seems clear that elevator->ops is NULL (elevator_dispatch_fn is 0x28 offset into that in a 64 bit system). That's because blk_cleanup_queue called elevator_exit, so we need an out in the peek case. So unwrapping the onion, this is the next level James --- Index: linux-2.6/block/blk.h =================================================================== --- linux-2.6.orig/block/blk.h +++ linux-2.6/block/blk.h @@ -62,7 +62,7 @@ static inline struct request *__elv_next return rq; } - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) + if (!q->elevator->ops || !q->elevator->ops->elevator_dispatch_fn(q, 0)) return NULL; } } ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 16:27 ` James Bottomley @ 2011-04-12 16:51 ` Steven Whitehouse 2011-04-12 17:41 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-12 16:51 UTC (permalink / raw) To: James Bottomley; +Cc: Tejun Heo, linux-kernel, Jens Axboe [-- Attachment #1: Type: text/plain, Size: 3881 bytes --] Hi, On Tue, 2011-04-12 at 11:27 -0500, James Bottomley wrote: > On Tue, 2011-04-12 at 17:04 +0100, Steven Whitehouse wrote: > > Hi, > > > > On Tue, 2011-04-12 at 10:14 -0500, James Bottomley wrote: > > > On Tue, 2011-04-12 at 15:06 +0100, Steven Whitehouse wrote: > > > > Messages attached - getting closer I think, but still not quite there. > > > > It is very odd that so far (at least I've seen no other reports) that I > > > > seem to be the only one who hits this. I wonder what is different about > > > > my kernel/hardware... > > > > > > > > > > csi: killing requests for dead queue > > > > scsi: killing requests for dead queue > > > > BUG: unable to handle kernel scsi: killing requests for dead queue > > > > NULL pointer dereference at 0000000000000028 > > > > IP: [<ffffffff813b34ed>] blk_peek_request+0x1ad/0x220 > > > > > > Hmm, I don't see where this is ... it's a null pointer deref offset by > > > 0x28 bytes ... but I can't see where ... can you resolve this to a line? > > > > > > James > > > > > > > > > > So assuming I've calculated this correctly, it should be just about.... > > > > /home/steve/linux-2.6/include/linux/rcupdate.h:677 > > 6de8: a8 08 test $0x8,%al > > 6dea: 0f 84 65 ff ff ff je 6d55 <blk_peek_request+0xf5> > > 6df0: e8 00 00 00 00 callq 6df5 <blk_peek_request+0x195> > > 6df1: R_X86_64_PC32 preempt_schedule-0x4 > > 6df5: e9 5b ff ff ff jmpq 6d55 <blk_peek_request+0xf5> > > 6dfa: 66 0f 1f 44 00 00 nopw 0x0(%rax,%rax,1) > > __elv_next_request(): > > /home/steve/linux-2.6/block/blk.h:65 > > if (!list_empty(&q->queue_head)) { > > rq = list_entry_rq(q->queue_head.next); > > return rq; > > } > > > > if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) > > 6e00: 49 8b 44 24 18 mov 0x18(%r12),%rax > > 6e05: 31 f6 xor %esi,%esi > > 6e07: 48 8b 00 mov (%rax),%rax > > 6e0a: 4c 89 e7 mov %r12,%rdi <---- here! > > 6e0d: ff 50 28 callq *0x28(%rax) > > 6e10: 85 c0 test %eax,%eax > > 6e12: 0f 85 f4 fe ff ff jne 6d0c <blk_peek_request+0xac> > > 6e18: 45 31 ed xor %r13d,%r13d > > 6e1b: e9 70 ff ff ff jmpq 6d90 <blk_peek_request+0x130> > > blk_peek_request(): > > /home/steve/linux-2.6/block/blk-core.c:1912 > > * so that we don't add it again > > */ > > > > The offset I got was 6e0d, but I guess thats the start of the following instruction > > by the time the fault is logged. Also I've attached my current .config just in case > > that might be a help is reproducing it, > > Good work! it's simpler if you compile with -g ... then the gdb line > command will just tell you all of this. However, it seems clear that > elevator->ops is NULL (elevator_dispatch_fn is 0x28 offset into that in > a 64 bit system). > > That's because blk_cleanup_queue called elevator_exit, so we need an out > in the peek case. > > So unwrapping the onion, this is the next level > > James > > --- > > Index: linux-2.6/block/blk.h > =================================================================== > --- linux-2.6.orig/block/blk.h > +++ linux-2.6/block/blk.h > @@ -62,7 +62,7 @@ static inline struct request *__elv_next > return rq; > } > > - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) > + if (!q->elevator->ops || !q->elevator->ops->elevator_dispatch_fn(q, 0)) > return NULL; > } > } > > Still not quite there, but looking more hopeful now, Steve. [-- Warning: decoded text below may be mangled, UTF-8 assumed --] [-- Attachment #2: james4.txt --] [-- Type: text/plain; name="james4.txt"; charset="UTF-8", Size: 39825 bytes --] Initializing cgroup subsys cpuset Initializing cgroup subsys cpu Linux version 2.6.39-rc2+ (root@chywoon) (gcc version 4.5.1 20100924 (Red Hat 4.5.1-4) (GCC) ) #193 SMP PREEMPT Tue Apr 12 17:12:25 BST 2011 Command line: ro root=/dev/mapper/VolGroup-lv_root rhgb console=ttyS0,115200n8 console=tty0 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us mem=4G BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 00000000000a0000 (usable) BIOS-e820: 0000000000100000 - 00000000cf669000 (usable) BIOS-e820: 00000000cf669000 - 00000000cf67f000 (reserved) BIOS-e820: 00000000cf67f000 - 00000000cf6be000 (ACPI data) BIOS-e820: 00000000cf6be000 - 00000000d0000000 (reserved) BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) BIOS-e820: 00000000fe000000 - 0000000100000000 (reserved) BIOS-e820: 0000000100000000 - 0000000330000000 (usable) NX (Execute Disable) protection: active user-defined physical RAM map: user: 0000000000000000 - 00000000000a0000 (usable) user: 0000000000100000 - 00000000cf669000 (usable) user: 00000000cf669000 - 00000000cf67f000 (reserved) user: 00000000cf67f000 - 00000000cf6be000 (ACPI data) user: 00000000cf6be000 - 00000000d0000000 (reserved) user: 00000000e0000000 - 00000000f0000000 (reserved) user: 00000000fe000000 - 0000000100000000 (reserved) DMI 2.6 present. No AGP bridge found last_pfn = 0xcf669 max_arch_pfn = 0x400000000 x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 found SMP MP-table at [ffff8800000fe710] fe710 init_memory_mapping: 0000000000000000-00000000cf669000 RAMDISK: 3768b000 - 37ff0000 ACPI: RSDP 00000000000f0a90 00024 (v02 DELL ) ACPI: XSDT 00000000000f0b94 0009C (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: FACP 00000000cf6a3f9c 000F4 (v03 DELL PE_SC3 00000001 DELL 00000001) ACPI: DSDT 00000000cf67f000 03D5A (v01 DELL PE_SC3 00000001 INTL 20050624) ACPI: FACS 00000000cf6a6000 00040 ACPI: APIC 00000000cf6a3478 0015E (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SPCR 00000000cf6a35d8 00050 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: HPET 00000000cf6a362c 00038 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: DMAR 00000000cf6a3668 001B0 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: MCFG 00000000cf6a38c4 0003C (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: WD__ 00000000cf6a3904 00134 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SLIC 00000000cf6a3a3c 00024 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: ERST 00000000cf682edc 00270 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: HEST 00000000cf68314c 003A8 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: BERT 00000000cf682d5c 00030 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: EINJ 00000000cf682d8c 00150 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SRAT 00000000cf6a3bc0 00370 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: TCPA 00000000cf6a3f34 00064 (v02 DELL PE_SC3 00000001 DELL 00000001) ACPI: SSDT 00000000cf6a7000 01DEC (v01 INTEL PPM RCM 80000001 INTL 20061109) SRAT: PXM 1 -> APIC 0x10 -> Node 0 SRAT: PXM 2 -> APIC 0x00 -> Node 1 SRAT: PXM 1 -> APIC 0x12 -> Node 0 SRAT: PXM 2 -> APIC 0x02 -> Node 1 SRAT: PXM 1 -> APIC 0x14 -> Node 0 SRAT: PXM 2 -> APIC 0x04 -> Node 1 SRAT: PXM 1 -> APIC 0x16 -> Node 0 SRAT: PXM 2 -> APIC 0x06 -> Node 1 SRAT: Node 1 PXM 2 0-d0000000 SRAT: Node 1 PXM 2 100000000-1b0000000 SRAT: Node 0 PXM 1 1b0000000-330000000 NUMA: Node 1 [0,cf669000) + [100000000,1b0000000) -> [0,cf669000) NUMA: nodes only cover 0MB of your 3317MB e820 RAM. Not used. No NUMA configuration found Faking a node at 0000000000000000-00000000cf669000 Initmem setup node 0 0000000000000000-00000000cf669000 NODE_DATA [00000000cf65e000 - 00000000cf662fff] Zone PFN ranges: DMA 0x00000010 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal empty Movable zone start PFN for each node early_node_map[2] active PFN ranges 0: 0x00000010 -> 0x000000a0 0: 0x00000100 -> 0x000cf669 ACPI: PM-Timer IO Port: 0x808 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32]) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Using ACPI (MADT) for SMP configuration information ACPI: HPET id: 0x8086a301 base: 0xfed00000 SMP: Allowing 8 CPUs, 0 hotplug CPUs Allocating PCI resources starting at d0000000 (gap: d0000000:10000000) Booting paravirtualized kernel on bare hardware setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 PERCPU: Embedded 475 pages/cpu @ffff8800cb000000 s1913872 r8192 d23536 u2097152 Built 1 zonelists in Node order, mobility grouping on. Total pages: 837782 Policy zone: DMA32 Kernel command line: ro root=/dev/mapper/VolGroup-lv_root rhgb console=ttyS0,115200n8 console=tty0 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us mem=4G PID hash table entries: 4096 (order: 3, 32768 bytes) Checking aperture... No AGP bridge found Memory: 3300120k/3398052k available (6695k kernel code, 448k absent, 97484k reserved, 6535k data, 2572k init) Preemptable hierarchical RCU implementation. RCU debugfs-based tracing is enabled. NR_IRQS:512 Extended CMOS year: 2000 Console: colour VGA+ 80x25 console [tty0] enabled console [ttyS0] enabled Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar ... MAX_LOCKDEP_SUBCLASSES: 8 ... MAX_LOCK_DEPTH: 48 ... MAX_LOCKDEP_KEYS: 8191 ... CLASSHASH_SIZE: 4096 ... MAX_LOCKDEP_ENTRIES: 16384 ... MAX_LOCKDEP_CHAINS: 32768 ... CHAINHASH_SIZE: 16384 memory used by lock dependency info: 6367 kB per task-struct memory footprint: 2688 bytes allocated 27262976 bytes of page_cgroup please try 'cgroup_disable=memory' option if you don't want memory cgroups Fast TSC calibration using PIT Detected 1994.649 MHz processor. Calibrating delay loop (skipped), value calculated using timer frequency.. 3989.29 BogoMIPS (lpj=1994649) pid_max: default: 32768 minimum: 301 Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) Mount-cache hash table entries: 256 Initializing cgroup subsys ns ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup. Initializing cgroup subsys cpuacct Initializing cgroup subsys memory Initializing cgroup subsys freezer Initializing cgroup subsys net_cls Initializing cgroup subsys perf_event CPU: Physical Processor ID: 1 CPU: Processor Core ID: 0 mce: CPU supports 9 MCE banks CPU0: Thermal monitoring enabled (TM1) using mwait in idle threads. Freeing SMP alternatives: 24k freed ACPI: Core revision 20110316 Setting APIC routing to flat ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 CPU0: Intel(R) Xeon(R) CPU E5504 @ 2.00GHz stepping 05 Performance Events: PEBS fmt1+, Nehalem events, Intel PMU driver. ... version: 3 ... bit width: 48 ... generic registers: 4 ... value mask: 0000ffffffffffff ... max period: 000000007fffffff ... fixed-purpose events: 3 ... event mask: 000000070000000f lockdep: fixing up alternatives. Booting Node 0, Processors #1 lockdep: fixing up alternatives. #2 lockdep: fixing up alternatives. #3 lockdep: fixing up alternatives. #4 lockdep: fixing up alternatives. #5 lockdep: fixing up alternatives. #6 lockdep: fixing up alternatives. #7 Ok. Brought up 8 CPUs Total of 8 processors activated (31914.94 BogoMIPS). kworker/u:0 used greatest stack depth: 4808 bytes left print_constraints: dummy: NET: Registered protocol family 16 ACPI FADT declares the system doesn't support PCIe ASPM, so disable it ACPI: bus type pci registered dca service started, version 1.12.1 PCI: Using configuration type 1 for base access bio: create slab <bio-0> at 0 [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored ACPI: Interpreter enabled ACPI: (supports S0 S5) ACPI: Using IOAPIC for interrupt routing PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) pci_root PNP0A08:00: host bridge window [io 0x0000-0x0cf7] pci_root PNP0A08:00: host bridge window [io 0x0d00-0xffff] pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff] pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xfdffffff] pci_root PNP0A08:00: host bridge window [mem 0xfed40000-0xfed44fff] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f) pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f) pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f) pci 0000:00:01.0: PCI bridge to [bus 01-01] pci 0000:00:03.0: PCI bridge to [bus 02-02] pci 0000:00:04.0: PCI bridge to [bus 03-03] pci 0000:00:05.0: PCI bridge to [bus 04-04] pci 0000:00:06.0: PCI bridge to [bus 05-05] pci 0000:00:07.0: PCI bridge to [bus 06-06] pci 0000:00:09.0: PCI bridge to [bus 07-07] pci 0000:00:1e.0: PCI bridge to [bus 08-08] (subtractive decode) ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15) ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15) ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15) ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15) ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15) vgaarb: device added: PCI:0000:08:03.0,decodes=io+mem,owns=io+mem,locks=none vgaarb: loaded SCSI subsystem initialized usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb PCI: Using ACPI for IRQ routing HPET: 4 timers in total, 0 timers will be used for per-cpu timer Switching to clocksource hpet Switched to NOHz mode on CPU #0 Switched to NOHz mode on CPU #2 Switched to NOHz mode on CPU #4 Switched to NOHz mode on CPU #6 Switched to NOHz mode on CPU #5 Switched to NOHz mode on CPU #1 Switched to NOHz mode on CPU #3 Switched to NOHz mode on CPU #7 pnp: PnP ACPI init ACPI: bus type pnp registered system 00:07: [io 0x0800-0x087f] has been reserved system 00:07: [io 0x0880-0x08ff] has been reserved system 00:07: [io 0x0900-0x091f] has been reserved system 00:07: [io 0x0920-0x0923] has been reserved system 00:07: [io 0x0924] has been reserved system 00:07: [io 0x0c00-0x0c7f] has been reserved system 00:07: [io 0x0ca0-0x0ca7] has been reserved system 00:07: [io 0x0ca9-0x0cab] has been reserved system 00:07: [io 0x0cad-0x0caf] has been reserved system 00:08: [io 0x0ca8] has been reserved system 00:08: [io 0x0cac] has been reserved system 00:09: [mem 0xe0000000-0xefffffff] has been reserved system 00:0b: [mem 0xfed90000-0xfed91fff] has been reserved pnp: PnP ACPI: found 12 devices ACPI: ACPI bus type pnp unregistered pci 0000:00:01.0: PCI bridge to [bus 01-01] pci 0000:00:01.0: bridge window [io disabled] pci 0000:00:01.0: bridge window [mem 0xd6000000-0xd9ffffff] pci 0000:00:01.0: bridge window [mem pref disabled] pci 0000:00:03.0: PCI bridge to [bus 02-02] pci 0000:00:03.0: bridge window [io disabled] pci 0000:00:03.0: bridge window [mem 0xda000000-0xddffffff] pci 0000:00:03.0: bridge window [mem pref disabled] pci 0000:00:04.0: PCI bridge to [bus 03-03] pci 0000:00:04.0: bridge window [io 0xf000-0xffff] pci 0000:00:04.0: bridge window [mem 0xdf100000-0xdf1fffff] pci 0000:00:04.0: bridge window [mem pref disabled] pci 0000:00:05.0: PCI bridge to [bus 04-04] pci 0000:00:05.0: bridge window [io disabled] pci 0000:00:05.0: bridge window [mem disabled] pci 0000:00:05.0: bridge window [mem pref disabled] pci 0000:00:06.0: PCI bridge to [bus 05-05] pci 0000:00:06.0: bridge window [io disabled] pci 0000:00:06.0: bridge window [mem disabled] pci 0000:00:06.0: bridge window [mem pref disabled] pci 0000:00:07.0: PCI bridge to [bus 06-06] pci 0000:00:07.0: bridge window [io disabled] pci 0000:00:07.0: bridge window [mem disabled] pci 0000:00:07.0: bridge window [mem pref disabled] pci 0000:00:09.0: PCI bridge to [bus 07-07] pci 0000:00:09.0: bridge window [io disabled] pci 0000:00:09.0: bridge window [mem disabled] pci 0000:00:09.0: bridge window [mem pref disabled] pci 0000:08:03.0: BAR 6: assigned [mem 0xde000000-0xde00ffff pref] pci 0000:00:1e.0: PCI bridge to [bus 08-08] pci 0000:00:1e.0: bridge window [io disabled] pci 0000:00:1e.0: bridge window [mem 0xde000000-0xdeffffff] pci 0000:00:1e.0: bridge window [mem 0xd5800000-0xd5ffffff 64bit pref] pci 0000:00:01.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:03.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:04.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:05.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:06.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:07.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:09.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 NET: Registered protocol family 2 IP route cache hash table entries: 131072 (order: 8, 1048576 bytes) TCP established hash table entries: 524288 (order: 11, 8388608 bytes) TCP bind hash table entries: 65536 (order: 10, 5242880 bytes) TCP: Hash tables configured (established 524288 bind 65536) TCP reno registered UDP hash table entries: 2048 (order: 6, 393216 bytes) UDP-Lite hash table entries: 2048 (order: 6, 393216 bytes) NET: Registered protocol family 1 RPC: Registered udp transport module. RPC: Registered tcp transport module. RPC: Registered tcp NFSv4.1 backchannel transport module. Trying to unpack rootfs image as initramfs... Freeing initrd memory: 9620k freed Intel AES-NI instructions are not detected. audit: initializing netlink socket (disabled) type=2000 audit(1302625000.516:1): initialized HugeTLB registered 2 MB page size, pre-allocated 0 pages VFS: Disk quotas dquot_6.5.2 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) OCFS2 1.5.0 ocfs2: Registered cluster interface o2cb OCFS2 DLMFS 1.5.0 OCFS2 User DLM kernel interface loaded OCFS2 Node Manager 1.5.0 OCFS2 DLM 1.5.0 msgmni has been set to 6464 Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254) io scheduler noop registered io scheduler deadline registered io scheduler cfq registered (default) input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 ACPI: Power Button [PWRF] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled ÿserial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Real Time Clock Driver v1.12b Linux agpgart interface v0.103 brd: module loaded megasas: 00.00.05.34-rc1 Thu. Feb. 24 17:00:00 PDT 2011 megasas: 0x1000:0x0060:0x1028:0x1f0c: bus 3:slot 0:func 0 megaraid_sas 0000:03:00.0: PCI INT A -> GSI 33 (level, low) -> IRQ 33 megasas: FW now in Ready state megasas_init_mfi: fw_support_ieee=0 megasas: INIT adapter done scsi0 : LSI SAS based MegaRAID driver scsi 0:0:0:0: Direct-Access SEAGATE ST3146356SS HS0A PQ: 0 ANSI: 5 scsi 0:0:1:0: Direct-Access SEAGATE ST3146356SS HS0A PQ: 0 ANSI: 5 scsi 0:0:2:0: Direct-Access SEAGATE ST3300656SS HS0A PQ: 0 ANSI: 5 scsi 0:0:3:0: Direct-Access SEAGATE ST3300656SS HS0A PQ: 0 ANSI: 5 Refined TSC clocksource calibration: 1994.999 MHz. Switching to clocksource tsc scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi: killing requests for dead queue ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 386, comm: kworker/6:1 Not tainted 2.6.39-rc2+ #193 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c984d>] kref_get+0x2d/0x30 [<ffffffff813c824a>] kobject_get+0x1a/0x30 [<ffffffff81460874>] get_device+0x14/0x20 [<ffffffff81478bd7>] scsi_request_fn+0x37/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace d1e6d87b12dd138b ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c564d810->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 386, comm: kworker/6:1 Tainted: G W 2.6.39-rc2+ #193 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7783>] __list_del_entry+0x63/0xd0 [<ffffffff813d7801>] list_del+0x11/0x40 [<ffffffff8147d2ed>] scsi_device_dev_release_usercontext+0x4d/0x140 [<ffffffff810cbd5d>] ? trace_hardirqs_on_caller+0x14d/0x190 [<ffffffff8147d2a0>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 [<ffffffff8147d277>] scsi_device_dev_release+0x17/0x20 [<ffffffff81460a72>] device_release+0x22/0x90 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff813c81e5>] kobject_release+0x45/0x90 [<ffffffff813c81a0>] ? kobject_del+0x40/0x40 [<ffffffff813c97e7>] kref_put+0x37/0x70 [<ffffffff813c80a7>] kobject_put+0x27/0x60 [<ffffffff814608a2>] put_device+0x12/0x20 [<ffffffff81478c59>] scsi_request_fn+0xb9/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace d1e6d87b12dd138c ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c564d820->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 386, comm: kworker/6:1 Tainted: G W 2.6.39-rc2+ #193 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7783>] __list_del_entry+0x63/0xd0 [<ffffffff813d7801>] list_del+0x11/0x40 [<ffffffff8147d2f7>] scsi_device_dev_release_usercontext+0x57/0x140 [<ffffffff810cbd5d>] ? trace_hardirqs_on_caller+0x14d/0x190 [<ffffffff8147d2a0>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 [<ffffffff8147d277>] scsi_device_dev_release+0x17/0x20 [<ffffffff81460a72>] device_release+0x22/0x90 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff813c81e5>] kobject_release+0x45/0x90 [<ffffffff813c81a0>] ? kobject_del+0x40/0x40 [<ffffffff813c97e7>] kref_put+0x37/0x70 [<ffffffff813c80a7>] kobject_put+0x27/0x60 [<ffffffff814608a2>] put_device+0x12/0x20 [<ffffffff81478c59>] scsi_request_fn+0xb9/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace d1e6d87b12dd138d ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c564d890->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 386, comm: kworker/6:1 Tainted: G W 2.6.39-rc2+ #193 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7783>] __list_del_entry+0x63/0xd0 [<ffffffff813d7801>] list_del+0x11/0x40 [<ffffffff8147d304>] scsi_device_dev_release_usercontext+0x64/0x140 [<ffffffff810cbd5d>] ? trace_hardirqs_on_caller+0x14d/0x190 [<ffffffff8147d2a0>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 [<ffffffff8147d277>] scsi_device_dev_release+0x17/0x20 [<ffffffff81460a72>] device_release+0x22/0x90 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff813c81e5>] kobject_release+0x45/0x90 [<ffffffff813c81a0>] ? kobject_del+0x40/0x40 [<ffffffff813c97e7>] kref_put+0x37/0x70 [<ffffffff813c80a7>] kobject_put+0x27/0x60 [<ffffffff814608a2>] put_device+0x12/0x20 [<ffffffff81478c59>] scsi_request_fn+0xb9/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace d1e6d87b12dd138e ]--- ------------[ cut here ]------------ WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() Hardware name: PowerEdge R710 Modules linked in: Pid: 698, comm: kworker/4:2 Tainted: G W 2.6.39-rc2+ #193 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 [<ffffffff813c984d>] kref_get+0x2d/0x30 [<ffffffff813c824a>] kobject_get+0x1a/0x30 [<ffffffff81460874>] get_device+0x14/0x20 [<ffffffff81478bd7>] scsi_request_fn+0x37/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace d1e6d87b12dd138f ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c564d810->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 698, comm: kworker/4:2 Tainted: G W 2.6.39-rc2+ #193 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7783>] __list_del_entry+0x63/0xd0 [<ffffffff813d7801>] list_del+0x11/0x40 [<ffffffff8147d2ed>] scsi_device_dev_release_usercontext+0x4d/0x140 [<ffffffff810cbd5d>] ? trace_hardirqs_on_caller+0x14d/0x190 [<ffffffff8147d2a0>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 [<ffffffff8147d277>] scsi_device_dev_release+0x17/0x20 [<ffffffff81460a72>] device_release+0x22/0x90 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff813c81e5>] kobject_release+0x45/0x90 [<ffffffff813c81a0>] ? kobject_del+0x40/0x40 [<ffffffff813c97e7>] kref_put+0x37/0x70 [<ffffffff813c80a7>] kobject_put+0x27/0x60 [<ffffffff814608a2>] put_device+0x12/0x20 [<ffffffff81478c59>] scsi_request_fn+0xb9/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace d1e6d87b12dd1390 ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c564d820->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 698, comm: kworker/4:2 Tainted: G W 2.6.39-rc2+ #193 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7783>] __list_del_entry+0x63/0xd0 [<ffffffff813d7801>] list_del+0x11/0x40 [<ffffffff8147d2f7>] scsi_device_dev_release_usercontext+0x57/0x140 [<ffffffff810cbd5d>] ? trace_hardirqs_on_caller+0x14d/0x190 [<ffffffff8147d2a0>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 [<ffffffff8147d277>] scsi_device_dev_release+0x17/0x20 [<ffffffff81460a72>] device_release+0x22/0x90 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff813c81e5>] kobject_release+0x45/0x90 [<ffffffff813c81a0>] ? kobject_del+0x40/0x40 [<ffffffff813c97e7>] kref_put+0x37/0x70 [<ffffffff813c80a7>] kobject_put+0x27/0x60 [<ffffffff814608a2>] put_device+0x12/0x20 [<ffffffff81478c59>] scsi_request_fn+0xb9/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace d1e6d87b12dd1391 ]--- ------------[ cut here ]------------ WARNING: at lib/list_debug.c:47 __list_del_entry+0x63/0xd0() Hardware name: PowerEdge R710 list_del corruption, ffff8800c564d890->next is LIST_POISON1 (dead000000100100) Modules linked in: Pid: 698, comm: kworker/4:2 Tainted: G W 2.6.39-rc2+ #193 Call Trace: [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 [<ffffffff8108fb71>] warn_slowpath_fmt+0x41/0x50 [<ffffffff813d7783>] __list_del_entry+0x63/0xd0 [<ffffffff813d7801>] list_del+0x11/0x40 [<ffffffff8147d304>] scsi_device_dev_release_usercontext+0x64/0x140 [<ffffffff810cbd5d>] ? trace_hardirqs_on_caller+0x14d/0x190 [<ffffffff8147d2a0>] ? scsi_device_cls_release+0x20/0x20 [<ffffffff810ac826>] execute_in_process_context+0x86/0xa0 [<ffffffff8147d277>] scsi_device_dev_release+0x17/0x20 [<ffffffff81460a72>] device_release+0x22/0x90 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff813c81e5>] kobject_release+0x45/0x90 [<ffffffff813c81a0>] ? kobject_del+0x40/0x40 [<ffffffff813c97e7>] kref_put+0x37/0x70 [<ffffffff813c80a7>] kobject_put+0x27/0x60 [<ffffffff814608a2>] put_device+0x12/0x20 [<ffffffff81478c59>] scsi_request_fn+0xb9/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810aad7c>] process_scheduled_works+0x2c/0x40 [<ffffffff810ad0fe>] worker_thread+0x26e/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 ---[ end trace d1e6d87b12dd1392 ]--- scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue BUG: unable to handle kernel NULL pointer dereference at 00000000000002bc IP: [<ffffffff8147ddb3>] scsi_sysfs_device_initialize+0xd3/0x150 PGD 0 Oops: 0000 [#1] PREEMPT SMP last sysfs file: CPU 4 Modules linked in: Pid: 1, comm: swapper Tainted: G W 2.6.39-rc2+ #193 Dell Inc. PowerEdge R710/0N047H RIP: 0010:[<ffffffff8147ddb3>] [<ffffffff8147ddb3>] scsi_sysfs_device_initialize+0xd3/0x150 RSP: 0018:ffff8800c90a18c0 EFLAGS: 00010246 RAX: 0000000000000000 RBX: ffff8800c564d800 RCX: 00000000ffffffff RDX: 0000000000000000 RSI: 000000000000002f RDI: 0000000000000001 RBP: ffff8800c90a18f0 R08: 000000000000fffc R09: 000000000000fffe R10: 0000000000000000 R11: 0000000000000000 R12: ffff8800379a6c10 R13: 0000000000000000 R14: ffff8800c564d9b0 R15: ffff8800c564dc20 FS: 0000000000000000(0000) GS:ffff8800cb800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 00000000000002bc CR3: 0000000001c33000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process swapper (pid: 1, threadinfo ffff8800c90a0000, task ffff8800c909e040) Stack: ffff8800c566f000 ffff8800c564d800 ffff8800c566f000 ffff8800c5640000 0000000000000000 ffff8800c566f028 ffff8800c90a1930 ffffffff8147a49e ffff8800c90a1930 0000000000000000 ffff8800c566f000 0000000000000000 Call Trace: [<ffffffff8147a49e>] scsi_alloc_sdev+0x1ee/0x290 [<ffffffff8147aba8>] scsi_probe_and_add_lun+0x3a8/0xc30 [<ffffffff810cbdad>] ? trace_hardirqs_on+0xd/0x10 [<ffffffff81467830>] ? anon_transport_dummy_function+0x10/0x10 [<ffffffff8167d029>] ? mutex_unlock+0x9/0x10 [<ffffffff8146758c>] ? attribute_container_add_device+0x6c/0x140 [<ffffffff813c824a>] ? kobject_get+0x1a/0x30 [<ffffffff8147a281>] ? scsi_alloc_target+0x2a1/0x2d0 [<ffffffff813c81a0>] ? kobject_del+0x40/0x40 [<ffffffff8147b6e2>] __scsi_scan_target+0x102/0x770 [<ffffffff81682739>] ? sub_preempt_count+0xa9/0xe0 [<ffffffff8147bdd6>] scsi_scan_channel+0x86/0xb0 [<ffffffff8147c0f8>] scsi_scan_host_selected+0xf8/0x1a0 [<ffffffff8147c229>] do_scsi_scan_host+0x89/0x90 [<ffffffff8147c508>] scsi_scan_host+0x198/0x1f0 [<ffffffff81673c8d>] megasas_probe_one+0x127b/0x1535 [<ffffffff813e8382>] pci_device_probe+0xf2/0x110 [<ffffffff8146407a>] ? driver_sysfs_add+0x7a/0xb0 [<ffffffff81464349>] driver_probe_device+0x89/0x1a0 [<ffffffff81464503>] __driver_attach+0xa3/0xb0 [<ffffffff81464460>] ? driver_probe_device+0x1a0/0x1a0 [<ffffffff8146336e>] bus_for_each_dev+0x5e/0x90 [<ffffffff81463ff9>] driver_attach+0x19/0x20 [<ffffffff81463b8a>] bus_add_driver+0xba/0x270 [<ffffffff81ef1c36>] ? megaraid_init+0xbc/0xbc [<ffffffff8146488f>] driver_register+0x6f/0x130 [<ffffffff81ef1c36>] ? megaraid_init+0xbc/0xbc [<ffffffff813e85f1>] __pci_register_driver+0x61/0xe0 [<ffffffff81ef1c36>] ? megaraid_init+0xbc/0xbc [<ffffffff81ef1cd2>] megasas_init+0x9c/0x1e6 [<ffffffff810002bf>] do_one_initcall+0x3f/0x1a0 [<ffffffff81ec1e28>] kernel_init+0xde/0x163 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff81ec1d4a>] ? start_kernel+0x4ca/0x4ca [<ffffffff816870e0>] ? gs_change+0x13/0x13 Code: 89 83 20 04 00 00 48 c7 c6 0d a5 a1 81 48 8b 03 48 c7 83 78 06 00 00 60 38 cb 81 4c 89 ff 8b 90 24 02 00 00 31 c0 e8 0d 2c fe ff 0f b6 85 bc 02 00 00 4c 89 f7 88 83 e9 00 00 00 e8 07 9c fe RIP [<ffffffff8147ddb3>] scsi_sysfs_device_initialize+0xd3/0x150 RSP <ffff8800c90a18c0> CR2: 00000000000002bc ---[ end trace d1e6d87b12dd1393 ]--- swapper used greatest stack depth: 3576 bytes left Kernel panic - not syncing: Attempted to kill init! Pid: 1, comm: swapper Tainted: G D W 2.6.39-rc2+ #193 Call Trace: [<ffffffff8167a336>] panic+0x96/0x1ab [<ffffffff81093cbd>] ? do_exit+0x7bd/0x900 [<ffffffff8167e60d>] ? _raw_write_lock_irq+0x7d/0x90 [<ffffffff81093d3b>] do_exit+0x83b/0x900 [<ffffffff816800b7>] oops_end+0x97/0xd0 [<ffffffff81064b70>] no_context+0xf0/0x260 [<ffffffff810cbbdb>] ? mark_held_locks+0x6b/0xa0 [<ffffffff81064e05>] __bad_area_nosemaphore+0x125/0x1f0 [<ffffffff8104376e>] ? native_sched_clock+0x2e/0x80 [<ffffffff816823ed>] ? do_page_fault+0x2bd/0x560 [<ffffffff81064ede>] bad_area_nosemaphore+0xe/0x10 [<ffffffff8168255e>] do_page_fault+0x42e/0x560 [<ffffffff813d0401>] ? vsnprintf+0x471/0x610 [<ffffffff813d1dcd>] ? trace_hardirqs_off_thunk+0x3a/0x3c [<ffffffff8167f255>] page_fault+0x25/0x30 [<ffffffff8147ddb3>] ? scsi_sysfs_device_initialize+0xd3/0x150 [<ffffffff8147a49e>] scsi_alloc_sdev+0x1ee/0x290 [<ffffffff8147aba8>] scsi_probe_and_add_lun+0x3a8/0xc30 [<ffffffff810cbdad>] ? trace_hardirqs_on+0xd/0x10 [<ffffffff81467830>] ? anon_transport_dummy_function+0x10/0x10 [<ffffffff8167d029>] ? mutex_unlock+0x9/0x10 [<ffffffff8146758c>] ? attribute_container_add_device+0x6c/0x140 [<ffffffff813c824a>] ? kobject_get+0x1a/0x30 [<ffffffff8147a281>] ? scsi_alloc_target+0x2a1/0x2d0 [<ffffffff813c81a0>] ? kobject_del+0x40/0x40 [<ffffffff8147b6e2>] __scsi_scan_target+0x102/0x770 [<ffffffff81682739>] ? sub_preempt_count+0xa9/0xe0 [<ffffffff8147bdd6>] scsi_scan_channel+0x86/0xb0 [<ffffffff8147c0f8>] scsi_scan_host_selected+0xf8/0x1a0 [<ffffffff8147c229>] do_scsi_scan_host+0x89/0x90 [<ffffffff8147c508>] scsi_scan_host+0x198/0x1f0 [<ffffffff81673c8d>] megasas_probe_one+0x127b/0x1535 [<ffffffff813e8382>] pci_device_probe+0xf2/0x110 [<ffffffff8146407a>] ? driver_sysfs_add+0x7a/0xb0 [<ffffffff81464349>] driver_probe_device+0x89/0x1a0 [<ffffffff81464503>] __driver_attach+0xa3/0xb0 [<ffffffff81464460>] ? driver_probe_device+0x1a0/0x1a0 [<ffffffff8146336e>] bus_for_each_dev+0x5e/0x90 [<ffffffff81463ff9>] driver_attach+0x19/0x20 [<ffffffff81463b8a>] bus_add_driver+0xba/0x270 [<ffffffff81ef1c36>] ? megaraid_init+0xbc/0xbc [<ffffffff8146488f>] driver_register+0x6f/0x130 [<ffffffff81ef1c36>] ? megaraid_init+0xbc/0xbc [<ffffffff813e85f1>] __pci_register_driver+0x61/0xe0 [<ffffffff81ef1c36>] ? megaraid_init+0xbc/0xbc [<ffffffff81ef1cd2>] megasas_init+0x9c/0x1e6 [<ffffffff810002bf>] do_one_initcall+0x3f/0x1a0 [<ffffffff81ec1e28>] kernel_init+0xde/0x163 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec66>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff81ec1d4a>] ? start_kernel+0x4ca/0x4ca [<ffffffff816870e0>] ? gs_change+0x13/0x13 ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 16:51 ` Steven Whitehouse @ 2011-04-12 17:41 ` James Bottomley 2011-04-12 18:33 ` Steven Whitehouse 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 17:41 UTC (permalink / raw) To: Steven Whitehouse; +Cc: Tejun Heo, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 17:51 +0100, Steven Whitehouse wrote: > Still not quite there, but looking more hopeful now, Not sure I share your optimism; but this one > scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 > scsi: killing requests for dead queue > ------------[ cut here ]------------ > WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() > Hardware name: PowerEdge R710 > Modules linked in: > Pid: 386, comm: kworker/6:1 Not tainted 2.6.39-rc2+ #193 > Call Trace: > [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 > [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 > [<ffffffff813c984d>] kref_get+0x2d/0x30 > [<ffffffff813c824a>] kobject_get+0x1a/0x30 > [<ffffffff81460874>] get_device+0x14/0x20 > [<ffffffff81478bd7>] scsi_request_fn+0x37/0x4a0 Is definitely a race between the last put of the SCSI device and the block delayed work. The signal that mediates that race is supposed to be the q->queuedata being null, but that doesn't get set until some time into the release function (by which time the ref is already zero). Closing the window completely involves setting this to NULL before we do the final put when we know everything else is gone. So, here's the next incremental. James --- Index: linux-2.6/drivers/scsi/scsi_sysfs.c =================================================================== --- linux-2.6.orig/drivers/scsi/scsi_sysfs.c +++ linux-2.6/drivers/scsi/scsi_sysfs.c @@ -323,7 +323,6 @@ static void scsi_device_dev_release_user } if (sdev->request_queue) { - sdev->request_queue->queuedata = NULL; /* user context needed to free queue */ scsi_free_queue(sdev->request_queue); /* temporary expedient, try to catch use of queue lock @@ -937,6 +936,7 @@ void __scsi_remove_device(struct scsi_de if (sdev->host->hostt->slave_destroy) sdev->host->hostt->slave_destroy(sdev); transport_destroy_device(dev); + sdev->request_queue->queuedata = NULL; put_device(dev); } ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 17:41 ` James Bottomley @ 2011-04-12 18:33 ` Steven Whitehouse 2011-04-12 19:56 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-12 18:33 UTC (permalink / raw) To: James Bottomley; +Cc: Tejun Heo, linux-kernel, Jens Axboe [-- Attachment #1: Type: text/plain, Size: 3678 bytes --] Hi, On Tue, 2011-04-12 at 12:41 -0500, James Bottomley wrote: > On Tue, 2011-04-12 at 17:51 +0100, Steven Whitehouse wrote: > > Still not quite there, but looking more hopeful now, > > Not sure I share your optimism; but this one > Neither do I any more :-) Looks like we are back in blk_peek_request() again. > > scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 > > scsi: killing requests for dead queue > > ------------[ cut here ]------------ > > WARNING: at lib/kref.c:34 kref_get+0x2d/0x30() > > Hardware name: PowerEdge R710 > > Modules linked in: > > Pid: 386, comm: kworker/6:1 Not tainted 2.6.39-rc2+ #193 > > Call Trace: > > [<ffffffff8108fa9a>] warn_slowpath_common+0x7a/0xb0 > > [<ffffffff8108fae5>] warn_slowpath_null+0x15/0x20 > > [<ffffffff813c984d>] kref_get+0x2d/0x30 > > [<ffffffff813c824a>] kobject_get+0x1a/0x30 > > [<ffffffff81460874>] get_device+0x14/0x20 > > [<ffffffff81478bd7>] scsi_request_fn+0x37/0x4a0 > > Is definitely a race between the last put of the SCSI device and the > block delayed work. The signal that mediates that race is supposed to > be the q->queuedata being null, but that doesn't get set until some time > into the release function (by which time the ref is already zero). > > Closing the window completely involves setting this to NULL before we do > the final put when we know everything else is gone. So, here's the next > incremental. > > James > > --- > > Index: linux-2.6/drivers/scsi/scsi_sysfs.c > =================================================================== > --- linux-2.6.orig/drivers/scsi/scsi_sysfs.c > +++ linux-2.6/drivers/scsi/scsi_sysfs.c > @@ -323,7 +323,6 @@ static void scsi_device_dev_release_user > } > > if (sdev->request_queue) { > - sdev->request_queue->queuedata = NULL; > /* user context needed to free queue */ > scsi_free_queue(sdev->request_queue); > /* temporary expedient, try to catch use of queue lock > @@ -937,6 +936,7 @@ void __scsi_remove_device(struct scsi_de > if (sdev->host->hostt->slave_destroy) > sdev->host->hostt->slave_destroy(sdev); > transport_destroy_device(dev); > + sdev->request_queue->queuedata = NULL; > put_device(dev); > } > > > __elv_next_request(): /home/steve/linux-2.6/block/blk.h:60 static inline struct request *__elv_next_request(struct request_queue *q) { struct request *rq; while (1) { if (!list_empty(&q->queue_head)) { 6d59: 49 39 dc cmp %rbx,%r12 6d5c: 0f 85 2e ff ff ff jne 6c90 <blk_peek_request+0x30> /home/steve/linux-2.6/block/blk.h:65 rq = list_entry_rq(q->queue_head.next); return rq; } if (!q->elevator->ops || !q->elevator->ops->elevator_dispatch_fn (q, 0)) 6d62: 49 8b 44 24 18 mov 0x18(%r12),%rax 6d67: 48 8b 00 mov (%rax),%rax 6d6a: 48 85 c0 test %rax,%rax 6d6d: 74 0c je 6d7b <blk_peek_request+0x11b> 6d6f: 31 f6 xor %esi,%esi 6d71: 4c 89 e7 mov %r12,%rdi <----- here 6d74: ff 50 28 callq *0x28(%rax) 6d77: 85 c0 test %eax,%eax 6d79: 75 da jne 6d55 <blk_peek_request+0xf5> 6d7b: 45 31 ed xor %r13d,%r13d blk_peek_request(): /home/steve/linux-2.6/block/blk-core.c:1929 break; } } return rq; } Boot logs attached as usual, Steve. [-- Warning: decoded text below may be mangled, UTF-8 assumed --] [-- Attachment #2: james5.txt --] [-- Type: text/plain; name="james5.txt"; charset="UTF-8", Size: 25009 bytes --] Initializing cgroup subsys cpuset Initializing cgroup subsys cpu Linux version 2.6.39-rc2+ (root@chywoon) (gcc version 4.5.1 20100924 (Red Hat 4.5.1-4) (GCC) ) #195 SMP PREEMPT Tue Apr 12 18:46:04 BST 2011 Command line: ro root=/dev/mapper/VolGroup-lv_root rhgb console=ttyS0,115200n8 console=tty0 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us mem=4G BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 00000000000a0000 (usable) BIOS-e820: 0000000000100000 - 00000000cf669000 (usable) BIOS-e820: 00000000cf669000 - 00000000cf67f000 (reserved) BIOS-e820: 00000000cf67f000 - 00000000cf6be000 (ACPI data) BIOS-e820: 00000000cf6be000 - 00000000d0000000 (reserved) BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) BIOS-e820: 00000000fe000000 - 0000000100000000 (reserved) BIOS-e820: 0000000100000000 - 0000000330000000 (usable) NX (Execute Disable) protection: active user-defined physical RAM map: user: 0000000000000000 - 00000000000a0000 (usable) user: 0000000000100000 - 00000000cf669000 (usable) user: 00000000cf669000 - 00000000cf67f000 (reserved) user: 00000000cf67f000 - 00000000cf6be000 (ACPI data) user: 00000000cf6be000 - 00000000d0000000 (reserved) user: 00000000e0000000 - 00000000f0000000 (reserved) user: 00000000fe000000 - 0000000100000000 (reserved) DMI 2.6 present. No AGP bridge found last_pfn = 0xcf669 max_arch_pfn = 0x400000000 x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 found SMP MP-table at [ffff8800000fe710] fe710 init_memory_mapping: 0000000000000000-00000000cf669000 RAMDISK: 3768b000 - 37ff0000 ACPI: RSDP 00000000000f0a90 00024 (v02 DELL ) ACPI: XSDT 00000000000f0b94 0009C (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: FACP 00000000cf6a3f9c 000F4 (v03 DELL PE_SC3 00000001 DELL 00000001) ACPI: DSDT 00000000cf67f000 03D5A (v01 DELL PE_SC3 00000001 INTL 20050624) ACPI: FACS 00000000cf6a6000 00040 ACPI: APIC 00000000cf6a3478 0015E (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SPCR 00000000cf6a35d8 00050 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: HPET 00000000cf6a362c 00038 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: DMAR 00000000cf6a3668 001B0 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: MCFG 00000000cf6a38c4 0003C (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: WD__ 00000000cf6a3904 00134 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SLIC 00000000cf6a3a3c 00024 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: ERST 00000000cf682edc 00270 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: HEST 00000000cf68314c 003A8 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: BERT 00000000cf682d5c 00030 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: EINJ 00000000cf682d8c 00150 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: SRAT 00000000cf6a3bc0 00370 (v01 DELL PE_SC3 00000001 DELL 00000001) ACPI: TCPA 00000000cf6a3f34 00064 (v02 DELL PE_SC3 00000001 DELL 00000001) ACPI: SSDT 00000000cf6a7000 01DEC (v01 INTEL PPM RCM 80000001 INTL 20061109) SRAT: PXM 1 -> APIC 0x10 -> Node 0 SRAT: PXM 2 -> APIC 0x00 -> Node 1 SRAT: PXM 1 -> APIC 0x12 -> Node 0 SRAT: PXM 2 -> APIC 0x02 -> Node 1 SRAT: PXM 1 -> APIC 0x14 -> Node 0 SRAT: PXM 2 -> APIC 0x04 -> Node 1 SRAT: PXM 1 -> APIC 0x16 -> Node 0 SRAT: PXM 2 -> APIC 0x06 -> Node 1 SRAT: Node 1 PXM 2 0-d0000000 SRAT: Node 1 PXM 2 100000000-1b0000000 SRAT: Node 0 PXM 1 1b0000000-330000000 NUMA: Node 1 [0,cf669000) + [100000000,1b0000000) -> [0,cf669000) NUMA: nodes only cover 0MB of your 3317MB e820 RAM. Not used. No NUMA configuration found Faking a node at 0000000000000000-00000000cf669000 Initmem setup node 0 0000000000000000-00000000cf669000 NODE_DATA [00000000cf65e000 - 00000000cf662fff] Zone PFN ranges: DMA 0x00000010 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal empty Movable zone start PFN for each node early_node_map[2] active PFN ranges 0: 0x00000010 -> 0x000000a0 0: 0x00000100 -> 0x000cf669 ACPI: PM-Timer IO Port: 0x808 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x28] disabled) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x29] disabled) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x2a] disabled) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x2b] disabled) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2c] disabled) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2d] disabled) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] disabled) ACPI: LAPIC (acpi_id[0x10] lapic_id[0x2f] disabled) ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled) ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled) ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled) ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled) ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled) ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled) ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled) ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled) ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled) ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled) ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled) ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled) ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled) ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled) ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled) ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled) ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32]) IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Using ACPI (MADT) for SMP configuration information ACPI: HPET id: 0x8086a301 base: 0xfed00000 SMP: Allowing 8 CPUs, 0 hotplug CPUs Allocating PCI resources starting at d0000000 (gap: d0000000:10000000) Booting paravirtualized kernel on bare hardware setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 PERCPU: Embedded 475 pages/cpu @ffff8800cb000000 s1913872 r8192 d23536 u2097152 Built 1 zonelists in Node order, mobility grouping on. Total pages: 837782 Policy zone: DMA32 Kernel command line: ro root=/dev/mapper/VolGroup-lv_root rhgb console=ttyS0,115200n8 console=tty0 SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us mem=4G PID hash table entries: 4096 (order: 3, 32768 bytes) Checking aperture... No AGP bridge found Memory: 3300120k/3398052k available (6695k kernel code, 448k absent, 97484k reserved, 6535k data, 2572k init) Preemptable hierarchical RCU implementation. RCU debugfs-based tracing is enabled. NR_IRQS:512 Extended CMOS year: 2000 Console: colour VGA+ 80x25 console [tty0] enabled console [ttyS0] enabled Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar ... MAX_LOCKDEP_SUBCLASSES: 8 ... MAX_LOCK_DEPTH: 48 ... MAX_LOCKDEP_KEYS: 8191 ... CLASSHASH_SIZE: 4096 ... MAX_LOCKDEP_ENTRIES: 16384 ... MAX_LOCKDEP_CHAINS: 32768 ... CHAINHASH_SIZE: 16384 memory used by lock dependency info: 6367 kB per task-struct memory footprint: 2688 bytes allocated 27262976 bytes of page_cgroup please try 'cgroup_disable=memory' option if you don't want memory cgroups Fast TSC calibration using PIT Detected 1995.192 MHz processor. Calibrating delay loop (skipped), value calculated using timer frequency.. 3990.38 BogoMIPS (lpj=1995192) pid_max: default: 32768 minimum: 301 Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) Mount-cache hash table entries: 256 Initializing cgroup subsys ns ns_cgroup deprecated: consider using the 'clone_children' flag without the ns_cgroup. Initializing cgroup subsys cpuacct Initializing cgroup subsys memory Initializing cgroup subsys freezer Initializing cgroup subsys net_cls Initializing cgroup subsys perf_event CPU: Physical Processor ID: 1 CPU: Processor Core ID: 0 mce: CPU supports 9 MCE banks CPU0: Thermal monitoring enabled (TM1) using mwait in idle threads. Freeing SMP alternatives: 24k freed ACPI: Core revision 20110316 Setting APIC routing to flat ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 CPU0: Intel(R) Xeon(R) CPU E5504 @ 2.00GHz stepping 05 Performance Events: PEBS fmt1+, Nehalem events, Intel PMU driver. ... version: 3 ... bit width: 48 ... generic registers: 4 ... value mask: 0000ffffffffffff ... max period: 000000007fffffff ... fixed-purpose events: 3 ... event mask: 000000070000000f lockdep: fixing up alternatives. Booting Node 0, Processors #1 lockdep: fixing up alternatives. #2 lockdep: fixing up alternatives. #3 lockdep: fixing up alternatives. #4 lockdep: fixing up alternatives. #5 lockdep: fixing up alternatives. #6 lockdep: fixing up alternatives. #7 Ok. Brought up 8 CPUs Total of 8 processors activated (31916.06 BogoMIPS). kworker/u:0 used greatest stack depth: 4808 bytes left print_constraints: dummy: NET: Registered protocol family 16 ACPI FADT declares the system doesn't support PCIe ASPM, so disable it ACPI: bus type pci registered dca service started, version 1.12.1 PCI: Using configuration type 1 for base access bio: create slab <bio-0> at 0 [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored ACPI: Interpreter enabled ACPI: (supports S0 S5) ACPI: Using IOAPIC for interrupt routing PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) pci_root PNP0A08:00: host bridge window [io 0x0000-0x0cf7] pci_root PNP0A08:00: host bridge window [io 0x0d00-0xffff] pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff] pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xfdffffff] pci_root PNP0A08:00: host bridge window [mem 0xfed40000-0xfed44fff] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f) pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f) pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f) pci 0000:00:01.0: PCI bridge to [bus 01-01] pci 0000:00:03.0: PCI bridge to [bus 02-02] pci 0000:00:04.0: PCI bridge to [bus 03-03] pci 0000:00:05.0: PCI bridge to [bus 04-04] pci 0000:00:06.0: PCI bridge to [bus 05-05] pci 0000:00:07.0: PCI bridge to [bus 06-06] pci 0000:00:09.0: PCI bridge to [bus 07-07] pci 0000:00:1e.0: PCI bridge to [bus 08-08] (subtractive decode) ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 10 11 14 *15) ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 10 11 *14 15) ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 10 *11 14 15) ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *10 11 14 15) ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 *6 7 10 11 14 15) ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 10 11 *14 15) vgaarb: device added: PCI:0000:08:03.0,decodes=io+mem,owns=io+mem,locks=none vgaarb: loaded SCSI subsystem initialized usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb PCI: Using ACPI for IRQ routing HPET: 4 timers in total, 0 timers will be used for per-cpu timer Switching to clocksource hpet Switched to NOHz mode on CPU #0 Switched to NOHz mode on CPU #4 Switched to NOHz mode on CPU #6 Switched to NOHz mode on CPU #2 Switched to NOHz mode on CPU #3 Switched to NOHz mode on CPU #5 Switched to NOHz mode on CPU #1 Switched to NOHz mode on CPU #7 pnp: PnP ACPI init ACPI: bus type pnp registered system 00:07: [io 0x0800-0x087f] has been reserved system 00:07: [io 0x0880-0x08ff] has been reserved system 00:07: [io 0x0900-0x091f] has been reserved system 00:07: [io 0x0920-0x0923] has been reserved system 00:07: [io 0x0924] has been reserved system 00:07: [io 0x0c00-0x0c7f] has been reserved system 00:07: [io 0x0ca0-0x0ca7] has been reserved system 00:07: [io 0x0ca9-0x0cab] has been reserved system 00:07: [io 0x0cad-0x0caf] has been reserved system 00:08: [io 0x0ca8] has been reserved system 00:08: [io 0x0cac] has been reserved system 00:09: [mem 0xe0000000-0xefffffff] has been reserved system 00:0b: [mem 0xfed90000-0xfed91fff] has been reserved pnp: PnP ACPI: found 12 devices ACPI: ACPI bus type pnp unregistered pci 0000:00:01.0: PCI bridge to [bus 01-01] pci 0000:00:01.0: bridge window [io disabled] pci 0000:00:01.0: bridge window [mem 0xd6000000-0xd9ffffff] pci 0000:00:01.0: bridge window [mem pref disabled] pci 0000:00:03.0: PCI bridge to [bus 02-02] pci 0000:00:03.0: bridge window [io disabled] pci 0000:00:03.0: bridge window [mem 0xda000000-0xddffffff] pci 0000:00:03.0: bridge window [mem pref disabled] pci 0000:00:04.0: PCI bridge to [bus 03-03] pci 0000:00:04.0: bridge window [io 0xf000-0xffff] pci 0000:00:04.0: bridge window [mem 0xdf100000-0xdf1fffff] pci 0000:00:04.0: bridge window [mem pref disabled] pci 0000:00:05.0: PCI bridge to [bus 04-04] pci 0000:00:05.0: bridge window [io disabled] pci 0000:00:05.0: bridge window [mem disabled] pci 0000:00:05.0: bridge window [mem pref disabled] pci 0000:00:06.0: PCI bridge to [bus 05-05] pci 0000:00:06.0: bridge window [io disabled] pci 0000:00:06.0: bridge window [mem disabled] pci 0000:00:06.0: bridge window [mem pref disabled] pci 0000:00:07.0: PCI bridge to [bus 06-06] pci 0000:00:07.0: bridge window [io disabled] pci 0000:00:07.0: bridge window [mem disabled] pci 0000:00:07.0: bridge window [mem pref disabled] pci 0000:00:09.0: PCI bridge to [bus 07-07] pci 0000:00:09.0: bridge window [io disabled] pci 0000:00:09.0: bridge window [mem disabled] pci 0000:00:09.0: bridge window [mem pref disabled] pci 0000:08:03.0: BAR 6: assigned [mem 0xde000000-0xde00ffff pref] pci 0000:00:1e.0: PCI bridge to [bus 08-08] pci 0000:00:1e.0: bridge window [io disabled] pci 0000:00:1e.0: bridge window [mem 0xde000000-0xdeffffff] pci 0000:00:1e.0: bridge window [mem 0xd5800000-0xd5ffffff 64bit pref] pci 0000:00:01.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:03.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:04.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:05.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:06.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:07.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 pci 0000:00:09.0: PCI INT A -> GSI 53 (level, low) -> IRQ 53 NET: Registered protocol family 2 IP route cache hash table entries: 131072 (order: 8, 1048576 bytes) TCP established hash table entries: 524288 (order: 11, 8388608 bytes) TCP bind hash table entries: 65536 (order: 10, 5242880 bytes) TCP: Hash tables configured (established 524288 bind 65536) TCP reno registered UDP hash table entries: 2048 (order: 6, 393216 bytes) UDP-Lite hash table entries: 2048 (order: 6, 393216 bytes) NET: Registered protocol family 1 RPC: Registered udp transport module. RPC: Registered tcp transport module. RPC: Registered tcp NFSv4.1 backchannel transport module. Trying to unpack rootfs image as initramfs... Freeing initrd memory: 9620k freed Intel AES-NI instructions are not detected. audit: initializing netlink socket (disabled) type=2000 audit(1302630586.518:1): initialized HugeTLB registered 2 MB page size, pre-allocated 0 pages VFS: Disk quotas dquot_6.5.2 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) OCFS2 1.5.0 ocfs2: Registered cluster interface o2cb OCFS2 DLMFS 1.5.0 OCFS2 User DLM kernel interface loaded OCFS2 Node Manager 1.5.0 OCFS2 DLM 1.5.0 msgmni has been set to 6464 Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254) io scheduler noop registered io scheduler deadline registered io scheduler cfq registered (default) input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 ACPI: Power Button [PWRF] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled ÿserial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:06: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Real Time Clock Driver v1.12b Linux agpgart interface v0.103 brd: module loaded megasas: 00.00.05.34-rc1 Thu. Feb. 24 17:00:00 PDT 2011 megasas: 0x1000:0x0060:0x1028:0x1f0c: bus 3:slot 0:func 0 megaraid_sas 0000:03:00.0: PCI INT A -> GSI 33 (level, low) -> IRQ 33 megasas: FW now in Ready state megasas_init_mfi: fw_support_ieee=0 megasas: INIT adapter done scsi0 : LSI SAS based MegaRAID driver scsi 0:0:0:0: Direct-Access SEAGATE ST3146356SS HS0A PQ: 0 ANSI: 5 scsi 0:0:1:0: Direct-Access SEAGATE ST3146356SS HS0A PQ: 0 ANSI: 5 scsi 0:0:2:0: Direct-Access SEAGATE ST3300656SS HS0A PQ: 0 ANSI: 5 scsi 0:0:3:0: Direct-Access SEAGATE ST3300656SS HS0A PQ: 0 ANSI: 5 Refined TSC clocksource calibration: 1994.999 MHz. Switching to clocksource tsc scsi 0:0:32:0: Enclosure DP BACKPLANE 1.07 PQ: 0 ANSI: 5 scsi 0:2:0:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi 0:2:1:0: Direct-Access DELL PERC 6/i 1.22 PQ: 0 ANSI: 5 scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue scsi: killing requests for dead queue BUG: unable to handle kernel paging request at fffffffcffffffd8 IP: [<ffffffff813b3454>] blk_peek_request+0x114/0x210 PGD 1c35067 PUD 0 Oops: 0000 [#1] PREEMPT SMP last sysfs file: CPU 7 Modules linked in: Pid: 702, comm: kworker/7:5 Not tainted 2.6.39-rc2+ #195 Dell Inc. PowerEdge R710/0N047H RIP: 0010:[<ffffffff813b3454>] [<ffffffff813b3454>] blk_peek_request+0x114/0x210 RSP: 0000:ffff88003797bc90 EFLAGS: 00010046 RAX: fffffffcffffffb0 RBX: ffff880037972b10 RCX: 0000000000000000 RDX: ffff8800c89c6a80 RSI: 0000000000000000 RDI: ffff880037972b10 RBP: ffff88003797bcd0 R08: 0000000000000002 R09: 0000000000000001 R10: 0000000000000001 R11: 0000000000000001 R12: ffff880037972b10 R13: ffff8800cbfd6700 R14: ffff88003797a000 R15: ffff88003797bfd8 FS: 0000000000000000(0000) GS:ffff8800cbe00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: fffffffcffffffd8 CR3: 0000000001c33000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process kworker/7:5 (pid: 702, threadinfo ffff88003797a000, task ffff8800c89c6a80) Stack: ffff88003797bca0 ffff8800c89c6a80 ffff88003797bcb0 0000000000000000 ffff880037972b10 ffff8800cbfd6700 ffff8800cbe0e340 ffff88003797bdb0 ffff88003797bd30 ffffffff81479015 0000000737972c58 0000000000000000 Call Trace: [<ffffffff81479015>] scsi_request_fn+0x475/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec56>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 Code: fb ff ff ff 48 89 df e8 9b f2 ff ff 49 8b 1c 24 49 39 dc 0f 85 2e ff ff ff 49 8b 44 24 18 48 8b 00 48 85 c0 74 0c 31 f6 4c 89 e7 <ff> 50 28 85 c0 75 da 45 31 ed 48 83 c4 18 4c 89 e8 5b 41 5c 41 RIP [<ffffffff813b3454>] blk_peek_request+0x114/0x210 RSP <ffff88003797bc90> CR2: fffffffcffffffd8 ---[ end trace c802a3d69a54cf56 ]--- note: kworker/7:5[702] exited with preempt_count 1 kworker/7:5 used greatest stack depth: 4552 bytes left BUG: unable to handle kernel paging request at fffffffffffffff8 IP: [<ffffffff810b220b>] kthread_data+0xb/0x20 PGD 1c35067 PUD 1c36067 PMD 0 Oops: 0000 [#2] PREEMPT SMP last sysfs file: CPU 7 Modules linked in: Pid: 702, comm: kworker/7:5 Tainted: G D 2.6.39-rc2+ #195 Dell Inc. PowerEdge R710/0N047H RIP: 0010:[<ffffffff810b220b>] [<ffffffff810b220b>] kthread_data+0xb/0x20 RSP: 0000:ffff88003797b7e8 EFLAGS: 00010092 RAX: 0000000000000000 RBX: 0000000000000007 RCX: ffff88003797bfd8 RDX: ffff8800c89c6a80 RSI: 0000000000000007 RDI: ffff8800c89c6a80 RBP: ffff88003797b7e8 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000001 R11: 0000000000000000 R12: ffff8800c89c6d28 R13: 0000000000000007 R14: 0000000000000007 R15: ffff88003797b9c0 FS: 0000000000000000(0000) GS:ffff8800cbe00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: fffffffffffffff8 CR3: 0000000001c33000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process kworker/7:5 (pid: 702, threadinfo ffff88003797a000, task ffff8800c89c6a80) Stack: ffff88003797b808 ffffffff810ada50 ffff8800cbfd2500 ffff8800cbfd2500 ffff88003797b958 ffffffff8167adc9 ffff880000000000 ffff8800c89c6a80 ffff880000000000 ffff88003797bfd8 ffff8800c89c6a80 ffff88003797bfd8 Call Trace: [<ffffffff810ada50>] wq_worker_sleeping+0x10/0xa0 [<ffffffff8167adc9>] schedule+0x609/0xa40 [<ffffffff810c6bec>] ? print_lock_contention_bug.clone.18+0x2c/0x110 [<ffffffff81091d14>] ? release_task+0x14/0x400 [<ffffffff813d71f6>] ? do_raw_spin_unlock+0x76/0xd0 [<ffffffff81093b04>] do_exit+0x604/0x900 [<ffffffff81091694>] ? kmsg_dump+0x104/0x140 [<ffffffff816800b7>] oops_end+0x97/0xd0 [<ffffffff81064b70>] no_context+0xf0/0x260 [<ffffffff8144fe10>] ? wait_for_xmitr+0xa0/0xa0 [<ffffffff81064e05>] __bad_area_nosemaphore+0x125/0x1f0 [<ffffffff81064ede>] bad_area_nosemaphore+0xe/0x10 [<ffffffff8168255e>] do_page_fault+0x42e/0x560 [<ffffffff810c51ed>] ? trace_hardirqs_off+0xd/0x10 [<ffffffff813d71f6>] ? do_raw_spin_unlock+0x76/0xd0 [<ffffffff813d71f6>] ? do_raw_spin_unlock+0x76/0xd0 [<ffffffff813d1dcd>] ? trace_hardirqs_off_thunk+0x3a/0x3c [<ffffffff8167f255>] page_fault+0x25/0x30 [<ffffffff813b3454>] ? blk_peek_request+0x114/0x210 [<ffffffff81479015>] scsi_request_fn+0x475/0x4a0 [<ffffffff813b2baa>] __blk_run_queue+0x6a/0x120 [<ffffffff813b3121>] blk_delay_work+0x31/0x60 [<ffffffff810aa9c7>] process_one_work+0x197/0x520 [<ffffffff810aa961>] ? process_one_work+0x131/0x520 [<ffffffff813b30f0>] ? blk_insert_request+0xa0/0xa0 [<ffffffff810acfec>] worker_thread+0x15c/0x330 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810ace90>] ? manage_workers.clone.20+0x240/0x240 [<ffffffff810b1f16>] kthread+0xa6/0xb0 [<ffffffff816870e4>] kernel_thread_helper+0x4/0x10 [<ffffffff8107fe1f>] ? finish_task_switch+0x6f/0x110 [<ffffffff8167ec56>] ? _raw_spin_unlock_irq+0x46/0x70 [<ffffffff8167f018>] ? retint_restore_args+0x13/0x13 [<ffffffff810b1e70>] ? __init_kthread_worker+0x70/0x70 [<ffffffff816870e0>] ? gs_change+0x13/0x13 Code: d8 fc ff 48 8b 85 28 ff ff ff 48 81 c4 e0 00 00 00 5b 41 5c c9 c3 66 2e 0f 1f 84 00 00 00 00 00 55 48 8b 87 50 02 00 00 48 89 e5 8b 40 f8 c9 c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 RIP [<ffffffff810b220b>] kthread_data+0xb/0x20 RSP <ffff88003797b7e8> CR2: fffffffffffffff8 ---[ end trace c802a3d69a54cf57 ]--- Fixing recursive fault but reboot is needed! ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 18:33 ` Steven Whitehouse @ 2011-04-12 19:56 ` James Bottomley 2011-04-12 20:30 ` Steven Whitehouse 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 19:56 UTC (permalink / raw) To: Steven Whitehouse; +Cc: Tejun Heo, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 19:33 +0100, Steven Whitehouse wrote: > Hi, > > On Tue, 2011-04-12 at 12:41 -0500, James Bottomley wrote: > > On Tue, 2011-04-12 at 17:51 +0100, Steven Whitehouse wrote: > > > Still not quite there, but looking more hopeful now, > > > > Not sure I share your optimism; but this one > > > Neither do I any more :-) Looks like we are back in blk_peek_request() > again. [...] > if (!q->elevator->ops || !q->elevator->ops->elevator_dispatch_fn > (q, 0)) > 6d62: 49 8b 44 24 18 mov 0x18(%r12),%rax > 6d67: 48 8b 00 mov (%rax),%rax > 6d6a: 48 85 c0 test %rax,%rax > 6d6d: 74 0c je 6d7b <blk_peek_request+0x11b> > 6d6f: 31 f6 xor %esi,%esi > 6d71: 4c 89 e7 mov %r12,%rdi <----- here > 6d74: ff 50 28 callq *0x28(%rax) > 6d77: 85 c0 test %eax,%eax > 6d79: 75 da jne 6d55 <blk_peek_request+0xf5> > 6d7b: 45 31 ed xor %r13d,%r13d Hmm, wrong signal for no elevator then. How about this? James --- Index: BUILD-2.6/block/blk.h =================================================================== --- BUILD-2.6.orig/block/blk.h 2011-04-12 14:51:35.000000000 -0500 +++ BUILD-2.6/block/blk.h 2011-04-12 14:51:53.000000000 -0500 @@ -62,7 +62,8 @@ static inline struct request *__elv_next return rq; } - if (!q->elevator->ops || !q->elevator->ops->elevator_dispatch_fn(q, 0)) + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || + !q->elevator->ops->elevator_dispatch_fn(q, 0)) return NULL; } } ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 19:56 ` James Bottomley @ 2011-04-12 20:30 ` Steven Whitehouse 2011-04-12 20:43 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-12 20:30 UTC (permalink / raw) To: James Bottomley; +Cc: Tejun Heo, linux-kernel, Jens Axboe Hi, On Tue, 2011-04-12 at 14:56 -0500, James Bottomley wrote: > On Tue, 2011-04-12 at 19:33 +0100, Steven Whitehouse wrote: > > Hi, > > > > On Tue, 2011-04-12 at 12:41 -0500, James Bottomley wrote: > > > On Tue, 2011-04-12 at 17:51 +0100, Steven Whitehouse wrote: > > > > Still not quite there, but looking more hopeful now, > > > > > > Not sure I share your optimism; but this one > > > > > Neither do I any more :-) Looks like we are back in blk_peek_request() > > again. > [...] > > if (!q->elevator->ops || !q->elevator->ops->elevator_dispatch_fn > > (q, 0)) > > 6d62: 49 8b 44 24 18 mov 0x18(%r12),%rax > > 6d67: 48 8b 00 mov (%rax),%rax > > 6d6a: 48 85 c0 test %rax,%rax > > 6d6d: 74 0c je 6d7b <blk_peek_request+0x11b> > > 6d6f: 31 f6 xor %esi,%esi > > 6d71: 4c 89 e7 mov %r12,%rdi <----- here > > 6d74: ff 50 28 callq *0x28(%rax) > > 6d77: 85 c0 test %eax,%eax > > 6d79: 75 da jne 6d55 <blk_peek_request+0xf5> > > 6d7b: 45 31 ed xor %r13d,%r13d > > Hmm, wrong signal for no elevator then. How about this? > > James > That seems to do the trick... the box has been booted for several minutes now and no sign of anything untoward so far :-) Below is the cumulative patch which I now have applied to the kernel. Many thanks for all your help in debugging this, its greatly appreciated :-) Steve. diff --git a/block/blk-core.c b/block/blk-core.c index 90f22cc..7f15eb7 100644 --- a/block/blk-core.c +++ b/block/blk-core.c @@ -219,6 +219,7 @@ static void blk_delay_work(struct work_struct *work) spin_lock_irq(q->queue_lock); __blk_run_queue(q, false); spin_unlock_irq(q->queue_lock); + blk_put_queue(q); } /** @@ -233,7 +234,8 @@ static void blk_delay_work(struct work_struct *work) */ void blk_delay_queue(struct request_queue *q, unsigned long msecs) { - schedule_delayed_work(&q->delay_work, msecs_to_jiffies(msecs)); + if (!blk_get_queue(q)) + schedule_delayed_work(&q->delay_work, msecs_to_jiffies(msecs)); } EXPORT_SYMBOL(blk_delay_queue); @@ -271,7 +273,8 @@ EXPORT_SYMBOL(blk_start_queue); **/ void blk_stop_queue(struct request_queue *q) { - __cancel_delayed_work(&q->delay_work); + if (__cancel_delayed_work(&q->delay_work)) + blk_put_queue(q); queue_flag_set(QUEUE_FLAG_STOPPED, q); } EXPORT_SYMBOL(blk_stop_queue); @@ -297,7 +300,8 @@ EXPORT_SYMBOL(blk_stop_queue); void blk_sync_queue(struct request_queue *q) { del_timer_sync(&q->timeout); - cancel_delayed_work_sync(&q->delay_work); + if (__cancel_delayed_work(&q->delay_work)) + blk_put_queue(q); queue_sync_plugs(q); } EXPORT_SYMBOL(blk_sync_queue); @@ -324,7 +328,7 @@ void __blk_run_queue(struct request_queue *q, bool force_kblockd) if (!force_kblockd && !queue_flag_test_and_set(QUEUE_FLAG_REENTER, q)) { q->request_fn(q); queue_flag_clear(QUEUE_FLAG_REENTER, q); - } else + } else if (!blk_get_queue(q)) queue_delayed_work(kblockd_workqueue, &q->delay_work, 0); } EXPORT_SYMBOL(__blk_run_queue); diff --git a/block/blk.h b/block/blk.h index 6126346..4df474d 100644 --- a/block/blk.h +++ b/block/blk.h @@ -62,7 +62,8 @@ static inline struct request *__elv_next_request(struct request_queue *q) return rq; } - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || + !q->elevator->ops->elevator_dispatch_fn(q, 0)) return NULL; } } diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c index e44ff64..2e85668 100644 --- a/drivers/scsi/scsi_sysfs.c +++ b/drivers/scsi/scsi_sysfs.c @@ -323,7 +323,6 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) } if (sdev->request_queue) { - sdev->request_queue->queuedata = NULL; /* user context needed to free queue */ scsi_free_queue(sdev->request_queue); /* temporary expedient, try to catch use of queue lock @@ -937,6 +936,7 @@ void __scsi_remove_device(struct scsi_device *sdev) if (sdev->host->hostt->slave_destroy) sdev->host->hostt->slave_destroy(sdev); transport_destroy_device(dev); + sdev->request_queue->queuedata = NULL; put_device(dev); } ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 20:30 ` Steven Whitehouse @ 2011-04-12 20:43 ` James Bottomley 2011-04-13 5:18 ` Tejun Heo 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 20:43 UTC (permalink / raw) To: Steven Whitehouse; +Cc: Tejun Heo, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 21:30 +0100, Steven Whitehouse wrote: > > Hmm, wrong signal for no elevator then. How about this? > > > > James > > > That seems to do the trick... the box has been booted for several > minutes now and no sign of anything untoward so far :-) > > Below is the cumulative patch which I now have applied to the kernel. > Many thanks for all your help in debugging this, its greatly > appreciated :-) Heh, you're welcome, but this is for some value of debug. There's still something strange going on on your box causing extreme delays in the way we do stuff. I took advantage of the delays to explore some races in block and SCSI, which is what got fixed .. I've still no idea what the actual root cause of the delays is. Now we need to huddle and decide what we're doing in block and SCSI. I think Tejun's patch with the moved signal for queue destruction patch would probably work as well. James ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 20:43 ` James Bottomley @ 2011-04-13 5:18 ` Tejun Heo 2011-04-13 6:06 ` Tejun Heo 0 siblings, 1 reply; 39+ messages in thread From: Tejun Heo @ 2011-04-13 5:18 UTC (permalink / raw) To: James Bottomley; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe Hello, On Tue, Apr 12, 2011 at 03:43:56PM -0500, James Bottomley wrote: > Heh, you're welcome, but this is for some value of debug. There's still > something strange going on on your box causing extreme delays in the way > we do stuff. I took advantage of the delays to explore some races in > block and SCSI, which is what got fixed .. I've still no idea what the > actual root cause of the delays is. A lot of thanks for tracking down all the issues. Something is definitely strange with Steven's setup tho. > Now we need to huddle and decide what we're doing in block and SCSI. I > think Tejun's patch with the moved signal for queue destruction patch > would probably work as well. Steven, can you be enticed to try the combination? I'll prep a combined patch and post it but please beware that I'm currently in a rather zombish state - sleep deprived, jet lagged and malfunctioning digestion - so the likelihood of doing something stupid is pretty high. Thanks. -- tejun ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 5:18 ` Tejun Heo @ 2011-04-13 6:06 ` Tejun Heo 2011-04-13 9:20 ` Steven Whitehouse 0 siblings, 1 reply; 39+ messages in thread From: Tejun Heo @ 2011-04-13 6:06 UTC (permalink / raw) To: James Bottomley; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe On Wed, Apr 13, 2011 at 02:18:46PM +0900, Tejun Heo wrote: > Steven, can you be enticed to try the combination? I'll prep a > combined patch and post it but please beware that I'm currently in a > rather zombish state - sleep deprived, jet lagged and malfunctioning > digestion - so the likelihood of doing something stupid is pretty > high. Does the following completely untested version work? diff --git a/block/blk-core.c b/block/blk-core.c index 90f22cc..bb27804 100644 --- a/block/blk-core.c +++ b/block/blk-core.c @@ -359,6 +359,14 @@ void blk_put_queue(struct request_queue *q) */ void blk_cleanup_queue(struct request_queue *q) { + /* mark @q stopped and dead */ + mutex_lock(&q->sysfs_lock); + spin_lock_irq(&q->queue_lock); + queue_flag_set(QUEUE_FLAG_STOPPED, q); + queue_flag_set(QUEUE_FLAG_DEAD, q); + spin_unlock_irq(&q->queue_lock); + mutex_unlock(&q->sysfs_lock); + /* * We know we have process context here, so we can be a little * cautious and ensure that pending block actions on this device @@ -368,9 +376,6 @@ void blk_cleanup_queue(struct request_queue *q) blk_sync_queue(q); del_timer_sync(&q->backing_dev_info.laptop_mode_wb_timer); - mutex_lock(&q->sysfs_lock); - queue_flag_set_unlocked(QUEUE_FLAG_DEAD, q); - mutex_unlock(&q->sysfs_lock); if (q->elevator) elevator_exit(q->elevator); @@ -1456,7 +1461,7 @@ static inline int bio_check_eod(struct bio *bio, unsigned int nr_sectors) * generic_make_request and the drivers it calls may use bi_next if this * bio happens to be merged with someone else, and may change bi_dev and * bi_sector for remaps as it sees fit. So the values of these fields - * should NOT be depended on after the call to generic_make_request. + * should NOT be depended on after thes call to generic_make_request. */ static inline void __generic_make_request(struct bio *bio) { diff --git a/block/blk.h b/block/blk.h index 6126346..4df474d 100644 --- a/block/blk.h +++ b/block/blk.h @@ -62,7 +62,8 @@ static inline struct request *__elv_next_request(struct request_queue *q) return rq; } - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || + !q->elevator->ops->elevator_dispatch_fn(q, 0)) return NULL; } } diff --git a/drivers/scsi/scsi.c b/drivers/scsi/scsi.c index 2aeb2e9..12ebcbc 100644 --- a/drivers/scsi/scsi.c +++ b/drivers/scsi/scsi.c @@ -70,6 +70,11 @@ #define CREATE_TRACE_POINTS #include <trace/events/scsi.h> +/* + * Utility multithreaded workqueue for SCSI. + */ +struct workqueue_struct *scsi_wq; + static void scsi_done(struct scsi_cmnd *cmd); /* @@ -1306,11 +1311,14 @@ MODULE_PARM_DESC(scsi_logging_level, "a bit mask of logging levels"); static int __init init_scsi(void) { - int error; + int error = -ENOMEM; + scsi_wq = alloc_workqueue("scsi", 0, 0); + if (!scsi_wq) + return error; error = scsi_init_queue(); if (error) - return error; + goto cleanup_wq; error = scsi_init_procfs(); if (error) goto cleanup_queue; @@ -1342,6 +1350,8 @@ cleanup_procfs: scsi_exit_procfs(); cleanup_queue: scsi_exit_queue(); +cleanup_wq: + destroy_workqueue(scsi_wq); printk(KERN_ERR "SCSI subsystem failed to initialize, error = %d\n", -error); return error; @@ -1356,6 +1366,7 @@ static void __exit exit_scsi(void) scsi_exit_devinfo(); scsi_exit_procfs(); scsi_exit_queue(); + destroy_workqueue(scsi_wq); } subsys_initcall(init_scsi); diff --git a/drivers/scsi/scsi_scan.c b/drivers/scsi/scsi_scan.c index 087821f..4222b58 100644 --- a/drivers/scsi/scsi_scan.c +++ b/drivers/scsi/scsi_scan.c @@ -362,6 +362,16 @@ int scsi_is_target_device(const struct device *dev) } EXPORT_SYMBOL(scsi_is_target_device); +static void scsi_target_reap_usercontext(struct work_struct *work) +{ + struct scsi_target *starget = + container_of(work, struct scsi_target, reap_work); + + transport_remove_device(&starget->dev); + device_del(&starget->dev); + scsi_target_destroy(starget); +} + static struct scsi_target *__scsi_find_target(struct device *parent, int channel, uint id) { @@ -427,6 +437,7 @@ static struct scsi_target *scsi_alloc_target(struct device *parent, starget->state = STARGET_CREATED; starget->scsi_level = SCSI_2; starget->max_target_blocked = SCSI_DEFAULT_TARGET_BLOCKED; + INIT_WORK(&starget->reap_work, scsi_target_reap_usercontext); retry: spin_lock_irqsave(shost->host_lock, flags); @@ -462,21 +473,11 @@ static struct scsi_target *scsi_alloc_target(struct device *parent, } /* Unfortunately, we found a dying target; need to * wait until it's dead before we can get a new one */ + flush_work(&found_target->reap_work); put_device(&found_target->dev); - flush_scheduled_work(); goto retry; } -static void scsi_target_reap_usercontext(struct work_struct *work) -{ - struct scsi_target *starget = - container_of(work, struct scsi_target, ew.work); - - transport_remove_device(&starget->dev); - device_del(&starget->dev); - scsi_target_destroy(starget); -} - /** * scsi_target_reap - check to see if target is in use and destroy if not * @starget: target to be checked @@ -507,8 +508,7 @@ void scsi_target_reap(struct scsi_target *starget) if (state == STARGET_CREATED) scsi_target_destroy(starget); else - execute_in_process_context(scsi_target_reap_usercontext, - &starget->ew); + queue_work(scsi_wq, &starget->reap_work); } /** diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c index e44ff64..e030091 100644 --- a/drivers/scsi/scsi_sysfs.c +++ b/drivers/scsi/scsi_sysfs.c @@ -300,7 +300,7 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) struct list_head *this, *tmp; unsigned long flags; - sdev = container_of(work, struct scsi_device, ew.work); + sdev = container_of(work, struct scsi_device, release_work); parent = sdev->sdev_gendev.parent; starget = to_scsi_target(parent); @@ -323,7 +323,6 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) } if (sdev->request_queue) { - sdev->request_queue->queuedata = NULL; /* user context needed to free queue */ scsi_free_queue(sdev->request_queue); /* temporary expedient, try to catch use of queue lock @@ -343,8 +342,8 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) static void scsi_device_dev_release(struct device *dev) { struct scsi_device *sdp = to_scsi_device(dev); - execute_in_process_context(scsi_device_dev_release_usercontext, - &sdp->ew); + + queue_work(scsi_wq, &sdp->release_work); } static struct class sdev_class = { @@ -937,6 +936,7 @@ void __scsi_remove_device(struct scsi_device *sdev) if (sdev->host->hostt->slave_destroy) sdev->host->hostt->slave_destroy(sdev); transport_destroy_device(dev); + sdev->request_queue->queuedata = NULL; put_device(dev); } @@ -1069,6 +1069,8 @@ void scsi_sysfs_device_initialize(struct scsi_device *sdev) dev_set_name(&sdev->sdev_dev, "%d:%d:%d:%d", sdev->host->host_no, sdev->channel, sdev->id, sdev->lun); sdev->scsi_level = starget->scsi_level; + INIT_WORK(&sdev->release_work, scsi_device_dev_release_usercontext); + transport_setup_device(&sdev->sdev_gendev); spin_lock_irqsave(shost->host_lock, flags); list_add_tail(&sdev->same_target_siblings, &starget->devices); diff --git a/include/scsi/scsi_device.h b/include/scsi/scsi_device.h index 2d3ec50..1d11750 100644 --- a/include/scsi/scsi_device.h +++ b/include/scsi/scsi_device.h @@ -168,7 +168,7 @@ struct scsi_device { struct device sdev_gendev, sdev_dev; - struct execute_work ew; /* used to get process context on put */ + struct work_struct release_work; /* for process context on put */ struct scsi_dh_data *scsi_dh_data; enum scsi_device_state sdev_state; @@ -259,7 +259,7 @@ struct scsi_target { #define SCSI_DEFAULT_TARGET_BLOCKED 3 char scsi_level; - struct execute_work ew; + struct work_struct reap_work; enum scsi_target_state state; void *hostdata; /* available to low-level driver */ unsigned long starget_data[0]; /* for the transport */ @@ -277,6 +277,8 @@ static inline struct scsi_target *scsi_target(struct scsi_device *sdev) #define starget_printk(prefix, starget, fmt, a...) \ dev_printk(prefix, &(starget)->dev, fmt, ##a) +extern struct workqueue_struct *scsi_wq; + extern struct scsi_device *__scsi_add_device(struct Scsi_Host *, uint, uint, uint, void *hostdata); extern int scsi_add_device(struct Scsi_Host *host, uint channel, ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 6:06 ` Tejun Heo @ 2011-04-13 9:20 ` Steven Whitehouse 2011-04-13 14:00 ` Steven Whitehouse 0 siblings, 1 reply; 39+ messages in thread From: Steven Whitehouse @ 2011-04-13 9:20 UTC (permalink / raw) To: Tejun Heo; +Cc: James Bottomley, linux-kernel, Jens Axboe Hi, On Wed, 2011-04-13 at 15:06 +0900, Tejun Heo wrote: > On Wed, Apr 13, 2011 at 02:18:46PM +0900, Tejun Heo wrote: > > Steven, can you be enticed to try the combination? I'll prep a > > combined patch and post it but please beware that I'm currently in a > > rather zombish state - sleep deprived, jet lagged and malfunctioning > > digestion - so the likelihood of doing something stupid is pretty > > high. > > Does the following completely untested version work? > Almost. With one small change (q->queue_lock is already a pointer to a spinlock, so it doesn't require an &) it seems to work for me. Let me know if you'd like me to do any more tests. I've attached an updated patch below, Steve. diff --git a/block/blk-core.c b/block/blk-core.c index 90f22cc..90de9ac 100644 --- a/block/blk-core.c +++ b/block/blk-core.c @@ -359,6 +359,14 @@ void blk_put_queue(struct request_queue *q) */ void blk_cleanup_queue(struct request_queue *q) { + /* mark @q stopped and dead */ + mutex_lock(&q->sysfs_lock); + spin_lock_irq(q->queue_lock); + queue_flag_set(QUEUE_FLAG_STOPPED, q); + queue_flag_set(QUEUE_FLAG_DEAD, q); + spin_unlock_irq(q->queue_lock); + mutex_unlock(&q->sysfs_lock); + /* * We know we have process context here, so we can be a little * cautious and ensure that pending block actions on this device @@ -368,9 +376,6 @@ void blk_cleanup_queue(struct request_queue *q) blk_sync_queue(q); del_timer_sync(&q->backing_dev_info.laptop_mode_wb_timer); - mutex_lock(&q->sysfs_lock); - queue_flag_set_unlocked(QUEUE_FLAG_DEAD, q); - mutex_unlock(&q->sysfs_lock); if (q->elevator) elevator_exit(q->elevator); @@ -1456,7 +1461,7 @@ static inline int bio_check_eod(struct bio *bio, unsigned int nr_sectors) * generic_make_request and the drivers it calls may use bi_next if this * bio happens to be merged with someone else, and may change bi_dev and * bi_sector for remaps as it sees fit. So the values of these fields - * should NOT be depended on after the call to generic_make_request. + * should NOT be depended on after thes call to generic_make_request. */ static inline void __generic_make_request(struct bio *bio) { diff --git a/block/blk.h b/block/blk.h index 6126346..4df474d 100644 --- a/block/blk.h +++ b/block/blk.h @@ -62,7 +62,8 @@ static inline struct request *__elv_next_request(struct request_queue *q) return rq; } - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || + !q->elevator->ops->elevator_dispatch_fn(q, 0)) return NULL; } } diff --git a/drivers/scsi/scsi.c b/drivers/scsi/scsi.c index 2aeb2e9..12ebcbc 100644 --- a/drivers/scsi/scsi.c +++ b/drivers/scsi/scsi.c @@ -70,6 +70,11 @@ #define CREATE_TRACE_POINTS #include <trace/events/scsi.h> +/* + * Utility multithreaded workqueue for SCSI. + */ +struct workqueue_struct *scsi_wq; + static void scsi_done(struct scsi_cmnd *cmd); /* @@ -1306,11 +1311,14 @@ MODULE_PARM_DESC(scsi_logging_level, "a bit mask of logging levels"); static int __init init_scsi(void) { - int error; + int error = -ENOMEM; + scsi_wq = alloc_workqueue("scsi", 0, 0); + if (!scsi_wq) + return error; error = scsi_init_queue(); if (error) - return error; + goto cleanup_wq; error = scsi_init_procfs(); if (error) goto cleanup_queue; @@ -1342,6 +1350,8 @@ cleanup_procfs: scsi_exit_procfs(); cleanup_queue: scsi_exit_queue(); +cleanup_wq: + destroy_workqueue(scsi_wq); printk(KERN_ERR "SCSI subsystem failed to initialize, error = %d\n", -error); return error; @@ -1356,6 +1366,7 @@ static void __exit exit_scsi(void) scsi_exit_devinfo(); scsi_exit_procfs(); scsi_exit_queue(); + destroy_workqueue(scsi_wq); } subsys_initcall(init_scsi); diff --git a/drivers/scsi/scsi_scan.c b/drivers/scsi/scsi_scan.c index 087821f..4222b58 100644 --- a/drivers/scsi/scsi_scan.c +++ b/drivers/scsi/scsi_scan.c @@ -362,6 +362,16 @@ int scsi_is_target_device(const struct device *dev) } EXPORT_SYMBOL(scsi_is_target_device); +static void scsi_target_reap_usercontext(struct work_struct *work) +{ + struct scsi_target *starget = + container_of(work, struct scsi_target, reap_work); + + transport_remove_device(&starget->dev); + device_del(&starget->dev); + scsi_target_destroy(starget); +} + static struct scsi_target *__scsi_find_target(struct device *parent, int channel, uint id) { @@ -427,6 +437,7 @@ static struct scsi_target *scsi_alloc_target(struct device *parent, starget->state = STARGET_CREATED; starget->scsi_level = SCSI_2; starget->max_target_blocked = SCSI_DEFAULT_TARGET_BLOCKED; + INIT_WORK(&starget->reap_work, scsi_target_reap_usercontext); retry: spin_lock_irqsave(shost->host_lock, flags); @@ -462,21 +473,11 @@ static struct scsi_target *scsi_alloc_target(struct device *parent, } /* Unfortunately, we found a dying target; need to * wait until it's dead before we can get a new one */ + flush_work(&found_target->reap_work); put_device(&found_target->dev); - flush_scheduled_work(); goto retry; } -static void scsi_target_reap_usercontext(struct work_struct *work) -{ - struct scsi_target *starget = - container_of(work, struct scsi_target, ew.work); - - transport_remove_device(&starget->dev); - device_del(&starget->dev); - scsi_target_destroy(starget); -} - /** * scsi_target_reap - check to see if target is in use and destroy if not * @starget: target to be checked @@ -507,8 +508,7 @@ void scsi_target_reap(struct scsi_target *starget) if (state == STARGET_CREATED) scsi_target_destroy(starget); else - execute_in_process_context(scsi_target_reap_usercontext, - &starget->ew); + queue_work(scsi_wq, &starget->reap_work); } /** diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c index e44ff64..e030091 100644 --- a/drivers/scsi/scsi_sysfs.c +++ b/drivers/scsi/scsi_sysfs.c @@ -300,7 +300,7 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) struct list_head *this, *tmp; unsigned long flags; - sdev = container_of(work, struct scsi_device, ew.work); + sdev = container_of(work, struct scsi_device, release_work); parent = sdev->sdev_gendev.parent; starget = to_scsi_target(parent); @@ -323,7 +323,6 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) } if (sdev->request_queue) { - sdev->request_queue->queuedata = NULL; /* user context needed to free queue */ scsi_free_queue(sdev->request_queue); /* temporary expedient, try to catch use of queue lock @@ -343,8 +342,8 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) static void scsi_device_dev_release(struct device *dev) { struct scsi_device *sdp = to_scsi_device(dev); - execute_in_process_context(scsi_device_dev_release_usercontext, - &sdp->ew); + + queue_work(scsi_wq, &sdp->release_work); } static struct class sdev_class = { @@ -937,6 +936,7 @@ void __scsi_remove_device(struct scsi_device *sdev) if (sdev->host->hostt->slave_destroy) sdev->host->hostt->slave_destroy(sdev); transport_destroy_device(dev); + sdev->request_queue->queuedata = NULL; put_device(dev); } @@ -1069,6 +1069,8 @@ void scsi_sysfs_device_initialize(struct scsi_device *sdev) dev_set_name(&sdev->sdev_dev, "%d:%d:%d:%d", sdev->host->host_no, sdev->channel, sdev->id, sdev->lun); sdev->scsi_level = starget->scsi_level; + INIT_WORK(&sdev->release_work, scsi_device_dev_release_usercontext); + transport_setup_device(&sdev->sdev_gendev); spin_lock_irqsave(shost->host_lock, flags); list_add_tail(&sdev->same_target_siblings, &starget->devices); diff --git a/fs/gfs2/file.c b/fs/gfs2/file.c index e483108..23eab47 100644 --- a/fs/gfs2/file.c +++ b/fs/gfs2/file.c @@ -545,18 +545,10 @@ static int gfs2_close(struct inode *inode, struct file *file) /** * gfs2_fsync - sync the dirty data for a file (across the cluster) * @file: the file that points to the dentry (we ignore this) - * @dentry: the dentry that points to the inode to sync + * @datasync: set if we can ignore timestamp changes * - * The VFS will flush "normal" data for us. We only need to worry - * about metadata here. For journaled data, we just do a log flush - * as we can't avoid it. Otherwise we can just bale out if datasync - * is set. For stuffed inodes we must flush the log in order to - * ensure that all data is on disk. - * - * The call to write_inode_now() is there to write back metadata and - * the inode itself. It does also try and write the data, but thats - * (hopefully) a no-op due to the VFS having already called filemap_fdatawrite() - * for us. + * The VFS will flush data for us. We only need to worry + * about metadata here. * * Returns: errno */ @@ -565,22 +557,20 @@ static int gfs2_fsync(struct file *file, int datasync) { struct inode *inode = file->f_mapping->host; int sync_state = inode->i_state & (I_DIRTY_SYNC|I_DIRTY_DATASYNC); - int ret = 0; - - if (gfs2_is_jdata(GFS2_I(inode))) { - gfs2_log_flush(GFS2_SB(inode), GFS2_I(inode)->i_gl); - return 0; - } + struct gfs2_inode *ip = GFS2_I(inode); + int ret; - if (sync_state != 0) { - if (!datasync) - ret = write_inode_now(inode, 0); + if (datasync) + sync_state &= ~I_DIRTY_SYNC; - if (gfs2_is_stuffed(GFS2_I(inode))) - gfs2_log_flush(GFS2_SB(inode), GFS2_I(inode)->i_gl); + if (sync_state) { + ret = sync_inode_metadata(inode, 1); + if (ret) + return ret; + gfs2_ail_flush(ip->i_gl); } - return ret; + return 0; } /** diff --git a/fs/gfs2/glops.c b/fs/gfs2/glops.c index 25eeb2b..7c1b08f 100644 --- a/fs/gfs2/glops.c +++ b/fs/gfs2/glops.c @@ -28,33 +28,18 @@ #include "trans.h" /** - * ail_empty_gl - remove all buffers for a given lock from the AIL + * __gfs2_ail_flush - remove all buffers for a given lock from the AIL * @gl: the glock * * None of the buffers should be dirty, locked, or pinned. */ -static void gfs2_ail_empty_gl(struct gfs2_glock *gl) +static void __gfs2_ail_flush(struct gfs2_glock *gl) { struct gfs2_sbd *sdp = gl->gl_sbd; struct list_head *head = &gl->gl_ail_list; struct gfs2_bufdata *bd; struct buffer_head *bh; - struct gfs2_trans tr; - - memset(&tr, 0, sizeof(tr)); - tr.tr_revokes = atomic_read(&gl->gl_ail_count); - - if (!tr.tr_revokes) - return; - - /* A shortened, inline version of gfs2_trans_begin() */ - tr.tr_reserved = 1 + gfs2_struct2blk(sdp, tr.tr_revokes, sizeof(u64)); - tr.tr_ip = (unsigned long)__builtin_return_address(0); - INIT_LIST_HEAD(&tr.tr_list_buf); - gfs2_log_reserve(sdp, tr.tr_reserved); - BUG_ON(current->journal_info); - current->journal_info = &tr; spin_lock(&sdp->sd_ail_lock); while (!list_empty(head)) { @@ -76,7 +61,47 @@ static void gfs2_ail_empty_gl(struct gfs2_glock *gl) } gfs2_assert_withdraw(sdp, !atomic_read(&gl->gl_ail_count)); spin_unlock(&sdp->sd_ail_lock); +} + + +static void gfs2_ail_empty_gl(struct gfs2_glock *gl) +{ + struct gfs2_sbd *sdp = gl->gl_sbd; + struct gfs2_trans tr; + + memset(&tr, 0, sizeof(tr)); + tr.tr_revokes = atomic_read(&gl->gl_ail_count); + + if (!tr.tr_revokes) + return; + + /* A shortened, inline version of gfs2_trans_begin() */ + tr.tr_reserved = 1 + gfs2_struct2blk(sdp, tr.tr_revokes, sizeof(u64)); + tr.tr_ip = (unsigned long)__builtin_return_address(0); + INIT_LIST_HEAD(&tr.tr_list_buf); + gfs2_log_reserve(sdp, tr.tr_reserved); + BUG_ON(current->journal_info); + current->journal_info = &tr; + + __gfs2_ail_flush(gl); + + gfs2_trans_end(sdp); + gfs2_log_flush(sdp, NULL); +} +void gfs2_ail_flush(struct gfs2_glock *gl) +{ + struct gfs2_sbd *sdp = gl->gl_sbd; + unsigned int revokes = atomic_read(&gl->gl_ail_count); + int ret; + + if (!revokes) + return; + + ret = gfs2_trans_begin(sdp, 0, revokes); + if (ret) + return; + __gfs2_ail_flush(gl); gfs2_trans_end(sdp); gfs2_log_flush(sdp, NULL); } diff --git a/fs/gfs2/glops.h b/fs/gfs2/glops.h index b3aa2e3..6fce409 100644 --- a/fs/gfs2/glops.h +++ b/fs/gfs2/glops.h @@ -23,4 +23,6 @@ extern const struct gfs2_glock_operations gfs2_quota_glops; extern const struct gfs2_glock_operations gfs2_journal_glops; extern const struct gfs2_glock_operations *gfs2_glops_list[]; +extern void gfs2_ail_flush(struct gfs2_glock *gl); + #endif /* __GLOPS_DOT_H__ */ diff --git a/include/scsi/scsi_device.h b/include/scsi/scsi_device.h index 2d3ec50..1d11750 100644 --- a/include/scsi/scsi_device.h +++ b/include/scsi/scsi_device.h @@ -168,7 +168,7 @@ struct scsi_device { struct device sdev_gendev, sdev_dev; - struct execute_work ew; /* used to get process context on put */ + struct work_struct release_work; /* for process context on put */ struct scsi_dh_data *scsi_dh_data; enum scsi_device_state sdev_state; @@ -259,7 +259,7 @@ struct scsi_target { #define SCSI_DEFAULT_TARGET_BLOCKED 3 char scsi_level; - struct execute_work ew; + struct work_struct reap_work; enum scsi_target_state state; void *hostdata; /* available to low-level driver */ unsigned long starget_data[0]; /* for the transport */ @@ -277,6 +277,8 @@ static inline struct scsi_target *scsi_target(struct scsi_device *sdev) #define starget_printk(prefix, starget, fmt, a...) \ dev_printk(prefix, &(starget)->dev, fmt, ##a) +extern struct workqueue_struct *scsi_wq; + extern struct scsi_device *__scsi_add_device(struct Scsi_Host *, uint, uint, uint, void *hostdata); extern int scsi_add_device(struct Scsi_Host *host, uint channel, ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 9:20 ` Steven Whitehouse @ 2011-04-13 14:00 ` Steven Whitehouse 2011-04-13 17:01 ` James Bottomley 2011-04-22 18:03 ` Tejun Heo 0 siblings, 2 replies; 39+ messages in thread From: Steven Whitehouse @ 2011-04-13 14:00 UTC (permalink / raw) To: Tejun Heo; +Cc: James Bottomley, linux-kernel, Jens Axboe Hi, On Wed, 2011-04-13 at 10:20 +0100, Steven Whitehouse wrote: > Hi, > > On Wed, 2011-04-13 at 15:06 +0900, Tejun Heo wrote: > > On Wed, Apr 13, 2011 at 02:18:46PM +0900, Tejun Heo wrote: > > > Steven, can you be enticed to try the combination? I'll prep a > > > combined patch and post it but please beware that I'm currently in a > > > rather zombish state - sleep deprived, jet lagged and malfunctioning > > > digestion - so the likelihood of doing something stupid is pretty > > > high. > > > > Does the following completely untested version work? > > > Almost. With one small change (q->queue_lock is already a pointer to a > spinlock, so it doesn't require an &) it seems to work for me. Let me > know if you'd like me to do any more tests. I've attached an updated > patch below, > > Steve. > Apologies, some gfs2 bits got included by accident. Here is a cleaned up version, Steve. diff --git a/block/blk-core.c b/block/blk-core.c index 90f22cc..90de9ac 100644 --- a/block/blk-core.c +++ b/block/blk-core.c @@ -359,6 +359,14 @@ void blk_put_queue(struct request_queue *q) */ void blk_cleanup_queue(struct request_queue *q) { + /* mark @q stopped and dead */ + mutex_lock(&q->sysfs_lock); + spin_lock_irq(q->queue_lock); + queue_flag_set(QUEUE_FLAG_STOPPED, q); + queue_flag_set(QUEUE_FLAG_DEAD, q); + spin_unlock_irq(q->queue_lock); + mutex_unlock(&q->sysfs_lock); + /* * We know we have process context here, so we can be a little * cautious and ensure that pending block actions on this device @@ -368,9 +376,6 @@ void blk_cleanup_queue(struct request_queue *q) blk_sync_queue(q); del_timer_sync(&q->backing_dev_info.laptop_mode_wb_timer); - mutex_lock(&q->sysfs_lock); - queue_flag_set_unlocked(QUEUE_FLAG_DEAD, q); - mutex_unlock(&q->sysfs_lock); if (q->elevator) elevator_exit(q->elevator); @@ -1456,7 +1461,7 @@ static inline int bio_check_eod(struct bio *bio, unsigned int nr_sectors) * generic_make_request and the drivers it calls may use bi_next if this * bio happens to be merged with someone else, and may change bi_dev and * bi_sector for remaps as it sees fit. So the values of these fields - * should NOT be depended on after the call to generic_make_request. + * should NOT be depended on after thes call to generic_make_request. */ static inline void __generic_make_request(struct bio *bio) { diff --git a/block/blk.h b/block/blk.h index 6126346..4df474d 100644 --- a/block/blk.h +++ b/block/blk.h @@ -62,7 +62,8 @@ static inline struct request *__elv_next_request(struct request_queue *q) return rq; } - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || + !q->elevator->ops->elevator_dispatch_fn(q, 0)) return NULL; } } diff --git a/drivers/scsi/scsi.c b/drivers/scsi/scsi.c index 2aeb2e9..12ebcbc 100644 --- a/drivers/scsi/scsi.c +++ b/drivers/scsi/scsi.c @@ -70,6 +70,11 @@ #define CREATE_TRACE_POINTS #include <trace/events/scsi.h> +/* + * Utility multithreaded workqueue for SCSI. + */ +struct workqueue_struct *scsi_wq; + static void scsi_done(struct scsi_cmnd *cmd); /* @@ -1306,11 +1311,14 @@ MODULE_PARM_DESC(scsi_logging_level, "a bit mask of logging levels"); static int __init init_scsi(void) { - int error; + int error = -ENOMEM; + scsi_wq = alloc_workqueue("scsi", 0, 0); + if (!scsi_wq) + return error; error = scsi_init_queue(); if (error) - return error; + goto cleanup_wq; error = scsi_init_procfs(); if (error) goto cleanup_queue; @@ -1342,6 +1350,8 @@ cleanup_procfs: scsi_exit_procfs(); cleanup_queue: scsi_exit_queue(); +cleanup_wq: + destroy_workqueue(scsi_wq); printk(KERN_ERR "SCSI subsystem failed to initialize, error = %d\n", -error); return error; @@ -1356,6 +1366,7 @@ static void __exit exit_scsi(void) scsi_exit_devinfo(); scsi_exit_procfs(); scsi_exit_queue(); + destroy_workqueue(scsi_wq); } subsys_initcall(init_scsi); diff --git a/drivers/scsi/scsi_scan.c b/drivers/scsi/scsi_scan.c index 087821f..4222b58 100644 --- a/drivers/scsi/scsi_scan.c +++ b/drivers/scsi/scsi_scan.c @@ -362,6 +362,16 @@ int scsi_is_target_device(const struct device *dev) } EXPORT_SYMBOL(scsi_is_target_device); +static void scsi_target_reap_usercontext(struct work_struct *work) +{ + struct scsi_target *starget = + container_of(work, struct scsi_target, reap_work); + + transport_remove_device(&starget->dev); + device_del(&starget->dev); + scsi_target_destroy(starget); +} + static struct scsi_target *__scsi_find_target(struct device *parent, int channel, uint id) { @@ -427,6 +437,7 @@ static struct scsi_target *scsi_alloc_target(struct device *parent, starget->state = STARGET_CREATED; starget->scsi_level = SCSI_2; starget->max_target_blocked = SCSI_DEFAULT_TARGET_BLOCKED; + INIT_WORK(&starget->reap_work, scsi_target_reap_usercontext); retry: spin_lock_irqsave(shost->host_lock, flags); @@ -462,21 +473,11 @@ static struct scsi_target *scsi_alloc_target(struct device *parent, } /* Unfortunately, we found a dying target; need to * wait until it's dead before we can get a new one */ + flush_work(&found_target->reap_work); put_device(&found_target->dev); - flush_scheduled_work(); goto retry; } -static void scsi_target_reap_usercontext(struct work_struct *work) -{ - struct scsi_target *starget = - container_of(work, struct scsi_target, ew.work); - - transport_remove_device(&starget->dev); - device_del(&starget->dev); - scsi_target_destroy(starget); -} - /** * scsi_target_reap - check to see if target is in use and destroy if not * @starget: target to be checked @@ -507,8 +508,7 @@ void scsi_target_reap(struct scsi_target *starget) if (state == STARGET_CREATED) scsi_target_destroy(starget); else - execute_in_process_context(scsi_target_reap_usercontext, - &starget->ew); + queue_work(scsi_wq, &starget->reap_work); } /** diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c index e44ff64..e030091 100644 --- a/drivers/scsi/scsi_sysfs.c +++ b/drivers/scsi/scsi_sysfs.c @@ -300,7 +300,7 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) struct list_head *this, *tmp; unsigned long flags; - sdev = container_of(work, struct scsi_device, ew.work); + sdev = container_of(work, struct scsi_device, release_work); parent = sdev->sdev_gendev.parent; starget = to_scsi_target(parent); @@ -323,7 +323,6 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) } if (sdev->request_queue) { - sdev->request_queue->queuedata = NULL; /* user context needed to free queue */ scsi_free_queue(sdev->request_queue); /* temporary expedient, try to catch use of queue lock @@ -343,8 +342,8 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) static void scsi_device_dev_release(struct device *dev) { struct scsi_device *sdp = to_scsi_device(dev); - execute_in_process_context(scsi_device_dev_release_usercontext, - &sdp->ew); + + queue_work(scsi_wq, &sdp->release_work); } static struct class sdev_class = { @@ -937,6 +936,7 @@ void __scsi_remove_device(struct scsi_device *sdev) if (sdev->host->hostt->slave_destroy) sdev->host->hostt->slave_destroy(sdev); transport_destroy_device(dev); + sdev->request_queue->queuedata = NULL; put_device(dev); } @@ -1069,6 +1069,8 @@ void scsi_sysfs_device_initialize(struct scsi_device *sdev) dev_set_name(&sdev->sdev_dev, "%d:%d:%d:%d", sdev->host->host_no, sdev->channel, sdev->id, sdev->lun); sdev->scsi_level = starget->scsi_level; + INIT_WORK(&sdev->release_work, scsi_device_dev_release_usercontext); + transport_setup_device(&sdev->sdev_gendev); spin_lock_irqsave(shost->host_lock, flags); list_add_tail(&sdev->same_target_siblings, &starget->devices); diff --git a/include/scsi/scsi_device.h b/include/scsi/scsi_device.h index 2d3ec50..1d11750 100644 --- a/include/scsi/scsi_device.h +++ b/include/scsi/scsi_device.h @@ -168,7 +168,7 @@ struct scsi_device { struct device sdev_gendev, sdev_dev; - struct execute_work ew; /* used to get process context on put */ + struct work_struct release_work; /* for process context on put */ struct scsi_dh_data *scsi_dh_data; enum scsi_device_state sdev_state; @@ -259,7 +259,7 @@ struct scsi_target { #define SCSI_DEFAULT_TARGET_BLOCKED 3 char scsi_level; - struct execute_work ew; + struct work_struct reap_work; enum scsi_target_state state; void *hostdata; /* available to low-level driver */ unsigned long starget_data[0]; /* for the transport */ @@ -277,6 +277,8 @@ static inline struct scsi_target *scsi_target(struct scsi_device *sdev) #define starget_printk(prefix, starget, fmt, a...) \ dev_printk(prefix, &(starget)->dev, fmt, ##a) +extern struct workqueue_struct *scsi_wq; + extern struct scsi_device *__scsi_add_device(struct Scsi_Host *, uint, uint, uint, void *hostdata); extern int scsi_add_device(struct Scsi_Host *host, uint channel, ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 14:00 ` Steven Whitehouse @ 2011-04-13 17:01 ` James Bottomley 2011-04-13 19:35 ` Steven Whitehouse ` (2 more replies) 2011-04-22 18:03 ` Tejun Heo 1 sibling, 3 replies; 39+ messages in thread From: James Bottomley @ 2011-04-13 17:01 UTC (permalink / raw) To: Steven Whitehouse; +Cc: Tejun Heo, linux-kernel, Jens Axboe While you still have the problematic system, can you try this patch? It avoids changing anything in block (other than to add a missing state guard for the elv_next_request). If it works, we can defer the sync vs async discussion and use it for a -stable fix. Thanks, James --- diff --git a/block/blk.h b/block/blk.h index c8db371..11d0d25 100644 --- a/block/blk.h +++ b/block/blk.h @@ -62,7 +62,8 @@ static inline struct request *__elv_next_request(struct request_queue *q) return rq; } - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || + !q->elevator->ops->elevator_dispatch_fn(q, 0)) return NULL; } } diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c index e44ff64..5aa4246 100644 --- a/drivers/scsi/scsi_sysfs.c +++ b/drivers/scsi/scsi_sysfs.c @@ -322,14 +322,9 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) kfree(evt); } - if (sdev->request_queue) { - sdev->request_queue->queuedata = NULL; - /* user context needed to free queue */ - scsi_free_queue(sdev->request_queue); - /* temporary expedient, try to catch use of queue lock - * after free of sdev */ - sdev->request_queue = NULL; - } + /* temporary expedient, try to catch use of queue lock after + * free of sdev */ + sdev->request_queue = NULL; scsi_target_reap(scsi_target(sdev)); @@ -937,6 +932,11 @@ void __scsi_remove_device(struct scsi_device *sdev) if (sdev->host->hostt->slave_destroy) sdev->host->hostt->slave_destroy(sdev); transport_destroy_device(dev); + /* Setting this to NULL causes the request function to reject + * any I/O requests */ + sdev->request_queue->queuedata = NULL; + /* Freeing the queue signals to block that we're done */ + scsi_free_queue(sdev->request_queue); put_device(dev); } ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 17:01 ` James Bottomley @ 2011-04-13 19:35 ` Steven Whitehouse 2011-04-13 20:12 ` Jens Axboe 2011-05-31 6:05 ` Anton V. Boyarshinov 2 siblings, 0 replies; 39+ messages in thread From: Steven Whitehouse @ 2011-04-13 19:35 UTC (permalink / raw) To: James Bottomley; +Cc: Tejun Heo, linux-kernel, Jens Axboe Hi, On Wed, 2011-04-13 at 12:01 -0500, James Bottomley wrote: > While you still have the problematic system, can you try this patch? It > avoids changing anything in block (other than to add a missing state > guard for the elv_next_request). If it works, we can defer the sync vs > async discussion and use it for a -stable fix. > > Thanks, > > James > > --- > Yes, that seems to work too, Steve. > diff --git a/block/blk.h b/block/blk.h > index c8db371..11d0d25 100644 > --- a/block/blk.h > +++ b/block/blk.h > @@ -62,7 +62,8 @@ static inline struct request *__elv_next_request(struct request_queue *q) > return rq; > } > > - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) > + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || > + !q->elevator->ops->elevator_dispatch_fn(q, 0)) > return NULL; > } > } > diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c > index e44ff64..5aa4246 100644 > --- a/drivers/scsi/scsi_sysfs.c > +++ b/drivers/scsi/scsi_sysfs.c > @@ -322,14 +322,9 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) > kfree(evt); > } > > - if (sdev->request_queue) { > - sdev->request_queue->queuedata = NULL; > - /* user context needed to free queue */ > - scsi_free_queue(sdev->request_queue); > - /* temporary expedient, try to catch use of queue lock > - * after free of sdev */ > - sdev->request_queue = NULL; > - } > + /* temporary expedient, try to catch use of queue lock after > + * free of sdev */ > + sdev->request_queue = NULL; > > scsi_target_reap(scsi_target(sdev)); > > @@ -937,6 +932,11 @@ void __scsi_remove_device(struct scsi_device *sdev) > if (sdev->host->hostt->slave_destroy) > sdev->host->hostt->slave_destroy(sdev); > transport_destroy_device(dev); > + /* Setting this to NULL causes the request function to reject > + * any I/O requests */ > + sdev->request_queue->queuedata = NULL; > + /* Freeing the queue signals to block that we're done */ > + scsi_free_queue(sdev->request_queue); > put_device(dev); > } > > > ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 17:01 ` James Bottomley 2011-04-13 19:35 ` Steven Whitehouse @ 2011-04-13 20:12 ` Jens Axboe 2011-04-13 20:17 ` James Bottomley 2011-05-31 6:05 ` Anton V. Boyarshinov 2 siblings, 1 reply; 39+ messages in thread From: Jens Axboe @ 2011-04-13 20:12 UTC (permalink / raw) To: James Bottomley Cc: Steven Whitehouse, Tejun Heo, linux-kernel@vger.kernel.org On 2011-04-13 19:01, James Bottomley wrote: > While you still have the problematic system, can you try this patch? It > avoids changing anything in block (other than to add a missing state > guard for the elv_next_request). If it works, we can defer the sync vs > async discussion and use it for a -stable fix. > > Thanks, > > James > > --- > > diff --git a/block/blk.h b/block/blk.h > index c8db371..11d0d25 100644 > --- a/block/blk.h > +++ b/block/blk.h > @@ -62,7 +62,8 @@ static inline struct request *__elv_next_request(struct request_queue *q) > return rq; > } > > - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) > + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || > + !q->elevator->ops->elevator_dispatch_fn(q, 0)) > return NULL; > } > } > diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c > index e44ff64..5aa4246 100644 > --- a/drivers/scsi/scsi_sysfs.c > +++ b/drivers/scsi/scsi_sysfs.c > @@ -322,14 +322,9 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) > kfree(evt); > } > > - if (sdev->request_queue) { > - sdev->request_queue->queuedata = NULL; > - /* user context needed to free queue */ > - scsi_free_queue(sdev->request_queue); > - /* temporary expedient, try to catch use of queue lock > - * after free of sdev */ > - sdev->request_queue = NULL; > - } > + /* temporary expedient, try to catch use of queue lock after > + * free of sdev */ > + sdev->request_queue = NULL; > > scsi_target_reap(scsi_target(sdev)); > > @@ -937,6 +932,11 @@ void __scsi_remove_device(struct scsi_device *sdev) > if (sdev->host->hostt->slave_destroy) > sdev->host->hostt->slave_destroy(sdev); > transport_destroy_device(dev); > + /* Setting this to NULL causes the request function to reject > + * any I/O requests */ > + sdev->request_queue->queuedata = NULL; > + /* Freeing the queue signals to block that we're done */ > + scsi_free_queue(sdev->request_queue); > put_device(dev); > } This patch looks pretty clean. Shouldn't you serialize that ->queuedata = NULL assignment with the queue lock, though? -- Jens Axboe ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 20:12 ` Jens Axboe @ 2011-04-13 20:17 ` James Bottomley 2011-04-22 18:01 ` Tejun Heo 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-13 20:17 UTC (permalink / raw) To: Jens Axboe; +Cc: Steven Whitehouse, Tejun Heo, linux-kernel@vger.kernel.org On Wed, 2011-04-13 at 22:12 +0200, Jens Axboe wrote: > On 2011-04-13 19:01, James Bottomley wrote: > > While you still have the problematic system, can you try this patch? It > > avoids changing anything in block (other than to add a missing state > > guard for the elv_next_request). If it works, we can defer the sync vs > > async discussion and use it for a -stable fix. > > > > Thanks, > > > > James > > > > --- > > > > diff --git a/block/blk.h b/block/blk.h > > index c8db371..11d0d25 100644 > > --- a/block/blk.h > > +++ b/block/blk.h > > @@ -62,7 +62,8 @@ static inline struct request *__elv_next_request(struct request_queue *q) > > return rq; > > } > > > > - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) > > + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || > > + !q->elevator->ops->elevator_dispatch_fn(q, 0)) > > return NULL; > > } > > } > > diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c > > index e44ff64..5aa4246 100644 > > --- a/drivers/scsi/scsi_sysfs.c > > +++ b/drivers/scsi/scsi_sysfs.c > > @@ -322,14 +322,9 @@ static void scsi_device_dev_release_usercontext(struct work_struct *work) > > kfree(evt); > > } > > > > - if (sdev->request_queue) { > > - sdev->request_queue->queuedata = NULL; > > - /* user context needed to free queue */ > > - scsi_free_queue(sdev->request_queue); > > - /* temporary expedient, try to catch use of queue lock > > - * after free of sdev */ > > - sdev->request_queue = NULL; > > - } > > + /* temporary expedient, try to catch use of queue lock after > > + * free of sdev */ > > + sdev->request_queue = NULL; > > > > scsi_target_reap(scsi_target(sdev)); > > > > @@ -937,6 +932,11 @@ void __scsi_remove_device(struct scsi_device *sdev) > > if (sdev->host->hostt->slave_destroy) > > sdev->host->hostt->slave_destroy(sdev); > > transport_destroy_device(dev); > > + /* Setting this to NULL causes the request function to reject > > + * any I/O requests */ > > + sdev->request_queue->queuedata = NULL; > > + /* Freeing the queue signals to block that we're done */ > > + scsi_free_queue(sdev->request_queue); > > put_device(dev); > > } > > This patch looks pretty clean. Shouldn't you serialize that ->queuedata > = NULL assignment with the queue lock, though? pointer assignment is atomic, isn't it? As in on a 32 bit arch, it definitely is, and I thought on 64 bits it also was. So a simultaneous reader either sees previous value or NULL. James ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 20:17 ` James Bottomley @ 2011-04-22 18:01 ` Tejun Heo 2011-04-22 18:06 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Tejun Heo @ 2011-04-22 18:01 UTC (permalink / raw) To: James Bottomley Cc: Jens Axboe, Steven Whitehouse, linux-kernel@vger.kernel.org Hello, guys. On Wed, Apr 13, 2011 at 03:17:46PM -0500, James Bottomley wrote: > On Wed, 2011-04-13 at 22:12 +0200, Jens Axboe wrote: > > This patch looks pretty clean. Shouldn't you serialize that ->queuedata > > = NULL assignment with the queue lock, though? > > pointer assignment is atomic, isn't it? As in on a 32 bit arch, it > definitely is, and I thought on 64 bits it also was. So a simultaneous > reader either sees previous value or NULL. What was the conclusion of this thread? James' fix seems minimal and good for this cycle but I don't see it there yet. Jens, James? Thanks. -- tejun ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-22 18:01 ` Tejun Heo @ 2011-04-22 18:06 ` James Bottomley 2011-04-22 18:30 ` Tejun Heo 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-22 18:06 UTC (permalink / raw) To: Tejun Heo; +Cc: Jens Axboe, Steven Whitehouse, linux-kernel@vger.kernel.org On Fri, 2011-04-22 at 20:01 +0200, Tejun Heo wrote: > Hello, guys. > > On Wed, Apr 13, 2011 at 03:17:46PM -0500, James Bottomley wrote: > > On Wed, 2011-04-13 at 22:12 +0200, Jens Axboe wrote: > > > This patch looks pretty clean. Shouldn't you serialize that ->queuedata > > > = NULL assignment with the queue lock, though? > > > > pointer assignment is atomic, isn't it? As in on a 32 bit arch, it > > definitely is, and I thought on 64 bits it also was. So a simultaneous > > reader either sees previous value or NULL. > > What was the conclusion of this thread? James' fix seems minimal and > good for this cycle but I don't see it there yet. Jens, James? Sorry, forgot to cc you. I've proposed the minimal fixes for this cycle here: http://marc.info/?l=linux-scsi&m=130348665328233 http://marc.info/?l=linux-scsi&m=130348673628282 http://marc.info/?l=linux-scsi&m=130348680328356 And I'll merge at least the scsi one. But there's been no long term conclusion yet. James ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-22 18:06 ` James Bottomley @ 2011-04-22 18:30 ` Tejun Heo 0 siblings, 0 replies; 39+ messages in thread From: Tejun Heo @ 2011-04-22 18:30 UTC (permalink / raw) To: James Bottomley Cc: Jens Axboe, Steven Whitehouse, linux-kernel@vger.kernel.org On Fri, Apr 22, 2011 at 01:06:18PM -0500, James Bottomley wrote: > I've proposed the minimal fixes for this cycle here: > > http://marc.info/?l=linux-scsi&m=130348665328233 > http://marc.info/?l=linux-scsi&m=130348673628282 > http://marc.info/?l=linux-scsi&m=130348680328356 > > And I'll merge at least the scsi one. Great, looks good to me too. > But there's been no long term conclusion yet. I'll clean up the workqueue conversion patch and try again. Thank you. -- tejun ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 17:01 ` James Bottomley 2011-04-13 19:35 ` Steven Whitehouse 2011-04-13 20:12 ` Jens Axboe @ 2011-05-31 6:05 ` Anton V. Boyarshinov 2 siblings, 0 replies; 39+ messages in thread From: Anton V. Boyarshinov @ 2011-05-31 6:05 UTC (permalink / raw) To: James Bottomley; +Cc: Steven Whitehouse, Tejun Heo, linux-kernel, Jens Axboe Hi > While you still have the problematic system, can you try this patch? It seems that a scsi_sysfs.c half of this patch there is in 2.6.39, but not blk.h part. Now we have frequent panics caused NULL in q->elevator->ops in block/blk.h. Panic is triggered by connecting USB Storage device without medium (card reader, android phone). We saw it on different computers with different kernel builds. Most frequent panics have seen on kernel build with forsed preemption under relatively havy load (for example, boot). Regards, Anton > It avoids changing anything in block (other than to add a missing > state guard for the elv_next_request). If it works, we can defer the > sync vs async discussion and use it for a -stable fix. > > Thanks, > > James > > --- > > diff --git a/block/blk.h b/ > index c8db371..11d0d25 100644 > --- a/block/blk.h > +++ b/block/blk.h > @@ -62,7 +62,8 @@ static inline struct request > *__elv_next_request(struct request_queue *q) return rq; > } > > - if (!q->elevator->ops->elevator_dispatch_fn(q, 0)) > + if (test_bit(QUEUE_FLAG_DEAD, &q->queue_flags) || > + !q->elevator->ops->elevator_dispatch_fn(q, 0)) > return NULL; > } > } > diff --git a/drivers/scsi/scsi_sysfs.c b/drivers/scsi/scsi_sysfs.c > index e44ff64..5aa4246 100644 > --- a/drivers/scsi/scsi_sysfs.c > +++ b/drivers/scsi/scsi_sysfs.c > @@ -322,14 +322,9 @@ static void > scsi_device_dev_release_usercontext(struct work_struct *work) > kfree(evt); } > > - if (sdev->request_queue) { > - sdev->request_queue->queuedata = NULL; > - /* user context needed to free queue */ > - scsi_free_queue(sdev->request_queue); > - /* temporary expedient, try to catch use of queue > lock > - * after free of sdev */ > - sdev->request_queue = NULL; > - } > + /* temporary expedient, try to catch use of queue lock after > + * free of sdev */ > + sdev->request_queue = NULL; > > scsi_target_reap(scsi_target(sdev)); > > @@ -937,6 +932,11 @@ void __scsi_remove_device(struct scsi_device > *sdev) if (sdev->host->hostt->slave_destroy) > sdev->host->hostt->slave_destroy(sdev); > transport_destroy_device(dev); > + /* Setting this to NULL causes the request function to reject > + * any I/O requests */ > + sdev->request_queue->queuedata = NULL; > + /* Freeing the queue signals to block that we're done */ > + scsi_free_queue(sdev->request_queue); > put_device(dev); > } > > > > -- > To unsubscribe from this list: send the line "unsubscribe > linux-kernel" in the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 14:00 ` Steven Whitehouse 2011-04-13 17:01 ` James Bottomley @ 2011-04-22 18:03 ` Tejun Heo 1 sibling, 0 replies; 39+ messages in thread From: Tejun Heo @ 2011-04-22 18:03 UTC (permalink / raw) To: Steven Whitehouse; +Cc: James Bottomley, linux-kernel, Jens Axboe On Wed, Apr 13, 2011 at 03:00:08PM +0100, Steven Whitehouse wrote: > Apologies, some gfs2 bits got included by accident. Here is a cleaned up > version, Great, thanks. I'll clean it up and try to get it included for the next merge window. Thank you. -- tejun ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 4:49 ` James Bottomley 2011-04-12 5:02 ` James Bottomley @ 2011-04-12 5:15 ` Tejun Heo 2011-04-12 15:15 ` James Bottomley 1 sibling, 1 reply; 39+ messages in thread From: Tejun Heo @ 2011-04-12 5:15 UTC (permalink / raw) To: James Bottomley; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe Hello, On Mon, Apr 11, 2011 at 11:49:17PM -0500, James Bottomley wrote: > > But confused here. Why does it make any difference whether the > > release operation is in the request_fn context or not? What makes > > SCSI refcounting different from others? > > I didn't say it did. SCSI refcounting is fairly standard. > > The problem isn't really anything to do with SCSI ... it's the way block > queue destruction must now be called. The block queue destruction > includes a synchronous flush of the work queue. That means it can't be > called from the executing workqueue without deadlocking. The last put > of a SCSI device destroys the queue. This now means that the last put > of the SCSI device can't be in the block delay work path. However, as > the device shuts down that can very well wind up happening if > blk_delay_queue() ends up being called as the device is dying. Yeah, I understood that part. I thought you were referring to the problem caused by the proposed workqueue replacement in the patch when you talked about workqueue related issues in the previous message, and saying that there's an inherent problem with using workqueue directly. > The entangled deadlock seems to have been introduced by commit > 3cca6dc1c81e2407928dc4c6105252146fd3924f prior to that, there was no > synchronous cancel in the destroy path. > > A fix might be to shunt more stuff off to workqueues, but that's > producing a more complex system which would be prone to entanglements > that would be even harder to spot. I don't agree there. To me, the cause for entanglement seems to be request_fn calling all the way through blocking destruction because it detected that the final put was called with sleepable context. It's just weird and difficult to anticipate to directly call into sleepable destruction path from request_fn whether it had sleepable context or not. With the yet-to-be-debugged bug caused by the conversion aside, I think simply using workqueue is the better solution. > Perhaps a better solution is just not to use sync cancellations in > block? As long as the work in the queue holds a queue ref, they can be > done asynchronously. Hmmm... maybe but at least I prefer doing explicit shutdown/draining on destruction even if the base data structure is refcounted. Things become much more predictable that way. Thanks. -- tejun ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 5:15 ` Tejun Heo @ 2011-04-12 15:15 ` James Bottomley 2011-04-13 5:11 ` Tejun Heo 0 siblings, 1 reply; 39+ messages in thread From: James Bottomley @ 2011-04-12 15:15 UTC (permalink / raw) To: Tejun Heo; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe On Tue, 2011-04-12 at 14:15 +0900, Tejun Heo wrote: > > A fix might be to shunt more stuff off to workqueues, but that's > > producing a more complex system which would be prone to entanglements > > that would be even harder to spot. > > I don't agree there. To me, the cause for entanglement seems to be > request_fn calling all the way through blocking destruction because it > detected that the final put was called with sleepable context. It's > just weird and difficult to anticipate to directly call into sleepable > destruction path from request_fn whether it had sleepable context or > not. With the yet-to-be-debugged bug caused by the conversion aside, > I think simply using workqueue is the better solution. So your idea is that all final puts should go through a workqueue? Like I said, that would work, but it's not just SCSI ... any call path that destroys a queue has to be audited. The problem is nothing to do with sleeping context ... it's that any work called by the block workqueue can't destroy that queue. In a refcounted model, that's a bit nasty. > > Perhaps a better solution is just not to use sync cancellations in > > block? As long as the work in the queue holds a queue ref, they can be > > done asynchronously. > > Hmmm... maybe but at least I prefer doing explicit shutdown/draining > on destruction even if the base data structure is refcounted. Things > become much more predictable that way. It is pretty much instantaneous. Unless we're executing, we cancel the work. If the work is already running, we just let it complete instead of waiting for it. Synchronous waits are dangerous because they cause entanglement. James ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-12 15:15 ` James Bottomley @ 2011-04-13 5:11 ` Tejun Heo 2011-04-13 14:15 ` James Bottomley 0 siblings, 1 reply; 39+ messages in thread From: Tejun Heo @ 2011-04-13 5:11 UTC (permalink / raw) To: James Bottomley; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe Hey, James. On Tue, Apr 12, 2011 at 10:15:18AM -0500, James Bottomley wrote: > So your idea is that all final puts should go through a workqueue? Like > I said, that would work, but it's not just SCSI ... any call path that > destroys a queue has to be audited. Yeap. > The problem is nothing to do with sleeping context ... it's that any > work called by the block workqueue can't destroy that queue. In a > refcounted model, that's a bit nasty. I can see your point but please read on. > > Hmmm... maybe but at least I prefer doing explicit shutdown/draining > > on destruction even if the base data structure is refcounted. Things > > become much more predictable that way. > > It is pretty much instantaneous. Unless we're executing, we cancel the > work. If the work is already running, we just let it complete instead > of waiting for it. > > Synchronous waits are dangerous because they cause entanglement. There are two different types of dangers involved. One is of getting trapped into deadlock by recursing and ending up waiting for oneself. The other of continuing operation on objects which could be in dubious state. I guess my point is that I prefer the former by a large margin. The deadlocks are more reliable in reproducibility. Lockdep and soft hang check can detect them easily and a single stack dump will point us right to where the problem is. The latter is much trickier. The problem is more difficult to trigger and even when it triggers the effect often wouldn't be obvious. Auditing for correctness is more difficult too - which fields are safe to access post-mortem? Is there any chance that the ongoing operation might reach out to hardware which is already gone or claimed by another software entity? In this particular case, IMHO it's reasonable for block layer to require that the destruction function not to be called directly from request queue path although it definitely could have used better documentation. Thank you. -- tejun ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: Strange block/scsi/workqueue issue 2011-04-13 5:11 ` Tejun Heo @ 2011-04-13 14:15 ` James Bottomley 0 siblings, 0 replies; 39+ messages in thread From: James Bottomley @ 2011-04-13 14:15 UTC (permalink / raw) To: Tejun Heo; +Cc: Steven Whitehouse, linux-kernel, Jens Axboe On Wed, 2011-04-13 at 14:11 +0900, Tejun Heo wrote: > > > Hmmm... maybe but at least I prefer doing explicit shutdown/draining > > > on destruction even if the base data structure is refcounted. Things > > > become much more predictable that way. > > > > It is pretty much instantaneous. Unless we're executing, we cancel the > > work. If the work is already running, we just let it complete instead > > of waiting for it. > > > > Synchronous waits are dangerous because they cause entanglement. > > There are two different types of dangers involved. One is of getting > trapped into deadlock by recursing and ending up waiting for oneself. > The other of continuing operation on objects which could be in dubious > state. I guess my point is that I prefer the former by a large > margin. > > The deadlocks are more reliable in reproducibility. Lockdep and soft > hang check can detect them easily and a single stack dump will point > us right to where the problem is. The latter is much trickier. I agree, but this is a bit of a false dichotomy. The hang will only detect the thread waiting on itself. Even in the flush model, we still have to detect inappropriate object use because others may still have references. So, in the sync model, on blk_cleanup_queue() you flush the pending requests and destroy the elevator. However, because the queue is refcounted, you still have to cope with the case where one of the reference holders submits more I/O or does anything else with the queue. This is what I don't like about the sync then shut down various bits before the refcount goes to zero. Now we don't have a fully functional queue so we need state guards on all the entry points to detect this and error out (that's some of the QUEUE_FLAG_DEAD checks we put in in the patch). In the async model, you can either do as above (state guards on the entry points) and impose a shutting down state, or you can delay destruction until final put. The former is an identical solution to the synchronous one, except that you don't have the flush. The latter loses the state guard on entry points requirements (because the queue is always fully functional until final put. > The > problem is more difficult to trigger and even when it triggers the > effect often wouldn't be obvious. Auditing for correctness is more > difficult too - which fields are safe to access post-mortem? But in a refcounted model you always have to expect postmortem operations ... you just have to make sure they're properly rejected. This is true for both sync or async if you impose a dying or dead state on the model. > Is there > any chance that the ongoing operation might reach out to hardware > which is already gone or claimed by another software entity? Yes ... in fact SCSI fully expects this ... that's why they dead queue check in the SCSI request function using a NULL ->queuedata signal (another thing that wasn't working quite right). We tear down the device in scsi_remove_device() including destroying the queue. If we go with the sync model for block, I'd actually move blk_cleanup_queue() into that function. There's no real point delaying queue destruction to final put of the SCSI object, since we won't accept I/O after scsi_remove_device() returns. > In this particular case, IMHO it's reasonable for block layer to > require that the destruction function not to be called directly from > request queue path although it definitely could have used better > documentation. I think we've both stated our cases, so it's time for Jens to decide what he wants to do. Given that block already has a state model which includes some QUEUE_FLAG_DEAD state guard checks, it probably makes sense to enhance that, rather than to delay all destruction until final put. James ^ permalink raw reply [flat|nested] 39+ messages in thread
end of thread, other threads:[~2011-05-31 6:16 UTC | newest] Thread overview: 39+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2011-04-11 14:56 Strange block/scsi/workqueue issue Steven Whitehouse 2011-04-11 17:18 ` Tejun Heo 2011-04-11 17:29 ` Jens Axboe 2011-04-11 17:52 ` Steven Whitehouse 2011-04-12 0:14 ` Tejun Heo 2011-04-12 8:49 ` Steven Whitehouse 2011-04-12 0:47 ` James Bottomley 2011-04-12 2:51 ` Tejun Heo 2011-04-12 4:49 ` James Bottomley 2011-04-12 5:02 ` James Bottomley 2011-04-12 8:42 ` Steven Whitehouse 2011-04-12 13:42 ` James Bottomley 2011-04-12 14:06 ` Steven Whitehouse 2011-04-12 15:14 ` James Bottomley 2011-04-12 16:04 ` Steven Whitehouse 2011-04-12 16:27 ` James Bottomley 2011-04-12 16:51 ` Steven Whitehouse 2011-04-12 17:41 ` James Bottomley 2011-04-12 18:33 ` Steven Whitehouse 2011-04-12 19:56 ` James Bottomley 2011-04-12 20:30 ` Steven Whitehouse 2011-04-12 20:43 ` James Bottomley 2011-04-13 5:18 ` Tejun Heo 2011-04-13 6:06 ` Tejun Heo 2011-04-13 9:20 ` Steven Whitehouse 2011-04-13 14:00 ` Steven Whitehouse 2011-04-13 17:01 ` James Bottomley 2011-04-13 19:35 ` Steven Whitehouse 2011-04-13 20:12 ` Jens Axboe 2011-04-13 20:17 ` James Bottomley 2011-04-22 18:01 ` Tejun Heo 2011-04-22 18:06 ` James Bottomley 2011-04-22 18:30 ` Tejun Heo 2011-05-31 6:05 ` Anton V. Boyarshinov 2011-04-22 18:03 ` Tejun Heo 2011-04-12 5:15 ` Tejun Heo 2011-04-12 15:15 ` James Bottomley 2011-04-13 5:11 ` Tejun Heo 2011-04-13 14:15 ` James Bottomley
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).