From: Laurence Oberman <loberman@redhat.com>
To: Bart Van Assche <bart.vanassche@sandisk.com>
Cc: dm-devel@redhat.com, linux-scsi@vger.kernel.org,
Mike Snitzer <snitzer@redhat.com>
Subject: Re: dm-mq and end_clone_request()
Date: Sat, 6 Aug 2016 10:47:33 -0400 (EDT) [thread overview]
Message-ID: <1616390775.11191.1470494853559.JavaMail.zimbra@redhat.com> (raw)
In-Reply-To: <73e2aeda-140d-72ab-d295-57f35139ae55@sandisk.com>
----- Original Message -----
> From: "Bart Van Assche" <bart.vanassche@sandisk.com>
> To: "Laurence Oberman" <loberman@redhat.com>, "Mike Snitzer" <snitzer@redhat.com>
> Cc: dm-devel@redhat.com, linux-scsi@vger.kernel.org
> Sent: Friday, August 5, 2016 2:42:49 PM
> Subject: Re: [dm-devel] dm-mq and end_clone_request()
>
> On 08/05/2016 04:43 AM, Laurence Oberman wrote:
> > Further testing has shown we are still exposed here so more investigation
> > is necessary.
> > The above patch seems to help but I still see sporadic cases of errors
> > escaping up the stack.
> >
> > I expect you will see the same so more work to do here to figure this out.
>
> Hello Laurence,
>
> Unfortunately I also still see sporadic I/O errors when testing
> all-paths-down with CONFIG_DM_MQ_DEFAULT=n (I have not yet tried to
> retest with CONFIG_DM_MQ_DEFAULT=y).
>
> Bart.
> --
> To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
Hello Bart,
I am still debugging this, now that I have no_path_retry=queue and not a count :)
I am often hitting the host delete race, have you seen this on your testing during debugging.
I am using your kernel built from your git tree that has Mikes patches applied.
4.7.0bart
[66813.896159] Hardware name: HP ProLiant DL380 G7, BIOS P67 08/16/2015
[66813.933246] Workqueue: srp_remove srp_remove_work [ib_srp]
[66813.964703] 0000000000000086 00000000d185b9ce ffff88060fa03d20 ffffffff813456df
[66814.007292] 0000000000000000 0000000000000000 ffff88060fa03d60 ffffffff81089fb1
[66814.049336] 0000007da067604b ffff880c01643d80 0000000000017ec0 ffff880c016447dc
[66814.091725] Call Trace:
[66814.104775] <IRQ> [<ffffffff813456df>] dump_stack+0x63/0x84
[66814.136507] [<ffffffff81089fb1>] __warn+0xd1/0xf0
[66814.163118] [<ffffffff8108a0ed>] warn_slowpath_null+0x1d/0x20
[66814.195409] [<ffffffff8104fd7e>] native_smp_send_reschedule+0x3e/0x40
[66814.231954] [<ffffffff810b47db>] try_to_wake_up+0x30b/0x390
[66814.263661] [<ffffffff810b4912>] default_wake_function+0x12/0x20
[66814.297713] [<ffffffff810ccb05>] __wake_up_common+0x55/0x90
[66814.330021] [<ffffffff810ccb53>] __wake_up_locked+0x13/0x20
[66814.361906] [<ffffffff81261179>] ep_poll_callback+0xb9/0x200
[66814.392784] [<ffffffff810ccb05>] __wake_up_common+0x55/0x90
[66814.424908] [<ffffffff810ccc59>] __wake_up+0x39/0x50
[66814.454327] [<ffffffff810e1f80>] wake_up_klogd_work_func+0x40/0x60
[66814.490152] [<ffffffff81177b6d>] irq_work_run_list+0x4d/0x70
[66814.523007] [<ffffffff810710d0>] ? do_flush_tlb_all+0x50/0x50
[66814.556161] [<ffffffff81177bbc>] irq_work_run+0x2c/0x30
[66814.586677] [<ffffffff8110ab5f>] flush_smp_call_function_queue+0x8f/0x160
[66814.625667] [<ffffffff8110b613>] generic_smp_call_function_single_interrupt+0x13/0x60
[66814.669276] [<ffffffff81050167>] smp_call_function_interrupt+0x27/0x40
[66814.706255] [<ffffffff816c7e9c>] call_function_interrupt+0x8c/0xa0
[66814.741406] <EOI> [<ffffffff8118e733>] ? panic+0x1ef/0x233
[66814.772851] [<ffffffff8118e72f>] ? panic+0x1eb/0x233
[66814.800207] [<ffffffff810308f8>] oops_end+0xb8/0xd0
[66814.827454] [<ffffffff8106977e>] no_context+0x13e/0x3a0
[66814.858368] [<ffffffff811f3feb>] ? __slab_free+0x9b/0x280
[66814.890365] [<ffffffff81069ace>] __bad_area_nosemaphore+0xee/0x1d0
[66814.926508] [<ffffffff81069bc4>] bad_area_nosemaphore+0x14/0x20
[66814.959939] [<ffffffff8106a269>] __do_page_fault+0x89/0x4a0
[66814.992039] [<ffffffff811f3feb>] ? __slab_free+0x9b/0x280
[66815.023052] [<ffffffff8106a6b0>] do_page_fault+0x30/0x80
[66815.053368] [<ffffffff816c8b88>] page_fault+0x28/0x30
[66815.083196] [<ffffffff814ae4e9>] ? __scsi_remove_device+0x79/0x160
[66815.117444] [<ffffffff814ae5c2>] ? __scsi_remove_device+0x152/0x160
[66815.152051] [<ffffffff814ac790>] scsi_forget_host+0x60/0x70
[66815.183939] [<ffffffff814a0137>] scsi_remove_host+0x77/0x110
[66815.216152] [<ffffffffa0677be0>] srp_remove_work+0x90/0x200 [ib_srp]
[66815.253221] [<ffffffff810a2e72>] process_one_work+0x152/0x400
[66815.286221] [<ffffffff810a3765>] worker_thread+0x125/0x4b0
[66815.317313] [<ffffffff810a3640>] ? rescuer_thread+0x380/0x380
[66815.349770] [<ffffffff810a9298>] kthread+0xd8/0xf0
[66815.376082] [<ffffffff816c6b3f>] ret_from_fork+0x1f/0x40
[66815.404767] [<ffffffff810a91c0>] ? kthread_park+0x60/0x60
[66815.436448] ---[ end trace bfaf79198d0976f5 ]---
next prev parent reply other threads:[~2016-08-06 14:47 UTC|newest]
Thread overview: 74+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-07-19 22:57 dm-mq and end_clone_request() Bart Van Assche
2016-07-20 14:08 ` Mike Snitzer
2016-07-20 14:27 ` Mike Snitzer
2016-07-20 17:37 ` Bart Van Assche
2016-07-20 18:33 ` Mike Snitzer
2016-07-21 20:58 ` [dm-devel] " Bart Van Assche
2016-07-25 17:53 ` Mike Snitzer
2016-07-25 21:23 ` Mike Snitzer
2016-07-25 22:00 ` Bart Van Assche
2016-07-26 1:16 ` Mike Snitzer
2016-07-26 22:51 ` Bart Van Assche
2016-07-27 14:08 ` Mike Snitzer
2016-07-27 15:52 ` [dm-devel] " Benjamin Marzinski
2016-07-27 19:06 ` Bart Van Assche
2016-07-27 19:54 ` Mike Snitzer
2016-07-27 20:09 ` Mike Snitzer
2016-07-27 23:05 ` Bart Van Assche
2016-07-28 13:33 ` Mike Snitzer
2016-07-28 15:23 ` Bart Van Assche
2016-07-28 15:40 ` Mike Snitzer
2016-07-29 6:28 ` [dm-devel] " Hannes Reinecke
2016-07-26 6:02 ` Hannes Reinecke
2016-07-26 16:06 ` Mike Snitzer
[not found] ` <317679447.7168375.1469729769593.JavaMail.zimbra@redhat.com>
[not found] ` <6880321d-e14f-169b-d100-6e460dd9bd09@sandisk.com>
[not found] ` <1110327939.7305916.1469819453678.JavaMail.zimbra@redhat.com>
[not found] ` <a5c1a149-b1a2-b5a4-2207-bdaf32db3cbd@sandisk.com>
[not found] ` <757522831.7667712.1470059860543.JavaMail.zimbra@redhat.com>
[not found] ` <536022978.7668211.1470060125271.JavaMail.zimbra@redhat.com>
[not found] ` <931235537.7668834.1470060339483.JavaMail.zimbra@redhat.com>
[not found] ` <1264951811.7684268.1470065187014.JavaMail.zimbra@redhat.com>
[not found] ` <17da3ab0-233a-2cec-f921-bfd42c953ccc@sandisk.com>
2016-08-01 17:59 ` Mike Snitzer
2016-08-01 18:55 ` Bart Van Assche
2016-08-01 19:15 ` Mike Snitzer
2016-08-01 20:46 ` Mike Snitzer
2016-08-01 22:41 ` Bart Van Assche
2016-08-01 22:41 ` Bart Van Assche
2016-08-02 17:45 ` Mike Snitzer
2016-08-03 0:19 ` Bart Van Assche
2016-08-03 0:40 ` Mike Snitzer
2016-08-03 1:33 ` Laurence Oberman
2016-08-03 2:10 ` Mike Snitzer
2016-08-03 2:18 ` Laurence Oberman
2016-08-03 2:55 ` Laurence Oberman
2016-08-03 15:10 ` Laurence Oberman
2016-08-03 16:06 ` Bart Van Assche
2016-08-03 17:25 ` Laurence Oberman
2016-08-03 18:03 ` [dm-devel] " Laurence Oberman
2016-08-03 16:55 ` Bart Van Assche
2016-08-04 9:53 ` Hannes Reinecke
2016-08-04 10:09 ` Hannes Reinecke
2016-08-04 15:10 ` Mike Snitzer
2016-08-04 16:10 ` Mike Snitzer
2016-08-04 17:42 ` Bart Van Assche
2016-08-04 23:58 ` Mike Snitzer
2016-08-05 1:07 ` Laurence Oberman
2016-08-05 11:43 ` Laurence Oberman
2016-08-05 15:39 ` Laurence Oberman
2016-08-05 15:43 ` Bart Van Assche
2016-08-05 18:42 ` [dm-devel] " Bart Van Assche
2016-08-06 14:47 ` Laurence Oberman [this message]
2016-08-07 22:31 ` Bart Van Assche
2016-08-08 12:45 ` Laurence Oberman
2016-08-08 13:44 ` Johannes Thumshirn
2016-08-08 13:44 ` Johannes Thumshirn
2016-08-08 14:32 ` Laurence Oberman
2016-08-08 14:54 ` Bart Van Assche
2016-08-08 15:11 ` Bart Van Assche
2016-08-08 15:26 ` Laurence Oberman
2016-08-08 15:28 ` Bart Van Assche
2016-08-08 22:39 ` Bart Van Assche
2016-08-08 22:52 ` Laurence Oberman
2016-08-09 0:09 ` Laurence Oberman
2016-08-09 15:51 ` Bart Van Assche
2016-08-09 17:12 ` [dm-devel] " Laurence Oberman
2016-08-09 17:16 ` Bart Van Assche
2016-08-09 17:21 ` Laurence Oberman
2016-08-10 21:38 ` Laurence Oberman
2016-08-11 16:51 ` Laurence Oberman
2016-08-05 18:40 ` Bart Van Assche
2016-07-21 20:32 ` Mike Snitzer
2016-07-21 20:40 ` [dm-devel] " Bart Van Assche
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1616390775.11191.1470494853559.JavaMail.zimbra@redhat.com \
--to=loberman@redhat.com \
--cc=bart.vanassche@sandisk.com \
--cc=dm-devel@redhat.com \
--cc=linux-scsi@vger.kernel.org \
--cc=snitzer@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.