From: Laurence Oberman <loberman@redhat.com>
To: Bart Van Assche <bart.vanassche@sandisk.com>
Cc: dm-devel@redhat.com, linux-scsi@vger.kernel.org,
Mike Snitzer <snitzer@redhat.com>
Subject: Re: dm-mq and end_clone_request()
Date: Sat, 6 Aug 2016 10:47:33 -0400 (EDT) [thread overview]
Message-ID: <1616390775.11191.1470494853559.JavaMail.zimbra@redhat.com> (raw)
In-Reply-To: <73e2aeda-140d-72ab-d295-57f35139ae55@sandisk.com>
----- Original Message -----
> From: "Bart Van Assche" <bart.vanassche@sandisk.com>
> To: "Laurence Oberman" <loberman@redhat.com>, "Mike Snitzer" <snitzer@redhat.com>
> Cc: dm-devel@redhat.com, linux-scsi@vger.kernel.org
> Sent: Friday, August 5, 2016 2:42:49 PM
> Subject: Re: [dm-devel] dm-mq and end_clone_request()
>
> On 08/05/2016 04:43 AM, Laurence Oberman wrote:
> > Further testing has shown we are still exposed here so more investigation
> > is necessary.
> > The above patch seems to help but I still see sporadic cases of errors
> > escaping up the stack.
> >
> > I expect you will see the same so more work to do here to figure this out.
>
> Hello Laurence,
>
> Unfortunately I also still see sporadic I/O errors when testing
> all-paths-down with CONFIG_DM_MQ_DEFAULT=n (I have not yet tried to
> retest with CONFIG_DM_MQ_DEFAULT=y).
>
> Bart.
> --
> To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
Hello Bart,
I am still debugging this, now that I have no_path_retry=queue and not a count :)
I am often hitting the host delete race, have you seen this on your testing during debugging.
I am using your kernel built from your git tree that has Mikes patches applied.
4.7.0bart
[66813.896159] Hardware name: HP ProLiant DL380 G7, BIOS P67 08/16/2015
[66813.933246] Workqueue: srp_remove srp_remove_work [ib_srp]
[66813.964703] 0000000000000086 00000000d185b9ce ffff88060fa03d20 ffffffff813456df
[66814.007292] 0000000000000000 0000000000000000 ffff88060fa03d60 ffffffff81089fb1
[66814.049336] 0000007da067604b ffff880c01643d80 0000000000017ec0 ffff880c016447dc
[66814.091725] Call Trace:
[66814.104775] <IRQ> [<ffffffff813456df>] dump_stack+0x63/0x84
[66814.136507] [<ffffffff81089fb1>] __warn+0xd1/0xf0
[66814.163118] [<ffffffff8108a0ed>] warn_slowpath_null+0x1d/0x20
[66814.195409] [<ffffffff8104fd7e>] native_smp_send_reschedule+0x3e/0x40
[66814.231954] [<ffffffff810b47db>] try_to_wake_up+0x30b/0x390
[66814.263661] [<ffffffff810b4912>] default_wake_function+0x12/0x20
[66814.297713] [<ffffffff810ccb05>] __wake_up_common+0x55/0x90
[66814.330021] [<ffffffff810ccb53>] __wake_up_locked+0x13/0x20
[66814.361906] [<ffffffff81261179>] ep_poll_callback+0xb9/0x200
[66814.392784] [<ffffffff810ccb05>] __wake_up_common+0x55/0x90
[66814.424908] [<ffffffff810ccc59>] __wake_up+0x39/0x50
[66814.454327] [<ffffffff810e1f80>] wake_up_klogd_work_func+0x40/0x60
[66814.490152] [<ffffffff81177b6d>] irq_work_run_list+0x4d/0x70
[66814.523007] [<ffffffff810710d0>] ? do_flush_tlb_all+0x50/0x50
[66814.556161] [<ffffffff81177bbc>] irq_work_run+0x2c/0x30
[66814.586677] [<ffffffff8110ab5f>] flush_smp_call_function_queue+0x8f/0x160
[66814.625667] [<ffffffff8110b613>] generic_smp_call_function_single_interrupt+0x13/0x60
[66814.669276] [<ffffffff81050167>] smp_call_function_interrupt+0x27/0x40
[66814.706255] [<ffffffff816c7e9c>] call_function_interrupt+0x8c/0xa0
[66814.741406] <EOI> [<ffffffff8118e733>] ? panic+0x1ef/0x233
[66814.772851] [<ffffffff8118e72f>] ? panic+0x1eb/0x233
[66814.800207] [<ffffffff810308f8>] oops_end+0xb8/0xd0
[66814.827454] [<ffffffff8106977e>] no_context+0x13e/0x3a0
[66814.858368] [<ffffffff811f3feb>] ? __slab_free+0x9b/0x280
[66814.890365] [<ffffffff81069ace>] __bad_area_nosemaphore+0xee/0x1d0
[66814.926508] [<ffffffff81069bc4>] bad_area_nosemaphore+0x14/0x20
[66814.959939] [<ffffffff8106a269>] __do_page_fault+0x89/0x4a0
[66814.992039] [<ffffffff811f3feb>] ? __slab_free+0x9b/0x280
[66815.023052] [<ffffffff8106a6b0>] do_page_fault+0x30/0x80
[66815.053368] [<ffffffff816c8b88>] page_fault+0x28/0x30
[66815.083196] [<ffffffff814ae4e9>] ? __scsi_remove_device+0x79/0x160
[66815.117444] [<ffffffff814ae5c2>] ? __scsi_remove_device+0x152/0x160
[66815.152051] [<ffffffff814ac790>] scsi_forget_host+0x60/0x70
[66815.183939] [<ffffffff814a0137>] scsi_remove_host+0x77/0x110
[66815.216152] [<ffffffffa0677be0>] srp_remove_work+0x90/0x200 [ib_srp]
[66815.253221] [<ffffffff810a2e72>] process_one_work+0x152/0x400
[66815.286221] [<ffffffff810a3765>] worker_thread+0x125/0x4b0
[66815.317313] [<ffffffff810a3640>] ? rescuer_thread+0x380/0x380
[66815.349770] [<ffffffff810a9298>] kthread+0xd8/0xf0
[66815.376082] [<ffffffff816c6b3f>] ret_from_fork+0x1f/0x40
[66815.404767] [<ffffffff810a91c0>] ? kthread_park+0x60/0x60
[66815.436448] ---[ end trace bfaf79198d0976f5 ]---
next prev parent reply other threads:[~2016-08-06 14:47 UTC|newest]
Thread overview: 66+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <4ed669ed-beae-76a8-b806-a284565b327a@sandisk.com>
2016-07-20 14:08 ` dm-mq and end_clone_request() Mike Snitzer
2016-07-20 14:27 ` Mike Snitzer
2016-07-20 17:37 ` Bart Van Assche
2016-07-20 18:33 ` Mike Snitzer
2016-07-21 20:58 ` [dm-devel] " Bart Van Assche
2016-07-25 17:53 ` Mike Snitzer
2016-07-25 21:23 ` Mike Snitzer
2016-07-25 22:00 ` Bart Van Assche
2016-07-26 1:16 ` Mike Snitzer
2016-07-26 22:51 ` Bart Van Assche
2016-07-27 14:08 ` Mike Snitzer
2016-07-27 15:52 ` [dm-devel] " Benjamin Marzinski
2016-07-27 19:06 ` Bart Van Assche
2016-07-27 19:54 ` Mike Snitzer
2016-07-27 20:09 ` Mike Snitzer
2016-07-27 23:05 ` Bart Van Assche
2016-07-28 13:33 ` Mike Snitzer
2016-07-28 15:23 ` Bart Van Assche
2016-07-28 15:40 ` Mike Snitzer
2016-07-29 6:28 ` [dm-devel] " Hannes Reinecke
[not found] ` <317679447.7168375.1469729769593.JavaMail.zimbra@redhat.com>
[not found] ` <6880321d-e14f-169b-d100-6e460dd9bd09@sandisk.com>
[not found] ` <1110327939.7305916.1469819453678.JavaMail.zimbra@redhat.com>
[not found] ` <a5c1a149-b1a2-b5a4-2207-bdaf32db3cbd@sandisk.com>
[not found] ` <757522831.7667712.1470059860543.JavaMail.zimbra@redhat.com>
[not found] ` <536022978.7668211.1470060125271.JavaMail.zimbra@redhat.com>
[not found] ` <931235537.7668834.1470060339483.JavaMail.zimbra@redhat.com>
[not found] ` <1264951811.7684268.1470065187014.JavaMail.zimbra@redhat.com>
[not found] ` <17da3ab0-233a-2cec-f921-bfd42c953ccc@sandisk.com>
2016-08-01 17:59 ` Mike Snitzer
2016-08-01 18:55 ` Bart Van Assche
2016-08-01 19:15 ` Mike Snitzer
2016-08-01 20:46 ` Mike Snitzer
2016-08-01 22:41 ` Bart Van Assche
2016-08-02 17:45 ` Mike Snitzer
2016-08-03 0:19 ` Bart Van Assche
2016-08-03 0:40 ` Mike Snitzer
2016-08-03 1:33 ` Laurence Oberman
2016-08-03 2:10 ` Mike Snitzer
2016-08-03 2:18 ` Laurence Oberman
2016-08-03 2:55 ` Laurence Oberman
2016-08-03 15:10 ` Laurence Oberman
2016-08-03 16:06 ` Bart Van Assche
2016-08-03 17:25 ` Laurence Oberman
2016-08-03 18:03 ` [dm-devel] " Laurence Oberman
2016-08-03 16:55 ` Bart Van Assche
2016-08-04 16:10 ` Mike Snitzer
2016-08-04 17:42 ` Bart Van Assche
2016-08-04 23:58 ` Mike Snitzer
2016-08-05 1:07 ` Laurence Oberman
2016-08-05 11:43 ` Laurence Oberman
2016-08-05 15:39 ` Laurence Oberman
2016-08-05 15:43 ` Bart Van Assche
2016-08-05 18:42 ` [dm-devel] " Bart Van Assche
2016-08-06 14:47 ` Laurence Oberman [this message]
2016-08-07 22:31 ` Bart Van Assche
2016-08-08 12:45 ` Laurence Oberman
2016-08-08 13:44 ` Johannes Thumshirn
2016-08-08 14:32 ` Laurence Oberman
2016-08-08 14:54 ` Bart Van Assche
2016-08-08 15:11 ` Bart Van Assche
2016-08-08 15:26 ` Laurence Oberman
2016-08-08 15:28 ` Bart Van Assche
2016-08-08 22:39 ` Bart Van Assche
2016-08-08 22:52 ` Laurence Oberman
2016-08-09 0:09 ` Laurence Oberman
2016-08-09 15:51 ` Bart Van Assche
2016-08-09 17:12 ` [dm-devel] " Laurence Oberman
2016-08-09 17:16 ` Bart Van Assche
2016-08-09 17:21 ` Laurence Oberman
2016-08-10 21:38 ` Laurence Oberman
2016-08-11 16:51 ` Laurence Oberman
2016-08-05 18:40 ` Bart Van Assche
2016-07-21 20:32 ` Mike Snitzer
2016-07-21 20:40 ` [dm-devel] " Bart Van Assche
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1616390775.11191.1470494853559.JavaMail.zimbra@redhat.com \
--to=loberman@redhat.com \
--cc=bart.vanassche@sandisk.com \
--cc=dm-devel@redhat.com \
--cc=linux-scsi@vger.kernel.org \
--cc=snitzer@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).