From: Laurence Oberman <loberman@redhat.com>
To: mgandhi@redhat.com
Cc: linux-scsi@vger.kernel.org, chad dupuis <chad.dupuis@cavium.com>
Subject: Re: [PATCH] qla2xxx: Get mutex lock before checking optrom_state
Date: Sat, 24 Dec 2016 11:38:37 -0500 (EST) [thread overview]
Message-ID: <128624601.9139938.1482597517537.JavaMail.zimbra@redhat.com> (raw)
In-Reply-To: <288dbcf8-29b5-8156-aba8-049edfed1dde@redhat.com>
----- Original Message -----
> From: "Milan P. Gandhi" <mgandhi@redhat.com>
> To: linux-scsi@vger.kernel.org
> Cc: "Laurence Oberman" <loberman@redhat.com>, "chad dupuis" <chad.dupuis@cavium.com>
> Sent: Saturday, December 24, 2016 11:32:46 AM
> Subject: [PATCH] qla2xxx: Get mutex lock before checking optrom_state
>
> Hello,
>
> There is a race condition with qla2xxx optrom functions where
> one thread might modify optrom buffer, optrom_state while
> other thread is still reading from it.
>
> In couple of crashes, it was found that we had successfully
> passed the following 'if' check where we confirm optrom_state
> to be QLA_SREADING. But by the time we acquired mutex lock
> to proceed with memory_read_from_buffer function, some other
> thread/process had already modified that option rom buffer
> and optrom_state from QLA_SREADING to QLA_SWAITING. Then
> we got ha->optrom_buffer 0x0 and crashed the system:
>
> if (ha->optrom_state != QLA_SREADING)
> return 0;
>
> mutex_lock(&ha->optrom_mutex);
> rval = memory_read_from_buffer(buf, count, &off, ha->optrom_buffer,
> ha->optrom_region_size);
> mutex_unlock(&ha->optrom_mutex);
>
>
> With current optrom function we get following crash due to
> a race condition:
>
> [ 1479.466679] BUG: unable to handle kernel NULL pointer dereference at
> (null)
> [ 1479.466707] IP: [<ffffffff81326756>] memcpy+0x6/0x110
> [...]
> [ 1479.473673] Call Trace:
> [ 1479.474296] [<ffffffff81225cbc>] ? memory_read_from_buffer+0x3c/0x60
> [ 1479.474941] [<ffffffffa01574dc>] qla2x00_sysfs_read_optrom+0x9c/0xc0
> [qla2xxx]
> [ 1479.475571] [<ffffffff8127e76b>] read+0xdb/0x1f0
> [ 1479.476206] [<ffffffff811fdf9e>] vfs_read+0x9e/0x170
> [ 1479.476839] [<ffffffff811feb6f>] SyS_read+0x7f/0xe0
> [ 1479.477466] [<ffffffff816964c9>] system_call_fastpath+0x16/0x1b
>
>
> Below patch modifies qla2x00_sysfs_read_optrom,
> qla2x00_sysfs_write_optrom functions to get the mutex_lock
> before checking ha->optrom_state to avoid similar crashes.
>
> The patch was applied and tested and same crashes were no
> longer observed again.
>
>
> Tested-by: Milan P. Gandhi <mgandhi@redhat.com>
> Signed-off-by: Milan P. Gandhi <mgandhi@redhat.com>
> ---
> drivers/scsi/qla2xxx/qla_attr.c | 18 +++++++++++++-----
> 1 file changed, 13 insertions(+), 5 deletions(-)
>
> diff --git a/drivers/scsi/qla2xxx/qla_attr.c
> b/drivers/scsi/qla2xxx/qla_attr.c
> index da5ae11..47ea164 100644
> --- a/drivers/scsi/qla2xxx/qla_attr.c
> +++ b/drivers/scsi/qla2xxx/qla_attr.c
> @@ -329,12 +329,15 @@ qla2x00_sysfs_read_optrom(struct file *filp, struct
> kobject *kobj,
> struct qla_hw_data *ha = vha->hw;
> ssize_t rval = 0;
>
> + mutex_lock(&ha->optrom_mutex);
> +
> if (ha->optrom_state != QLA_SREADING)
> - return 0;
> + goto out;
>
> - mutex_lock(&ha->optrom_mutex);
> rval = memory_read_from_buffer(buf, count, &off, ha->optrom_buffer,
> ha->optrom_region_size);
> +
> +out:
> mutex_unlock(&ha->optrom_mutex);
>
> return rval;
> @@ -349,14 +352,19 @@ qla2x00_sysfs_write_optrom(struct file *filp, struct
> kobject *kobj,
> struct device, kobj)));
> struct qla_hw_data *ha = vha->hw;
>
> - if (ha->optrom_state != QLA_SWRITING)
> + mutex_lock(&ha->optrom_mutex);
> +
> + if (ha->optrom_state != QLA_SWRITING) {
> + mutex_unlock(&ha->optrom_mutex);
> return -EINVAL;
> - if (off > ha->optrom_region_size)
> + }
> + if (off > ha->optrom_region_size) {
> + mutex_unlock(&ha->optrom_mutex);
> return -ERANGE;
> + }
> if (off + count > ha->optrom_region_size)
> count = ha->optrom_region_size - off;
>
> - mutex_lock(&ha->optrom_mutex);
> memcpy(&ha->optrom_buffer[off], buf, count);
> mutex_unlock(&ha->optrom_mutex);
>
>
Looks good, and I know it fixed the issue.
Milan, Thank you for this work.
Reviewed-by: Laurence Oberman <loberman@redhat.com>
next prev parent reply other threads:[~2016-12-24 16:39 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-12-24 16:32 [PATCH] qla2xxx: Get mutex lock before checking optrom_state Milan P. Gandhi
2016-12-24 16:38 ` Laurence Oberman [this message]
2017-01-06 1:49 ` Martin K. Petersen
2017-01-06 20:07 ` Madhani, Himanshu
2017-01-10 4:16 ` Martin K. Petersen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=128624601.9139938.1482597517537.JavaMail.zimbra@redhat.com \
--to=loberman@redhat.com \
--cc=chad.dupuis@cavium.com \
--cc=linux-scsi@vger.kernel.org \
--cc=mgandhi@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).