All of lore.kernel.org
 help / color / mirror / Atom feed
From: Oleg Nesterov <oleg@redhat.com>
To: Jason Wang <jasowang@redhat.com>
Cc: axboe@kernel.dk, brauner@kernel.org, mst@redhat.com,
	linux@leemhuis.info, linux-kernel@vger.kernel.org,
	ebiederm@xmission.com, stefanha@redhat.com,
	nicolas.dichtel@6wind.com,
	virtualization@lists.linux-foundation.org,
	torvalds@linux-foundation.org
Subject: Re: [PATCH 3/3] fork, vhost: Use CLONE_THREAD to fix freezer/ps regression
Date: Wed, 31 May 2023 09:25:11 +0200	[thread overview]
Message-ID: <20230531072449.GA25046@redhat.com> (raw)
In-Reply-To: <26c87be0-8e19-d677-a51b-e6821e6f7ae4@redhat.com>

On 05/31, Jason Wang wrote:
>
> 在 2023/5/23 20:15, Oleg Nesterov 写道:
> >
> >		/* make sure flag is seen after deletion */
> >		smp_wmb();
> >		llist_for_each_entry_safe(work, work_next, node, node) {
> >			clear_bit(VHOST_WORK_QUEUED, &work->flags);
> >
> >I am not sure about smp_wmb + clear_bit. Once we clear VHOST_WORK_QUEUED,
> >vhost_work_queue() can add this work again and change work->node->next.
> >
> >That is why we use _safe, but we need to ensure that llist_for_each_safe()
> >completes LOAD(work->node->next) before VHOST_WORK_QUEUED is cleared.
>
> This should be fine since store is not speculated, so work->node->next needs
> to be loaded before VHOST_WORK_QUEUED is cleared to meet the loop condition.

I don't understand you. OK, to simplify, suppose we have 2 global vars

	void *PTR = something_non_null;
	unsigned long FLAGS = -1ul;

Now I think this code

	CPU_0				CPU_1

	void *ptr = PTR;		if (!test_and_set_bit(0, FLAGS))
	clear_bit(0, FLAGS);			PTR = NULL;
	BUG_ON(!ptr);

is racy and can hit the BUG_ON(!ptr).

I guess it is fine on x86, but in general you need smp_mb__before_atomic()
before clear_bit(), or clear_bit_unlock().

> >			__set_current_state(TASK_RUNNING);
> >
> >Why do we set TASK_RUNNING inside the loop? Does this mean that work->fn()
> >can return with current->state != RUNNING ?
>
> It is because the state were set to TASK_INTERRUPTIBLE in the beginning of
> the loop otherwise it might be side effect while executing work->fn().

Again, I don't understand you. So let me repeat: can work->fn() return with
current->_state != TASK_RUNNING ? If not (and I'd say it should not), you can
do __set_current_state(TASK_RUNNING) once, before llist_for_each_entry_safe().

> >Now the main question. Whatever we do, SIGKILL/SIGSTOP/etc can come right
> >before we call work->fn(). Is it "safe" to run this callback with
> >signal_pending() or fatal_signal_pending() ?
>
> It looks safe since:
>
> 1) vhost hold refcnt of the mm
> 2) release will sync with the worker

Well, that's not what I asked... nevermind, please forget.

Thanks.

Oleg.

_______________________________________________
Virtualization mailing list
Virtualization@lists.linux-foundation.org
https://lists.linuxfoundation.org/mailman/listinfo/virtualization

WARNING: multiple messages have this Message-ID (diff)
From: Oleg Nesterov <oleg@redhat.com>
To: Jason Wang <jasowang@redhat.com>
Cc: Mike Christie <michael.christie@oracle.com>,
	linux@leemhuis.info, nicolas.dichtel@6wind.com, axboe@kernel.dk,
	ebiederm@xmission.com, torvalds@linux-foundation.org,
	linux-kernel@vger.kernel.org,
	virtualization@lists.linux-foundation.org, mst@redhat.com,
	sgarzare@redhat.com, stefanha@redhat.com, brauner@kernel.org
Subject: Re: [PATCH 3/3] fork, vhost: Use CLONE_THREAD to fix freezer/ps regression
Date: Wed, 31 May 2023 09:25:11 +0200	[thread overview]
Message-ID: <20230531072449.GA25046@redhat.com> (raw)
In-Reply-To: <26c87be0-8e19-d677-a51b-e6821e6f7ae4@redhat.com>

On 05/31, Jason Wang wrote:
>
> 在 2023/5/23 20:15, Oleg Nesterov 写道:
> >
> >		/* make sure flag is seen after deletion */
> >		smp_wmb();
> >		llist_for_each_entry_safe(work, work_next, node, node) {
> >			clear_bit(VHOST_WORK_QUEUED, &work->flags);
> >
> >I am not sure about smp_wmb + clear_bit. Once we clear VHOST_WORK_QUEUED,
> >vhost_work_queue() can add this work again and change work->node->next.
> >
> >That is why we use _safe, but we need to ensure that llist_for_each_safe()
> >completes LOAD(work->node->next) before VHOST_WORK_QUEUED is cleared.
>
> This should be fine since store is not speculated, so work->node->next needs
> to be loaded before VHOST_WORK_QUEUED is cleared to meet the loop condition.

I don't understand you. OK, to simplify, suppose we have 2 global vars

	void *PTR = something_non_null;
	unsigned long FLAGS = -1ul;

Now I think this code

	CPU_0				CPU_1

	void *ptr = PTR;		if (!test_and_set_bit(0, FLAGS))
	clear_bit(0, FLAGS);			PTR = NULL;
	BUG_ON(!ptr);

is racy and can hit the BUG_ON(!ptr).

I guess it is fine on x86, but in general you need smp_mb__before_atomic()
before clear_bit(), or clear_bit_unlock().

> >			__set_current_state(TASK_RUNNING);
> >
> >Why do we set TASK_RUNNING inside the loop? Does this mean that work->fn()
> >can return with current->state != RUNNING ?
>
> It is because the state were set to TASK_INTERRUPTIBLE in the beginning of
> the loop otherwise it might be side effect while executing work->fn().

Again, I don't understand you. So let me repeat: can work->fn() return with
current->_state != TASK_RUNNING ? If not (and I'd say it should not), you can
do __set_current_state(TASK_RUNNING) once, before llist_for_each_entry_safe().

> >Now the main question. Whatever we do, SIGKILL/SIGSTOP/etc can come right
> >before we call work->fn(). Is it "safe" to run this callback with
> >signal_pending() or fatal_signal_pending() ?
>
> It looks safe since:
>
> 1) vhost hold refcnt of the mm
> 2) release will sync with the worker

Well, that's not what I asked... nevermind, please forget.

Thanks.

Oleg.


  reply	other threads:[~2023-05-31  7:25 UTC|newest]

Thread overview: 103+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-05-22  2:51 [PATCH 0/3] vhost: Fix freezer/ps regressions Mike Christie
2023-05-22  2:51 ` Mike Christie
2023-05-22  2:51 ` [PATCH 1/3] signal: Don't always put SIGKILL in shared_pending Mike Christie
2023-05-22  2:51   ` Mike Christie
2023-05-23 15:30   ` Eric W. Biederman
2023-05-23 15:30     ` Eric W. Biederman
2023-05-22  2:51 ` [PATCH 2/3] signal: Don't exit for PF_USER_WORKER tasks Mike Christie
2023-05-22  2:51   ` Mike Christie
2023-05-22  2:51 ` [PATCH 3/3] fork, vhost: Use CLONE_THREAD to fix freezer/ps regression Mike Christie
2023-05-22  2:51   ` Mike Christie
2023-05-22 12:30   ` Oleg Nesterov
2023-05-22 12:30     ` Oleg Nesterov
2023-05-22 17:00     ` Mike Christie
2023-05-22 17:00       ` Mike Christie
2023-05-22 17:47       ` Oleg Nesterov
2023-05-22 17:47         ` Oleg Nesterov
2023-05-23 12:15         ` Oleg Nesterov
2023-05-23 12:15           ` Oleg Nesterov
2023-05-23 15:57           ` Eric W. Biederman
2023-05-23 15:57             ` Eric W. Biederman
2023-05-24 14:10             ` Oleg Nesterov
2023-05-24 14:10               ` Oleg Nesterov
2023-05-24 14:44               ` Eric W. Biederman
2023-05-24 14:44                 ` Eric W. Biederman
2023-05-25 11:55                 ` Oleg Nesterov
2023-05-25 11:55                   ` Oleg Nesterov
2023-05-25 15:30                   ` Eric W. Biederman
2023-05-25 15:30                     ` Eric W. Biederman
2023-05-25 16:20                     ` Linus Torvalds
2023-05-25 16:20                       ` Linus Torvalds
2023-05-27  9:49                       ` Eric W. Biederman
2023-05-27  9:49                         ` Eric W. Biederman
2023-05-27 16:12                         ` Linus Torvalds
2023-05-27 16:12                           ` Linus Torvalds
2023-05-28  1:17                           ` Eric W. Biederman
2023-05-28  1:17                             ` Eric W. Biederman
2023-05-28  1:21                             ` Linus Torvalds
2023-05-28  1:21                               ` Linus Torvalds
2023-05-29 11:19                             ` Oleg Nesterov
2023-05-29 11:19                               ` Oleg Nesterov
2023-05-29 16:09                               ` michael.christie
2023-05-29 16:09                                 ` michael.christie
2023-05-29 17:46                                 ` Oleg Nesterov
2023-05-29 17:46                                   ` Oleg Nesterov
2023-05-29 17:54                                   ` Oleg Nesterov
2023-05-29 17:54                                     ` Oleg Nesterov
2023-05-29 19:03                                     ` Mike Christie
2023-05-29 19:03                                       ` Mike Christie
2023-05-29 19:35                                   ` Mike Christie
2023-05-29 19:35                                     ` Mike Christie
2023-05-29 19:46                                     ` michael.christie
2023-05-29 19:46                                       ` michael.christie
2023-05-30  2:48                                       ` Eric W. Biederman
2023-05-30  2:48                                         ` Eric W. Biederman
2023-05-30  2:38                                 ` Eric W. Biederman
2023-05-30  2:38                                   ` Eric W. Biederman
2023-05-30 15:34                                   ` Mike Christie
2023-05-30 15:34                                     ` Mike Christie
2023-05-31  3:30                                   ` Mike Christie
2023-05-31  3:30                                     ` Mike Christie
2023-05-29 16:11                               ` michael.christie
2023-05-29 16:11                                 ` michael.christie
2023-05-30 14:15                               ` Christian Brauner
2023-05-30 17:55                                 ` Oleg Nesterov
2023-05-30 17:55                                   ` Oleg Nesterov
2023-05-30 15:01                         ` Eric W. Biederman
2023-05-30 15:01                           ` Eric W. Biederman
2023-05-31  5:22             ` Jason Wang
2023-05-31  5:22               ` Jason Wang
2023-05-24  0:02           ` Mike Christie
2023-05-24  0:02             ` Mike Christie
2023-05-25 16:15           ` Mike Christie
2023-05-25 16:15             ` Mike Christie
2023-05-28  1:41             ` Eric W. Biederman
2023-05-28  1:41               ` Eric W. Biederman
2023-05-28 19:29               ` Mike Christie
2023-05-28 19:29                 ` Mike Christie
2023-05-31  5:22           ` Jason Wang
2023-05-31  5:22             ` Jason Wang
2023-05-31  7:25             ` Oleg Nesterov [this message]
2023-05-31  7:25               ` Oleg Nesterov
2023-05-31  8:17               ` Jason Wang
2023-05-31  8:17                 ` Jason Wang
2023-05-31  9:14                 ` Oleg Nesterov
2023-05-31  9:14                   ` Oleg Nesterov
2023-06-01  2:44                   ` Jason Wang
2023-06-01  2:44                     ` Jason Wang
2023-06-01  7:43                     ` Oleg Nesterov
2023-06-01  7:43                       ` Oleg Nesterov
2023-06-02  5:03                       ` Jason Wang
2023-06-02  5:03                         ` Jason Wang
2023-06-02 17:58                         ` Oleg Nesterov
2023-06-02 17:58                           ` Oleg Nesterov
2023-06-02 20:07                           ` Linus Torvalds
2023-06-02 20:07                             ` Linus Torvalds
2023-06-05 14:20                             ` Oleg Nesterov
2023-06-05 14:20                               ` Oleg Nesterov
2023-05-22 19:40   ` Michael S. Tsirkin
2023-05-22 19:40     ` Michael S. Tsirkin
2023-05-23 15:39     ` Eric W. Biederman
2023-05-23 15:39       ` Eric W. Biederman
2023-05-23 15:48     ` Mike Christie
2023-05-23 15:48       ` Mike Christie

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20230531072449.GA25046@redhat.com \
    --to=oleg@redhat.com \
    --cc=axboe@kernel.dk \
    --cc=brauner@kernel.org \
    --cc=ebiederm@xmission.com \
    --cc=jasowang@redhat.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux@leemhuis.info \
    --cc=mst@redhat.com \
    --cc=nicolas.dichtel@6wind.com \
    --cc=stefanha@redhat.com \
    --cc=torvalds@linux-foundation.org \
    --cc=virtualization@lists.linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.