From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id BF0F5E732DB for ; Thu, 28 Sep 2023 15:16:39 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:In-Reply-To: Content-Transfer-Encoding:Content-Type:MIME-Version:References:Message-ID: Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=1aMZSHFJ00QdHHcRXWNmjtWw9D0/fDe8zQRO1jC0Y6c=; b=UCSuyBy11tzQrDPpDL0vCEPCML +Q34p/qErFSmj8UrXoUVCObvz04H2JiTBfqmjsumjPENEkeNvHmdS1NqDy1haJ+Y6fCaBuFfg5ooc HZlNdaRQQNVACNjlRmo/k8QKqskeggFk+hNJfa5bBB9TRJg9alYgdI7m63Mm54DbLA9j+4y3kBu3p E3uUlfDqalgVsrU7Jj5TuVAnw2hizWOg5WoOwQhkUgsQZLmt3GxC3jP84NzUx5Q/fvCGniyBYAfLt P1lk/7lz/AhDlEQYD5zgNBdjllcvae/3pgo3uXOAQFNI/YMzvICNuDkA9cfXTNklaU8VhdRf93N2M 7TJ6YCHg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1qlskn-005Kna-1V; Thu, 28 Sep 2023 15:16:37 +0000 Received: from casper.infradead.org ([2001:8b0:10b:1236::1]) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1qlska-005Kcn-0t; Thu, 28 Sep 2023 15:16:24 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Transfer-Encoding: Content-Type:MIME-Version:References:Message-ID:Subject:Cc:To:From:Date: Sender:Reply-To:Content-ID:Content-Description; bh=1aMZSHFJ00QdHHcRXWNmjtWw9D0/fDe8zQRO1jC0Y6c=; b=ksh//XmFWudVXcwZB/50DEfC2b S71MVheqbnADXAn7PH/N3RCcPF5sbzGGR2lQ3Qm1i66oCNNvF8KKBQMmL37ZX3hcmQbVI30NxsNVG TPvPdA8T6HHf08D/1X0JHIKJzW6h9x8OninTY8z+y9mZ30mVQy+nRoUy4jQrG3gICpcdTZl1qnife VgGcxFjLIWhmikV2TaSyYQhUGvRo+etPZlac8lh+KVNSU2VXjNk7C1HNbCjg9HjV5ZD39kw3HYa7P e/JPfxnUOIL0blFRQqQ7aEZvqmF9w+Sd+OLEO994Fic7j6yTH64hnaq9KO5VM54GjU7Ho3io5IEqY 1PlJZOsQ==; Received: from j130084.upc-j.chello.nl ([24.132.130.84] helo=noisy.programming.kicks-ass.net) by casper.infradead.org with esmtpsa (Exim 4.94.2 #2 (Red Hat Linux)) id 1qlskS-003CWF-JS; Thu, 28 Sep 2023 15:16:16 +0000 Received: by noisy.programming.kicks-ass.net (Postfix, from userid 1000) id 4669A3002E3; Thu, 28 Sep 2023 17:16:16 +0200 (CEST) Date: Thu, 28 Sep 2023 17:16:16 +0200 From: Peter Zijlstra To: Kuyo Chang =?utf-8?B?KOW8teW7uuaWhyk=?= Cc: "dietmar.eggemann@arm.com" , "linux-kernel@vger.kernel.org" , "linux-mediatek@lists.infradead.org" , "rostedt@goodmis.org" , wsd_upstream , "vschneid@redhat.com" , "bristot@redhat.com" , "juri.lelli@redhat.com" , "mingo@redhat.com" , "linux-arm-kernel@lists.infradead.org" , "bsegall@google.com" , "mgorman@suse.de" , "matthias.bgg@gmail.com" , "vincent.guittot@linaro.org" , "angelogioacchino.delregno@collabora.com" Subject: Re: [PATCH 1/1] sched/core: Fix stuck on completion for affine_move_task() when stopper disable Message-ID: <20230928151616.GD27245@noisy.programming.kicks-ass.net> References: <20230927033431.12406-1-kuyo.chang@mediatek.com> <20230927080850.GB21824@noisy.programming.kicks-ass.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-BeenThere: linux-mediatek@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "Linux-mediatek" Errors-To: linux-mediatek-bounces+linux-mediatek=archiver.kernel.org@lists.infradead.org On Wed, Sep 27, 2023 at 03:57:35PM +0000, Kuyo Chang (張建文) wrote: > On Wed, 2023-09-27 at 10:08 +0200, Peter Zijlstra wrote: > > > > External email : Please do not click links or open attachments until > > you have verified the sender or the content. > > On Wed, Sep 27, 2023 at 11:34:28AM +0800, Kuyo Chang wrote: > > > From: kuyo chang > > > > > > [Syndrome] hung detect shows below warning msg > > > [ 4320.666557] [ T56] khungtaskd: [name:hung_task&]INFO: task > > stressapptest:17803 blocked for more than 3600 seconds. > > > [ 4320.666589] [ T56] khungtaskd: > > [name:core&]task:stressapptest state:D stack:0 pid:17803 > > ppid:17579 flags:0x04000008 > > > [ 4320.666601] [ T56] khungtaskd: Call trace: > > > [ 4320.666607] [ T56] khungtaskd: __switch_to+0x17c/0x338 > > > [ 4320.666642] [ T56] khungtaskd: __schedule+0x54c/0x8ec > > > [ 4320.666651] [ T56] khungtaskd: schedule+0x74/0xd4 > > > [ 4320.666656] [ T56] khungtaskd: schedule_timeout+0x34/0x108 > > > [ 4320.666672] [ T56] khungtaskd: do_wait_for_common+0xe0/0x154 > > > [ 4320.666678] [ T56] khungtaskd: wait_for_completion+0x44/0x58 > > > [ 4320.666681] [ T56] > > khungtaskd: __set_cpus_allowed_ptr_locked+0x344/0x730 > > > [ 4320.666702] [ T56] > > khungtaskd: __sched_setaffinity+0x118/0x160 > > > [ 4320.666709] [ T56] khungtaskd: sched_setaffinity+0x10c/0x248 > > > [ 4320.666715] [ T56] > > khungtaskd: __arm64_sys_sched_setaffinity+0x15c/0x1c0 > > > [ 4320.666719] [ T56] khungtaskd: invoke_syscall+0x3c/0xf8 > > > [ 4320.666743] [ T56] khungtaskd: el0_svc_common+0xb0/0xe8 > > > [ 4320.666749] [ T56] khungtaskd: do_el0_svc+0x28/0xa8 > > > [ 4320.666755] [ T56] khungtaskd: el0_svc+0x28/0x9c > > > [ 4320.666761] [ T56] khungtaskd: el0t_64_sync_handler+0x7c/0xe4 > > > [ 4320.666766] [ T56] khungtaskd: el0t_64_sync+0x18c/0x190 > > > > > > [Analysis] > > > > > > After add some debug footprint massage, this issue happened at > > stopper > > > disable case. > > > It cannot exec migration_cpu_stop fun to complete migration. > > > This will cause stuck on wait_for_completion. > > > > How did you get in this situation? > > > > This issue occurs at CPU hotplug/set_affinity stress test. > The reproduce ratio is very low(about once a week). > > So I add/record some debug message to snapshot the task status while it > stuck on wait_for_completion. > > Below is the snapshot status while issue happened: > > cpu_active_mask is 0xFC > new_mask is 0x8 > pending->arg.dest_cpu is 0x3 > task_on_cpu(rq,p) is 1 > task_cpu is 0x2 > p__state = TASK_RUNNING > flag is SCA_CHACK|SCA_USER > stop_one_cpu_nowait(stopper->enabled) return value is false. > > I also record the footprint at migration_cpu_stop. > It shows the migration_cpu_stop is not execute. AFAICT this is migrate_enable(), which acts on current, so how can the CPU that current runs on go away? That is completely unexplained. You've not given a proper description of the race scenario. And because you've not, we can't even begin to talk about how best to address the issue. > > struct task_struct *p, struct rq_flag > > > task_rq_unlock(rq, p, rf); > > > > > > if (!stop_pending) { > > > -stop_one_cpu_nowait(cpu_of(rq), migration_cpu_stop, > > > - &pending->arg, &pending->stop_work); > > > +if (!stop_one_cpu_nowait(cpu_of(rq), migration_cpu_stop, > > > + &pending->arg, &pending->stop_work)) > > > +return -ENOENT; > > > > And -ENOENT is the right return code for when the target CPU is not > > available? > > > > I suspect you're missing more than halp the picture and this is a > > band-aid solution at best. Please try harder. > > > > I think -ENOENT means stopper is not execute? > Perhaps the error code is abused, or could you kindly give me some > suggestions? Well, at this point you're leaving the whole affine_move_task() machinery in an undefined state, which is a much bigger problem than the weird return value. Please read through that function and its comments a number of times. If you're not a little nervous, you've not understood the thing. Your patch has at least one very obvious resource leak. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 2621DE732DB for ; Thu, 28 Sep 2023 15:17:19 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=hQm1tryriDFUSjutnggX/nvW0gCQVArvFSkKyNp4ujg=; b=krempoQTR4Nuj5 W1JPcRFtfyeujP9yr2ms+Sp/edbmd69B1ZTi79ndP+pWZSBnJdzfZ6k7Equt14tgV/c5JsbkSoJWT 3VReja3SvqQybWt4eDnTJ7+k5DSoE/KM9JRGSI7Jt0fykVFgNZkT4/H6ej8XA78aThei1Nwlon4VF vafyGcaecU9BDrDreQSEzlvkKI4Ji0zioKlPrfMjq2dfGrwhPD/RCTegM/fQK0sNcDTzI2qYkzGHa 0Wu/dnFT54OzO+uAYt0D/WiH0Dmw09QxnliKzPyEyiPZK1EtcF87ydee6g4IViQqvtxLwuzEap9u/ P/4G9nrXZs3D/Lf1Aq5Q==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1qlsky-005Kwk-1H; Thu, 28 Sep 2023 15:16:48 +0000 Received: from casper.infradead.org ([2001:8b0:10b:1236::1]) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1qlska-005Kcn-0t; Thu, 28 Sep 2023 15:16:24 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Transfer-Encoding: Content-Type:MIME-Version:References:Message-ID:Subject:Cc:To:From:Date: Sender:Reply-To:Content-ID:Content-Description; bh=1aMZSHFJ00QdHHcRXWNmjtWw9D0/fDe8zQRO1jC0Y6c=; b=ksh//XmFWudVXcwZB/50DEfC2b S71MVheqbnADXAn7PH/N3RCcPF5sbzGGR2lQ3Qm1i66oCNNvF8KKBQMmL37ZX3hcmQbVI30NxsNVG TPvPdA8T6HHf08D/1X0JHIKJzW6h9x8OninTY8z+y9mZ30mVQy+nRoUy4jQrG3gICpcdTZl1qnife VgGcxFjLIWhmikV2TaSyYQhUGvRo+etPZlac8lh+KVNSU2VXjNk7C1HNbCjg9HjV5ZD39kw3HYa7P e/JPfxnUOIL0blFRQqQ7aEZvqmF9w+Sd+OLEO994Fic7j6yTH64hnaq9KO5VM54GjU7Ho3io5IEqY 1PlJZOsQ==; Received: from j130084.upc-j.chello.nl ([24.132.130.84] helo=noisy.programming.kicks-ass.net) by casper.infradead.org with esmtpsa (Exim 4.94.2 #2 (Red Hat Linux)) id 1qlskS-003CWF-JS; Thu, 28 Sep 2023 15:16:16 +0000 Received: by noisy.programming.kicks-ass.net (Postfix, from userid 1000) id 4669A3002E3; Thu, 28 Sep 2023 17:16:16 +0200 (CEST) Date: Thu, 28 Sep 2023 17:16:16 +0200 From: Peter Zijlstra To: Kuyo Chang =?utf-8?B?KOW8teW7uuaWhyk=?= Cc: "dietmar.eggemann@arm.com" , "linux-kernel@vger.kernel.org" , "linux-mediatek@lists.infradead.org" , "rostedt@goodmis.org" , wsd_upstream , "vschneid@redhat.com" , "bristot@redhat.com" , "juri.lelli@redhat.com" , "mingo@redhat.com" , "linux-arm-kernel@lists.infradead.org" , "bsegall@google.com" , "mgorman@suse.de" , "matthias.bgg@gmail.com" , "vincent.guittot@linaro.org" , "angelogioacchino.delregno@collabora.com" Subject: Re: [PATCH 1/1] sched/core: Fix stuck on completion for affine_move_task() when stopper disable Message-ID: <20230928151616.GD27245@noisy.programming.kicks-ass.net> References: <20230927033431.12406-1-kuyo.chang@mediatek.com> <20230927080850.GB21824@noisy.programming.kicks-ass.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org T24gV2VkLCBTZXAgMjcsIDIwMjMgYXQgMDM6NTc6MzVQTSArMDAwMCwgS3V5byBDaGFuZyAo5by1 5bu65paHKSB3cm90ZToKPiBPbiBXZWQsIDIwMjMtMDktMjcgYXQgMTA6MDggKzAyMDAsIFBldGVy IFppamxzdHJhIHdyb3RlOgo+ID4gIAkgCj4gPiBFeHRlcm5hbCBlbWFpbCA6IFBsZWFzZSBkbyBu b3QgY2xpY2sgbGlua3Mgb3Igb3BlbiBhdHRhY2htZW50cyB1bnRpbAo+ID4geW91IGhhdmUgdmVy aWZpZWQgdGhlIHNlbmRlciBvciB0aGUgY29udGVudC4KPiA+ICBPbiBXZWQsIFNlcCAyNywgMjAy MyBhdCAxMTozNDoyOEFNICswODAwLCBLdXlvIENoYW5nIHdyb3RlOgo+ID4gPiBGcm9tOiBrdXlv IGNoYW5nIDxrdXlvLmNoYW5nQG1lZGlhdGVrLmNvbT4KPiA+ID4gCj4gPiA+IFtTeW5kcm9tZV0g aHVuZyBkZXRlY3Qgc2hvd3MgYmVsb3cgd2FybmluZyBtc2cKPiA+ID4gWyA0MzIwLjY2NjU1N10g WyAgIFQ1Nl0ga2h1bmd0YXNrZDogW25hbWU6aHVuZ190YXNrJl1JTkZPOiB0YXNrCj4gPiBzdHJl c3NhcHB0ZXN0OjE3ODAzIGJsb2NrZWQgZm9yIG1vcmUgdGhhbiAzNjAwIHNlY29uZHMuCj4gPiA+ IFsgNDMyMC42NjY1ODldIFsgICBUNTZdIGtodW5ndGFza2Q6Cj4gPiBbbmFtZTpjb3JlJl10YXNr OnN0cmVzc2FwcHRlc3QgICBzdGF0ZTpEIHN0YWNrOjAgICAgIHBpZDoxNzgwMwo+ID4gcHBpZDox NzU3OSAgZmxhZ3M6MHgwNDAwMDAwOAo+ID4gPiBbIDQzMjAuNjY2NjAxXSBbICAgVDU2XSBraHVu Z3Rhc2tkOiBDYWxsIHRyYWNlOgo+ID4gPiBbIDQzMjAuNjY2NjA3XSBbICAgVDU2XSBraHVuZ3Rh c2tkOiAgX19zd2l0Y2hfdG8rMHgxN2MvMHgzMzgKPiA+ID4gWyA0MzIwLjY2NjY0Ml0gWyAgIFQ1 Nl0ga2h1bmd0YXNrZDogIF9fc2NoZWR1bGUrMHg1NGMvMHg4ZWMKPiA+ID4gWyA0MzIwLjY2NjY1 MV0gWyAgIFQ1Nl0ga2h1bmd0YXNrZDogIHNjaGVkdWxlKzB4NzQvMHhkNAo+ID4gPiBbIDQzMjAu NjY2NjU2XSBbICAgVDU2XSBraHVuZ3Rhc2tkOiAgc2NoZWR1bGVfdGltZW91dCsweDM0LzB4MTA4 Cj4gPiA+IFsgNDMyMC42NjY2NzJdIFsgICBUNTZdIGtodW5ndGFza2Q6ICBkb193YWl0X2Zvcl9j b21tb24rMHhlMC8weDE1NAo+ID4gPiBbIDQzMjAuNjY2Njc4XSBbICAgVDU2XSBraHVuZ3Rhc2tk OiAgd2FpdF9mb3JfY29tcGxldGlvbisweDQ0LzB4NTgKPiA+ID4gWyA0MzIwLjY2NjY4MV0gWyAg IFQ1Nl0KPiA+IGtodW5ndGFza2Q6ICBfX3NldF9jcHVzX2FsbG93ZWRfcHRyX2xvY2tlZCsweDM0 NC8weDczMAo+ID4gPiBbIDQzMjAuNjY2NzAyXSBbICAgVDU2XQo+ID4ga2h1bmd0YXNrZDogIF9f c2NoZWRfc2V0YWZmaW5pdHkrMHgxMTgvMHgxNjAKPiA+ID4gWyA0MzIwLjY2NjcwOV0gWyAgIFQ1 Nl0ga2h1bmd0YXNrZDogIHNjaGVkX3NldGFmZmluaXR5KzB4MTBjLzB4MjQ4Cj4gPiA+IFsgNDMy MC42NjY3MTVdIFsgICBUNTZdCj4gPiBraHVuZ3Rhc2tkOiAgX19hcm02NF9zeXNfc2NoZWRfc2V0 YWZmaW5pdHkrMHgxNWMvMHgxYzAKPiA+ID4gWyA0MzIwLjY2NjcxOV0gWyAgIFQ1Nl0ga2h1bmd0 YXNrZDogIGludm9rZV9zeXNjYWxsKzB4M2MvMHhmOAo+ID4gPiBbIDQzMjAuNjY2NzQzXSBbICAg VDU2XSBraHVuZ3Rhc2tkOiAgZWwwX3N2Y19jb21tb24rMHhiMC8weGU4Cj4gPiA+IFsgNDMyMC42 NjY3NDldIFsgICBUNTZdIGtodW5ndGFza2Q6ICBkb19lbDBfc3ZjKzB4MjgvMHhhOAo+ID4gPiBb IDQzMjAuNjY2NzU1XSBbICAgVDU2XSBraHVuZ3Rhc2tkOiAgZWwwX3N2YysweDI4LzB4OWMKPiA+ ID4gWyA0MzIwLjY2Njc2MV0gWyAgIFQ1Nl0ga2h1bmd0YXNrZDogIGVsMHRfNjRfc3luY19oYW5k bGVyKzB4N2MvMHhlNAo+ID4gPiBbIDQzMjAuNjY2NzY2XSBbICAgVDU2XSBraHVuZ3Rhc2tkOiAg ZWwwdF82NF9zeW5jKzB4MThjLzB4MTkwCj4gPiA+IAo+ID4gPiBbQW5hbHlzaXNdCj4gPiA+IAo+ ID4gPiBBZnRlciBhZGQgc29tZSBkZWJ1ZyBmb290cHJpbnQgbWFzc2FnZSwgdGhpcyBpc3N1ZSBo YXBwZW5lZCBhdAo+ID4gc3RvcHBlcgo+ID4gPiBkaXNhYmxlIGNhc2UuCj4gPiA+IEl0IGNhbm5v dCBleGVjIG1pZ3JhdGlvbl9jcHVfc3RvcCBmdW4gdG8gY29tcGxldGUgbWlncmF0aW9uLgo+ID4g PiBUaGlzIHdpbGwgY2F1c2Ugc3R1Y2sgb24gd2FpdF9mb3JfY29tcGxldGlvbi4KPiA+IAo+ID4g SG93IGRpZCB5b3UgZ2V0IGluIHRoaXMgc2l0dWF0aW9uPwo+ID4gCj4gCj4gVGhpcyBpc3N1ZSBv Y2N1cnMgYXQgQ1BVIGhvdHBsdWcvc2V0X2FmZmluaXR5IHN0cmVzcyB0ZXN0Lgo+IFRoZSByZXBy b2R1Y2UgcmF0aW8gaXMgdmVyeSBsb3coYWJvdXQgb25jZSBhIHdlZWspLgo+IAo+IFNvIEkgYWRk L3JlY29yZCBzb21lIGRlYnVnIG1lc3NhZ2UgdG8gc25hcHNob3QgdGhlIHRhc2sgc3RhdHVzIHdo aWxlIGl0Cj4gc3R1Y2sgb24gd2FpdF9mb3JfY29tcGxldGlvbi4KPiAKPiBCZWxvdyBpcyB0aGUg c25hcHNob3Qgc3RhdHVzIHdoaWxlIGlzc3VlIGhhcHBlbmVkOgo+IAo+IGNwdV9hY3RpdmVfbWFz ayBpcyAweEZDCj4gbmV3X21hc2sgaXMgMHg4Cj4gcGVuZGluZy0+YXJnLmRlc3RfY3B1IGlzIDB4 Mwo+IHRhc2tfb25fY3B1KHJxLHApIGlzIDEKPiB0YXNrX2NwdSBpcyAweDIKPiBwX19zdGF0ZSA9 IFRBU0tfUlVOTklORwo+IGZsYWcgaXMgU0NBX0NIQUNLfFNDQV9VU0VSCj4gc3RvcF9vbmVfY3B1 X25vd2FpdChzdG9wcGVyLT5lbmFibGVkKSByZXR1cm4gdmFsdWUgaXMgZmFsc2UuCj4gCj4gSSBh bHNvIHJlY29yZCB0aGUgZm9vdHByaW50IGF0IG1pZ3JhdGlvbl9jcHVfc3RvcC4KPiBJdCBzaG93 cyB0aGUgbWlncmF0aW9uX2NwdV9zdG9wIGlzIG5vdCBleGVjdXRlLgoKQUZBSUNUIHRoaXMgaXMg bWlncmF0ZV9lbmFibGUoKSwgd2hpY2ggYWN0cyBvbiBjdXJyZW50LCBzbyBob3cgY2FuIHRoZQpD UFUgdGhhdCBjdXJyZW50IHJ1bnMgb24gZ28gYXdheT8KClRoYXQgaXMgY29tcGxldGVseSB1bmV4 cGxhaW5lZC4gWW91J3ZlIG5vdCBnaXZlbiBhIHByb3BlciBkZXNjcmlwdGlvbiBvZgp0aGUgcmFj ZSBzY2VuYXJpby4gQW5kIGJlY2F1c2UgeW91J3ZlIG5vdCwgd2UgY2FuJ3QgZXZlbiBiZWdpbiB0 byB0YWxrCmFib3V0IGhvdyBiZXN0IHRvIGFkZHJlc3MgdGhlIGlzc3VlLgoKPiA+IHN0cnVjdCB0 YXNrX3N0cnVjdCAqcCwgc3RydWN0IHJxX2ZsYWcKPiA+ID4gIHRhc2tfcnFfdW5sb2NrKHJxLCBw LCByZik7Cj4gPiA+ICAKPiA+ID4gIGlmICghc3RvcF9wZW5kaW5nKSB7Cj4gPiA+IC1zdG9wX29u ZV9jcHVfbm93YWl0KGNwdV9vZihycSksIG1pZ3JhdGlvbl9jcHVfc3RvcCwKPiA+ID4gLSAgICAm cGVuZGluZy0+YXJnLCAmcGVuZGluZy0+c3RvcF93b3JrKTsKPiA+ID4gK2lmICghc3RvcF9vbmVf Y3B1X25vd2FpdChjcHVfb2YocnEpLCBtaWdyYXRpb25fY3B1X3N0b3AsCj4gPiA+ICsgICAgJnBl bmRpbmctPmFyZywgJnBlbmRpbmctPnN0b3Bfd29yaykpCj4gPiA+ICtyZXR1cm4gLUVOT0VOVDsK PiA+IAo+ID4gQW5kIC1FTk9FTlQgaXMgdGhlIHJpZ2h0IHJldHVybiBjb2RlIGZvciB3aGVuIHRo ZSB0YXJnZXQgQ1BVIGlzIG5vdAo+ID4gYXZhaWxhYmxlPwo+ID4gCj4gPiBJIHN1c3BlY3QgeW91 J3JlIG1pc3NpbmcgbW9yZSB0aGFuIGhhbHAgdGhlIHBpY3R1cmUgYW5kIHRoaXMgaXMgYQo+ID4g YmFuZC1haWQgc29sdXRpb24gYXQgYmVzdC4gUGxlYXNlIHRyeSBoYXJkZXIuCj4gPiAKPiAKPiBJ IHRoaW5rIC1FTk9FTlQgbWVhbnMgc3RvcHBlciBpcyBub3QgZXhlY3V0ZT8gCj4gUGVyaGFwcyB0 aGUgZXJyb3IgY29kZSBpcyBhYnVzZWQsIG9yIGNvdWxkIHlvdSBraW5kbHkgZ2l2ZSBtZSBzb21l Cj4gc3VnZ2VzdGlvbnM/CgpXZWxsLCBhdCB0aGlzIHBvaW50IHlvdSdyZSBsZWF2aW5nIHRoZSB3 aG9sZSBhZmZpbmVfbW92ZV90YXNrKCkKbWFjaGluZXJ5IGluIGFuIHVuZGVmaW5lZCBzdGF0ZSwg d2hpY2ggaXMgYSBtdWNoIGJpZ2dlciBwcm9ibGVtIHRoYW4gdGhlCndlaXJkIHJldHVybiB2YWx1 ZS4KClBsZWFzZSByZWFkIHRocm91Z2ggdGhhdCBmdW5jdGlvbiBhbmQgaXRzIGNvbW1lbnRzIGEg bnVtYmVyIG9mIHRpbWVzLiBJZgp5b3UncmUgbm90IGEgbGl0dGxlIG5lcnZvdXMsIHlvdSd2ZSBu b3QgdW5kZXJzdG9vZCB0aGUgdGhpbmcuCgpZb3VyIHBhdGNoIGhhcyBhdCBsZWFzdCBvbmUgdmVy eSBvYnZpb3VzIHJlc291cmNlIGxlYWsuCgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX18KbGludXgtYXJtLWtlcm5lbCBtYWlsaW5nIGxpc3QKbGludXgtYXJt LWtlcm5lbEBsaXN0cy5pbmZyYWRlYWQub3JnCmh0dHA6Ly9saXN0cy5pbmZyYWRlYWQub3JnL21h aWxtYW4vbGlzdGluZm8vbGludXgtYXJtLWtlcm5lbAo=