From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.7 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 48A50C433DB for ; Tue, 2 Mar 2021 23:38:11 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id E8B1764F3D for ; Tue, 2 Mar 2021 23:38:10 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230139AbhCBXfE (ORCPT ); Tue, 2 Mar 2021 18:35:04 -0500 Received: from sonic304-25.consmr.mail.gq1.yahoo.com ([98.137.68.206]:33718 "EHLO sonic304-25.consmr.mail.gq1.yahoo.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1379150AbhCBBMg (ORCPT ); Mon, 1 Mar 2021 20:12:36 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.ca; s=s2048; t=1614647479; bh=vA9wWjDn6bLma0CuAY4qp6fi9IxIzOHwRVYPhrr5f6E=; h=Date:From:Subject:To:References:From:Subject:Reply-To; b=Vu8WpEOl3eyDaqFR514gADQhRzcVj1lj3tm2smImtleOLAAzaK5PnW+9KetRE0w1WLjjzIm+54qLSl2U//gXRapJXYJUqxiGRgeFS/vLakHifYwcv3WWJ3yiBw1yTWEo1g6C9F1M19hPDtHOAm6biV7qayN0DBmaftg7TCYaA2wWfTlZaV3S9Z987456KfsA1c8D8+331mIXFBtNJTF7OFnQydJ49/2mQNUJ63ayZGAyzxI18tG5HltWndfZ1ZwzGOPix3OjGr05b4Q7n/mlYhCmX26YaYO1CB6dSAqdVYoBISe4rE02gtEbg3KHdR3scHsFgjyEwOjwQVUTe5vHtA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1614647479; bh=z3m6ZmX2LUAktpLfjMmPCb1cFVcFIVwfZaBazPLcwE9=; h=X-Sonic-MF:Date:From:Subject:To:From:Subject; b=MD1WCxQBF+Zc/8ZteJtIhl+cqe5PUzdmbToKsG2L03t4Km9DdQJT53xvEaYFTgY63MTJiUEQDBd58SvRi3uZ9wcgSzg0L5kjXWRz9RoWzkIpQhocPz/tgy0C/G+bHknYPP09G+QlcLkQH9SaKYO+rSlqSclfHAkUEF/TVqbF50cXhmfOSIWAaywohjT/RYZo67g957OV0MjqFXyyLVG2tDROexoZhEwNavFu8DdGexdVKtMX1Jx+e22LPuTDMI6N29PvNkQ0dyYSJTW9Lf9HiDYq/UtCsrC7yGjvEyZcRHkhQlr0McFqOYbZ2LlXxAZ9U9TsydW5cnxob0h2FpK3nw== X-YMail-OSG: bU8m3UQVM1kKpbeCirlobVfuXYiKp.RHohhdsuz6o5CAuD5e5vIT6wMPvCyWFo7 vPB4hEp7UY9HjxnMBXe2hK8dkOfzyt8Y7xx1mUUWp2RK4pEO2zMy0Cz6z70UylQhOJ9eODe65PTy u1LmJ2Xxkjq9d1aHb.d9F2xMX1xjK0Uh6trEfKRj8eem7zG9NFVC2BYCIEQVm4pNPPsnLmRGdbmh xLw125Fh4qnn1DsaetCC9KYIAC8rFSmpTxvWj191Vc4cnht.5iyXsd_YTmckKWCsud2VTsxykTy2 _ai5_HAbPpzVh6AbIY4qHt8DboZvneaqHFdm93JX0g9Sp391pQWme4_5wqa8dQrbTAKssr_cluGx .95mW1Q.WpAGdV__oXvGlpvvM4J9jqQZXWv21fFqG2Wai__wrubu_S88mp_ntLoaNb7_vruqQ6NH cqaHverwIUS3GxCOZBZlH.ZrvNgcmUS6cJ9AjpFylvkvipmt4sJCpPjZDvyuh1W_RT.ZqZQglg8k NJQOyKpBmgd.pxG1gwUNmjhRMzg.nntQGw34WipMX2UvX34iZ7u5AiAMiygZkS78MpLDNyis5YNB moo6zqgueIAynTssHuIGus_rf1nuNM.pnAu7rrXo9ns1jNwdRN7tjASrTL4F0IhZdB9feDt6XY68 3rVyTgcMmaF9tdgSjjR7Y6CQGSUfcqbPr8WUI2HU2OhHxWNkyzxepYj4u32kRtGT1yKffdZsfUev MMJ0GxHv0tiJSyenXMCMF9X1sSyV9s99uv.cWZ2AS93HY4BMZqzBYRBUL_PaGcMVRgg0reH5P_YL FR_UAn5wft1VaRRMvpJmIx9XSKst3yxjy.Iq3QZLBMd16eOOexoNMYUM3H4sTNjFeX5ugmwNYUw5 7yNPPol0qCgw0BmUPdz1CuPQjCDkmMU4.jNwKmGZb37Lxdwn67lQp5YmYfq8ctjIkzsilVOmrKX. 9C8i82dMQkkhYwBxobR7_HTb5C.uvDUDW00XIgCqOeSrGkZHyddOlAhzRrULnilP.iO1sJa9kxt4 LQCY4RJSh1vOBvGqVd6oOhLolx2whfMJJ9O93XBly8Dkvnn9T2i8pDioKYcpOuDSqCUqnRS5m27A DR1qbiFT2mvpoBTr1YMR8FTkybphjDX9TBFDjKX3XridXL9eVAy6mVuQI7altDgARTk8ddli9Zqa amehohK_rDrpkE1Z3KwFYjMenq8UwboEHnQeE76KyF7O_JoQMxa_kvxdiPuauU__GI5fUulE0qbf Ph.vlm92OWPtlDZkwXu1BEyx6CGcLnONhc6Gte2N2ybqsbzVc8lf2iGABQ7wIu4_irtLTI_ObzmC gZnnDgatVKgBKNpDZgM_tq3kYDm9Mlg3uRSmVkqo7vtpdkwkcoiWismHm3q1JJT_FjXO_zj.uKPO l5lt8BIIWbg7U_RtdqxuA6pZq1kbEZcEsOoos84H9sOHikn07Z0Q9Q6WVoVoUudfzwkZiEetmYBZ 4adhXf4SoqgYFpXic2J_b0ivczjsvjPsBssw1ZwgUJKQqhlGnpi4jd0B2iaRfVeE2d1LYMTd1pLV 7b4avpmoWSL3NDau5qJb1eJyLi.7r.0qVFuRBNN7.CIFjT1rQBVGmEcYsNE67f7H8w_63wxLkLqs pyHOUMUD3v6Bvo6szhCxcGtgttwvpCCXlc_EPVqcIvEcOUBd2CTs6zqAfpx1hAY_x5Xq2HZnEiui IiHpG69uFthhkey9YeHwkxlbjXuOI9bgliTTHD34datZOrxP.2Vf02mr6ca87UO436qJ4YGTC7So Th2flvtlHqcCQVp6szXdsjzouDCdI3viofyN1BNyCrgcpVwudfSaaEa8Kt9GgUtbZ4qZfoIkoU9R ID..kDb62fO7xAa0IA.Ur8XBxFFDgHzYzw_yW_cgjmxMOuG3wuuTt9JbDDb82XKXf6S9DUcoQSod YMFw3vEuc0WxJtX_nmgdMHooehztOGRIOYYBjMBGgkm1dyXnotYMEjzXZbT7.aDoLVN0jdMd_YU7 Z4B46gYmlzlZoRsxJsZMRFKyf6ag9iIUNIUFSa86Q5i_I..Dc2116GhY68tnfqO6QQ49rpHhFzfx Z7L4Yhw0hNk20r0WfCVIs8omp0I.CqbV.TJ3coe_E6xaWeuci1nWeBVqiSlAhz1D8XH877KfQ0o4 lvgcnUtK57jLwwQnBAlz9a_e.nGEeG4WD0ox0kneaGVpm41OpRXS.kGHYg0iRce.Ew66MqMRJgXR j8dFgYrEeMNGEfDt0z8.kmVHOBcrdbwAPsUtwl7cx3z9KxtMr99FgO3UGBsl3TednBbxka9.NG_o KEmn4.RGxoCRNDj5BQtzDVFHS2WQwRupea2Roff8W207FhtygiYxFzQKTdBhDeQxr5.XjYrBLqG. S4vLYgtM1WFLWBsjl.tdUfdoB1F8YZo6hXgRsrIE9dcI04qMmcGnCuvtHJkStx_64ZU6OiDoD99X Kxa56fAkyC.7WgMpPnIDey8zZC6HLFo3gH__cd2FXcRcLBbcmBguDX8Wtfl_WJurW0lw- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Tue, 2 Mar 2021 01:11:19 +0000 Received: by smtp401.mail.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 1eada59726444d77940edec9cae3d9d9; Tue, 02 Mar 2021 00:57:50 +0000 (UTC) Date: Mon, 01 Mar 2021 19:57:46 -0500 From: "Alex Xu (Hello71)" Subject: 5.12-rc1 regression: freezing iou-mgr/wrk failed To: linux-kernel@vger.kernel.org, linux-block@vger.kernel.org, Jens Axboe MIME-Version: 1.0 Message-Id: <1614646241.av51lk2de4.none@localhost> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable References: <1614646241.av51lk2de4.none.ref@localhost> X-Mailer: WebService/1.1.17828 mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo Apache-HttpAsyncClient/4.1.4 (Java/11.0.9.1) Precedence: bulk List-ID: X-Mailing-List: linux-block@vger.kernel.org Hi, On Linux 5.12-rc1, I am unable to suspend to RAM. The system freezes for=20 about 40 seconds and then continues operation. The following messages=20 are printed to the kernel log: [ 240.650300] PM: suspend entry (deep) [ 240.650748] Filesystems sync: 0.000 seconds [ 240.725605] Freezing user space processes ... [ 260.739483] Freezing of tasks failed after 20.013 seconds (3 tasks refus= ing to freeze, wq_busy=3D0): [ 260.739497] task:iou-mgr-446 state:S stack: 0 pid: 516 ppid: 4= 39 flags:0x00004224 [ 260.739504] Call Trace: [ 260.739507] ? sysvec_apic_timer_interrupt+0xb/0x81 [ 260.739515] ? pick_next_task_fair+0x197/0x1cde [ 260.739519] ? sysvec_reschedule_ipi+0x2f/0x6a [ 260.739522] ? asm_sysvec_reschedule_ipi+0x12/0x20 [ 260.739525] ? __schedule+0x57/0x6d6 [ 260.739529] ? del_timer_sync+0xb9/0x115 [ 260.739533] ? schedule+0x63/0xd5 [ 260.739536] ? schedule_timeout+0x219/0x356 [ 260.739540] ? __next_timer_interrupt+0xf1/0xf1 [ 260.739544] ? io_wq_manager+0x73/0xb1 [ 260.739549] ? io_wq_create+0x262/0x262 [ 260.739553] ? ret_from_fork+0x22/0x30 [ 260.739557] task:iou-mgr-517 state:S stack: 0 pid: 522 ppid: 4= 39 flags:0x00004224 [ 260.739561] Call Trace: [ 260.739563] ? sysvec_apic_timer_interrupt+0xb/0x81 [ 260.739566] ? pick_next_task_fair+0x16f/0x1cde [ 260.739569] ? sysvec_apic_timer_interrupt+0xb/0x81 [ 260.739571] ? asm_sysvec_apic_timer_interrupt+0x12/0x20 [ 260.739574] ? __schedule+0x5b7/0x6d6 [ 260.739578] ? del_timer_sync+0x70/0x115 [ 260.739581] ? schedule_timeout+0x211/0x356 [ 260.739585] ? __next_timer_interrupt+0xf1/0xf1 [ 260.739588] ? io_wq_check_workers+0x15/0x11f [ 260.739592] ? io_wq_manager+0x69/0xb1 [ 260.739596] ? io_wq_create+0x262/0x262 [ 260.739600] ? ret_from_fork+0x22/0x30 [ 260.739603] task:iou-wrk-517 state:S stack: 0 pid: 523 ppid: 4= 39 flags:0x00004224 [ 260.739607] Call Trace: [ 260.739609] ? __schedule+0x5b7/0x6d6 [ 260.739614] ? schedule+0x63/0xd5 [ 260.739617] ? schedule_timeout+0x219/0x356 [ 260.739621] ? __next_timer_interrupt+0xf1/0xf1 [ 260.739624] ? task_thread.isra.0+0x148/0x3af [ 260.739628] ? task_thread_unbound+0xa/0xa [ 260.739632] ? task_thread_bound+0x7/0x7 [ 260.739636] ? ret_from_fork+0x22/0x30 [ 260.739647] OOM killer enabled. [ 260.739648] Restarting tasks ... done. [ 260.740077] PM: suspend exit and then a set of similar messages except with s2idle instead of deep. Reverting 5695e51619 ("Merge tag 'io_uring-worker.v3-2021-02-25' of=20 git://git.kernel.dk/linux-block") appears to resolve the issue. I have=20 not yet bisected further. Let me know which troubleshooting steps I=20 should perform next. Thanks, Alex.