From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.9 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7710FC43461 for ; Mon, 7 Sep 2020 02:03:02 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 305A220796 for ; Mon, 7 Sep 2020 02:03:02 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=kernel-dk.20150623.gappssmtp.com header.i=@kernel-dk.20150623.gappssmtp.com header.b="kh/iPolp" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726161AbgIGCDA (ORCPT ); Sun, 6 Sep 2020 22:03:00 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:41384 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725773AbgIGCDA (ORCPT ); Sun, 6 Sep 2020 22:03:00 -0400 Received: from mail-pf1-x444.google.com (mail-pf1-x444.google.com [IPv6:2607:f8b0:4864:20::444]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B9AEFC061573 for ; Sun, 6 Sep 2020 19:02:59 -0700 (PDT) Received: by mail-pf1-x444.google.com with SMTP id z19so5648595pfn.8 for ; Sun, 06 Sep 2020 19:02:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=pz784VpLfI+5OGs7U5u0jBjY4PZjuW2svTZ1AVCbqbU=; b=kh/iPolpVielz4qn4rHGRU9wyM7u6TWbx68wtun6UEpUGPYDBEbWH/A6zo5xYhgGzo BLCKafK0QaAxj7jjwkMHU1pOwBgGs7g4ru/9vajd//+siaoVx0B7h54+pnKrpVRBQrvB awRorjHF4IR6L8Hb/7gOrPIFQySvI9FOXA+4EWE9iTrrf5BcpLPCRnfG6Z/ETOg0x1Mh e91sRckrAWkvcm4oqg2KBsHbv4ixeHVexNATS65Zd11LkBMKnYQv+uSef2xx2gKz6Cyt MCSFkAydDD1nROSbDJ1Rv4Ei5yrh1F9pQSF2Rk5R1ksTCoAJZuR0wLxuI2E6h6ybzwmg fVgg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=pz784VpLfI+5OGs7U5u0jBjY4PZjuW2svTZ1AVCbqbU=; b=QGHs6SetMnvPoLT3TzgdD8X3FABS2qmhaxObzUjV5AfdhhvlXvv/cUcDpbfhAgWRU+ Ef3Gw4AvPbpMqJMVpORYa5LPGC4xw9u3K6RhBtR9Y07S1XIP1VcsLa6ZUfUp7xxe5pX/ MticY3uh6yDWouxGdZIwoxP1bDwfbFe5z7TsvdiZevhCj4jRpd4yksTy9AQMAisw9WGc YuASf9EIvUrnKmEWMItilRgPABAttAQS/yd4ctzBAGgTXa8FOCvGJ2/z7kKvrnkAyHZU Ms3hbZ8Mdiqym5ABrctOGtbOisRyET1agx94ghTytDr5tEG5YlTH9QLAPy0v+dg2SYL0 pb8Q== X-Gm-Message-State: AOAM532m/ICpOn1P1S8mPN/t1hnb0qoIMzLAVhfejQkvi4UZdlT1/5C/ lUUPucFbQD4gdLW2s1pXRLfvaQ== X-Google-Smtp-Source: ABdhPJwrm7AMNJR0261LUIrXYmdurtRBkvueTkgJyClOCiPXDvhLCG5hMz3+vGJd6/KAHot0I5H4vQ== X-Received: by 2002:a62:37c1:: with SMTP id e184mr19072485pfa.224.1599444177478; Sun, 06 Sep 2020 19:02:57 -0700 (PDT) Received: from [192.168.1.182] ([66.219.217.173]) by smtp.gmail.com with ESMTPSA id k11sm2364522pjs.18.2020.09.06.19.02.56 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 06 Sep 2020 19:02:56 -0700 (PDT) Subject: Re: panic happened on 5.8.6-rc2-650d8f2 To: Jianlin Shi , linux-block@vger.kernel.org Cc: Rachel Sibley , Paolo Valente References: From: Jens Axboe Message-ID: <7fe5bdcc-b366-2139-01f3-da613323eaba@kernel.dk> Date: Sun, 6 Sep 2020 20:02:55 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-block-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-block@vger.kernel.org CC Paolo On 9/6/20 6:36 PM, Jianlin Shi wrote: > Hi, > > panic happened when we run jobs on 5.8.6-rc2-650d8f2: > https://beaker.engineering.redhat.com/recipes/8756377#task115008997 > > and the core trace is as follows, have you ever seen this before? > > [ 7522.385926] BUG: kernel NULL pointer dereference, address: 0000000000000000 > [ 7522.393694] #PF: supervisor read access in kernel mode > [ 7522.399425] #PF: error_code(0x0000) - not-present page > [ 7522.405154] PGD 0 P4D 0 > [ 7522.407977] Oops: 0000 [#1] SMP PTI > [ 7522.411866] CPU: 14 PID: 668 Comm: kworker/14:1H Kdump: loaded > Tainted: G L 5.8.6-rc2-650d8f2.cki #1 > [ 7522.423510] Hardware name: Dell Inc. PowerEdge R630/0CNCJW, BIOS > 1.2.10 03/09/2015 > [ 7522.431959] Workqueue: kblockd blk_mq_run_work_fn > [ 7522.437206] RIP: 0010:__list_del_entry_valid+0x2d/0x4c > [ 7522.442936] Code: 4c 8b 47 08 48 b8 00 01 00 00 00 00 ad de 48 39 > c2 0f 84 71 00 00 00 48 b8 22 01 00 00 00 00 ad de 49 39 c0 0f 84 91 > 00 00 00 <49> 8b 30 48 39 fe 0f 85 71 00 00 00 48 8b 52 08 48 39 f2 0f > 85 56 > [ 7522.463891] RSP: 0018:ffffa5b9009dfcd8 EFLAGS: 00010017 > [ 7522.469719] RAX: dead000000000122 RBX: ffff8b458d4c9950 RCX: > 0000000000000000 > [ 7522.477680] RDX: 0000000000000000 RSI: 0000000000000000 RDI: > ffff8b448a753938 > [ 7522.485640] RBP: ffff8b448a753898 R08: 0000000000000000 R09: > ffff8b45bb6bb32c > [ 7522.493600] R10: 0000000000000018 R11: 0000000000000018 R12: > ffff8b448a753810 > [ 7522.501560] R13: ffff8b44993e2800 R14: 0000000000000000 R15: > ffff8b458d07c900 > [ 7522.509520] FS: 0000000000000000(0000) GS:ffff8b45bfd80000(0000) > knlGS:0000000000000000 > [ 7522.518548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 7522.524957] CR2: 0000000000000000 CR3: 0000000875570005 CR4: > 00000000001606e0 > [ 7522.532917] Call Trace: > [ 7522.535647] bfq_idle_extract+0x52/0xb0 > [ 7522.539926] bfq_put_idle_entity+0x12/0x60 > [ 7522.544494] bfq_bfqq_served+0xb0/0x190 > [ 7522.548770] bfq_dispatch_request+0x2c2/0x1070 > [ 7522.553727] blk_mq_do_dispatch_sched+0xa4/0x140 > [ 7522.558879] ? newidle_balance+0x1c0/0x390 > [ 7522.563446] __blk_mq_sched_dispatch_requests+0x159/0x160 > [ 7522.569467] blk_mq_sched_dispatch_requests+0x30/0x60 > [ 7522.575102] __blk_mq_run_hw_queue+0x49/0x110 > [ 7522.579962] process_one_work+0x1b4/0x370 > [ 7522.584434] worker_thread+0x53/0x3e0 > [ 7522.588517] ? process_one_work+0x370/0x370 > [ 7522.593180] kthread+0x119/0x140 > [ 7522.596779] ? __kthread_bind_mask+0x60/0x60 > [ 7522.601541] ret_from_fork+0x22/0x30 > [ 7522.605528] Modules linked in: scsi_transport_iscsi crypto_user > can_bcm pptp gre l2tp_ip6 l2tp_ip l2tp_core ip6_udp_tunnel udp_tunnel > rfcomm can_raw hidp bnep nfc af_key mpls_router ip_tunnel > vsock_loopback vmw_vsock_virtio_transport_common > vmw_vsock_vmci_transport vsock vmw_vmci kcm ieee802154_socket > ieee802154 bluetooth ecdh_generic ecc fcrypt pcbc rxrpc pppoe pppox > smc ib_core atm can mlx4_en mlx4_core n_gsm pps_ldisc slcan > ppp_synctty n_hdlc mkiss ax25 ppp_async ppp_generic slip slhc nls_utf8 > isofs minix binfmt_misc nfsv3 nfs_acl rds brd exfat vfat fat loop sctp > tun xt_multiport xt_nat xt_addrtype xt_mark xt_conntrack xt_MASQUERADE > nft_counter xt_comment nft_compat nft_chain_nat nf_nat nf_conntrack > nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink overlay fuse > rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache > rfkill intel_rapl_msr intel_rapl_common sb_edac x86_pkg_temp_thermal > intel_powerclamp coretemp iTCO_wdt intel_pmc_bxt iTCO_vendor_support > sunrpc dcdbas > [ 7522.605556] kvm_intel kvm irqbypass rapl intel_cstate > intel_uncore pcspkr ipmi_ssif lpc_ich mei_me mei igb dca ipmi_si > ipmi_devintf ipmi_msghandler acpi_power_meter ip_tables xfs mgag200 > lpfc drm_vram_helper drm_kms_helper cec nvmet_fc drm_ttm_helper nvmet > ttm crct10dif_pclmul nvme_fc crc32_pclmul crc32c_intel nvme_fabrics > drm ghash_clmulni_intel i2c_algo_bit nvme_core megaraid_sas > scsi_transport_fc wmi [last unloaded: dummy] > [ 7522.744918] CR2: 0000000000000000 > [ 7522.748613] ---[ end trace ed34032a61d7e2a6 ]--- > > Thanks & Best Regards, > > Jianlin Shi > -- Jens Axboe