From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Goutham GS" Subject: vfio issue in qemu 2.5 Date: Thu, 4 Feb 2016 20:31:17 +0530 Message-ID: <10c201d15f5c$f7819670$e684c350$@zadarastorage.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_NextPart_000_10C3_01D15F8B.1139F980" To: Return-path: Received: from mail-wm0-f54.google.com ([74.125.82.54]:34116 "EHLO mail-wm0-f54.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S965649AbcBDPBL (ORCPT ); Thu, 4 Feb 2016 10:01:11 -0500 Received: by mail-wm0-f54.google.com with SMTP id 128so31059642wmz.1 for ; Thu, 04 Feb 2016 07:01:10 -0800 (PST) Received: from GouthamPC ([106.206.150.76]) by smtp.gmail.com with ESMTPSA id p9sm11710273wjy.41.2016.02.04.07.01.06 for (version=TLSv1/SSLv3 cipher=OTHER); Thu, 04 Feb 2016 07:01:09 -0800 (PST) Content-Language: en-us Sender: kvm-owner@vger.kernel.org List-ID: This is a multipart message in MIME format. ------=_NextPart_000_10C3_01D15F8B.1139F980 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi All, We are facing a vfio issue on qemu 2.5. Really appreciate any help or pointers. Details are as below: We are using qemu 2.5 compiled out of git commit 0b0571dd246871f18b7d64b5279511e91e2a7bf6 and are using Linux Kernel 3.18.19 for both host and the VM. We are also using KVM VM with pci-assign'ed SRIOV VF interfaces. The issue happens once in a while when a running VM is rebooted. On boot, the VM hits the following error and stops. qemu-system-x86_64: -device vfio-pci,host=04:00.7,id=hostdev2,bus=pci.0,addr=0x9: vfio: failed to set iommu for container: Bad address qemu-system-x86_64: -device vfio-pci,host=04:00.7,id=hostdev2,bus=pci.0,addr=0x9: vfio: failed to setup container for group 40 qemu-system-x86_64: -device vfio-pci,host=04:00.7,id=hostdev2,bus=pci.0,addr=0x9: vfio: failed to get group 40 qemu-system-x86_64: -device vfio-pci,host=04:00.7,id=hostdev2,bus=pci.0,addr=0x9: Device initialization failed Strange thing is, once this error is hit, no further VMs can be spawned on the host and all of them run into the same problem. However a reboot of the host appears to solve the issue. I have attached the relevant logs. Regards, Goutham. ------=_NextPart_000_10C3_01D15F8B.1139F980 Content-Type: application/x-compressed; name="vfio_issue.tgz" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="vfio_issue.tgz" H4sIAIZis1YAA+1bbU/juBbmc3+Fpf0y6Dat7bwUKvUDU1imK9jpUmZ2pNUKuYnTWqRxN3EK3F9/ j5O0pS2UAeqi1Y0RNC8+zznHz7F97JpZKOSNSNOMNw9MFQyl5br5J5T1z/yaUM91PA9T0jrAhLQc fIBcYxY9KlmqWILQQSKl2lbvpff/0jJb8h+lU1/cMHUzlqlqqPuduasJ9hznGf6p3Wq5Jf9uq0UJ 8O/aHvCPd2XAtvJ/zj/GbYwbGH0BztEwEcGIt1EvVjxCXZlMZcKUkDFyXYxRr/kVfcmGSEl0Nuih vkwU+pTwGSL2YU0DEQDqd3tbcShuarDmD/doAahlzu6nCU9TdAXtXECTVXB7p+D2Knhrp+CtVfDj F8FbGvc1Go5XNbDdayB4RQVxtIpe95XYg4dU8Qm6ZDEb8QmPFbriIwHPknQdnrwB/rzf+4pYHKCB D5X9Meqz4HkN9A0aujJWiYzQQDGVpbmuq5PBczo0D98Gn5FfSEU8eUrdET3C5Lce+tTrfoFm/pVN RPRwmAt++wJkdBfS6BenxCU7xnVL3Na7cCk6WwemOXCw84YgJe6uG2JuL90xrl3i2jvG9UrcnRNX NDB/cSTJQfM6n/M6RQ84xkUPCEG+Nzh5Sf633lVp1dUhuuh383pJyHz+yKYaJsXkdKbGPIm5WnH3 cyJZ4MvJCvjvXP1QCYw0qAf2dS/dFvHQuRixoVBLmNxiqi3OFRCDCmjhwdVJ7xQNYQB5rOACJtEL ORI+asJAORkKmZb3l3zEcpEBjDWU4CP014UYcrBBJn8X6NgFdHtL+1zyKGKxvEfX3B/HMgJgnqLL a9qCga6MBfQXtHbMffXDslE/kX+XkM+0yBZI/CTkd5GojEXo1yz2dfPN8alhfNswvmMY3zWM7xnG bxnFJ28I+dfhm41/Yjj+ieH4J4bjnxiOf2I4/onh+KeG458ajn9qOP6p4finhuOfGo5/ajj+qeH4 tw3Hv204/m3D8W8bjn/bcPzbhuPfNhz/tuH4d0zGv1f0r+/nJwA9mcKqZxjxVS0MLu/RWQQgiYyF n5bbPLB6UUEDXYLoOcWY/4n+7HcvHbfcScLssBbyn9pu/MH1jpsHRg94on34IxP+bZ+pMTpJ/LFQ oDpLODrnMbz30e8ytnwJD9b2ZTCdqyS7UlnuaJ0EQb5hdsp9GcDyeUUdfYuHfVgMivgW4XWsN5gO WP3xQyp84HYDj74a71IkiUyKfcGnbbTfj0nWMZ23t+EGlvu+NlzDs9/Ar64ygpc8gG46kcnD482X Z8LWfgP3W/Vcs2QEY8bW4LXfECDbndvcL13qej3J2x3k6cYW81yZs2vWumMGI6nuYfNd4jV9O2Zv qW9O4Jq+HRO31HfFoFOtKXt9l/9JZdcws01Y9HSjuqZIJM/pM0QieZpE1xSJ5AkSXVMkku0keqZI pM/pM0QifZpEzxSJ9AkSPVMk0i0khvtP48L9pnHhDtO4cMdpXGggjQsNpHHhDtO4cMdpXLinNC78 iDQu3GMaF+4zjQv3nMaFe07jwn2mceEHpXHhntO4cM9pXLjPNC78oDQu3HMaF+45jQv3mcaFH5PG Hayc//yHT7IbPxK7PPpZnjHcdv4T2x52F+d/sQ31iGPj6vznXspF9+bk4qLTRf2T6y+dZpYmzUhC rtRMhyJuP7pf3C4uihrFX/iD/ji7/HZz8u209/Xm9Op7J5YxR3OJ5u1sYqVT4XNkxWzCkYih3WOf W/MgQNYAWRMGKTqITX1LOA4O7y3a8Gp15vs86gBEPUuHHRmGyPKnGdLnlEEGuYRiZCWcRUoA9AQM vi1qpZMpcuop3HOVdpy6XlykHVJXY6gdwBWyskwEaOiGrsfwsUVcz7Yc7A+tI3xELBuTgB9zlzlH HhgurSzlCSxR4lCM9H3AQ5ZFKq1Z/pglAXSrQlddBB39ZCJjoWRSn8L6o9OcMWhMMdS/M5GovMM1 NxqiMRcCVTOe1GN5x4T2Ezp/qWUFG1TNLydgUKfcqocGUT4aspR3Mriw4pq00nGmAnkXI2uoz3mm ChZdqgO4FoBqbqZC3Nvg5NDKxr7Q0HBdH2ZpZ+qLBq4zGCY7+J408D0FoUTMOApFxJe+xXLGFj6l m941A5He1kWYh4dWkINYuj2EtGr6La6HEsYr1fnHl3d0YVtZZRjdWmBMPfVToUnetM6p55iryAUw 6Fu5180g4oDf60j4SXdqm/40ioh41i1dh7pztxJ293qn3OecAtxVr6iLoB3fQk3RGi+40XqXG97S jdoG8JofLQharnSnUmxaD4NO4aru9fAc12f6CqK3uNDvvXWDoF5uUIGzFAWY/BPGmw6mbeK1bd72 3LbvtMnxI6trpdkwOs07uG7TefeGHipYhNe694vtDNGSyog3IjlaGCxSZhVw9cedfK4BFJaXS0um 6kE/ry3rkZ+DI0s4kJjFPsKN/KcN6LeIxzACLJB8WOBnqTUbsYKfgEu8yeuymwoP5m4OowbUvtNn sgM5wrVNiSGy5q8tln/5iGBshlXtgkLITHLycpqxk587mgcA1HnCitYWYdpoPRImm8K1oy3SeEWa bkofb/QFFkVSxjkMSJa3TxjNarUPnP/X87/N6Qii9J06Xsj/nJa3/v9fHvHcKv/bR6nyvyr/q/K/ Kv+r8r8q/6vyv4/J/07lhMH8CbWOWsAchLuIFQ/a+QSnZ7qcYlTiJzwQCff1pp+SqAlPm1OVNjH6 FLEhj9Ajng9reoqx0vy7Tuv+yLvxnPa7vGznUm0UMugGuQGaMiEnkwzBuJCfEwTr83+fYgFixbbq fszIpkv1uTGjRMIzB+9Bvf46zqC607JvwTQPvIr/FvvBhfoahXzZwpCsEIRJ24Gx7LhxTI7/oweb NtJzvh7VkZ74P3SpUZWqVKUqValKVapSlapUpSpV+cDyP1y57UIAUAAA ------=_NextPart_000_10C3_01D15F8B.1139F980--