From mboxrd@z Thu Jan 1 00:00:00 1970 From: Atom2 Subject: Re: segfault in xl create for HVM with PCI passthrough Date: Wed, 29 Oct 2014 01:26:40 +0100 Message-ID: <54503440.3050302@web2web.at> References: <544EB843.9060503@web2web.at> <1414493998.10206.3.camel@citrix.com> <544FB8C4.9000102@web2web.at> <1414512266.10974.5.camel@citrix.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="------------060208010004030908020104" Return-path: Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1XjH64-0001Yk-Ql for xen-devel@lists.xenproject.org; Wed, 29 Oct 2014 00:26:45 +0000 In-Reply-To: <1414512266.10974.5.camel@citrix.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: Ian Campbell Cc: xen-devel List-Id: xen-devel@lists.xenproject.org This is a multi-part message in MIME format. --------------060208010004030908020104 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit To keep the thread together I am again submitting the relevant parts of my last answer (which due to an error on my part originally went out to Ian only and I only forward it to the list afterwards which resulted in an out-of-thread appeareance) together with the (new) results of my gdb excercise. Sorry for any confusion this may(might have) cause(d). Am 28.10.14 um 17:04 schrieb Ian Campbell: [...] >> With regards to gdb: I can certainly run the command under gdb after >> including debug support to the executables - that's no big deal. >> I would, however, ask for your advice as to what I need to recompile >> with debugger support? Is xen-tools (which includes xl) sufficient > > I think just the Xen bits would be sufficient, at least to start with. > >> or >> would you think that I also need to include debug support for gcc as the >> library that is mentioned in /var/log/messages (libgcc_s.so.1) seems to >> belong to the gcc package? Or is this library a red herring that just >> works as the catch-all code getting and finally handling the segfault? > > I'd recommend ignoring it for now, in the event that the backtrace from > just the xen bits suggests a gcc issue that might change. My money right > now is on it being a xen issue though. > After recompiling xen-tools with gdb debug support I started the following command: # gdb --args /usr/sbin/xl create pfsense -c Please find the command's screen output after its start up to the segfault including the output of the bt command after the segfault in the attached document named "create". Furthermore I did the same for the destroy command: # gdb --args /usr/sbin/xl destroy pfsense The output of this command is in the attached document named "destroy". I haven't got much experience with gdb yet so I am unable to interpret the outcome of either. Also if there's more/different stuff required, please advise me what to do next. Tx. >>> [...] >>>> pci = [ '04:00.0', '0a:08.0', '0a:0b.0' ] >>> >>> You say in $subject that the failure is with PCI, is that because you've >>> tried an HVM domain without and it is ok, or is it just that all your >>> HVM domains happen to have passthrough enabled? >> I haven't tried HVM domains without PCI passthrough (but PV domains w/o >> PCI passthrough and they did not segfault) so far as all my HVM domains >> require PCI devices (either at least a network card for pfsense - in >> actual facts it's more than one that's being passed through - or a SATA >> controller for my second HVM which is used as a storage VM). > > The VM doesn't need to be fully functional, it just needs to boot > without crashing the toolstack. Just running your existing VM with the > pci line commented out would be useful. Before re-compiling the xen-tools I made a quick test as you suggested and commented out the pci line from my config file ... and the boot menu showed up (which it did not before when the segfault happened). I did not boot the pfsense vm any further as this might lead to a change in my configuration due to missing devices, but to me this at first sight seemed to indicate that is has to do with the PCI passthrough functionality. Although as I did not want to boot the machine (and "xl shutdown" did not work, not even with -F) I then decided to xl destroy pfsense and that printed a segmentation fault message (in both the shell window where I started the command from and the console window where the boot-menu was shown) despite no PCI devices being passed through. To also check PCI passthrough with a PV domain: I added a pci device to a config file for a PV domain and started that with xl create voip -c The boot menu appeared without issues. I then also tried xl destroy voip from another window and that issued the following error messages in the shell window (without using any -vvv option): # xl destroy voip libxl: error: libxl_pci.c:1247:do_pci_remove: xc_domain_irq_permission irq=17 libxl: error: libxl_device.c:1127:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/4/0 not ready libxl: error: libxl_pci.c:1247:do_pci_remove: xc_domain_irq_permission irq=16 libxl: error: libxl_device.c:1127:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/4/0 not ready libxl: error: libxl_pci.c:1247:do_pci_remove: xc_domain_irq_permission irq=23 libxl: error: libxl_device.c:1127:libxl__wait_for_backend: Backend /local/domain/0/backend/pci/4/0 not ready Segmentation fault The "Segmentation fault" message also appeared in both the console window for the domU and the shell window. This all seems a bit strange to me at the moement, but I am sure with your help we will arrive at the grounds of this. Thanks and regards Atom --------------060208010004030908020104 Content-Type: text/plain; charset=windows-1252; name="create" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="create" R05VIGdkYiAoR2VudG9vIDcuNi4yIHAxKSA3LjYuMgpDb3B5cmlnaHQgKEMpIDIwMTMgRnJl ZSBTb2Z0d2FyZSBGb3VuZGF0aW9uLCBJbmMuCkxpY2Vuc2UgR1BMdjMrOiBHTlUgR1BMIHZl cnNpb24gMyBvciBsYXRlciA8aHR0cDovL2dudS5vcmcvbGljZW5zZXMvZ3BsLmh0bWw+ClRo aXMgaXMgZnJlZSBzb2Z0d2FyZTogeW91IGFyZSBmcmVlIHRvIGNoYW5nZSBhbmQgcmVkaXN0 cmlidXRlIGl0LgpUaGVyZSBpcyBOTyBXQVJSQU5UWSwgdG8gdGhlIGV4dGVudCBwZXJtaXR0 ZWQgYnkgbGF3LiAgVHlwZSAic2hvdyBjb3B5aW5nIgphbmQgInNob3cgd2FycmFudHkiIGZv ciBkZXRhaWxzLgpUaGlzIEdEQiB3YXMgY29uZmlndXJlZCBhcyAieDg2XzY0LXBjLWxpbnV4 LWdudSIuCkZvciBidWcgcmVwb3J0aW5nIGluc3RydWN0aW9ucywgcGxlYXNlIHNlZToKPGh0 dHA6Ly9idWdzLmdlbnRvby5vcmcvPi4uLgpSZWFkaW5nIHN5bWJvbHMgZnJvbSAvdXNyL3Ni aW4veGwuLi5SZWFkaW5nIHN5bWJvbHMgZnJvbSAvdXNyL2xpYjY0L2RlYnVnL3Vzci9zYmlu L3hsLmRlYnVnLi4uZG9uZS4KZG9uZS4KKGdkYikgcnVuClN0YXJ0aW5nIHByb2dyYW06IC91 c3Ivc2Jpbi94bCBjcmVhdGUgcGZzZW5zZSAtYwp3YXJuaW5nOiBubyBsb2FkYWJsZSBzZWN0 aW9ucyBmb3VuZCBpbiBhZGRlZCBzeW1ib2wtZmlsZSBzeXN0ZW0tc3VwcGxpZWQgRFNPIGF0 IDB4N2ZmZmY3ZmZhMDAwCndhcm5pbmc6IENvdWxkIG5vdCBsb2FkIHNoYXJlZCBsaWJyYXJ5 IHN5bWJvbHMgZm9yIGxpbnV4LXZkc28uc28uMS4KRG8geW91IG5lZWQgInNldCBzb2xpYi1z ZWFyY2gtcGF0aCIgb3IgInNldCBzeXNyb290Ij8KW1RocmVhZCBkZWJ1Z2dpbmcgdXNpbmcg bGlidGhyZWFkX2RiIGVuYWJsZWRdClVzaW5nIGhvc3QgbGlidGhyZWFkX2RiIGxpYnJhcnkg Ii9saWI2NC9saWJ0aHJlYWRfZGIuc28uMSIuClBhcnNpbmcgY29uZmlnIGZyb20gcGZzZW5z ZQp4YzogaW5mbzogVklSVFVBTCBNRU1PUlkgQVJSQU5HRU1FTlQ6CiAgTG9hZGVyOiAgICAg ICAgMDAwMDAwMDAwMDEwMDAwMC0+MDAwMDAwMDAwMDFjMTJhNAogIE1vZHVsZXM6ICAgICAg IDAwMDAwMDAwMDAwMDAwMDAtPjAwMDAwMDAwMDAwMDAwMDAKICBUT1RBTDogICAgICAgICAw MDAwMDAwMDAwMDAwMDAwLT4wMDAwMDAwMDFmODAwMDAwCiAgRU5UUlkgQUREUkVTUzogMDAw MDAwMDAwMDEwMDAwMAp4YzogaW5mbzogUEhZU0lDQUwgTUVNT1JZIEFMTE9DQVRJT046CiAg NEtCIFBBR0VTOiAweDAwMDAwMDAwMDAwMDAyMDAKICAyTUIgUEFHRVM6IDB4MDAwMDAwMDAw MDAwMDBmYgogIDFHQiBQQUdFUzogMHgwMDAwMDAwMDAwMDAwMDAwCltOZXcgVGhyZWFkIDB4 N2ZmZmY3ZmY1NzAwIChMV1AgMTM0NjQpXQpbTmV3IFRocmVhZCAweDdmZmZmN2ZlNjcwMCAo TFdQIDEzNTc0KV0KClByb2dyYW0gcmVjZWl2ZWQgc2lnbmFsIFNJR1NFR1YsIFNlZ21lbnRh dGlvbiBmYXVsdC4KW1N3aXRjaGluZyB0byBUaHJlYWQgMHg3ZmZmZjdmZTY3MDAgKExXUCAx MzU3NCldCjB4MDAwMDdmZmZmNTg4MmI2NCBpbiA/PyAoKSBmcm9tIC91c3IvbGliL2djYy94 ODZfNjQtcGMtbGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKKGdkYikgYnQKIzAgIDB4 MDAwMDdmZmZmNTg4MmI2NCBpbiA/PyAoKSBmcm9tIC91c3IvbGliL2djYy94ODZfNjQtcGMt bGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKIzEgIDB4MDAwMDdmZmZmNTg4MzVjYyBp biA/PyAoKSBmcm9tIC91c3IvbGliL2djYy94ODZfNjQtcGMtbGludXgtZ251LzQuOC4zL2xp YmdjY19zLnNvLjEKIzIgIDB4MDAwMDdmZmZmNTg4Mzk0NSBpbiA/PyAoKSBmcm9tIC91c3Iv bGliL2djYy94ODZfNjQtcGMtbGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKIzMgIDB4 MDAwMDdmZmZmNTg4NDVjNiBpbiA/PyAoKSBmcm9tIC91c3IvbGliL2djYy94ODZfNjQtcGMt bGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKIzQgIDB4MDAwMDdmZmZmNTg4NDk0YyBp biBfVW53aW5kX0ZvcmNlZFVud2luZCAoKSBmcm9tIC91c3IvbGliL2djYy94ODZfNjQtcGMt bGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKIzUgIDB4MDAwMDdmZmZmNzMxYTczMyBp biBfX3B0aHJlYWRfdW53aW5kICgpIGZyb20gL2xpYjY0L2xpYnB0aHJlYWQuc28uMAojNiAg MHgwMDAwN2ZmZmY3MzExYjQ5IGluIHNpZ2NhbmNlbF9oYW5kbGVyICgpIGZyb20gL2xpYjY0 L2xpYnB0aHJlYWQuc28uMAojNyAgPHNpZ25hbCBoYW5kbGVyIGNhbGxlZD4KIzggIDB4MDAw MDdmZmZmNzMxYWU0ZCBpbiByZWFkICgpIGZyb20gL2xpYjY0L2xpYnB0aHJlYWQuc28uMAoj OSAgMHgwMDAwN2ZmZmY2YjE3YjUzIGluIHJlYWQgKF9fbmJ5dGVzPTE2LCBfX2J1Zj0weDdm ZmZlODAwMDhkMCwgX19mZD0xOCkgYXQgL3Vzci9pbmNsdWRlL2JpdHMvdW5pc3RkLmg6NDQK IzEwIHJlYWRfYWxsIChmZD0xOCwgZGF0YT1kYXRhQGVudHJ5PTB4N2ZmZmU4MDAwOGQwLCBs ZW49bGVuQGVudHJ5PTE2LCBub25ibG9ja2luZz1ub25ibG9ja2luZ0BlbnRyeT0wKSBhdCB4 cy5jOjM3NAojMTEgMHgwMDAwN2ZmZmY2YjE3Yzk0IGluIHJlYWRfbWVzc2FnZSAoaD1oQGVu dHJ5PTB4NTU1NTU1Nzg1NjcwLCBub25ibG9ja2luZz1ub25ibG9ja2luZ0BlbnRyeT0wKSBh dCB4cy5jOjExMzkKIzEyIDB4MDAwMDdmZmZmNmIxODYyNiBpbiByZWFkX3RocmVhZCAoYXJn PTB4NTU1NTU1Nzg1NjcwKSBhdCB4cy5jOjEyMTEKIzEzIDB4MDAwMDdmZmZmNzMxMzMyZCBp biBzdGFydF90aHJlYWQgKCkgZnJvbSAvbGliNjQvbGlicHRocmVhZC5zby4wCiMxNCAweDAw MDA3ZmZmZjcwNGExOWQgaW4gY2xvbmUgKCkgZnJvbSAvbGliNjQvbGliYy5zby42CihnZGIp Cg== --------------060208010004030908020104 Content-Type: text/plain; charset=windows-1252; name="destroy" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="destroy" R05VIGdkYiAoR2VudG9vIDcuNi4yIHAxKSA3LjYuMgpDb3B5cmlnaHQgKEMpIDIwMTMgRnJl ZSBTb2Z0d2FyZSBGb3VuZGF0aW9uLCBJbmMuCkxpY2Vuc2UgR1BMdjMrOiBHTlUgR1BMIHZl cnNpb24gMyBvciBsYXRlciA8aHR0cDovL2dudS5vcmcvbGljZW5zZXMvZ3BsLmh0bWw+ClRo aXMgaXMgZnJlZSBzb2Z0d2FyZTogeW91IGFyZSBmcmVlIHRvIGNoYW5nZSBhbmQgcmVkaXN0 cmlidXRlIGl0LgpUaGVyZSBpcyBOTyBXQVJSQU5UWSwgdG8gdGhlIGV4dGVudCBwZXJtaXR0 ZWQgYnkgbGF3LiAgVHlwZSAic2hvdyBjb3B5aW5nIgphbmQgInNob3cgd2FycmFudHkiIGZv ciBkZXRhaWxzLgpUaGlzIEdEQiB3YXMgY29uZmlndXJlZCBhcyAieDg2XzY0LXBjLWxpbnV4 LWdudSIuCkZvciBidWcgcmVwb3J0aW5nIGluc3RydWN0aW9ucywgcGxlYXNlIHNlZToKPGh0 dHA6Ly9idWdzLmdlbnRvby5vcmcvPi4uLgpSZWFkaW5nIHN5bWJvbHMgZnJvbSAvdXNyL3Ni aW4veGwuLi5SZWFkaW5nIHN5bWJvbHMgZnJvbSAvdXNyL2xpYjY0L2RlYnVnL3Vzci9zYmlu L3hsLmRlYnVnLi4uZG9uZS4KZG9uZS4KKGdkYikgcnVuClN0YXJ0aW5nIHByb2dyYW06IC91 c3Ivc2Jpbi94bCBkZXN0cm95IHBmc2Vuc2UKd2FybmluZzogbm8gbG9hZGFibGUgc2VjdGlv bnMgZm91bmQgaW4gYWRkZWQgc3ltYm9sLWZpbGUgc3lzdGVtLXN1cHBsaWVkIERTTyBhdCAw eDdmZmZmN2ZmYTAwMAp3YXJuaW5nOiBDb3VsZCBub3QgbG9hZCBzaGFyZWQgbGlicmFyeSBz eW1ib2xzIGZvciBsaW51eC12ZHNvLnNvLjEuCkRvIHlvdSBuZWVkICJzZXQgc29saWItc2Vh cmNoLXBhdGgiIG9yICJzZXQgc3lzcm9vdCI/CltUaHJlYWQgZGVidWdnaW5nIHVzaW5nIGxp YnRocmVhZF9kYiBlbmFibGVkXQpVc2luZyBob3N0IGxpYnRocmVhZF9kYiBsaWJyYXJ5ICIv bGliNjQvbGlidGhyZWFkX2RiLnNvLjEiLgpbTmV3IFRocmVhZCAweDdmZmZmN2ZmNjcwMCAo TFdQIDEzNjM5KV0KClByb2dyYW0gcmVjZWl2ZWQgc2lnbmFsIFNJR1NFR1YsIFNlZ21lbnRh dGlvbiBmYXVsdC4KW1N3aXRjaGluZyB0byBUaHJlYWQgMHg3ZmZmZjdmZjY3MDAgKExXUCAx MzYzOSldCjB4MDAwMDdmZmZmNTg4MmI2NCBpbiA/PyAoKSBmcm9tIC91c3IvbGliL2djYy94 ODZfNjQtcGMtbGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKKGdkYikgYnQKIzAgIDB4 MDAwMDdmZmZmNTg4MmI2NCBpbiA/PyAoKSBmcm9tIC91c3IvbGliL2djYy94ODZfNjQtcGMt bGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKIzEgIDB4MDAwMDdmZmZmNTg4MzVjYyBp biA/PyAoKSBmcm9tIC91c3IvbGliL2djYy94ODZfNjQtcGMtbGludXgtZ251LzQuOC4zL2xp YmdjY19zLnNvLjEKIzIgIDB4MDAwMDdmZmZmNTg4Mzk0NSBpbiA/PyAoKSBmcm9tIC91c3Iv bGliL2djYy94ODZfNjQtcGMtbGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKIzMgIDB4 MDAwMDdmZmZmNTg4NDVjNiBpbiA/PyAoKSBmcm9tIC91c3IvbGliL2djYy94ODZfNjQtcGMt bGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKIzQgIDB4MDAwMDdmZmZmNTg4NDk0YyBp biBfVW53aW5kX0ZvcmNlZFVud2luZCAoKSBmcm9tIC91c3IvbGliL2djYy94ODZfNjQtcGMt bGludXgtZ251LzQuOC4zL2xpYmdjY19zLnNvLjEKIzUgIDB4MDAwMDdmZmZmNzMxYTczMyBp biBfX3B0aHJlYWRfdW53aW5kICgpIGZyb20gL2xpYjY0L2xpYnB0aHJlYWQuc28uMAojNiAg MHgwMDAwN2ZmZmY3MzExYjQ5IGluIHNpZ2NhbmNlbF9oYW5kbGVyICgpIGZyb20gL2xpYjY0 L2xpYnB0aHJlYWQuc28uMAojNyAgPHNpZ25hbCBoYW5kbGVyIGNhbGxlZD4KIzggIDB4MDAw MDdmZmZmNzMxYWU0ZCBpbiByZWFkICgpIGZyb20gL2xpYjY0L2xpYnB0aHJlYWQuc28uMAoj OSAgMHgwMDAwN2ZmZmY2YjE3YjUzIGluIHJlYWQgKF9fbmJ5dGVzPTE2LCBfX2J1Zj0weDdm ZmZmMDAwMGExMCwgX19mZD0xMCkgYXQgL3Vzci9pbmNsdWRlL2JpdHMvdW5pc3RkLmg6NDQK IzEwIHJlYWRfYWxsIChmZD0xMCwgZGF0YT1kYXRhQGVudHJ5PTB4N2ZmZmYwMDAwYTEwLCBs ZW49bGVuQGVudHJ5PTE2LCBub25ibG9ja2luZz1ub25ibG9ja2luZ0BlbnRyeT0wKSBhdCB4 cy5jOjM3NAojMTEgMHgwMDAwN2ZmZmY2YjE3Yzk0IGluIHJlYWRfbWVzc2FnZSAoaD1oQGVu dHJ5PTB4NTU1NTU1NzdlZDQwLCBub25ibG9ja2luZz1ub25ibG9ja2luZ0BlbnRyeT0wKSBh dCB4cy5jOjExMzkKIzEyIDB4MDAwMDdmZmZmNmIxODYyNiBpbiByZWFkX3RocmVhZCAoYXJn PTB4NTU1NTU1NzdlZDQwKSBhdCB4cy5jOjEyMTEKIzEzIDB4MDAwMDdmZmZmNzMxMzMyZCBp biBzdGFydF90aHJlYWQgKCkgZnJvbSAvbGliNjQvbGlicHRocmVhZC5zby4wCiMxNCAweDAw MDA3ZmZmZjcwNGExOWQgaW4gY2xvbmUgKCkgZnJvbSAvbGliNjQvbGliYy5zby42CihnZGIp Cg== --------------060208010004030908020104 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --------------060208010004030908020104--