Disk add fails while domain creation, which uses disk backend- "storage driver domain" with xen-4.3.0 , with errors libxl.c:2125

Disk add fails while domain creation, which uses disk backend- "storage driver domain" with xen-4.3.0 , with errors libxl.c:2125

[Pravin Chavan]

[-- Attachment #1.1: Type: text/plain, Size: 8491 bytes --]

Hi All, 

I am working on creating storage driver domain with xen-4.3.0 . 

I am referring this - http://wiki.xen.org/wiki?title=Storage_driver_domains&oldid=9371 

I have created Storage domain with xl utility of xen, then followed above wiki for rest of the steps, additionally 
I did install blktap-dkms package also- 

Following xen processes are running on Domain 0: 
root@suksha:~/domsikernel# ps -ef | grep xen 
root 31 2 0 Aug12 ? 00:00:00 [xenwatch] 
root 32 2 0 Aug12 ? 00:00:00 [xenbus] 
root 59 2 0 Aug12 ? 00:00:00 [xen_pciback_wor] 
root 1282 1 0 Aug12 ? 00:00:03 /usr/local/sbin/oxenstored --pid-file /var/run/xenstored.pid 
root 1288 1 0 Aug12 ? 00:00:09 /usr/local/sbin/xenconsoled --pid-file=/var/run/xenconsoled.pid 
root 1292 1 0 Aug12 ? 00:00:07 /usr/local/lib/xen/bin/qemu-system-i386 -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv -daemonize -monitor /dev/null -serial /dev/null -parallel /dev/null -pidfile /var/run/qemu-dom0.pid 
root 12673 8660 0 15:05 pts/4 00:00:00 /usr/local/lib/xen/bin/xenconsole 56 --num 0 --type pv 
root 12861 9107 0 17:55 pts/6 00:00:00 grep --color=auto xen 

Config file for storage driver domain: 

kernel = '/root/storage-domu/linux-3.7.1/vmlinux' 
ramdisk = '/root/storage-domu/initrd.img-3.7.1-domU' 
vcpus = '2' 
memory = '1024' 
root = '/dev/xvda1 ro' 
disk=['tap:aio:/root/storage-domu/storage-domu.img,xvda1,w'] 
name = 'storage' 
vif = [ '','bridge=xenbr0'] 
dhcp = "dhcp" 
on_poweroff = 'destroy' 
on_reboot = 'restart' 
on_crash = 'restart' 
extra = 'console=hvc0 xencons=tty' 
blkif = "yes" 

While compiling kernel for storage-domain I did set- 
CONFIG_XEN_BLKDEV_BACKEND=y 

Storage domain will have .img file (created with dd command), and I want to use that file in new domains that I will create, as block device. 
(that image file is formatted and it got file system with debootstrap) 

Config file for new domain to be created which will use image file from storage driver domain as its disk - 

kernel = '/root/domsikernel/linux-3.7.1/vmlinux' 
ramdisk = '/root/domsikernel/initrd.img-3.7.1-domU' 
vcpus = '2' 
memory = '2056' 
root = '/dev/xvda1 ro' 
name = 'domsi' 
dhcp = "dhcp" 
on_poweroff = 'destroy' 
on_reboot = 'restart' 
on_crash = 'restart' 
extra = 'console=hvc0 xencons=tty' 
disk = ['access=w,vdev=xvda1,backend=storage,backendtype=tap,target=/root/domsi.img'] 


Where /root/domsi.img is path from Storage domain file system. 

While creating new domain I got this console log- 

root@suksha:~/domsikernel# xl create -c domsi 
Parsing config from domsi 
libxl: error: libxl.c:2125:device_disk_add: failed to get blktap devpath for 0x1f9e9e0 
libxl: error: libxl_create.c:932:domcreate_launch_dm: unable to add disk devices 


Second try: 

then I did changed disk param to- 
disk = ['access=w,vdev=xvda1,backend=storage,target=/root/domsi.img'] 


And I got this console log - 

[ 5.588091] XENBUS: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s...100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s... 
[ 270.588319] XENBUS: Timeout connecting to device: device/vbd/51713 (local state 3, remote state 2) 
[ 270.588492] Magic number: 1:252:3141 
[ 270.588543] drivers/rtc/hctosys.c: unable to open rtc device (rtc0) 
[ 270.588716] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found 
[ 270.588730] EDD information not available. 
[ 270.589358] Freeing unused kernel memory: 972k freed 
[ 270.589603] Write protecting the kernel read-only data: 12288k 
[ 270.594498] Freeing unused kernel memory: 1300k freed 
[ 270.595289] Freeing unused kernel memory: 1088k freed 
Loading, please wait... 
[ 270.636766] udev[90]: starting version 164 
Begin: Loading essential drivers ... done. 
Begin: Running /scripts/init-premount ... done. 
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. 
Begin: Waiting for root file system ... done. 
Gave up waiting for root device. Common problems: 
- Boot args (cat /proc/cmdline) 
- Check rootdelay= (did the system wait long enough?) 
- Check root= (did the system wait for the right device?) 
- Missing modules (cat /proc/modules; ls /dev) 
ALERT! /dev/xvda1 does not exist. Dropping to a shell! 


BusyBox v1.17.1 (Debian 1:1.17.1-8) built-in shell (ash) 
Enter 'help' for a list of built-in commands. 

/bin/sh: can't access tty; job control turned off 
(initramfs) 


And syslog from storage domain is- 

Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: add XENBUS_PATH=b 
ackend/vbd/62/51713 
Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
bd/62/51713/hotplug-error xenstore-read backend/vbd/62/51713/params failed. back 
end/vbd/62/51713/hotplug-status error to xenstore. 
Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: xenstore-read bac 
kend/vbd/62/51713/params failed. 
Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
bd/62/51713/hotplug-error /etc/xen/scripts/block failed; error detected. backend 
/vbd/62/51713/hotplug-status error to xenstore. 
Aug 14 09:37:57 suksha-storage kernel: [14140.537637] xen-blkback:ring-ref 8, ev 
ent-channel 17, protocol 1 (x86_64-abi) 


--- 

Third thing that I tried, 

I did attach a block to storage driver domain using block attach, 
which created block device on storage driver domain lets say - /dev/xvda2 
I put this path in disk specification for new domain to be created- 

disk=['phy:/dev/xvda2,xvda2,w,backend=storage'] 

which also failed with logs- 
[ 5.576108] XENBUS: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s...100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s... 
[ 270.576347] XENBUS: Timeout connecting to device: device/vbd/51714 (local state 3, remote state 2) 
[ 270.576524] Magic number: 1:252:3141 
[ 270.576570] drivers/rtc/hctosys.c: unable to open rtc device (rtc0) 
[ 270.576698] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found 
[ 270.576710] EDD information not available. 
[ 270.577319] Freeing unused kernel memory: 972k freed 
[ 270.577565] Write protecting the kernel read-only data: 12288k 
[ 270.582483] Freeing unused kernel memory: 1300k freed 
[ 270.583272] Freeing unused kernel memory: 1088k freed 
Loading, please wait... 
[ 270.624933] udev[90]: starting version 164 
Begin: Loading essential drivers ... done. 
Begin: Running /scripts/init-premount ... done. 
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. 
Begin: Waiting for root file system ... done. 
Gave up waiting for root device. Common problems: 
- Boot args (cat /proc/cmdline) 
- Check rootdelay= (did the system wait long enough?) 
- Check root= (did the system wait for the right device?) 
- Missing modules (cat /proc/modules; ls /dev) 
ALERT! /dev/xvda1 does not exist. Dropping to a shell! 


BusyBox v1.17.1 (Debian 1:1.17.1-8) built-in shell (ash) 
Enter 'help' for a list of built-in commands. 

/bin/sh: can't access tty; job control turned off 


/var/log/syslog from storage driver domain- 

Aug 14 11:17:01 suksha-storage /USR/SBIN/CRON[967]: (root) CMD ( cd / && run-p 
arts --report /etc/cron.hourly) 
Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: add XENBUS_PATH=b 
ackend/vbd/63/51714 
Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
bd/63/51714/hotplug-error xenstore-read backend/vbd/63/51714/params failed. back 
end/vbd/63/51714/hotplug-status error to xenstore. 
Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: xenstore-read bac 
kend/vbd/63/51714/params failed. 
Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
bd/63/51714/hotplug-error /etc/xen/scripts/block failed; error detected. backend 
/vbd/63/51714/hotplug-status error to xenstore. 
Aug 14 11:46:50 suksha-storage kernel: [21873.415391] xen-blkback:ring-ref 8, ev 
ent-channel 17, protocol 1 (x86_64-abi) 

--------- 


So I am stuck here, Could you please help me. 


Thanks, 
Pravin 








[-- Attachment #1.2: Type: text/html, Size: 10348 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: Disk add fails while domain creation, which uses disk backend- "storage driver domain" with xen-4.3.0 , with errors libxl.c:2125

[Wei Liu]

On Wed, Aug 14, 2013 at 06:14:14PM +0530, Pravin Chavan wrote:
> Hi All, 
> 
> I am working on creating storage driver domain with xen-4.3.0 . 
> 
> I am referring this - http://wiki.xen.org/wiki?title=Storage_driver_domains&oldid=9371 
> 
> I have created Storage domain with xl utility of xen, then followed above wiki for rest of the steps, additionally 
> I did install blktap-dkms package also- 
> 
> Following xen processes are running on Domain 0: 
> root@suksha:~/domsikernel# ps -ef | grep xen 
> root 31 2 0 Aug12 ? 00:00:00 [xenwatch] 
> root 32 2 0 Aug12 ? 00:00:00 [xenbus] 
> root 59 2 0 Aug12 ? 00:00:00 [xen_pciback_wor] 
> root 1282 1 0 Aug12 ? 00:00:03 /usr/local/sbin/oxenstored --pid-file /var/run/xenstored.pid 
> root 1288 1 0 Aug12 ? 00:00:09 /usr/local/sbin/xenconsoled --pid-file=/var/run/xenconsoled.pid 
> root 1292 1 0 Aug12 ? 00:00:07 /usr/local/lib/xen/bin/qemu-system-i386 -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv -daemonize -monitor /dev/null -serial /dev/null -parallel /dev/null -pidfile /var/run/qemu-dom0.pid 
> root 12673 8660 0 15:05 pts/4 00:00:00 /usr/local/lib/xen/bin/xenconsole 56 --num 0 --type pv 
> root 12861 9107 0 17:55 pts/6 00:00:00 grep --color=auto xen 
> 
> Config file for storage driver domain: 
> 
> kernel = '/root/storage-domu/linux-3.7.1/vmlinux' 
> ramdisk = '/root/storage-domu/initrd.img-3.7.1-domU' 
> vcpus = '2' 
> memory = '1024' 
> root = '/dev/xvda1 ro' 
> disk=['tap:aio:/root/storage-domu/storage-domu.img,xvda1,w'] 
> name = 'storage' 
> vif = [ '','bridge=xenbr0'] 
> dhcp = "dhcp" 
> on_poweroff = 'destroy' 
> on_reboot = 'restart' 
> on_crash = 'restart' 
> extra = 'console=hvc0 xencons=tty' 
> blkif = "yes" 
> 
> While compiling kernel for storage-domain I did set- 
> CONFIG_XEN_BLKDEV_BACKEND=y 
> 
> Storage domain will have .img file (created with dd command), and I want to use that file in new domains that I will create, as block device. 
> (that image file is formatted and it got file system with debootstrap) 
> 
> Config file for new domain to be created which will use image file from storage driver domain as its disk - 
> 
> kernel = '/root/domsikernel/linux-3.7.1/vmlinux' 
> ramdisk = '/root/domsikernel/initrd.img-3.7.1-domU' 
> vcpus = '2' 
> memory = '2056' 
> root = '/dev/xvda1 ro' 
> name = 'domsi' 
> dhcp = "dhcp" 
> on_poweroff = 'destroy' 
> on_reboot = 'restart' 
> on_crash = 'restart' 
> extra = 'console=hvc0 xencons=tty' 
> disk = ['access=w,vdev=xvda1,backend=storage,backendtype=tap,target=/root/domsi.img'] 

The "backendtype" on the wiki page is "phy". Did you try that?

I don't think 3.7 has blktap module.

Wei.

> 
> 
> Where /root/domsi.img is path from Storage domain file system. 
> 
> While creating new domain I got this console log- 
> 
> root@suksha:~/domsikernel# xl create -c domsi 
> Parsing config from domsi 
> libxl: error: libxl.c:2125:device_disk_add: failed to get blktap devpath for 0x1f9e9e0 
> libxl: error: libxl_create.c:932:domcreate_launch_dm: unable to add disk devices 
> 
> 
> Second try: 
> 
> then I did changed disk param to- 
> disk = ['access=w,vdev=xvda1,backend=storage,target=/root/domsi.img'] 
> 
> 
> And I got this console log - 
> 
> [ 5.588091] XENBUS: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s...100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s... 
> [ 270.588319] XENBUS: Timeout connecting to device: device/vbd/51713 (local state 3, remote state 2) 
> [ 270.588492] Magic number: 1:252:3141 
> [ 270.588543] drivers/rtc/hctosys.c: unable to open rtc device (rtc0) 
> [ 270.588716] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found 
> [ 270.588730] EDD information not available. 
> [ 270.589358] Freeing unused kernel memory: 972k freed 
> [ 270.589603] Write protecting the kernel read-only data: 12288k 
> [ 270.594498] Freeing unused kernel memory: 1300k freed 
> [ 270.595289] Freeing unused kernel memory: 1088k freed 
> Loading, please wait... 
> [ 270.636766] udev[90]: starting version 164 
> Begin: Loading essential drivers ... done. 
> Begin: Running /scripts/init-premount ... done. 
> Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. 
> Begin: Waiting for root file system ... done. 
> Gave up waiting for root device. Common problems: 
> - Boot args (cat /proc/cmdline) 
> - Check rootdelay= (did the system wait long enough?) 
> - Check root= (did the system wait for the right device?) 
> - Missing modules (cat /proc/modules; ls /dev) 
> ALERT! /dev/xvda1 does not exist. Dropping to a shell! 
> 
> 
> BusyBox v1.17.1 (Debian 1:1.17.1-8) built-in shell (ash) 
> Enter 'help' for a list of built-in commands. 
> 
> /bin/sh: can't access tty; job control turned off 
> (initramfs) 
> 
> 
> And syslog from storage domain is- 
> 
> Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: add XENBUS_PATH=b 
> ackend/vbd/62/51713 
> Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
> bd/62/51713/hotplug-error xenstore-read backend/vbd/62/51713/params failed. back 
> end/vbd/62/51713/hotplug-status error to xenstore. 
> Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: xenstore-read bac 
> kend/vbd/62/51713/params failed. 
> Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
> bd/62/51713/hotplug-error /etc/xen/scripts/block failed; error detected. backend 
> /vbd/62/51713/hotplug-status error to xenstore. 
> Aug 14 09:37:57 suksha-storage kernel: [14140.537637] xen-blkback:ring-ref 8, ev 
> ent-channel 17, protocol 1 (x86_64-abi) 
> 
> 
> --- 
> 
> Third thing that I tried, 
> 
> I did attach a block to storage driver domain using block attach, 
> which created block device on storage driver domain lets say - /dev/xvda2 
> I put this path in disk specification for new domain to be created- 
> 
> disk=['phy:/dev/xvda2,xvda2,w,backend=storage'] 
> 
> which also failed with logs- 
> [ 5.576108] XENBUS: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s...100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s... 
> [ 270.576347] XENBUS: Timeout connecting to device: device/vbd/51714 (local state 3, remote state 2) 
> [ 270.576524] Magic number: 1:252:3141 
> [ 270.576570] drivers/rtc/hctosys.c: unable to open rtc device (rtc0) 
> [ 270.576698] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found 
> [ 270.576710] EDD information not available. 
> [ 270.577319] Freeing unused kernel memory: 972k freed 
> [ 270.577565] Write protecting the kernel read-only data: 12288k 
> [ 270.582483] Freeing unused kernel memory: 1300k freed 
> [ 270.583272] Freeing unused kernel memory: 1088k freed 
> Loading, please wait... 
> [ 270.624933] udev[90]: starting version 164 
> Begin: Loading essential drivers ... done. 
> Begin: Running /scripts/init-premount ... done. 
> Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. 
> Begin: Waiting for root file system ... done. 
> Gave up waiting for root device. Common problems: 
> - Boot args (cat /proc/cmdline) 
> - Check rootdelay= (did the system wait long enough?) 
> - Check root= (did the system wait for the right device?) 
> - Missing modules (cat /proc/modules; ls /dev) 
> ALERT! /dev/xvda1 does not exist. Dropping to a shell! 
> 
> 
> BusyBox v1.17.1 (Debian 1:1.17.1-8) built-in shell (ash) 
> Enter 'help' for a list of built-in commands. 
> 
> /bin/sh: can't access tty; job control turned off 
> 
> 
> /var/log/syslog from storage driver domain- 
> 
> Aug 14 11:17:01 suksha-storage /USR/SBIN/CRON[967]: (root) CMD ( cd / && run-p 
> arts --report /etc/cron.hourly) 
> Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: add XENBUS_PATH=b 
> ackend/vbd/63/51714 
> Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
> bd/63/51714/hotplug-error xenstore-read backend/vbd/63/51714/params failed. back 
> end/vbd/63/51714/hotplug-status error to xenstore. 
> Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: xenstore-read bac 
> kend/vbd/63/51714/params failed. 
> Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
> bd/63/51714/hotplug-error /etc/xen/scripts/block failed; error detected. backend 
> /vbd/63/51714/hotplug-status error to xenstore. 
> Aug 14 11:46:50 suksha-storage kernel: [21873.415391] xen-blkback:ring-ref 8, ev 
> ent-channel 17, protocol 1 (x86_64-abi) 
> 
> --------- 
> 
> 
> So I am stuck here, Could you please help me. 
> 
> 
> Thanks, 
> Pravin 
> 
> 
> 
> 
> 
> 
> 

> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

Re: Disk add fails while domain creation, which uses disk backend- "storage driver domain" with xen-4.3.0 , with errors libxl.c:2125

[Pravin Chavan]

Hi,

Yes, I also tried with- backendtype=phy

disk = ['access=w,backendtype=phy,backend=storage,vdev=xvda1,target=/root/domsi.img']

Got this log on console-

[    5.576092] XENBUS: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s...100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s...
[  270.576336] XENBUS: Timeout connecting to device: device/vbd/51713 (local state 3, remote state 2)
[  270.576525]   Magic number: 1:252:3141
[  270.576583] drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[  270.576741] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[  270.576752] EDD information not available.
[  270.577365] Freeing unused kernel memory: 972k freed
[  270.577608] Write protecting the kernel read-only data: 12288k
[  270.582489] Freeing unused kernel memory: 1300k freed
[  270.583275] Freeing unused kernel memory: 1088k freed
Loading, please wait...
[  270.624946] udev[90]: starting version 164
Begin: Loading essential drivers ... done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Begin: Waiting for root file system ... done.
Gave up waiting for root device.  Common problems:
 - Boot args (cat /proc/cmdline)
   - Check rootdelay= (did the system wait long enough?)
   - Check root= (did the system wait for the right device?)
 - Missing modules (cat /proc/modules; ls /dev)
ALERT!  /dev/xvda1 does not exist.  Dropping to a shell!


BusyBox v1.17.1 (Debian 1:1.17.1-8) built-in shell (ash)
Enter 'help' for a list of built-in commands.

/bin/sh: can't access tty; job control turned off
(initramfs)



Got this log on storage driver domain-

Aug 16 06:32:50 suksha-storage logger: /etc/xen/scripts/block: add XENBUS_PATH=b
ackend/vbd/69/51713
Aug 16 06:32:50 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v
bd/69/51713/hotplug-error xenstore-read backend/vbd/69/51713/params failed. back
end/vbd/69/51713/hotplug-status error to xenstore.
Aug 16 06:32:50 suksha-storage logger: /etc/xen/scripts/block: xenstore-read bac
kend/vbd/69/51713/params failed.
Aug 16 06:32:50 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v
bd/69/51713/hotplug-error /etc/xen/scripts/block failed; error detected. backend
/vbd/69/51713/hotplug-status error to xenstore.
Aug 16 06:32:51 suksha-storage kernel: [175833.999219] xen-blkback:ring-ref 8, e
vent-channel 17, protocol 1 (x86_64-abi)


Thanks,
Pravin




----- Original Message -----
From: "Wei Liu" <wei.liu2@citrix.com>
To: "Pravin Chavan" <pravin.chavan@gslab.com>
Cc: xen-users@lists.xenproject.org, xen-devel@lists.xenproject.org, "wei liu2" <wei.liu2@citrix.com>
Sent: Thursday, August 15, 2013 6:22:39 PM
Subject: Re: [Xen-devel] Disk add fails while domain creation, which uses disk backend- "storage driver domain"  with xen-4.3.0 , with errors  libxl.c:2125

On Wed, Aug 14, 2013 at 06:14:14PM +0530, Pravin Chavan wrote:
> Hi All, 
> 
> I am working on creating storage driver domain with xen-4.3.0 . 
> 
> I am referring this - http://wiki.xen.org/wiki?title=Storage_driver_domains&oldid=9371 
> 
> I have created Storage domain with xl utility of xen, then followed above wiki for rest of the steps, additionally 
> I did install blktap-dkms package also- 
> 
> Following xen processes are running on Domain 0: 
> root@suksha:~/domsikernel# ps -ef | grep xen 
> root 31 2 0 Aug12 ? 00:00:00 [xenwatch] 
> root 32 2 0 Aug12 ? 00:00:00 [xenbus] 
> root 59 2 0 Aug12 ? 00:00:00 [xen_pciback_wor] 
> root 1282 1 0 Aug12 ? 00:00:03 /usr/local/sbin/oxenstored --pid-file /var/run/xenstored.pid 
> root 1288 1 0 Aug12 ? 00:00:09 /usr/local/sbin/xenconsoled --pid-file=/var/run/xenconsoled.pid 
> root 1292 1 0 Aug12 ? 00:00:07 /usr/local/lib/xen/bin/qemu-system-i386 -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv -daemonize -monitor /dev/null -serial /dev/null -parallel /dev/null -pidfile /var/run/qemu-dom0.pid 
> root 12673 8660 0 15:05 pts/4 00:00:00 /usr/local/lib/xen/bin/xenconsole 56 --num 0 --type pv 
> root 12861 9107 0 17:55 pts/6 00:00:00 grep --color=auto xen 
> 
> Config file for storage driver domain: 
> 
> kernel = '/root/storage-domu/linux-3.7.1/vmlinux' 
> ramdisk = '/root/storage-domu/initrd.img-3.7.1-domU' 
> vcpus = '2' 
> memory = '1024' 
> root = '/dev/xvda1 ro' 
> disk=['tap:aio:/root/storage-domu/storage-domu.img,xvda1,w'] 
> name = 'storage' 
> vif = [ '','bridge=xenbr0'] 
> dhcp = "dhcp" 
> on_poweroff = 'destroy' 
> on_reboot = 'restart' 
> on_crash = 'restart' 
> extra = 'console=hvc0 xencons=tty' 
> blkif = "yes" 
> 
> While compiling kernel for storage-domain I did set- 
> CONFIG_XEN_BLKDEV_BACKEND=y 
> 
> Storage domain will have .img file (created with dd command), and I want to use that file in new domains that I will create, as block device. 
> (that image file is formatted and it got file system with debootstrap) 
> 
> Config file for new domain to be created which will use image file from storage driver domain as its disk - 
> 
> kernel = '/root/domsikernel/linux-3.7.1/vmlinux' 
> ramdisk = '/root/domsikernel/initrd.img-3.7.1-domU' 
> vcpus = '2' 
> memory = '2056' 
> root = '/dev/xvda1 ro' 
> name = 'domsi' 
> dhcp = "dhcp" 
> on_poweroff = 'destroy' 
> on_reboot = 'restart' 
> on_crash = 'restart' 
> extra = 'console=hvc0 xencons=tty' 
> disk = ['access=w,vdev=xvda1,backend=storage,backendtype=tap,target=/root/domsi.img'] 

The "backendtype" on the wiki page is "phy". Did you try that?

I don't think 3.7 has blktap module.

Wei.

> 
> 
> Where /root/domsi.img is path from Storage domain file system. 
> 
> While creating new domain I got this console log- 
> 
> root@suksha:~/domsikernel# xl create -c domsi 
> Parsing config from domsi 
> libxl: error: libxl.c:2125:device_disk_add: failed to get blktap devpath for 0x1f9e9e0 
> libxl: error: libxl_create.c:932:domcreate_launch_dm: unable to add disk devices 
> 
> 
> Second try: 
> 
> then I did changed disk param to- 
> disk = ['access=w,vdev=xvda1,backend=storage,target=/root/domsi.img'] 
> 
> 
> And I got this console log - 
> 
> [ 5.588091] XENBUS: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s...100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s... 
> [ 270.588319] XENBUS: Timeout connecting to device: device/vbd/51713 (local state 3, remote state 2) 
> [ 270.588492] Magic number: 1:252:3141 
> [ 270.588543] drivers/rtc/hctosys.c: unable to open rtc device (rtc0) 
> [ 270.588716] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found 
> [ 270.588730] EDD information not available. 
> [ 270.589358] Freeing unused kernel memory: 972k freed 
> [ 270.589603] Write protecting the kernel read-only data: 12288k 
> [ 270.594498] Freeing unused kernel memory: 1300k freed 
> [ 270.595289] Freeing unused kernel memory: 1088k freed 
> Loading, please wait... 
> [ 270.636766] udev[90]: starting version 164 
> Begin: Loading essential drivers ... done. 
> Begin: Running /scripts/init-premount ... done. 
> Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. 
> Begin: Waiting for root file system ... done. 
> Gave up waiting for root device. Common problems: 
> - Boot args (cat /proc/cmdline) 
> - Check rootdelay= (did the system wait long enough?) 
> - Check root= (did the system wait for the right device?) 
> - Missing modules (cat /proc/modules; ls /dev) 
> ALERT! /dev/xvda1 does not exist. Dropping to a shell! 
> 
> 
> BusyBox v1.17.1 (Debian 1:1.17.1-8) built-in shell (ash) 
> Enter 'help' for a list of built-in commands. 
> 
> /bin/sh: can't access tty; job control turned off 
> (initramfs) 
> 
> 
> And syslog from storage domain is- 
> 
> Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: add XENBUS_PATH=b 
> ackend/vbd/62/51713 
> Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
> bd/62/51713/hotplug-error xenstore-read backend/vbd/62/51713/params failed. back 
> end/vbd/62/51713/hotplug-status error to xenstore. 
> Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: xenstore-read bac 
> kend/vbd/62/51713/params failed. 
> Aug 14 09:37:57 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
> bd/62/51713/hotplug-error /etc/xen/scripts/block failed; error detected. backend 
> /vbd/62/51713/hotplug-status error to xenstore. 
> Aug 14 09:37:57 suksha-storage kernel: [14140.537637] xen-blkback:ring-ref 8, ev 
> ent-channel 17, protocol 1 (x86_64-abi) 
> 
> 
> --- 
> 
> Third thing that I tried, 
> 
> I did attach a block to storage driver domain using block attach, 
> which created block device on storage driver domain lets say - /dev/xvda2 
> I put this path in disk specification for new domain to be created- 
> 
> disk=['phy:/dev/xvda2,xvda2,w,backend=storage'] 
> 
> which also failed with logs- 
> [ 5.576108] XENBUS: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...120s...115s...110s...105s...100s...95s...90s...85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s... 
> [ 270.576347] XENBUS: Timeout connecting to device: device/vbd/51714 (local state 3, remote state 2) 
> [ 270.576524] Magic number: 1:252:3141 
> [ 270.576570] drivers/rtc/hctosys.c: unable to open rtc device (rtc0) 
> [ 270.576698] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found 
> [ 270.576710] EDD information not available. 
> [ 270.577319] Freeing unused kernel memory: 972k freed 
> [ 270.577565] Write protecting the kernel read-only data: 12288k 
> [ 270.582483] Freeing unused kernel memory: 1300k freed 
> [ 270.583272] Freeing unused kernel memory: 1088k freed 
> Loading, please wait... 
> [ 270.624933] udev[90]: starting version 164 
> Begin: Loading essential drivers ... done. 
> Begin: Running /scripts/init-premount ... done. 
> Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. 
> Begin: Waiting for root file system ... done. 
> Gave up waiting for root device. Common problems: 
> - Boot args (cat /proc/cmdline) 
> - Check rootdelay= (did the system wait long enough?) 
> - Check root= (did the system wait for the right device?) 
> - Missing modules (cat /proc/modules; ls /dev) 
> ALERT! /dev/xvda1 does not exist. Dropping to a shell! 
> 
> 
> BusyBox v1.17.1 (Debian 1:1.17.1-8) built-in shell (ash) 
> Enter 'help' for a list of built-in commands. 
> 
> /bin/sh: can't access tty; job control turned off 
> 
> 
> /var/log/syslog from storage driver domain- 
> 
> Aug 14 11:17:01 suksha-storage /USR/SBIN/CRON[967]: (root) CMD ( cd / && run-p 
> arts --report /etc/cron.hourly) 
> Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: add XENBUS_PATH=b 
> ackend/vbd/63/51714 
> Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
> bd/63/51714/hotplug-error xenstore-read backend/vbd/63/51714/params failed. back 
> end/vbd/63/51714/hotplug-status error to xenstore. 
> Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: xenstore-read bac 
> kend/vbd/63/51714/params failed. 
> Aug 14 11:46:50 suksha-storage logger: /etc/xen/scripts/block: Writing backend/v 
> bd/63/51714/hotplug-error /etc/xen/scripts/block failed; error detected. backend 
> /vbd/63/51714/hotplug-status error to xenstore. 
> Aug 14 11:46:50 suksha-storage kernel: [21873.415391] xen-blkback:ring-ref 8, ev 
> ent-channel 17, protocol 1 (x86_64-abi) 
> 
> --------- 
> 
> 
> So I am stuck here, Could you please help me. 
> 
> 
> Thanks, 
> Pravin 
> 
> 
> 
> 
> 
> 
> 

> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel