* xen domU disk on nfs shared file @ 2016-01-11 14:08 Kojedzinszky Richárd 2016-01-12 12:05 ` blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) Wei Liu 2016-01-12 12:05 ` Wei Liu 0 siblings, 2 replies; 6+ messages in thread From: Kojedzinszky Richárd @ 2016-01-11 14:08 UTC (permalink / raw) To: xen-users, linux-nfs [-- Attachment #1: Type: text/plain, Size: 1922 bytes --] Dear all, We are facing a regular lockup with our xen setup. We have an nfs share mounted on the xen dom0, where the vm images are served, and those files are given to xen domUs. I was just preparing an experiment, where I created a 100G file on the host: # truncate -s 100G /srv/nfs/domU/disk2 And after added this disk to the instance's configuration. On the host this is the mountpoint: # mount|grep srv/xen 10.1.1.1:/mnt/main/vps on /srv/xen type nfs (rw,relatime,vers=3,rsize=16384,wsize=16384,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.1.1.1,mountvers=3,mountport=4045,mountproto=udp,local_lock=none,addr=10.1.1.1) After starting the instance I partitioned the disk with gdisk, and created an xfs fs on it. While the fs has been created well, strange messages appeared on the console: [ 23.787504] blk_update_request: I/O error, dev xvdc, sector 2048 [ 23.788904] blk_update_request: I/O error, dev xvdc, sector 8390655 [ 23.789611] blk_update_request: I/O error, dev xvdc, sector 16779262 [ 23.790359] blk_update_request: I/O error, dev xvdc, sector 25167869 [ 23.791148] blk_update_request: I/O error, dev xvdc, sector 33556476 [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 41945083 [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 50333690 [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 58722297 [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 67110904 [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 75499511 I dont think that this is normal. If I chose a local block device (probably lvm) for the domU, this does not appear. The host is running xen-4.4 with 3.16.0-4-amd64 kernel (debian jessie stock), the domU is running 4.3.0-0.bpo.1-amd64 (jessie backport, 4.4.4). I suspect those messages should not be there. Regards, Kojedzinszky Richárd Euronet Magyarorszag Informatika Zrt. ^ permalink raw reply [flat|nested] 6+ messages in thread
* blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) 2016-01-11 14:08 xen domU disk on nfs shared file Kojedzinszky Richárd @ 2016-01-12 12:05 ` Wei Liu 2016-01-12 12:05 ` Wei Liu 1 sibling, 0 replies; 6+ messages in thread From: Wei Liu @ 2016-01-12 12:05 UTC (permalink / raw) To: Kojedzinszky Richárd, Xen-devel Cc: linux-nfs, wei.liu2, Roger Pau Monné Drop xen-users@, CC xen-devel@ and blk maintainers, change title. On Mon, Jan 11, 2016 at 03:08:24PM +0100, Kojedzinszky Richárd wrote: > Dear all, > > We are facing a regular lockup with our xen setup. We have an nfs share > mounted on the xen dom0, where the vm images are served, and those files are > given to xen domUs. > > I was just preparing an experiment, where I created a 100G file on the host: > # truncate -s 100G /srv/nfs/domU/disk2 > And after added this disk to the instance's configuration. > > On the host this is the mountpoint: > # mount|grep srv/xen > 10.1.1.1:/mnt/main/vps on /srv/xen type nfs (rw,relatime,vers=3,rsize=16384,wsize=16384,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.1.1.1,mountvers=3,mountport=4045,mountproto=udp,local_lock=none,addr=10.1.1.1) > > After starting the instance I partitioned the disk with gdisk, and created > an xfs fs on it. While the fs has been created well, strange messages > appeared on the console: > > [ 23.787504] blk_update_request: I/O error, dev xvdc, sector 2048 > [ 23.788904] blk_update_request: I/O error, dev xvdc, sector 8390655 > [ 23.789611] blk_update_request: I/O error, dev xvdc, sector 16779262 > [ 23.790359] blk_update_request: I/O error, dev xvdc, sector 25167869 > [ 23.791148] blk_update_request: I/O error, dev xvdc, sector 33556476 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 41945083 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 50333690 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 58722297 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 67110904 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 75499511 > > I dont think that this is normal. If I chose a local block device (probably > lvm) for the domU, this does not appear. > > The host is running xen-4.4 with 3.16.0-4-amd64 kernel (debian jessie > stock), the domU is running 4.3.0-0.bpo.1-amd64 (jessie backport, 4.4.4). > > I suspect those messages should not be there. > > Regards, > > Kojedzinszky Richárd > Euronet Magyarorszag Informatika Zrt. > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users ^ permalink raw reply [flat|nested] 6+ messages in thread
* blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) 2016-01-11 14:08 xen domU disk on nfs shared file Kojedzinszky Richárd 2016-01-12 12:05 ` blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) Wei Liu @ 2016-01-12 12:05 ` Wei Liu 2016-01-12 12:58 ` blk_update_request: I/O error on NFS Roger Pau Monné ` (2 more replies) 1 sibling, 3 replies; 6+ messages in thread From: Wei Liu @ 2016-01-12 12:05 UTC (permalink / raw) To: Kojedzinszky Richárd, Xen-devel Cc: linux-nfs, wei.liu2, Roger Pau Monné, Konrad Rzeszutek Wilk Drop xen-users@, CC xen-devel@ and blk maintainers, change title. On Mon, Jan 11, 2016 at 03:08:24PM +0100, Kojedzinszky Richárd wrote: > Dear all, > > We are facing a regular lockup with our xen setup. We have an nfs share > mounted on the xen dom0, where the vm images are served, and those files are > given to xen domUs. > > I was just preparing an experiment, where I created a 100G file on the host: > # truncate -s 100G /srv/nfs/domU/disk2 > And after added this disk to the instance's configuration. > > On the host this is the mountpoint: > # mount|grep srv/xen > 10.1.1.1:/mnt/main/vps on /srv/xen type nfs (rw,relatime,vers=3,rsize=16384,wsize=16384,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.1.1.1,mountvers=3,mountport=4045,mountproto=udp,local_lock=none,addr=10.1.1.1) > > After starting the instance I partitioned the disk with gdisk, and created > an xfs fs on it. While the fs has been created well, strange messages > appeared on the console: > > [ 23.787504] blk_update_request: I/O error, dev xvdc, sector 2048 > [ 23.788904] blk_update_request: I/O error, dev xvdc, sector 8390655 > [ 23.789611] blk_update_request: I/O error, dev xvdc, sector 16779262 > [ 23.790359] blk_update_request: I/O error, dev xvdc, sector 25167869 > [ 23.791148] blk_update_request: I/O error, dev xvdc, sector 33556476 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 41945083 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 50333690 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 58722297 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 67110904 > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 75499511 > > I dont think that this is normal. If I chose a local block device (probably > lvm) for the domU, this does not appear. > > The host is running xen-4.4 with 3.16.0-4-amd64 kernel (debian jessie > stock), the domU is running 4.3.0-0.bpo.1-amd64 (jessie backport, 4.4.4). > > I suspect those messages should not be there. > > Regards, > > Kojedzinszky Richárd > Euronet Magyarorszag Informatika Zrt. > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: blk_update_request: I/O error on NFS 2016-01-12 12:05 ` Wei Liu @ 2016-01-12 12:58 ` Roger Pau Monné 2016-01-12 12:58 ` Roger Pau Monné 2016-01-27 17:40 ` blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) Konrad Rzeszutek Wilk 2 siblings, 0 replies; 6+ messages in thread From: Roger Pau Monné @ 2016-01-12 12:58 UTC (permalink / raw) To: Wei Liu, Kojedzinszky Richárd, Xen-devel; +Cc: linux-nfs Hello, El 12/01/16 a les 13.05, Wei Liu ha escrit: > Drop xen-users@, CC xen-devel@ and blk maintainers, change title. > > On Mon, Jan 11, 2016 at 03:08:24PM +0100, Kojedzinszky Richárd wrote: >> Dear all, >> >> We are facing a regular lockup with our xen setup. We have an nfs share >> mounted on the xen dom0, where the vm images are served, and those files are >> given to xen domUs. >> >> I was just preparing an experiment, where I created a 100G file on the host: >> # truncate -s 100G /srv/nfs/domU/disk2 >> And after added this disk to the instance's configuration. Have you tried creating the file with dd instead of truncate? (so it's not sparse) >> On the host this is the mountpoint: >> # mount|grep srv/xen >> 10.1.1.1:/mnt/main/vps on /srv/xen type nfs (rw,relatime,vers=3,rsize=16384,wsize=16384,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.1.1.1,mountvers=3,mountport=4045,mountproto=udp,local_lock=none,addr=10.1.1.1) >> >> After starting the instance I partitioned the disk with gdisk, and created >> an xfs fs on it. While the fs has been created well, strange messages >> appeared on the console: AFAICT this is the guest console. Is there any corresponding error on the host console? >> [ 23.787504] blk_update_request: I/O error, dev xvdc, sector 2048 >> [ 23.788904] blk_update_request: I/O error, dev xvdc, sector 8390655 >> [ 23.789611] blk_update_request: I/O error, dev xvdc, sector 16779262 >> [ 23.790359] blk_update_request: I/O error, dev xvdc, sector 25167869 >> [ 23.791148] blk_update_request: I/O error, dev xvdc, sector 33556476 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 41945083 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 50333690 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 58722297 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 67110904 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 75499511 >> >> I dont think that this is normal. If I chose a local block device (probably >> lvm) for the domU, this does not appear. IIRC Xen 4.4 still uses Qemu (Qdisk) for raw disks, do you have any kind of errors/warnings in /var/log/xen/qemu-dm-<domain_name>.log? Roger. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: blk_update_request: I/O error on NFS 2016-01-12 12:05 ` Wei Liu 2016-01-12 12:58 ` blk_update_request: I/O error on NFS Roger Pau Monné @ 2016-01-12 12:58 ` Roger Pau Monné 2016-01-27 17:40 ` blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) Konrad Rzeszutek Wilk 2 siblings, 0 replies; 6+ messages in thread From: Roger Pau Monné @ 2016-01-12 12:58 UTC (permalink / raw) To: Wei Liu, Kojedzinszky Richárd, Xen-devel Cc: linux-nfs, Konrad Rzeszutek Wilk Hello, El 12/01/16 a les 13.05, Wei Liu ha escrit: > Drop xen-users@, CC xen-devel@ and blk maintainers, change title. > > On Mon, Jan 11, 2016 at 03:08:24PM +0100, Kojedzinszky Richárd wrote: >> Dear all, >> >> We are facing a regular lockup with our xen setup. We have an nfs share >> mounted on the xen dom0, where the vm images are served, and those files are >> given to xen domUs. >> >> I was just preparing an experiment, where I created a 100G file on the host: >> # truncate -s 100G /srv/nfs/domU/disk2 >> And after added this disk to the instance's configuration. Have you tried creating the file with dd instead of truncate? (so it's not sparse) >> On the host this is the mountpoint: >> # mount|grep srv/xen >> 10.1.1.1:/mnt/main/vps on /srv/xen type nfs (rw,relatime,vers=3,rsize=16384,wsize=16384,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.1.1.1,mountvers=3,mountport=4045,mountproto=udp,local_lock=none,addr=10.1.1.1) >> >> After starting the instance I partitioned the disk with gdisk, and created >> an xfs fs on it. While the fs has been created well, strange messages >> appeared on the console: AFAICT this is the guest console. Is there any corresponding error on the host console? >> [ 23.787504] blk_update_request: I/O error, dev xvdc, sector 2048 >> [ 23.788904] blk_update_request: I/O error, dev xvdc, sector 8390655 >> [ 23.789611] blk_update_request: I/O error, dev xvdc, sector 16779262 >> [ 23.790359] blk_update_request: I/O error, dev xvdc, sector 25167869 >> [ 23.791148] blk_update_request: I/O error, dev xvdc, sector 33556476 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 41945083 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 50333690 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 58722297 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 67110904 >> [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 75499511 >> >> I dont think that this is normal. If I chose a local block device (probably >> lvm) for the domU, this does not appear. IIRC Xen 4.4 still uses Qemu (Qdisk) for raw disks, do you have any kind of errors/warnings in /var/log/xen/qemu-dm-<domain_name>.log? Roger. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) 2016-01-12 12:05 ` Wei Liu 2016-01-12 12:58 ` blk_update_request: I/O error on NFS Roger Pau Monné 2016-01-12 12:58 ` Roger Pau Monné @ 2016-01-27 17:40 ` Konrad Rzeszutek Wilk 2 siblings, 0 replies; 6+ messages in thread From: Konrad Rzeszutek Wilk @ 2016-01-27 17:40 UTC (permalink / raw) To: Wei Liu Cc: Xen-devel, Kojedzinszky Richárd, linux-nfs, Roger Pau Monné On Tue, Jan 12, 2016 at 12:05:48PM +0000, Wei Liu wrote: > Drop xen-users@, CC xen-devel@ and blk maintainers, change title. > What is the MTU you are using? How do you mount the disk? > On Mon, Jan 11, 2016 at 03:08:24PM +0100, Kojedzinszky Richárd wrote: > > Dear all, > > > > We are facing a regular lockup with our xen setup. We have an nfs share > > mounted on the xen dom0, where the vm images are served, and those files are > > given to xen domUs. > > > > I was just preparing an experiment, where I created a 100G file on the host: > > # truncate -s 100G /srv/nfs/domU/disk2 > > And after added this disk to the instance's configuration. > > > > On the host this is the mountpoint: > > # mount|grep srv/xen > > 10.1.1.1:/mnt/main/vps on /srv/xen type nfs (rw,relatime,vers=3,rsize=16384,wsize=16384,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.1.1.1,mountvers=3,mountport=4045,mountproto=udp,local_lock=none,addr=10.1.1.1) > > > > After starting the instance I partitioned the disk with gdisk, and created > > an xfs fs on it. While the fs has been created well, strange messages > > appeared on the console: > > > > [ 23.787504] blk_update_request: I/O error, dev xvdc, sector 2048 > > [ 23.788904] blk_update_request: I/O error, dev xvdc, sector 8390655 > > [ 23.789611] blk_update_request: I/O error, dev xvdc, sector 16779262 > > [ 23.790359] blk_update_request: I/O error, dev xvdc, sector 25167869 > > [ 23.791148] blk_update_request: I/O error, dev xvdc, sector 33556476 > > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 41945083 > > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 50333690 > > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 58722297 > > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 67110904 > > [ 23.791498] blk_update_request: I/O error, dev xvdc, sector 75499511 > > > > I dont think that this is normal. If I chose a local block device (probably > > lvm) for the domU, this does not appear. > > > > The host is running xen-4.4 with 3.16.0-4-amd64 kernel (debian jessie > > stock), the domU is running 4.3.0-0.bpo.1-amd64 (jessie backport, 4.4.4). > > > > I suspect those messages should not be there. > > > > Regards, > > > > Kojedzinszky Richárd > > Euronet Magyarorszag Informatika Zrt. > > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xen.org > > http://lists.xen.org/xen-users > ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2016-01-27 17:40 UTC | newest] Thread overview: 6+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2016-01-11 14:08 xen domU disk on nfs shared file Kojedzinszky Richárd 2016-01-12 12:05 ` blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) Wei Liu 2016-01-12 12:05 ` Wei Liu 2016-01-12 12:58 ` blk_update_request: I/O error on NFS Roger Pau Monné 2016-01-12 12:58 ` Roger Pau Monné 2016-01-27 17:40 ` blk_update_request: I/O error on NFS (was: [Xen-users] xen domU disk on nfs shared file) Konrad Rzeszutek Wilk
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.