ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Brian Wolfe]

Well, finally I have bit the bullet and cut the debs. :) These are
probably FULL of bugs, mistakes and outright wrong methods of packaging.
SO, use at your own risk! If it eats your lunch, sorry!

http://www.terrabox.com/debian/

Files: *_1.3-20040819_*.deb

Notes of interest:

 If you notice that the packages do NOT contain any XenLinux kernels,
don't worry. I pakcaged it that way intentionally. WIth the vast array
of configuration options now possible with XenLinux 2.4 and 2.6 I
decided that it would make more sense to split XenLinux kernel creation
and Xen kernel creation into 2 systems.  The XenLinux kernels will be
creted using the patch sets generated and XenLinux-Builder.

XenLinux Builder:

XenLinux-Build 0.1 is also available there. It's a first attempt at
building a slightly inteligent packager for XenLinux kernels. Right now
it only creates tarballs. The next version I hope to have it creating
deb files. It's based on the Debian kernel-source and kernel-patches
filesets. Anyways, standard bleeding edge warnings apply here as well,
even though I'm using it to generate my production XenLinux kernels. ;)

Main Intents:

a: multiple config source file handling, 
b: simplify building a XenLinux kernel from the admin's perspective.
c: separate Xen* guest OS kernel building from the main Xen package.
d: other reasons I forget I thought of. heh

TODO: 

--Create debian style kernel-headers tarball/deb/whatever filesets for
compiling modules against.
--Manage specification of 3rd party patch files on the kernel source
tree.
--Create deb targets.
--Create RPM targets.(any volunteers? I'm totally unfamiliar with rpm.)
--Have the package copy the build environment files to a new location
via setupXenBuilder script. (preserves pristine original build files in
usr/share/xen-builder)
--whatever else makes sense to be handled here. :)

Comments, questions, gripes, and advice is all welcome on all of the
packages. :) Patches are definitly more than welcome. I'll eventually
submit the debian/* file tree from my patchset to the wonderful Xen
maintainers for inclusion once things look to be stable.

I'll cut a new set of the latest in the next few days once I see a
version of Xen that appears to be stable enough to be worth it. :) Gotta
love a moving target. *grin*

Laters!
Brian Wolfe
TerraBox.com Inc.



-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285

Re: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Rik van Riel]

On Wed, 25 Aug 2004, Brian Wolfe wrote:

> Well, finally I have bit the bullet and cut the debs. :) These are
> probably FULL of bugs, mistakes and outright wrong methods of packaging.
> SO, use at your own risk! If it eats your lunch, sorry!

I've decided to hold out on building RPMs for a bit more
for two reasons:

1) the kernel/hypervisor interface might still change
   before 2.0, so it's probably best if people keep
   building them together

2) rpm crashes inside xenU, doing gettimeofday, sleep
   and then another gettimeofday, probably a divide by
   zero

In short, I'll be spending my effort trying to get a few
obvious bugs fixed before inviting other people over to
discover more bugs ;)

-- 
"Debugging is twice as hard as writing the code in the first place.
Therefore, if you write the code as cleverly as possible, you are,
by definition, not smart enough to debug it." - Brian W. Kernighan



-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285

RE: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[James Harper]

[-- Attachment #1: Type: text/plain, Size: 3445 bytes --]

at this stage what would be really useful to me is a way to do the bk pull ; make world as normal, but then do a make debian which would build me some packages, probably xen0, xenU, xend & xendsv, but not do any of the compilation (as it's already been done).

If I knew the tinyest bit about the debian packaging I could probably do this myself, but i don't.

james

 



From: Brian Wolfe
Sent: Thu 26/08/2004 3:45 AM
To: xen-devel@lists.sourceforge.net
Subject: [Xen-devel] ANOUNCEMENT:  Debian packages for xen built on 2004-08-19 bk source


Well, finally I have bit the bullet and cut the debs. :) These are
probably FULL of bugs, mistakes and outright wrong methods of packaging.
SO, use at your own risk! If it eats your lunch, sorry!

http://www.terrabox.com/debian/

Files: *_1.3-20040819_*.deb

Notes of interest:

 If you notice that the packages do NOT contain any XenLinux kernels,
don't worry. I pakcaged it that way intentionally. WIth the vast array
of configuration options now possible with XenLinux 2.4 and 2.6 I
decided that it would make more sense to split XenLinux kernel creation
and Xen kernel creation into 2 systems.  The XenLinux kernels will be
creted using the patch sets generated and XenLinux-Builder.

XenLinux Builder:

XenLinux-Build 0.1 is also available there. It's a first attempt at
building a slightly inteligent packager for XenLinux kernels. Right now
it only creates tarballs. The next version I hope to have it creating
deb files. It's based on the Debian kernel-source and kernel-patches
filesets. Anyways, standard bleeding edge warnings apply here as well,
even though I'm using it to generate my production XenLinux kernels. ;)

Main Intents:

a: multiple config source file handling, 
b: simplify building a XenLinux kernel from the admin's perspective.
c: separate Xen* guest OS kernel building from the main Xen package.
d: other reasons I forget I thought of. heh

TODO: 

--Create debian style kernel-headers tarball/deb/whatever filesets for
compiling modules against.
--Manage specification of 3rd party patch files on the kernel source
tree.
--Create deb targets.
--Create RPM targets.(any volunteers? I'm totally unfamiliar with rpm.)
--Have the package copy the build environment files to a new location
via setupXenBuilder script. (preserves pristine original build files in
usr/share/xen-builder)
--whatever else makes sense to be handled here. :)

Comments, questions, gripes, and advice is all welcome on all of the
packages. :) Patches are definitly more than welcome. I'll eventually
submit the debian/* file tree from my patchset to the wonderful Xen
maintainers for inclusion once things look to be stable.

I'll cut a new set of the latest in the next few days once I see a
version of Xen that appears to be stable enough to be worth it. :) Gotta
love a moving target. *grin*

Laters!
Brian Wolfe
TerraBox.com Inc.



-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xen-devel

[-- Attachment #2: Type: text/html, Size: 4082 bytes --]

RE: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Brian Wolfe]

[-- Attachment #1: Type: text/plain, Size: 3891 bytes --]

weeeel, I DO have the start of a makefile that will do most of this for
you. I suppose I could be talked into tossing that out as well. ;) No
promises that it will work for you though since it was a one-off script
for myself. 

Brian

On Wed, 2004-08-25 at 22:38, James Harper wrote:
> at this stage what would be really useful to me is a way to do the bk
> pull ; make world as normal, but then do a make debian which would
> build me some packages, probably xen0, xenU, xend & xendsv, but not do
> any of the compilation (as it's already been done).
>  
> If I knew the tinyest bit about the debian packaging I could probably
> do this myself, but i don't.
>  
> james
>  
> 
> ______________________________________________________________________
> From: Brian Wolfe
> Sent: Thu 26/08/2004 3:45 AM
> To: xen-devel@lists.sourceforge.net
> Subject: [Xen-devel] ANOUNCEMENT:  Debian packages for xen built on
> 2004-08-19 bk source
> 
> 
> Well, finally I have bit the bullet and cut the debs. :) These are
> probably FULL of bugs, mistakes and outright wrong methods of packaging.
> SO, use at your own risk! If it eats your lunch, sorry!
> 
> http://www.terrabox.com/debian/
> 
> Files: *_1.3-20040819_*.deb
> 
> Notes of interest:
> 
>  If you notice that the packages do NOT contain any XenLinux kernels,
> don't worry. I pakcaged it that way intentionally. WIth the vast array
> of configuration options now possible with XenLinux 2.4 and 2.6 I
> decided that it would make more sense to split XenLinux kernel creation
> and Xen kernel creation into 2 systems.  The XenLinux kernels will be
> creted using the patch sets generated and XenLinux-Builder.
> 
> XenLinux Builder:
> 
> XenLinux-Build 0.1 is also available there. It's a first attempt at
> building a slightly inteligent packager for XenLinux kernels. Right now
> it only creates tarballs. The next version I hope to have it creating
> deb files. It's based on the Debian kernel-source and kernel-patches
> filesets. Anyways, standard bleeding edge warnings apply here as well,
> even though I'm using it to generate my production XenLinux kernels. ;)
> 
> Main Intents:
> 
> a: multiple config source file handling, 
> b: simplify building a XenLinux kernel from the admin's perspective.
> c: separate Xen* guest OS kernel building from the main Xen package.
> d: other reasons I forget I thought of. heh
> 
> TODO: 
> 
> --Create debian style kernel-headers tarball/deb/whatever filesets for
> compiling modules against.
> --Manage specification of 3rd party patch files on the kernel source
> tree.
> --Create deb targets.
> --Create RPM targets.(any volunteers? I'm totally unfamiliar with rpm.)
> --Have the package copy the build environment files to a new location
> via setupXenBuilder script. (preserves pristine original build files in
> usr/share/xen-builder)
> --whatever else makes sense to be handled here. :)
> 
> Comments, questions, gripes, and advice is all welcome on all of the
> packages. :) Patches are definitly more than welcome. I'll eventually
> submit the debian/* file tree from my patchset to the wonderful Xen
> maintainers for inclusion once things look to be stable.
> 
> I'll cut a new set of the latest in the next few days once I see a
> version of Xen that appears to be stable enough to be worth it. :) Gotta
> love a moving target. *grin*
> 
> Laters!
> Brian Wolfe
> TerraBox.com Inc.
> 
> 
> 
> -------------------------------------------------------
> SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
> 100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
> Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
> http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xen-devel

[-- Attachment #2: Makefile --]
[-- Type: text/x-makefile, Size: 457 bytes --]

DATESTAMP	:= $(shell date +"%Y%m%d")
XEN_VER		:= 1.3
BKDIR		:= xen-$(XEN_VER)-$(DATESTAMP)
BKBASE		:= xeno-unstable.bk


all:
	@echo Creating dist tarball $(BKDIR) 
	cd $(BKBASE) ;\
	bk pull ;\
	bk changes > ../ChangeLog ;\
	bk export ../$(BKDIR) 
	mv ChangeLog $(BKDIR)/
	tar -clzpsf $(BKDIR).tar.gz $(BKDIR)
	@echo Done.

mkdeb:
	mv $(BKDIR) $(BKDIR).orig

values:
	@echo DATESTAMP       == $(DATESTAMP)
	@echo BKDIR           == $(BKDIR)

.PHONY: values

Re: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Ian Pratt]

> I've decided to hold out on building RPMs for a bit more
> for two reasons:
> 
> 1) the kernel/hypervisor interface might still change
>    before 2.0, so it's probably best if people keep
>    building them together

I think what we're going to do is to declare a 2.0 beta at the
end of the week, in the hope that we encourage a few more
existing 1.2 users to try 2.0 and get feedback.

There are a couple of remaining things we're planning to do
before the final 2.0 release:

 * switch over to using Xen's new foreign-page grant-table
mechanism, which is a useful interface clean up for domains
wishing to share pages in a safe fashion.

 * upgrade to 2.8.6.1. This shouldn't be more than a few hours
work, but its really boring ;-)

 * do a few MMU optimisations to the 2.6 / Xen interface. In
particular we want to switch over to using the writeable page
tables mechanism by default. We should be able to get 2.6
performance as good as 2.4. It's not bad right now, but we know
we can do better.

 
> 2) rpm crashes inside xenU, doing gettimeofday, sleep
>    and then another gettimeofday, probably a divide by
>    zero

Ouch -- I haven't seen a crash for quite a while. We had a bunch
of problems with time in 2.6 a couple weeks back, but I thought
we'd put that behind us...

Running rpm under FC2 in a XenU domain seems to work fine for me,
so I think it might be something more subtle. 

Feel free to post crash dumps ;-) 

Ian


-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285

Re: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Brian Wolfe]

I know that heartbeat inside a priv XenLinux 2.6.7 crashes silently. It
fails on locking memory as non-swapable from what I could tell of strace
and whatnot. 8-P

I talked with Adam earlier tonight about taking over the debian
packaging of Xen. Obviously I'll avail myself of his experience in
managing Debianisms. :)

I too used a redhat install in a XenU domain today, as well as in a Xen0
domain. No glitches that I could see while installing packages. Good
luck in finding the cause Rik. :)

I'll wait until the beta is declared before I cut a new set of debs.
Hopefully I'll have nailed a few more XenLinux-Builder features and a
few Xen packaging bugs by then as well. I got my gpg key signed today so
hopefully I can start tossing the debs at Adam to be submitted to the
unstable and then testing archives on the main debian mirrors along with
XenLinux-Builder.

Has anyone here gotten an iSCSI initiator and/or iSCSI target
modules/daemons working on a debian system? If so I'd love to find out
what package and kernel you got them working on specificly so I can
package them up as well. My first encounter with 4 different iSCSI
packages has been less than happy on 2.6.7. 8-/ 

Brian


On Thu, 2004-08-26 at 02:50, Ian Pratt wrote:
> > I've decided to hold out on building RPMs for a bit more
> > for two reasons:
> > 
> > 1) the kernel/hypervisor interface might still change
> >    before 2.0, so it's probably best if people keep
> >    building them together
> 
> I think what we're going to do is to declare a 2.0 beta at the
> end of the week, in the hope that we encourage a few more
> existing 1.2 users to try 2.0 and get feedback.
> 
> There are a couple of remaining things we're planning to do
> before the final 2.0 release:
> 
>  * switch over to using Xen's new foreign-page grant-table
> mechanism, which is a useful interface clean up for domains
> wishing to share pages in a safe fashion.
> 
>  * upgrade to 2.8.6.1. This shouldn't be more than a few hours
> work, but its really boring ;-)
> 
>  * do a few MMU optimisations to the 2.6 / Xen interface. In
> particular we want to switch over to using the writeable page
> tables mechanism by default. We should be able to get 2.6
> performance as good as 2.4. It's not bad right now, but we know
> we can do better.
> 
>  
> > 2) rpm crashes inside xenU, doing gettimeofday, sleep
> >    and then another gettimeofday, probably a divide by
> >    zero
> 
> Ouch -- I haven't seen a crash for quite a while. We had a bunch
> of problems with time in 2.6 a couple weeks back, but I thought
> we'd put that behind us...
> 
> Running rpm under FC2 in a XenU domain seems to work fine for me,
> so I think it might be something more subtle. 
> 
> Feel free to post crash dumps ;-) 
> 
> Ian



-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285

Re: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Rik van Riel]

On Thu, 26 Aug 2004, Ian Pratt wrote:

> > 2) rpm crashes inside xenU, doing gettimeofday, sleep
> >    and then another gettimeofday, probably a divide by
> >    zero

> Running rpm under FC2 in a XenU domain seems to work fine for me,
> so I think it might be something more subtle. 

It works sometimes, but not all the time.

It appears that the timer ticks don't always run, or
at least the wall clock can just stop for a while.

Of course, vmstat crashes with a divide by zero too,
since xen guests don't increment idle time and vmstat
ends up doing a divide by zero.  I'll figure out how
Xen timing works and will post a patch, if I've got
the time this week.

> Feel free to post crash dumps ;-) 

Will do.

-- 
"Debugging is twice as hard as writing the code in the first place.
Therefore, if you write the code as cleverly as possible, you are,
by definition, not smart enough to debug it." - Brian W. Kernighan



-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285

RE: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[James Harper]

[-- Attachment #1: Type: text/plain, Size: 4411 bytes --]

I tried a combination 'iSCSI Enterprise Target' (http://sourceforge.net/projects/iscsitarget/) (v0.2.6  but i think 0.3.0 is out now) + 'Linux-iSCSI Project' (http://linux-iscsi.sourceforge.net/). Unfortunately, after finally getting network booting working I found I was getting massive and almost immediate filesystem corruption. Both are running under xen which places a rather large number of variables into the equation, so I have no idea what is causing what.

I'm now battling with unh-iscsi (http://unh-iscsi.sourceforge.net/) which provides a target and an initiator, but looks like it needs a bit of hand holding to get running (changes to .h files to modify config, no init scripts, clumsy admin tools). It does support linux 2.6 though.

If I can get it working, i'll be trying the Linux-iSCSI initiator against the unh-iscsi target tonight.

James



From: Brian Wolfe
Sent: Thu 26/08/2004 6:32 PM
To: Ian Pratt
Cc: Rik van Riel; xen-devel@lists.sourceforge.net
Subject: Re: [Xen-devel] ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source


I know that heartbeat inside a priv XenLinux 2.6.7 crashes silently. It
fails on locking memory as non-swapable from what I could tell of strace
and whatnot. 8-P

I talked with Adam earlier tonight about taking over the debian
packaging of Xen. Obviously I'll avail myself of his experience in
managing Debianisms. :)

I too used a redhat install in a XenU domain today, as well as in a Xen0
domain. No glitches that I could see while installing packages. Good
luck in finding the cause Rik. :)

I'll wait until the beta is declared before I cut a new set of debs.
Hopefully I'll have nailed a few more XenLinux-Builder features and a
few Xen packaging bugs by then as well. I got my gpg key signed today so
hopefully I can start tossing the debs at Adam to be submitted to the
unstable and then testing archives on the main debian mirrors along with
XenLinux-Builder.

Has anyone here gotten an iSCSI initiator and/or iSCSI target
modules/daemons working on a debian system? If so I'd love to find out
what package and kernel you got them working on specificly so I can
package them up as well. My first encounter with 4 different iSCSI
packages has been less than happy on 2.6.7. 8-/ 

Brian


On Thu, 2004-08-26 at 02:50, Ian Pratt wrote:
> > I've decided to hold out on building RPMs for a bit more
> > for two reasons:
> > 
> > 1) the kernel/hypervisor interface might still change
> >    before 2.0, so it's probably best if people keep
> >    building them together
> 
> I think what we're going to do is to declare a 2.0 beta at the
> end of the week, in the hope that we encourage a few more
> existing 1.2 users to try 2.0 and get feedback.
> 
> There are a couple of remaining things we're planning to do
> before the final 2.0 release:
> 
>  * switch over to using Xen's new foreign-page grant-table
> mechanism, which is a useful interface clean up for domains
> wishing to share pages in a safe fashion.
> 
>  * upgrade to 2.8.6.1. This shouldn't be more than a few hours
> work, but its really boring ;-)
> 
>  * do a few MMU optimisations to the 2.6 / Xen interface. In
> particular we want to switch over to using the writeable page
> tables mechanism by default. We should be able to get 2.6
> performance as good as 2.4. It's not bad right now, but we know
> we can do better.
> 
>  
> > 2) rpm crashes inside xenU, doing gettimeofday, sleep
> >    and then another gettimeofday, probably a divide by
> >    zero
> 
> Ouch -- I haven't seen a crash for quite a while. We had a bunch
> of problems with time in 2.6 a couple weeks back, but I thought
> we'd put that behind us...
> 
> Running rpm under FC2 in a XenU domain seems to work fine for me,
> so I think it might be something more subtle. 
> 
> Feel free to post crash dumps ;-) 
> 
> Ian



-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xen-devel

[-- Attachment #2: Type: text/html, Size: 5428 bytes --]

Re: RE: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Niraj Tolia]

James,

Go here <http://www.zaal.org/iscsi/> for help on how to get the
linux-iscsi initiator to talk to the UNH target. You might also need
to apply the attached patch at
<http://sourceforge.net/tracker/index.php?func=detail&aid=979782&group_id=77733&atid=551069>
to the UNH target to get it to work with the Cisco initiator.

I managed to get the UNH and linux-iscsi (3.4.3) initiators to talk to
the UNH target. I ran the initiators both under Xen and on vanilla
Linux. However this was with a 2.4 kernel.

Also, any particular reason for running the targets under Xen?

Niraj

----- Original Message -----
From: James Harper <jamesh@bendigoit.com.au>
Date: Thu, 26 Aug 2004 21:14:39 +1000
Subject: RE: [Xen-devel] ANOUNCEMENT: Debian packages for xen built on
	2004-08-19 bk source
To: brianw@terrabox.com, Ian Pratt <ian.pratt@cl.cam.ac.uk>
Cc: Rik van Riel <riel@redhat.com>, xen-devel@lists.sourceforge.net

 
 
I tried a combination 'iSCSI Enterprise Target'
(http://sourceforge.net/projects/iscsitarget/) (v0.2.6  but i think
0.3.0 is out now) + 'Linux-iSCSI Project'
(http://linux-iscsi.sourceforge.net/). Unfortunately, after finally
getting network booting working I found I was getting massive and
almost immediate filesystem corruption. Both are running under xen
which places a rather large number of variables into the equation, so
I have no idea what is causing what.
  
I'm now battling with unh-iscsi (http://unh-iscsi.sourceforge.net/)
which provides a target and an initiator, but looks like it needs a
bit of hand holding to get running (changes to .h files to modify
config, no init scripts, clumsy admin tools). It does support linux
2.6 though.
  
If I can get it working, i'll be trying the Linux-iSCSI initiator
against the unh-iscsi target tonight.
  
James


-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285

Re: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Ian Pratt]

> > Running rpm under FC2 in a XenU domain seems to work fine for me,
> > so I think it might be something more subtle. 
> 
> It works sometimes, but not all the time.
> 
> It appears that the timer ticks don't always run, or
> at least the wall clock can just stop for a while.

I've seen it stop for a handfull of microseconds when Xen is
doing its occasional resynchronisation with the RTC, but nothing
significant (this sort of thing happens normally if you are
running NTP anyhow). BTW: are you running NTP in dom0, or is Xen
running off the RTC?

[Xen/Linux 2.6 used to have a number of time problems, which
caused me to write the appended little program to help figure out
what was going in. I've just run it on our 2.6.7 and it doesn't
print anything, which is a good sign that gettimeofday is OK.]

> Of course, vmstat crashes with a divide by zero too,
> since xen guests don't increment idle time and vmstat
> ends up doing a divide by zero.  I'll figure out how
> Xen timing works and will post a patch, if I've got
> the time this week.

In 2.6, it looks like we're not accounting time spent in the idle
task, which is a bug (it works OK under 2.4).

The vmstat from RH9 is at least smart enough not to divide by
zero, though...

Ian



#include <stdlib.h>
#include <stdio.h>
#include <sys/time.h>

/**************************************************************************/


/* rpcc: get full 64-bit Pentium TSC value */
static __inline__ unsigned long long int rpcc(void) 
{
    unsigned int __h, __l;
    __asm__ __volatile__ ("rdtsc" :"=a" (__l), "=d" (__h));
    return (((unsigned long long)__h) << 32) + __l;
}


/*
 * find_cpu_speed:
 *   Interrogates /proc/cpuinfo for the processor clock speed.
 * 
 *   Returns: speed of processor in MHz, rounded down to nearest whole MHz.
 */
#define MAX_LINE_LEN 50
int find_cpu_speed(void)
{
    FILE *f;
    char s[MAX_LINE_LEN], *a, *b;

    if ( (f = fopen("/proc/cpuinfo", "r")) == NULL ) goto out;

    while ( fgets(s, MAX_LINE_LEN, f) )
    {
        if ( strstr(s, "cpu MHz") )
        {
            /* Find the start of the speed value, and stop at the dec point. */
            if ( !(a=strpbrk(s,"0123456789")) || !(b=strpbrk(a,".")) ) break;
            *b = '\0';
            fclose(f);
            return(atoi(a));
        }
    }

 out:
    fprintf(stderr, "find_cpu_speed: error parsing /proc/cpuinfo for cpu MHz");
    exit(1);
}

int mhz;


main()
{
    int stride;
    unsigned long long start=0,stop=0, last=0, now, gt_firsteventtime;
    unsigned long long xnow, xlast, skip;
    unsigned long long firsteventtime=0, lasteventtime, lastfirsteventtime = 0;
    struct timeval a,b;
    int count=0, okcount=0;

    /* Required in order to print intermediate results at fixed period. */
    mhz = find_cpu_speed();
    printf("CPU speed = %d MHz\n", mhz);

    start = rpcc();
    while(1)
    {
	gettimeofday(&a, NULL);
	xnow = rpcc();

	if(xnow < xlast)
	    printf("** %lld %lld **\n", xnow, xlast);

        now = (((long long)a.tv_sec) * 1000000) + a.tv_usec;

	if(now<last)
	{
	    printf("backwards!\n");
	    exit(-1);
	}

	if(now==last) 
	{
	    count++;
	    lasteventtime = rpcc();
	    if( firsteventtime == 0 ) 
	    {
		firsteventtime = lasteventtime;
		gt_firsteventtime = now;
		skip = (xnow-xlast)/mhz;
	    }

	}

	if(now>last)
	{
	    if(count>5)
	    {
		printf("[%lld.%lld %lld] duplicates= % 5d (% 5lldus)\t prev OK= % 6d\t fe %lldus (d=%lldus) skip = %lld\n",
		       gt_firsteventtime/1000000,gt_firsteventtime%1000000,
		       firsteventtime,
		       count, (lasteventtime-firsteventtime)/mhz,
		       okcount,(firsteventtime-start)/mhz,
		       (firsteventtime-lastfirsteventtime)/mhz,
		       skip);
		okcount = 0;
		lastfirsteventtime = firsteventtime;
	    }
	    count = 0;
	    firsteventtime = 0;
	    okcount++;
	}
	
	last = now;
	xlast = xnow;
    }



}


-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285

RE: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Brian Wolfe]

On Thu, 2004-08-26 at 06:14, James Harper wrote:
> I tried a combination 'iSCSI Enterprise Target'
> (http://sourceforge.net/projects/iscsitarget/) (v0.2.6  but i think
> 0.3.0 is out now) + 'Linux-iSCSI Project'
> (http://linux-iscsi.sourceforge.net/). Unfortunately, after finally
> getting network booting working I found I was getting massive and
> almost immediate filesystem corruption. Both are running under xen
> which places a rather large number of variables into the equation, so
> I have no idea what is causing what.

urk! Not good.

>  
> I'm now battling with unh-iscsi (http://unh-iscsi.sourceforge.net/)
> which provides a target and an initiator, but looks like it needs a
> bit of hand holding to get running (changes to .h files to modify
> config, no init scripts, clumsy admin tools). It does support linux
> 2.6 though.

*nod* this is the one that had me tearing my hair out. ;-P 

What all have you patched on it so far? I"m stalled at one point where
it seems gcc is getting very confused in defines and structures from
socket.h and in.h. 8-(

>  
> If I can get it working, i'll be trying the Linux-iSCSI initiator
> against the unh-iscsi target tonight.
>  
> James

Feel free to toss me a patchset for it if you would once it's compiling
at least. :) Thanks!
> 
> ______________________________________________________________________
** trimmed bunch of backlog **




-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285

Re: ANOUNCEMENT: Debian packages for xen built on 2004-08-19 bk source

[Ian Pratt]

> > Of course, vmstat crashes with a divide by zero too,
> > since xen guests don't increment idle time and vmstat
> > ends up doing a divide by zero.  I'll figure out how
> > Xen timing works and will post a patch, if I've got
> > the time this week.
> 
> In 2.6, it looks like we're not accounting time spent in the idle
> task, which is a bug (it works OK under 2.4).

I believe this to now be fixed: the test in ptrace.h to determine
whether we were in user or system mode was broken as it was
looking for ring 0 rather than ring 1.

FC2 vmstat now no longer segfaults, at least for me.

Ian


-------------------------------------------------------
SF.Net email is sponsored by Shop4tech.com-Lowest price on Blank Media
100pk Sonic DVD-R 4x for only $29 -100pk Sonic DVD+R for only $33
Save 50% off Retail on Ink & Toner - Free Shipping and Free Gift.
http://www.shop4tech.com/z/Inkjet_Cartridges/9_108_r285