q-tools-0.0 released

q-tools-0.0 released

[David Mosberger]

[-- Attachment #1: message body text --]
[-- Type: text/plain, Size: 1136 bytes --]

OK, I guess I'm running very late with releasing it this week, but
better late than never: I finally got around to releasing a _snaphot_
of my profiling tools.  They're very rough, but I think they might be
useful to a number of projects even in their current rough shape.  I
have ideas and plans for many improvements but don't expect to find
time to work on q-tools for the next couple of weeks so either you'll
have to live with the current limitations or start sending
patches---either way is fine with me... ;-)

You can get q-tools from:

 ftp://ftp.hpl.hp.com/pub/linux-ia64/q-tools-0.0.tar.gz

There is a README in there which should contain everything needed to
get you started (if not, complain and I'll fix it).  Just as a teaser,
below is a picture you'd get when running the following commands on an
Itanium 2 machine with q-tools installed:

 $ q-syscollect -k -t 10
 $ q-dot kernel-cpu0.info | dot -Tps -Gcenter,rotate=90,size=10.75 | gv

Note that q-tools is all user-level stuff.  There are no kernel
modules or patches of any sort required (apart from the normal perfmon
support in the 2.6 kernel).

Enjoy,

	--david


[-- Attachment #2: call-graph for idle kernel --]
[-- Type: image/png, Size: 47745 bytes --]

Re: q-tools-0.0 released

[Grant Grundler]

On Sat, Dec 06, 2003 at 05:17:20PM -0800, David Mosberger wrote:
> I finally got around to releasing a _snaphot_ of my profiling tools.
...

> You can get q-tools from:
> 
>  ftp://ftp.hpl.hp.com/pub/linux-ia64/q-tools-0.0.tar.gz

Is there a newer version of the tools?
I tried to build this on a Debian "testing" box and got:
gsyprf3:/usr/src/q-tools-0.0# make
make[1]: Entering directory `/usr/src/q-tools-0.0/q-syscollect'
cc -g -O2 -Wall -D_GNU_SOURCE -I.  -c -o q-syscollect.o q-syscollect.c
q-syscollect.c:34:29: perfmon/perfmon.h: No such file or directory
q-syscollect.c:35:42: perfmon/perfmon_default_smpl.h: No such file or directory
q-syscollect.c:36:28: perfmon/pfmlib.h: No such file or directory
q-syscollect.c:37:37: perfmon/pfmlib_itanium2.h: No such file or directory
q-syscollect.c:131: error: parse error before "pd"
...


> There is a README in there which should contain everything needed to
> get you started (if not, complain and I'll fix it).

Ok! :^)

thanks,
grant

ps. looks very cool and I have a need for it.

Re: q-tools-0.0 released

[Grant Grundler]

On Thu, Feb 05, 2004 at 01:50:09PM -0800, Grant Grundler wrote:
> > You can get q-tools from:
> > 
> >  ftp://ftp.hpl.hp.com/pub/linux-ia64/q-tools-0.0.tar.gz
> 
> Is there a newer version of the tools?
> I tried to build this on a Debian "testing" box and got:
> gsyprf3:/usr/src/q-tools-0.0# make
> make[1]: Entering directory `/usr/src/q-tools-0.0/q-syscollect'
> cc -g -O2 -Wall -D_GNU_SOURCE -I.  -c -o q-syscollect.o q-syscollect.c
> q-syscollect.c:34:29: perfmon/perfmon.h: No such file or directory
> q-syscollect.c:35:42: perfmon/perfmon_default_smpl.h: No such file or directory
> q-syscollect.c:36:28: perfmon/pfmlib.h: No such file or directory
> q-syscollect.c:37:37: perfmon/pfmlib_itanium2.h: No such file or directory
> q-syscollect.c:131: error: parse error before "pd"
> ...

Ok - part of this was resolved by grabbing pfmon-devel-1.1-1.ia64.rpm
from the same FTP location.

Still not finding one of the header files...
gsyprf3:/usr/src/q-tools-0.0# make
make[1]: Entering directory `/usr/src/q-tools-0.0/q-syscollect'
cc -g -O2 -Wall -D_GNU_SOURCE -I.  -c -o q-syscollect.o q-syscollect.c
q-syscollect.c:35:42: perfmon/perfmon_default_smpl.h: No such file or
directory
q-syscollect.c:131: error: `PFMLIB_MAX_PMDS' undeclared here (not in a
function)
q-syscollect.c:137: error: parse error before '*' token
...

Stephane,
Maybe I need newer pfmon "devel" package?

thanks,
grant

Re: q-tools-0.0 released

[Stephane Eranian]

Grant,

On Thu, Feb 05, 2004 at 02:28:24PM -0800, Grant Grundler wrote:
> On Thu, Feb 05, 2004 at 01:50:09PM -0800, Grant Grundler wrote:
> > > You can get q-tools from:
> > > 
> > >  ftp://ftp.hpl.hp.com/pub/linux-ia64/q-tools-0.0.tar.gz
> > 
> > Is there a newer version of the tools?
> > I tried to build this on a Debian "testing" box and got:
> > gsyprf3:/usr/src/q-tools-0.0# make
> > make[1]: Entering directory `/usr/src/q-tools-0.0/q-syscollect'
> > cc -g -O2 -Wall -D_GNU_SOURCE -I.  -c -o q-syscollect.o q-syscollect.c
> > q-syscollect.c:34:29: perfmon/perfmon.h: No such file or directory
> > q-syscollect.c:35:42: perfmon/perfmon_default_smpl.h: No such file or directory
> > q-syscollect.c:36:28: perfmon/pfmlib.h: No such file or directory
> > q-syscollect.c:37:37: perfmon/pfmlib_itanium2.h: No such file or directory
> > q-syscollect.c:131: error: parse error before "pd"
> > ...
> 
You need to have libpfm-3.0 installed on your system. I think 
Al Stone published the package on the Debian sites. You need the
development + runtime packages.

If you don't find the Debian package, then download:

	ftp://ftp.hpl.hp.com/pub/linux-ia64/libpfm-3.0.tar.gz

Note that q-tools/libpfm-3.0/pfmon-3.0 ONLY work on 2.6 kernels.

-- 

-Stephane

Re: q-tools-0.0 released

[Grant Grundler]

On Thu, Feb 05, 2004 at 02:57:22PM -0800, Stephane Eranian wrote:
> You need to have libpfm-3.0 installed on your system.
> I think Al Stone published the package on the Debian sites.
> You need the development + runtime packages.

Stephane,
Yes, he did.
Debian currently has:
ii  libpfm         2.0-6          IA-64 Performance Monitor (PMU) -- runt-time
ii  libpfm-dev     2.0-6          IA-64 Performance Monitor (PMU) -- developme
ii  pfmon          3.0-2          a performance monitoring tool for Linux/ia64

The pfmon from debian was probably built against "2.0-6" libpfm.
Is that bad?
I'll try this pfmon under 2.6 and see how that works.

> If you don't find the Debian package, then download:
> 
> 	ftp://ftp.hpl.hp.com/pub/linux-ia64/libpfm-3.0.tar.gz


"make install" default is "DESTDIR=/usr/local".
If I rebuild the pfmon package, it's unlikely to find that by default.

> Note that q-tools/libpfm-3.0/pfmon-3.0 ONLY work on 2.6 kernels.

yup - that's what I'm using here.

BTW, Once this is resolved,  someone will need to update the "README"
for q-tools or create a debian package for q-tools.

thanks,
grant

Re: q-tools-0.0 released

[Stephane Eranian]

Grant,

On Thu, Feb 05, 2004 at 09:05:21PM -0800, Grant Grundler wrote:
> On Thu, Feb 05, 2004 at 02:57:22PM -0800, Stephane Eranian wrote:
> > You need to have libpfm-3.0 installed on your system.
> > I think Al Stone published the package on the Debian sites.
> > You need the development + runtime packages.
> 
> Stephane,
> Yes, he did.
> Debian currently has:
> ii  libpfm         2.0-6          IA-64 Performance Monitor (PMU) -- runt-time
> ii  libpfm-dev     2.0-6          IA-64 Performance Monitor (PMU) -- developme
> ii  pfmon          3.0-2          a performance monitoring tool for Linux/ia64
> 
> The pfmon from debian was probably built against "2.0-6" libpfm.
That's wrong. I don't event think it compiles that way.

> Is that bad?
Yes, it is. there should be a libpfm_3.0 and libpfm-dev_3.0 packages.


-- 

-Stephane

Re: q-tools-0.0 released

[Matthew Wilcox]

On Thu, Feb 05, 2004 at 11:26:47PM -0800, Stephane Eranian wrote:
> Grant,
> 
> On Thu, Feb 05, 2004 at 09:05:21PM -0800, Grant Grundler wrote:
> > On Thu, Feb 05, 2004 at 02:57:22PM -0800, Stephane Eranian wrote:
> > > You need to have libpfm-3.0 installed on your system.
> > > I think Al Stone published the package on the Debian sites.
> > > You need the development + runtime packages.
> > 
> > Stephane,
> > Yes, he did.
> > Debian currently has:
> > ii  libpfm         2.0-6          IA-64 Performance Monitor (PMU) -- runt-time
> > ii  libpfm-dev     2.0-6          IA-64 Performance Monitor (PMU) -- developme
> > ii  pfmon          3.0-2          a performance monitoring tool for Linux/ia64
> > 
> > The pfmon from debian was probably built against "2.0-6" libpfm.
> That's wrong. I don't event think it compiles that way.
> 
> > Is that bad?
> Yes, it is. there should be a libpfm_3.0 and libpfm-dev_3.0 packages.

Looks like the Debian packages have some problems:

Package: pfmon
Depends: libc6.1 (>= 2.3.2.ds1-4), libelfg0, libpfm2, libpfm3
$ sudo apt-get install pfmon
The following packages have unmet dependencies:
  pfmon: Depends: libpfm2 but it is not installable
         Depends: libpfm3 but it is not installable

Al, what's up?

-- 
"Next the statesmen will invent cheap lies, putting the blame upon 
the nation that is attacked, and every man will be glad of those
conscience-soothing falsities, and will diligently study them, and refuse
to examine any refutations of them; and thus he will by and by convince 
himself that the war is just, and will thank God for the better sleep 
he enjoys after this process of grotesque self-deception." -- Mark Twain

Re: q-tools-0.0 released

[Al Stone]

On Fri, 2004-02-06 at 05:24, Matthew Wilcox wrote:
> On Thu, Feb 05, 2004 at 11:26:47PM -0800, Stephane Eranian wrote:
> > Grant,
> > 
> > On Thu, Feb 05, 2004 at 09:05:21PM -0800, Grant Grundler wrote:
> > > On Thu, Feb 05, 2004 at 02:57:22PM -0800, Stephane Eranian wrote:
> > > > You need to have libpfm-3.0 installed on your system.
> > > > I think Al Stone published the package on the Debian sites.
> > > > You need the development + runtime packages.
> > > 
> > > Stephane,
> > > Yes, he did.
> > > Debian currently has:
> > > ii  libpfm         2.0-6          IA-64 Performance Monitor (PMU) -- runt-time
> > > ii  libpfm-dev     2.0-6          IA-64 Performance Monitor (PMU) -- developme
> > > ii  pfmon          3.0-2          a performance monitoring tool for Linux/ia64
> > > 
> > > The pfmon from debian was probably built against "2.0-6" libpfm.
> > That's wrong. I don't event think it compiles that way.

No, that is not correct.  The pfmon_3.0-1 packages includes
_both_ the 2.0 and 3.0 pfmon commands plus a wrapper that
determines what kernel is currently being run and execs the
proper pfmon.  Each of the pfmon commands was built using 
the proper version of libpfm.

The pfmon_3.0-1 packages depends on libpfm2_2.0-1 and
libpfm3_3.0-1 (but not the -dev packages).

> > > Is that bad?
> > Yes, it is. there should be a libpfm_3.0 and libpfm-dev_3.0 packages.

There are:
   -- libpfm2 and libpfm2-dev packages.
   -- libpfm3 and libpfm3-dev packages.

Note that I chose to move the location of the header files
in the -dev packages so they wouldn't overwrite one another
(they used to both go in /usr/include/perfmon, but now go in
/usr/include/perfmon2 and /usr/include/perfmon3); the other
alternative was to completely rewrite them and merge them so
they had the proper API for the proper kernel version.  I may
yet do that, but it seemed more important to get the 3.0 stuff
out first.

> Looks like the Debian packages have some problems:
> 
> Package: pfmon
> Depends: libc6.1 (>= 2.3.2.ds1-4), libelfg0, libpfm2, libpfm3
> $ sudo apt-get install pfmon
> The following packages have unmet dependencies:
>   pfmon: Depends: libpfm2 but it is not installable
>          Depends: libpfm3 but it is not installable
> 
> Al, what's up?

Hmmm.  I must have missed a case in my install testing.
pfmon is set up to depend on libpfm2 and libpfm3.  libpfm2
was told to replace libpfm.  It looks like I forgot to tell
it to replace libpfm-dev, too.  Oops.  I'll rebuild and
upload later today.  If you remove libpfm and libpfm-dev
in the meantime, the install should proceed.  Sorry 'bout
that....

-- 
Ciao,
al
----------------------------
Al Stone
Linux & Open Source Lab
Hewlett-Packard Company
E-mail: ahs3@fc.hp.com
----------------------------