public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
* [STABILITY] Compile / STP metrics
@ 2003-01-06 17:25 John Cherry
  2003-01-06 19:21 ` Greg KH
  0 siblings, 1 reply; 3+ messages in thread
From: John Cherry @ 2003-01-06 17:25 UTC (permalink / raw)
  To: linux-kernel; +Cc: linstab

Compile statistics have been for kernel releases from 2.5.46 to 2.5.54
at: www.osdl.org/archive/cherry/stability

This page also has the beginnings of STP (Scalable Test Platform)
results for a number of tests (aim9, LTP, unixbench, contest, bonnie++,
debench (quick), hackbench, iozone, dbt1 (1-tier), lmbench (short)) for
recent kernel releases.

These metrics are simply one way to measure how 2.5 is converging.  Many
of the compilation errors are being addressed by various kernel
developers, so in some ways, these statics are restating the obvious.

Reasonable convergence of compile time warnings/errors was happening
until 2.5.54 was released.  However, 2.5.54 took a step backwards.  The
latest results show...

                           2.5.53                       2.5.54
                       ------------------------ ------------------------
bzImage (defconfig)      16 warnings/0 errors     68 warnings/0 errors
bzImage (allmodconfig)   31 warnings/9 errors     40 warnings/11 errors
modules (allmodconfig) 1843 warnings/118 errors 3223 warnings/208 errors

The script that generated this data is also at
www.osdl.org/archive/cherry/stability.  Detailed information on warnings
and errors can be found by following the links in the table, but a
summary of the 2.5.54 run is shown here....

Kernel version: 2.5.54
Kernel build: 
   Making bzImage (defconfig): 68 warnings, 0 errors
   Making bzImage (allmodconfig): 40 warnings, 11 errors
   Making modules (allmodconfig): 3223 warnings, 208 errors

Building directories:
   Building fs/autofs: clean
   Building fs/autofs4: clean
   Building fs/befs: 0 warnings, 2 errors
   Building fs/bfs: clean
   Building fs/devfs: clean
   Building fs/devpts: clean
   Building fs/efs: clean
   Building fs/exportfs: clean
   Building fs/ext2: clean
   Building fs/ext3: clean
   Building fs/fat: clean
   Building fs/hfs: clean
   Building fs/hpfs: clean
   Building fs/hugetlbfs: clean
   Building fs/intermezzo: 2 warnings, 0 errors
   Building fs/isofs: clean
   Building fs/jbd: clean
   Building fs/jffs: clean
   Building fs/jffs2: clean
   Building fs/jfs: clean
   Building fs/lockd: 4 warnings, 0 errors
   Building fs/ncpfs: clean
   Building fs/nfs: clean
   Building fs/nfsd: 2 warnings, 0 errors
   Building fs/nls: clean
   Building fs/ntfs: 3 warnings, 0 errors
   Building fs/openpromfs: clean
   Building fs/partitions: clean
   Building fs/proc: clean
   Building fs/qnx4: clean
   Building fs/reiserfs: 1 warnings, 0 errors
   Building fs/romfs: 0 warnings, 2 errors
   Building fs/smbfs: 2 warnings, 0 errors
   Building fs/sysfs: clean
   Building fs/sysv: clean
   Building fs/udf: clean
   Building fs/ufs: clean
   Building fs/umsdos: clean
   Building fs/vfat: clean
   Building fs/xfs: 2 warnings, 0 errors
   Building drivers/acorn: clean
   Building drivers/cdrom: 34 warnings, 0 errors
   Building drivers/ide: 45 warnings, 2 errors
   Building drivers/mca: clean
   Building drivers/net: 626 warnings, 20 errors
   Building drivers/pcmcia: 13 warnings, 0 errors
   Building drivers/sgi: clean
   Building drivers/acpi: clean
   Building drivers/char: 374 warnings, 8 errors
   Building drivers/ieee1394: 17 warnings, 2 errors
   Building drivers/md: 18 warnings, 0 errors
   Building drivers/nubus: clean
   Building drivers/pnp: clean
   Building drivers/tc: clean
   Building river/atm: clean
   Building drivers/dio: clean
   Building drivers/input: 5 warnings, 0 errors
   Building drivers/media: 176 warnings, 31 errors
   Building drivers/oprofile: clean
   Building drivers/s390: clean
   Building drivers/telephony: 15 warnings, 2 errors
   Building drivers/base: clean
   Building drivers/fc4: clean
   Building drivers/isdn: 477 warnings, 18 errors
   Building drivers/message: 18 warnings, 2 errors
   Building drivers/parisc: clean
   Building drivers/sbus: clean
   Building drivers/usb: 34 warnings, 0 errors
   Building drivers/block: 10 warnings, 2 errors
   Building drivers/hotplug: 10 warnings, 0 errors
   Building drivers/misc: clean
   Building drivers/parport: 10 warnings, 0 errors
   Building drivers/scsi/aacraid: 3 warnings, 0 errors
   Building drivers/scsi/aic7xxx: 1 warnings, 0 errors
   Building drivers/scsi/dpt: clean
   Building drivers/scsi/pcmcia: 24 warnings, 3 errors
   Building drivers/scsi/sym53c8xx_2: 1 warnings, 0 errors
   Building drivers/video/aty: 0 warnings, 2 errors
   Building drivers/video/console: 2 warnings, 0 errors
   Building drivers/video/matrox: 106 warnings, 20 errors
   Building drivers/video/riva: clean
   Building drivers/video/sis: 37 warnings, 3 errors
   Building drivers/bluetooth: 15 warnings, 0 errors
   Building drivers/i2c: 3 warnings, 0 errors
   Building drivers/mtd: 30 warnings, 4 errors
   Building drivers/pci: clean
   Building drivers/serial: 1 warnings, 0 errors
   Building drivers/zorro: clean
   Building sound/core: 2 warnings, 0 errors
   Building sound/drivers: 1 warnings, 0 errors
   Building sound/i2c: clean
   Building sound/isa: 105 warnings, 34 errors
   Building sound/oss: 159 warnings, 13 errors
   Building sound/pci: 8 warnings, 0 errors
   Building sound/synth: clean
   Building sound/usb: clean
   Building arch/i386: clean
   Building crypto: clean
   Building ipc: clean
   Building lib: clean
   Building mm: clean
   Building net: 311 warnings, 0 errors
   Building security: 2 warnings, 0 errors
   Building sound: 123 warnings, 47 errors
   Building drivers/video: 297 warnings, 35 errors
   Building usr: clean


Failure Summary:

   drivers/block: 10 warnings, 2 errors
   drivers/char: 374 warnings, 8 errors
   drivers/ide: 45 warnings, 2 errors
   drivers/ieee1394: 17 warnings, 2 errors
   drivers/isdn: 477 warnings, 18 errors
   drivers/media: 176 warnings, 31 errors
   drivers/message: 18 warnings, 2 errors
   drivers/mtd: 30 warnings, 4 errors
   drivers/net: 626 warnings, 20 errors
   drivers/scsi/pcmcia: 24 warnings, 3 errors
   drivers/telephony: 15 warnings, 2 errors
   drivers/video: 297 warnings, 35 errors
   drivers/video/aty: 0 warnings, 2 errors
   drivers/video/matrox: 106 warnings, 20 errors
   drivers/video/sis: 37 warnings, 3 errors
   fs/befs: 0 warnings, 2 errors
   fs/romfs: 0 warnings, 2 errors
   sound: 123 warnings, 47 errors
   sound/isa: 105 warnings, 34 errors
   sound/oss: 159 warnings, 13 errors


Warning Summary:

   drivers/bluetooth: 15 warnings, 0 errors
   drivers/cdrom: 34 warnings, 0 errors
   drivers/hotplug: 10 warnings, 0 errors
   drivers/i2c: 3 warnings, 0 errors
   drivers/input: 5 warnings, 0 errors
   drivers/md: 18 warnings, 0 errors
   drivers/parport: 10 warnings, 0 errors
   drivers/pcmcia: 13 warnings, 0 errors
   drivers/scsi/aacraid: 3 warnings, 0 errors
   drivers/scsi/aic7xxx: 1 warnings, 0 errors
   drivers/scsi/sym53c8xx_2: 1 warnings, 0 errors
   drivers/serial: 1 warnings, 0 errors
   drivers/usb: 34 warnings, 0 errors
   drivers/video/console: 2 warnings, 0 errors
   fs/intermezzo: 2 warnings, 0 errors
   fs/lockd: 4 warnings, 0 errors
   fs/nfsd: 2 warnings, 0 errors
   fs/ntfs: 3 warnings, 0 errors
   fs/reiserfs: 1 warnings, 0 errors
   fs/smbfs: 2 warnings, 0 errors
   fs/xfs: 2 warnings, 0 errors
   net: 311 warnings, 0 errors
   security: 2 warnings, 0 errors
   sound/core: 2 warnings, 0 errors
   sound/drivers: 1 warnings, 0 errors
   sound/pci: 8 warnings, 0 errors

John Cherry
OSDL




^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [STABILITY] Compile / STP metrics
  2003-01-06 17:25 [STABILITY] Compile / STP metrics John Cherry
@ 2003-01-06 19:21 ` Greg KH
  2003-01-06 21:15   ` [Linstab] " John Cherry
  0 siblings, 1 reply; 3+ messages in thread
From: Greg KH @ 2003-01-06 19:21 UTC (permalink / raw)
  To: John Cherry; +Cc: linux-kernel, linstab

On Mon, Jan 06, 2003 at 09:25:38AM -0800, John Cherry wrote:
> modules (allmodconfig) 1843 warnings/118 errors 3223 warnings/208 errors

The 2.5.54 file for this is not available on the web site, any ideas
where it could be found?

thanks,

greg k-h

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [Linstab] Re: [STABILITY] Compile / STP metrics
  2003-01-06 19:21 ` Greg KH
@ 2003-01-06 21:15   ` John Cherry
  0 siblings, 0 replies; 3+ messages in thread
From: John Cherry @ 2003-01-06 21:15 UTC (permalink / raw)
  To: Greg KH; +Cc: linux-kernel, linstab

Stale link.  Sorry.  Try it now.

On Mon, 2003-01-06 at 11:21, Greg KH wrote:
> On Mon, Jan 06, 2003 at 09:25:38AM -0800, John Cherry wrote:
> > modules (allmodconfig) 1843 warnings/118 errors 3223 warnings/208 errors
> 
> The 2.5.54 file for this is not available on the web site, any ideas
> where it could be found?
> 
> thanks,
> 
> greg k-h
> _______________________________________________
> Linstab mailing list
> Linstab@lists.osdl.org
> http://lists.osdl.org/mailman/listinfo/linstab
-- 
John Cherry <cherry@osdl.org>


^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2003-01-06 20:55 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2003-01-06 17:25 [STABILITY] Compile / STP metrics John Cherry
2003-01-06 19:21 ` Greg KH
2003-01-06 21:15   ` [Linstab] " John Cherry

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox