comparing FreeBSD to linux

comparing FreeBSD to linux

[Raz Ben-Jehuda(caro)]

I have evaluated which is better in terms cpu load when dealing with raid.
FreeBSD vinum's or linux raid.
When i issued a huge amount of io's read to linux raid i got 93% cpu
load ( 7% idle),
while i having 10% cpu load  ( 90% idle ) in the freebsd.

I need to switch to linux from freebsd. I am using in linux 2.6.6 kernel .
is problem is a known issue in linux , is it fixed ?

--
Raz

Re: comparing FreeBSD to linux

[Lajber Zoltan]

On Sun, 20 Nov 2005, Raz Ben-Jehuda(caro) wrote:

> I have evaluated which is better in terms cpu load when dealing with raid.
> FreeBSD vinum's or linux raid.
> When i issued a huge amount of io's read to linux raid i got 93% cpu
> load ( 7% idle),
> while i having 10% cpu load  ( 90% idle ) in the freebsd.
>
> I need to switch to linux from freebsd. I am using in linux 2.6.6 kernel .
> is problem is a known issue in linux , is it fixed ?

It's not a sw raid problem, i never got such load. It seams to be a driver
problem. Do you use good kernel for your hardware?

Bye,
-=Lajbi=----------------------------------------------------------------
 LAJBER Zoltan               Szent Istvan Egyetem,  Informatika Hivatal
 Most of the time, if you think you are in trouble, crank that throttle!

Re: comparing FreeBSD to linux

[Raz Ben-Jehuda(caro)]

i have an intel ich6 ide controller chipset revision 3.
this is the obnly chipset i found in dmesg.

On 11/20/05, Lajber Zoltan <lajbi@lajli.gau.hu> wrote:
> Hi,
>
> On Sun, 20 Nov 2005, Raz Ben-Jehuda(caro) wrote:
>
> > I am using sata maxtor disks over raid0. i am using
> > 2.6.6 kernel.
> > What do u mean by "good kernel" ?
>
> Good kernel: apropriate driver for your disk driver. Wich sata chipset do
> you have?
> The 2.6.6 is rather old, go with recent kernel.
>
> raid0 has very low overhead, compared to raid1 or raid5. I haven o mora
> than 5% cpu on raid1 on a good motherboard.
>
> Bye,
> -=Lajbi=----------------------------------------------------------------
>  LAJBER Zoltan               Szent Istvan Egyetem,  Informatika Hivatal
>  Most of the time, if you think you are in trouble, crank that throttle!
>


--
Raz

RE: comparing FreeBSD to linux

[Guy]

> -----Original Message-----
> From: linux-raid-owner@vger.kernel.org [mailto:linux-raid-
> owner@vger.kernel.org] On Behalf Of Raz Ben-Jehuda(caro)
> Sent: Sunday, November 20, 2005 6:50 AM
> To: Linux RAID Mailing List
> Subject: comparing FreeBSD to linux
> 
> I have evaluated which is better in terms cpu load when dealing with raid.
> FreeBSD vinum's or linux raid.
> When i issued a huge amount of io's read to linux raid i got 93% cpu
> load ( 7% idle),
> while i having 10% cpu load  ( 90% idle ) in the freebsd.

Maybe a silly question...  But is it 9.3 times faster under Linux?  :)
That would explain the 9.3 times increase in CPU load.

It is important that you are comparing the CPU load at the same disks rate,
or at least factor in the disk rate.

Guy

> 
> I need to switch to linux from freebsd. I am using in linux 2.6.6 kernel .
> is problem is a known issue in linux , is it fixed ?
> 
> --
> Raz
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: comparing FreeBSD to linux

[Raz Ben-Jehuda(caro)]

fetching from a disk a random block of 1 MB is aproximately
20MB/s for a sata disk ( randomly , all over the disk and over a file
system).
god help us if the cpu what that slow.

On 11/21/05, Guy <bugzilla@watkins-home.com> wrote:
> > -----Original Message-----
> > From: linux-raid-owner@vger.kernel.org [mailto:linux-raid-
> > owner@vger.kernel.org] On Behalf Of Raz Ben-Jehuda(caro)
> > Sent: Sunday, November 20, 2005 6:50 AM
> > To: Linux RAID Mailing List
> > Subject: comparing FreeBSD to linux
> >
> > I have evaluated which is better in terms cpu load when dealing with raid.
> > FreeBSD vinum's or linux raid.
> > When i issued a huge amount of io's read to linux raid i got 93% cpu
> > load ( 7% idle),
> > while i having 10% cpu load  ( 90% idle ) in the freebsd.
>
> Maybe a silly question...  But is it 9.3 times faster under Linux?  :)
> That would explain the 9.3 times increase in CPU load.
>
> It is important that you are comparing the CPU load at the same disks rate,
> or at least factor in the disk rate.
>
> Guy
>
> >
> > I need to switch to linux from freebsd. I am using in linux 2.6.6 kernel .
> > is problem is a known issue in linux , is it fixed ?
> >
> > --
> > Raz
> > -
> > To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>


--
Raz

RE: comparing FreeBSD to linux

[Guy]

> -----Original Message-----
> From: linux-raid-owner@vger.kernel.org [mailto:linux-raid-
> owner@vger.kernel.org] On Behalf Of Raz Ben-Jehuda(caro)
> Sent: Monday, November 21, 2005 9:47 AM
> To: Guy
> Cc: Linux RAID Mailing List
> Subject: Re: comparing FreeBSD to linux
> 
> fetching from a disk a random block of 1 MB is aproximately
> 20MB/s for a sata disk ( randomly , all over the disk and over a file
> system).
> god help us if the cpu what that slow.

If your CPU load is 90% at 20MB/sec then you have a problem.

I get about 56MB per sec on my filesystem which is on a RAID5.
The CPU load is less than 50%
I have a P3-500MHz 2 CPU system.  VERY OLD!

I have Linux 2.4.31.  I don't know if the newer 2.6 is better or not.

Guy

> 
> On 11/21/05, Guy <bugzilla@watkins-home.com> wrote:
> > > -----Original Message-----
> > > From: linux-raid-owner@vger.kernel.org [mailto:linux-raid-
> > > owner@vger.kernel.org] On Behalf Of Raz Ben-Jehuda(caro)
> > > Sent: Sunday, November 20, 2005 6:50 AM
> > > To: Linux RAID Mailing List
> > > Subject: comparing FreeBSD to linux
> > >
> > > I have evaluated which is better in terms cpu load when dealing with
> raid.
> > > FreeBSD vinum's or linux raid.
> > > When i issued a huge amount of io's read to linux raid i got 93% cpu
> > > load ( 7% idle),
> > > while i having 10% cpu load  ( 90% idle ) in the freebsd.
> >
> > Maybe a silly question...  But is it 9.3 times faster under Linux?  :)
> > That would explain the 9.3 times increase in CPU load.
> >
> > It is important that you are comparing the CPU load at the same disks
> rate,
> > or at least factor in the disk rate.
> >
> > Guy
> >
> > >
> > > I need to switch to linux from freebsd. I am using in linux 2.6.6
> kernel .
> > > is problem is a known issue in linux , is it fixed ?
> > >
> > > --
> > > Raz
> > > -
> > > To unsubscribe from this list: send the line "unsubscribe linux-raid"
> in
> > > the body of a message to majordomo@vger.kernel.org
> > > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >
> > -
> > To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >
> 
> 
> --
> Raz
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: comparing FreeBSD to linux

[Raz Ben-Jehuda(caro)]

What sort of  a test is it ? what filesystem ?
I am reading concurrently 50 files .
Are you reading one file , several files ?

On 11/21/05, Guy <bugzilla@watkins-home.com> wrote:
> > -----Original Message-----
> > From: linux-raid-owner@vger.kernel.org [mailto:linux-raid-
> > owner@vger.kernel.org] On Behalf Of Raz Ben-Jehuda(caro)
> > Sent: Monday, November 21, 2005 9:47 AM
> > To: Guy
> > Cc: Linux RAID Mailing List
> > Subject: Re: comparing FreeBSD to linux
> >
> > fetching from a disk a random block of 1 MB is aproximately
> > 20MB/s for a sata disk ( randomly , all over the disk and over a file
> > system).
> > god help us if the cpu what that slow.
>
> If your CPU load is 90% at 20MB/sec then you have a problem.
>
> I get about 56MB per sec on my filesystem which is on a RAID5.
> The CPU load is less than 50%
> I have a P3-500MHz 2 CPU system.  VERY OLD!
>
> I have Linux 2.4.31.  I don't know if the newer 2.6 is better or not.
>
> Guy
>
> >
> > On 11/21/05, Guy <bugzilla@watkins-home.com> wrote:
> > > > -----Original Message-----
> > > > From: linux-raid-owner@vger.kernel.org [mailto:linux-raid-
> > > > owner@vger.kernel.org] On Behalf Of Raz Ben-Jehuda(caro)
> > > > Sent: Sunday, November 20, 2005 6:50 AM
> > > > To: Linux RAID Mailing List
> > > > Subject: comparing FreeBSD to linux
> > > >
> > > > I have evaluated which is better in terms cpu load when dealing with
> > raid.
> > > > FreeBSD vinum's or linux raid.
> > > > When i issued a huge amount of io's read to linux raid i got 93% cpu
> > > > load ( 7% idle),
> > > > while i having 10% cpu load  ( 90% idle ) in the freebsd.
> > >
> > > Maybe a silly question...  But is it 9.3 times faster under Linux?  :)
> > > That would explain the 9.3 times increase in CPU load.
> > >
> > > It is important that you are comparing the CPU load at the same disks
> > rate,
> > > or at least factor in the disk rate.
> > >
> > > Guy
> > >
> > > >
> > > > I need to switch to linux from freebsd. I am using in linux 2.6.6
> > kernel .
> > > > is problem is a known issue in linux , is it fixed ?
> > > >
> > > > --
> > > > Raz
> > > > -
> > > > To unsubscribe from this list: send the line "unsubscribe linux-raid"
> > in
> > > > the body of a message to majordomo@vger.kernel.org
> > > > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> > >
> > > -
> > > To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> > > the body of a message to majordomo@vger.kernel.org
> > > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> > >
> >
> >
> > --
> > Raz
> > -
> > To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>


--
Raz

Re: comparing FreeBSD to linux

[Raz Ben-Jehuda(caro)]

Well , i have tested the disk with a new tester i have written. it seems that
the ata driver causes the high cpu and not raid.

On 11/21/05, Raz Ben-Jehuda(caro) <raziebe@gmail.com> wrote:
> What sort of  a test is it ? what filesystem ?
> I am reading concurrently 50 files .
> Are you reading one file , several files ?
>
> On 11/21/05, Guy <bugzilla@watkins-home.com> wrote:
> > > -----Original Message-----
> > > From: linux-raid-owner@vger.kernel.org [mailto:linux-raid-
> > > owner@vger.kernel.org] On Behalf Of Raz Ben-Jehuda(caro)
> > > Sent: Monday, November 21, 2005 9:47 AM
> > > To: Guy
> > > Cc: Linux RAID Mailing List
> > > Subject: Re: comparing FreeBSD to linux
> > >
> > > fetching from a disk a random block of 1 MB is aproximately
> > > 20MB/s for a sata disk ( randomly , all over the disk and over a file
> > > system).
> > > god help us if the cpu what that slow.
> >
> > If your CPU load is 90% at 20MB/sec then you have a problem.
> >
> > I get about 56MB per sec on my filesystem which is on a RAID5.
> > The CPU load is less than 50%
> > I have a P3-500MHz 2 CPU system.  VERY OLD!
> >
> > I have Linux 2.4.31.  I don't know if the newer 2.6 is better or not.
> >
> > Guy
> >
> > >
> > > On 11/21/05, Guy <bugzilla@watkins-home.com> wrote:
> > > > > -----Original Message-----
> > > > > From: linux-raid-owner@vger.kernel.org [mailto:linux-raid-
> > > > > owner@vger.kernel.org] On Behalf Of Raz Ben-Jehuda(caro)
> > > > > Sent: Sunday, November 20, 2005 6:50 AM
> > > > > To: Linux RAID Mailing List
> > > > > Subject: comparing FreeBSD to linux
> > > > >
> > > > > I have evaluated which is better in terms cpu load when dealing with
> > > raid.
> > > > > FreeBSD vinum's or linux raid.
> > > > > When i issued a huge amount of io's read to linux raid i got 93% cpu
> > > > > load ( 7% idle),
> > > > > while i having 10% cpu load  ( 90% idle ) in the freebsd.
> > > >
> > > > Maybe a silly question...  But is it 9.3 times faster under Linux?  :)
> > > > That would explain the 9.3 times increase in CPU load.
> > > >
> > > > It is important that you are comparing the CPU load at the same disks
> > > rate,
> > > > or at least factor in the disk rate.
> > > >
> > > > Guy
> > > >
> > > > >
> > > > > I need to switch to linux from freebsd. I am using in linux 2.6.6
> > > kernel .
> > > > > is problem is a known issue in linux , is it fixed ?
> > > > >
> > > > > --
> > > > > Raz
> > > > > -
> > > > > To unsubscribe from this list: send the line "unsubscribe linux-raid"
> > > in
> > > > > the body of a message to majordomo@vger.kernel.org
> > > > > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> > > >
> > > > -
> > > > To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> > > > the body of a message to majordomo@vger.kernel.org
> > > > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> > > >
> > >
> > >
> > > --
> > > Raz
> > > -
> > > To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> > > the body of a message to majordomo@vger.kernel.org
> > > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >
> > -
> > To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >
>
>
> --
> Raz
>


--
Raz

Re: comparing FreeBSD to linux

[Jeff Garzik]

On Mon, Nov 21, 2005 at 10:15:11AM -0800, Raz Ben-Jehuda(caro) wrote:
> Well , i have tested the disk with a new tester i have written. it seems that
> the ata driver causes the high cpu and not raid.

Which drivers are you using?  lspci and kernel .config?

	Jeff

Re: comparing FreeBSD to linux

[Gil]

Jeff Garzik wrote:
> On Mon, Nov 21, 2005 at 10:15:11AM -0800, Raz Ben-Jehuda(caro)
> wrote:
> 
>> Well , i have tested the disk with a new tester i have written.
>> it seems that the ata driver causes the high cpu and not raid.
> 
> Which drivers are you using?  lspci and kernel .config?

And have you turned on DMA?

hdparm /dev/hda

--Gil

Re: comparing FreeBSD to linux

[Raz Ben-Jehuda(caro)]

>lspci
00:00.0 Host bridge: Intel Corp.: Unknown device 2588 (rev 05)
00:01.0 PCI bridge: Intel Corp.: Unknown device 2589 (rev 05)
00:02.0 VGA compatible controller: Intel Corp.: Unknown device 258a (rev 05)
00:1c.0 PCI bridge: Intel Corp.: Unknown device 2660 (rev 03)
00:1c.1 PCI bridge: Intel Corp.: Unknown device 2662 (rev 03)
00:1e.0 PCI bridge: Intel Corp. 82801BA/CA/DB PCI Bridge (rev d3)
00:1f.0 ISA bridge: Intel Corp.: Unknown device 2640 (rev 03)
00:1f.1 IDE interface: Intel Corp.: Unknown device 266f (rev 03)
00:1f.2 IDE interface: Intel Corp.: Unknown device 2652 (rev 03)
00:1f.3 SMBus: Intel Corp.: Unknown device 266a (rev 03)
01:00.0 PCI bridge: Intel Corp.: Unknown device 032c (rev 09)
01:00.1 PIC: Intel Corp.: Unknown device 0326 (rev 09)
03:00.0 Ethernet controller: Broadcom Corporation: Unknown device 1659 (rev 11)
04:00.0 Ethernet controller: Broadcom Corporation: Unknown device 1659 (rev 11)

.config
...
#
# SCSI low-level drivers
#
CONFIG_BLK_DEV_3W_XXXX_RAID=y
CONFIG_SCSI_3W_9XXX=y
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC7XXX_OLD is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_SCSI_DPT_I2O is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
CONFIG_SCSI_SATA=y
# CONFIG_SCSI_SATA_AHCI is not set
# CONFIG_SCSI_SATA_SVW is not set
CONFIG_SCSI_ATA_PIIX=y
# CONFIG_SCSI_SATA_NV is not set
CONFIG_SCSI_SATA_PROMISE=y
# CONFIG_SCSI_SATA_QSTOR is not set
# CONFIG_SCSI_SATA_SX4 is not set
CONFIG_SCSI_SATA_SIL=y
# CONFIG_SCSI_SATA_SIS is not set
# CONFIG_SCSI_SATA_ULI is not set
# CONFIG_SCSI_SATA_VIA is not set
# CONFIG_SCSI_SATA_VITESSE is not set

...

i am using a supermicro board.
sata controler is onboard. I know that when i use a controller such as 3ware
that "hides" the disks and export scsi disks i have much less cpu.
cpu is xeon 3.0 GHZ.
this is the storage information from dmesg.

ata1: SATA max UDMA/133 cmd 0xE900 ctl 0xEA02 bmdma 0xED00 irq 10
ata2: SATA max UDMA/133 cmd 0xEB00 ctl 0xEC02 bmdma 0xED08 irq 10
ata1: dev 0 cfg 49:2f00 82:7c6b 83:7f09 84:4673 85:7c69 86:3e01 87:4663 88:207f
ata1: dev 0 ATA, max UDMA/133, 490234752 sectors: lba48
ata1: dev 0 configured for UDMA/133
scsi0 : ata_piix
ata2: dev 0 cfg 49:2f00 82:7c6b 83:7f09 84:4673 85:7c69 86:3e01 87:4663 88:207f
ata2: dev 0 ATA, max UDMA/133, 490234752 sectors: lba48
ata2: dev 0 configured for UDMA/133
scsi1 : ata_piix
  Vendor: ATA       Model: Maxtor 7L250S0    Rev: BANC
  Type:   Direct-Access                      ANSI SCSI revision: 05
  Vendor: ATA       Model: Maxtor 7L250S0    Rev: BANC
  Type:   Direct-Access                      ANSI SCSI revision: 05
SCSI device sda: 490234752 512-byte hdwr sectors (251000 MB)
SCSI device sda: drive cache: write back
SCSI device sda: 490234752 512-byte hdwr sectors (251000 MB)
SCSI device sda: drive cache: write back
 /dev/scsi/host0/bus0/target0/lun0: p1 p2 p3
Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
SCSI device sdb: 490234752 512-byte hdwr sectors (251000 MB)
SCSI device sdb: drive cache: write back
SCSI device sdb: 490234752 512-byte hdwr sectors (251000 MB)
SCSI device sdb: drive cache: write back
 /dev/scsi/host1/bus0/target0/lun0: p1 p2 p3
Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
Attached scsi generic sg0 at scsi0, channel 0, id 0, lun 0,  type 0
Attached scsi generic sg1 at scsi1, channel 0, id 0, lun 0,  type 0
mice: PS/2 mouse device common for all mice
input: AT Translated Set 2 keyboard on isa0060/serio0
i2c /dev entries driver
md: linear personality registered as nr 1
md: raid0 personality registered as nr 2
md: raid1 personality registered as nr 3
md: raid5 personality registered as nr 4

On 11/21/05, Jeff Garzik <jgarzik@pobox.com> wrote:
> On Mon, Nov 21, 2005 at 10:15:11AM -0800, Raz Ben-Jehuda(caro) wrote:
> > Well , i have tested the disk with a new tester i have written. it seems that
> > the ata driver causes the high cpu and not raid.
>
> Which drivers are you using?  lspci and kernel .config?
>
>         Jeff
>
>
>
>


--
Raz