Doubt

Doubt

[Light King]

i have four cf card and i have one pci based cf card
contoller(addonics card with pata_sil6800 driver).when i am connecting
this four cf card to addonics card(which has four slots for cf cards)
and inserting this total hardware package to pci slot of pc in linux
os it is showing four different block devices to me.So using mdadm
2.6.3 software raid i am creating a raid device of level 0 . If one cf
card from this hardware package getting failed the raid-device is
becoming inactive .If i am trying to reactive the raid device using
mdamd -R command it is giving a error of "memory cannot be allocated
for the raid device " .The same thing i am trying with raid10 (our
hardware only supports raid  level 0 ,1,10) and if one cf card got
failed we are abel to reactive the raid device.But  the issue we are
facing in raid10 is it is taking 50%(2-CF card out of 4) of total
memory space as mirroring which is a loss for us .

So we dont want any kind of data recovery in our raid device (like
raid0) but we want if one cf card failed also, the raid device should
run or should reactive without any error(like raid10) but we should
abel to use the total disk space (like raid0).

or

any idea to increase size of storage memory created by raid10 (50% is
going waste due to mirroring and our hardware doesnot support raid5) .



How we are simulating  a cf card fail?
answer: according to raid document  "
http://tldp.org/HOWTO/Software-RAID-HOWTO-6.html " if we switch of the
system and remove a cf card ,it will simulate a disk failure .

Please provid any help to me i will be kind of you.
thanking you for your genuine support

ANSH
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Doubt

[Iustin Pop]

On Thu, Nov 05, 2009 at 12:56:30PM +0530, Light King wrote:
> So we dont want any kind of data recovery in our raid device (like
> raid0) but we want if one cf card failed also, the raid device should
> run or should reactive without any error(like raid10) but we should
> abel to use the total disk space (like raid0).

Uh... you don't want to use any space for redundancy but you want redundancy??

iustin

Re: Doubt

[Michael Evans]

Your requirements are contradictory.  You want to span all your
devices with a single storage system, but you do not want to use any
devices for redundancy and expect the filing system on them to remain
consistent should any of the devices fail.

That is simply impossible for file-systems, which is what block-device
aggregation such as mdadm is designed to support.  Were you to loose
any random device out of the four portions of the filesystem metadata
as well as your actual data would be missing.  That may be tolerable
for special cases (regularly sampled data, such as sensor outputs
comes to mind, when you don't -require- the sensor data, but merely
want to have it), however those cases are all application specific,
not general solution.

One typical way a specific application might use four devices would be
a round-robin method.  In this a list of currently online devices
would be kept, then each cohesive unit would be stored to the next
device in the list.  Should a device be added the list would grow,
should a device fail (be removed) it would be taken out of the list.

You have four choices then:

1) What I described above
2) A Raid 0 that gives you 100% storage, but all devices working or none.
3) A Raid 1+0 or 10 (same idea different drivers) solution, you're
already trying it and disliking it though.
4) Raid 5; you spend more CPU but you use one of the devices for
recovery data, so that you can tolerate a single failure.
5) Technically you might also have raid 6; but I'm not counting it
because you're already complaining about loosing 50% of your data and
this has the addition of being slower (BUT surviving -literally- any 2
devices, instead of any 1 device of the correct set.)

Re: Doubt

[Michael Evans]

You're not looking for something that raid, software or otherwise, can provide.

Given that you are using only 4 devices, overall storage to redundancy
ratios can be 0, 25, 50, 66, or 75%.  Were you using 5 devices those
ratios would be 0, 20, 40, 50, 60, 66, and 80%. (The 50% number can
always be attained when using raid10. As can 2 redundant stripes per
data stripe (2/3); I'm ignoring higher multiples of this number.)

If you only want a small percentage of redundancy you must seek other
solutions.  My prior suggestion of using each card individually and
utilizing some kind of software solution to distribute the load could
work; you could also use the par2 (parchive version 2 aka par2cmdline
) command to create redundancy information for one or more files
within a directory; it uses a more general case reed-solomon
http://en.wikipedia.org/wiki/Reed–Solomon_error_correction to
logically divide a set of input files in to a number of byte-chunks
and then produce a rough percentage of redundancy or to produce a
specified number of redundancy blocks (blocks that can fail in the
file in question).

This won't protect you from device-level failure that compromises the
filesystem, but it will protect against partial device failure.  For
your application merely detecting the existence of a failure may be
sufficient, in which case any number of checksum utilities would be
useful.

On Thu, Nov 5, 2009 at 12:44 AM, Light King <thelightking@gmail.com> wrote:
> Sir ,
>
> Thanks for Ur valuable reply .  I ve some more thoughts ....
>
> We want a solution like if 5 to 10 % of memory is going for reductancy
> thn it is ok for us . We dont want data recovery fully of permanent
> data . We want when system is running if one CARD goes bad then the
> array shd continue work without any disturbance .
>
> Can we run the reductancy application of the array in RAM (We ve to
> specify some space in RAM) of the system ? When system
> is switched off we dont want previous data stored but ;upto the period
> the system is switched on we want the CF cars to work as a cache (Its
> not like RAM opeartion exactly)for our system for running data .
>
> plz give some idea ......
>
> Ansh
>
>
> On Thu, Nov 5, 2009 at 1:12 PM, Michael Evans <mjevans1983@gmail.com> wrote:
>> Your requirements are contradictory.  You want to span all your
>> devices with a single storage system, but you do not want to use any
>> devices for redundancy and expect the filing system on them to remain
>> consistent should any of the devices fail.
>>
>> That is simply impossible for file-systems, which is what block-device
>> aggregation such as mdadm is designed to support.  Were you to loose
>> any random device out of the four portions of the filesystem metadata
>> as well as your actual data would be missing.  That may be tolerable
>> for special cases (regularly sampled data, such as sensor outputs
>> comes to mind, when you don't -require- the sensor data, but merely
>> want to have it), however those cases are all application specific,
>> not general solution.
>>
>> One typical way a specific application might use four devices would be
>> a round-robin method.  In this a list of currently online devices
>> would be kept, then each cohesive unit would be stored to the next
>> device in the list.  Should a device be added the list would grow,
>> should a device fail (be removed) it would be taken out of the list.
>>
>> You have four choices then:
>>
>> 1) What I described above
>> 2) A Raid 0 that gives you 100% storage, but all devices working or none.
>> 3) A Raid 1+0 or 10 (same idea different drivers) solution, you're
>> already trying it and disliking it though.
>> 4) Raid 5; you spend more CPU but you use one of the devices for
>> recovery data, so that you can tolerate a single failure.
>> 5) Technically you might also have raid 6; but I'm not counting it
>> because you're already complaining about loosing 50% of your data and
>> this has the addition of being slower (BUT surviving -literally- any 2
>> devices, instead of any 1 device of the correct set.)
>>
>
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Doubt

[Bill Davidsen]

Light King wrote:
> i have four cf card and i have one pci based cf card
> contoller(addonics card with pata_sil6800 driver).when i am connecting
> this four cf card to addonics card(which has four slots for cf cards)
> and inserting this total hardware package to pci slot of pc in linux
> os it is showing four different block devices to me.So using mdadm
> 2.6.3 software raid i am creating a raid device of level 0 . If one cf
> card from this hardware package getting failed the raid-device is
> becoming inactive .If i am trying to reactive the raid device using
> mdamd -R command it is giving a error of "memory cannot be allocated
> for the raid device " .The same thing i am trying with raid10 (our
> hardware only supports raid  level 0 ,1,10) and if one cf card got
> failed we are abel to reactive the raid device.But  the issue we are
> facing in raid10 is it is taking 50%(2-CF card out of 4) of total
> memory space as mirroring which is a loss for us .
>
> So we dont want any kind of data recovery in our raid device (like
> raid0) but we want if one cf card failed also, the raid device should
> run or should reactive without any error(like raid10) but we should
> abel to use the total disk space (like raid0).
>
> or
>
> any idea to increase size of storage memory created by raid10 (50% is
> going waste due to mirroring and our hardware doesnot support raid5) .
>   

If I understand what you are asking, when one part of your array fails, 
you want to throw away all the data on all the devices and create a new 
array using the remaining functional devices. I guess you could run a 
script to do that, but only if you put the controller in JBOD mode so 
software raid can manipulate the individual devices. Then you could use 
the drive fail event to trigger the script.

If that isn't what you want, have a go at explaining what you want to 
happen when a device fails. Bear in mind that with raid0 when any one 
fails all of your data is gone. Period. You have traded capacity and 
performance for reliability, so there is no recovery other than start 
over using the working bits.

-- 
Bill Davidsen <davidsen@tmr.com>
  "We can't solve today's problems by using the same thinking we
   used in creating them." - Einstein

Re: Doubt

[Drew]

> So we dont want any kind of data recovery in our raid device (like
> raid0) but we want if one cf card failed also, the raid device should
> run or should reactive without any error(like raid10) but we should
> abel to use the total disk space (like raid0).

I honestly don't think there is any sort of setup that will work as
you described. If you want to have an array continue to function with
missing devices, you *will* have to sacrifice some space. The closest
type of block device I can think of which *might* achieve your goal is
spanning. Basically it turns all four drives into one huge drive but
doesn't stripe across them so *some* data will survive a device
failure.

Even if you were use spanning (assuming mdadm supports it, haven't
looked) and md doesn't complain when the device drops out, the
filesystem will choke as soon as you tried to access the data on the
missing device.

What is the application that needs this configuration?


-- 
Drew

"Nothing in life is to be feared. It is only to be understood."
--Marie Curie

Doubt

[Mulyadi Santosa]

Hi :)

I can't help you for that, sorry. It's better if  you discuss it
further in kernelnewbies. Also, I think there are few basics you need
to strengthen first and that might be solely up to you to work on it.

On Wed, Apr 18, 2012 at 08:17, Niamathullah Sharief <shariefbe@gmail.com> wrote:
> Dear Mulyadi,
>
> I research it but i?didn't?get an idea.
>
> Could?you please help me to do?research?in kernel programming?
>
> Actually i am student of?Engineering?College.
>
> As you are my Guru in Linux could you please me?
>
> I will be very very happy if you help me to do any research.
>
> Regards
> Sharief
>
>
> On Tue, Apr 10, 2012 at 2:17 PM, Niamathullah Sharief <shariefbe@gmail.com>
> wrote:
>>
>> Sure Mulyadi, I will let you know about the thing for sure.....
>>
>> On 4/10/12, Mulyadi Santosa <mulyadi.santosa@gmail.com> wrote:
>> > Hi :)
>> >
>> > Wish you luck. And if you have time, you could let me know what you
>> > found out later :)
>> >
>> > On Mon, Apr 9, 2012 at 00:30, Niamathullah Sharief <shariefbe@gmail.com>
>> > wrote:
>> >> Dear mulyadi santosa,
>> >>
>> >> Thanks for replying my mail...
>> >>
>> >> I will research it on which you asked me and i will let you know un
>> >> detail
>> >> soon....
>> >>
>> >> Thanks a lot....
>> >>
>> >> Regards
>> >> Sharief
>> >>
>> >> On 8 Apr 2012 22:39, "Mulyadi Santosa" <mulyadi.santosa@gmail.com>
>> >> wrote:
>> >>>
>> >>> Hi :)
>> >>>
>> >>> Oh gee, this is the first time someone admit being my fans :) thanks a
>> >>> lot for your appreciation :)
>> >>>
>> >>> Hm, device driver that does I/O? what kind of I/O? reading from block
>> >>> device? char device? console? network?
>> >>>
>> >>> Try to elaborate more .... :)
>> >>>
>> >>> On Sun, Apr 8, 2012 at 09:25, Niamathullah Sharief
>> >>> <shariefbe@gmail.com>
>> >>> wrote:
>> >>> > Dear Mulyadi,
>> >>> >
>> >>> > This is Sharief from India. I am fan of you. I have some doubt in
>> >>> > writing
>> >>> > device drivers.
>> >>> >
>> >>> > I am planning to write an code which can access the I/O.
>> >>> >
>> >>> > What will be the best approach to do this?
>> >>> >
>> >>> > Please help me..
>> >>> >
>> >>> > Regards
>> >>> > Sharief
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> regards,
>> >>>
>> >>> Mulyadi Santosa
>> >>> Freelance Linux trainer and consultant
>> >>>
>> >>> blog: the-hydra.blogspot.com
>> >>> training: mulyaditraining.blogspot.com
>> >
>> >
>> >
>> > --
>> > regards,
>> >
>> > Mulyadi Santosa
>> > Freelance Linux trainer and consultant
>> >
>> > blog: the-hydra.blogspot.com
>> > training: mulyaditraining.blogspot.com
>> >
>
>



-- 
regards,

Mulyadi Santosa
Freelance Linux trainer and consultant

blog: the-hydra.blogspot.com
training: mulyaditraining.blogspot.com

Doubt...

[dhananjay.tembe]

Hi,
      I am facing a problem when I run tc on the bonded nic cards.
When I run tc on a single nic card, it worked perfectly fine. But when I
run tc on a bond of two nics, tc gives poor performance.  The two nics
were bonded in round-robin (load balancing) mode. I created a qdisc, class
and a filter as follows:

tc qdisc add dev bond0 root handle 1: htb
tc class add dev bond0 parent 1: classid 1:1 htb rate 240mbps
tc class add dev bond0 parent 1:1 classid 1:2 htb rate 50 ceil 50 quantum
1500

I started a TCP traffic between this bond (2gbit bandwidth) and a remote
nic (1gbit bandwidth).
Without qos, bond was transmitting at 960Mbps.
After I executed above mentioned commands, it was expected that the bond
will transmit at 400Mbps but it was transmitting only at 70Mbps.
Same thing was observed with different qos rates for class 1:2, outbound
traffic through bond was very less than the rate specified in the tc
command.

Is getting poor performance after running tc over a bond is a known issue?
Please help me with this issue.

Thanks and regards,
---Dhananjay.

doubt

[durgam]

 i  am accessing a variable from two modules . in one module iam  reading
the varible , and in another module i am updating the variable for each a
second.
in the second module i am using interruptible_sleep_on_timeout so that it
will
be wake up after one second and update the varible. but the problem i am
facing is i couldn't read the variable in the first module  for the moment
of time when the second module gets sleep. please can any one help me to
come out .

phani

Doubt

[so usp]

Hi...

i would like to know how to copy a string such as
"Test" to a char vector (char buffer[256]) in kernel
mode.

Thanks,
Luis Henrique.

______________________________________________________________________

Yahoo! Mail - agora com 100MB de espaço, anti-spam e antivírus grátis!
http://br.info.mail.yahoo.com/

Re: Doubt

[Esteve Espuña Sargatal]

Example from  arch/i386/kernel/kgdb_stub.c:


#include <asm/string.h>         /* for strcpy */

static char remcomOutBuffer[BUFMAX];

strcpy(remcomOutBuffer, "OK");

Hope it's ok.

On Mon, 2004-06-28 at 20:43, so usp wrote:
> Hi...
> 
> i would like to know how to copy a string such as
> "Test" to a char vector (char buffer[256]) in kernel
> mode.
> 
> Thanks,
> Luis Henrique.
> 
> ______________________________________________________________________
> 
> Yahoo! Mail - agora com 100MB de espaço, anti-spam e antivírus grátis!
> http://br.info.mail.yahoo.com/
> -
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
> 

Re: Doubt

[Christophe Saout]

[-- Attachment #1: Type: text/plain, Size: 431 bytes --]

Am Mo, den 28.06.2004 um 20:59 Uhr +0200 schrieb Esteve Espuña Sargatal:

> #include <asm/string.h>         /* for strcpy */
> 
> static char remcomOutBuffer[BUFMAX];
> 
> strcpy(remcomOutBuffer, "OK");
> 
> Hope it's ok.

Not really. Well, this example here works, but only if you know that you
won't overflow the buffer.

strlcpy(emcomOutBuffer, "OK", BUFMAX);

(replace "OK" with the string you wish to copy)


[-- Attachment #2: Dies ist ein digital signierter Nachrichtenteil --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Doubt

[so usp]

Hi Guys,

I would like to know when a compiling the kernel if a
really need to use the comand make modules_install.
I'm asking the question because a would like to use
the old kernel to with the new one that a create.

Luis Henrique.

______________________________________________________________________

Yahoo! Mail - agora com 100MB de espaço, anti-spam e antivírus grátis!
http://br.info.mail.yahoo.com/

Re: Doubt

[Gard Spreemann]

On Friday 25 June 2004 21:14, so usp wrote:
> Hi Guys,
>
> I would like to know when a compiling the kernel if a
> really need to use the comand make modules_install.
> I'm asking the question because a would like to use
> the old kernel to with the new one that a create.

Do the make modules_install. The new modules will be in a separate directory 
(/lib/modules/<version>) and will not interfere with older kernels that you 
might have.

 -- Gard