Scripting question

Scripting question

[Michael French]

    I have a couple of scripts that I am working on that pull data from an
application and print a human readable report from the data.  I have all of
the data pulled and stored in variables, but I am stumped on how to put in
all in one file.  I hope that I can clearly explain this, here goes.

    For one script, I have three pieces of info to report: node name,
customer name, and total data stored.  The first two bits of data are
getting pulled out together and stored in one file.  The third bit is being
calculated and then stored in a second file.  I then get the data in like
this:

NODES=`cat nodeinfo.txt | awk '{print $1}'`
CUSTOMER=`cat nodeinfo.txt | awk '{print $2}'`
MBTOTALS=`cat mbtotals.txt`

I then need to print out a report like:

Nodes        Customer        MB
----------------------------------
node1           customer1        20.0

How can I do this?  I can't seem to figure out how to do it with one for
loop.

    I have another little script I am working on to report restore data and
it has one temp file holding all of the info I need and is greping out about
10 different pieces of data I need before overwriting the temp file with the
info on the next node.  The problem I have run into is that some of the
restores have duplicate data in them so I am going to have to rewrite the
report to put the data in variables and then loop through them to generate a
report just like the one above, except with more variables so you can see
why I am trying to figure out how to do this as cleanly as possible.  Maybe
I am starting off all wrong so feel free to redirect me.  Also, I am using
Korn shell to do this (my only option).

Thanks!

Michael French

Re: Scripting question

[Andrew B. Cramer]

Hi Michael,
	Switch to PERL. You open the input files, then open the output file, 
sort, and write. Perhaps if there are duplicates, you need additional 
information, like a datestamp for each entry to compare.

(.02) - Andrew

On 22 Jan 2003 at 21:14, Michael French wrote:

>     I have a couple of scripts that I am working on that pull data from an
> application and print a human readable report from the data.  I have all of
> the data pulled and stored in variables, but I am stumped on how to put in
> all in one file.  I hope that I can clearly explain this, here goes.
> 
>     For one script, I have three pieces of info to report: node name,
> customer name, and total data stored.  The first two bits of data are
> getting pulled out together and stored in one file.  The third bit is being
> calculated and then stored in a second file.  I then get the data in like
> this:
> 
> NODES=`cat nodeinfo.txt | awk '{print $1}'`
> CUSTOMER=`cat nodeinfo.txt | awk '{print $2}'`
> MBTOTALS=`cat mbtotals.txt`
> 
> I then need to print out a report like:
> 
> Nodes        Customer        MB
> ----------------------------------
> node1           customer1        20.0
> 
> How can I do this?  I can't seem to figure out how to do it with one for
> loop.
> 
>     I have another little script I am working on to report restore data and
> it has one temp file holding all of the info I need and is greping out about
> 10 different pieces of data I need before overwriting the temp file with the
> info on the next node.  The problem I have run into is that some of the
> restores have duplicate data in them so I am going to have to rewrite the
> report to put the data in variables and then loop through them to generate a
> report just like the one above, except with more variables so you can see
> why I am trying to figure out how to do this as cleanly as possible.  Maybe
> I am starting off all wrong so feel free to redirect me.  Also, I am using
> Korn shell to do this (my only option).
> 
> Thanks!
> 
> Michael French
> 
> -
> To unsubscribe from this list: send the line "unsubscribe linux-admin" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

Re: Scripting question

[urgrue]

everyone is gonna tell you to learn a "real" scripting language, but i 
wont.
yeah, shell scripts are slow and ugly but, after all, it works, and its 
easier than blowing your nose.
anyway i dont have the time to learn perl, so there.

i think it would be easiest to first combine the two files nodeinfo.txt 
and mbtotals.txt into one with three columns, using for example any 
spreadsheet program.
then you can just do something like:
while read LINE
do
NODES=`echo $LINE | awk '{print $1}'`
CUSTOMER=`echo $LINE | awk '{print $2}'`
TOTAL=`echo $LINE | awk '{print $3}'`
echo -e $NODES\t$CUSTOMER\t$TOTAL >> tmpfile
done < nodeinfo.txt

its much easier to work with one file only. otherwise, all i can think 
of is using sed/awk somehow. maybe like:
while read LINE
do
NODES=as above
CUSTOMER=as above
WHAT_LINE_ARE_WE_ON=1
TOTALS=<use awk or sed to print the Nth line of mbtotals.txt, ie the 
$WHAT_LINE_ARE_WE_ONth line>
add one to $WHAT...
echo all to a file >> tmpfile
done < nodeinfo.txt



>     I have a couple of scripts that I am working on that pull data
> from an
> application and print a human readable report from the data.  I have
> all of
> the data pulled and stored in variables, but I am stumped on how to
> put in
> all in one file.  I hope that I can clearly explain this, here goes.
> 
>     For one script, I have three pieces of info to report: node name,
> customer name, and total data stored.  The first two bits of data are
> getting pulled out together and stored in one file.  The third bit is
> being
> calculated and then stored in a second file.  I then get the data in
> like
> this:
> 
> NODES=`cat nodeinfo.txt | awk '{print $1}'`
> CUSTOMER=`cat nodeinfo.txt | awk '{print $2}'`
> MBTOTALS=`cat mbtotals.txt`
> 
> I then need to print out a report like:
> 
> Nodes        Customer        MB
> ----------------------------------
> node1           customer1        20.0
> 
> How can I do this?  I can't seem to figure out how to do it with one
> for
> loop.
> 
>     I have another little script I am working on to report restore
> data and
> it has one temp file holding all of the info I need and is greping out
> about
> 10 different pieces of data I need before overwriting the temp file
> with the
> info on the next node.  The problem I have run into is that some of
> the
> restores have duplicate data in them so I am going to have to rewrite
> the
> report to put the data in variables and then loop through them to
> generate a
> report just like the one above, except with more variables so you can
> see
> why I am trying to figure out how to do this as cleanly as possible.
> Maybe
> I am starting off all wrong so feel free to redirect me.  Also, I am
> using
> Korn shell to do this (my only option).
> 
> Thanks!
> 
> Michael French
> 
> -
> To unsubscribe from this list: send the line "unsubscribe linux-admin"
> in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

Re: Scripting question

[Jude DaShiell]

There's also paste if the hook up needs to be on identical records.

-- 
Jude <dashielljt(at)gmpexpress-dot-net>

Re: Scripting question

[rich+ml]

Got Perl?
---
#!/usr/bin/perl

format STDOUT_TOP =
Nodes        Customer        MB
----------------------------------
.

format =
@<<<<<<<<<<< @<<<<<<<<<<<<<< @>>>>
$1,$2,$3
.

(open A,$ARGV[0]) && (open B,$ARGV[1]) or die $!;
write while split ' ',<A>.<B>;
---

Invoke as one of:
script nodeinfo.txt mbtotals.txt 
script - mbtotals.txt < nodeinfo.txt 
script nodeinfo.txt - < mbtotals.txt

== Rich

On Wed, 22 Jan 2003, Michael French wrote:

> Date: Wed, 22 Jan 2003 21:14:15 -0800
> From: Michael French <mfrench@ashevillemail.com>
> To: linux-admin@vger.kernel.org
> Subject: Scripting question
> 
>     I have a couple of scripts that I am working on that pull data from an
> application and print a human readable report from the data.  I have all of
> the data pulled and stored in variables, but I am stumped on how to put in
> all in one file.  I hope that I can clearly explain this, here goes.
> 
>     For one script, I have three pieces of info to report: node name,
> customer name, and total data stored.  The first two bits of data are
> getting pulled out together and stored in one file.  The third bit is being
> calculated and then stored in a second file.  I then get the data in like
> this:
> 
> NODES=`cat nodeinfo.txt | awk '{print $1}'`
> CUSTOMER=`cat nodeinfo.txt | awk '{print $2}'`
> MBTOTALS=`cat mbtotals.txt`
> 
> I then need to print out a report like:
> 
> Nodes        Customer        MB
> ----------------------------------
> node1           customer1        20.0
> 
> How can I do this?  I can't seem to figure out how to do it with one for
> loop.
> 
>     I have another little script I am working on to report restore data and
> it has one temp file holding all of the info I need and is greping out about
> 10 different pieces of data I need before overwriting the temp file with the
> info on the next node.  The problem I have run into is that some of the
> restores have duplicate data in them so I am going to have to rewrite the
> report to put the data in variables and then loop through them to generate a
> report just like the one above, except with more variables so you can see
> why I am trying to figure out how to do this as cleanly as possible.  Maybe
> I am starting off all wrong so feel free to redirect me.  Also, I am using
> Korn shell to do this (my only option).
> 
> Thanks!
> 
> Michael French
> 
> -
> To unsubscribe from this list: send the line "unsubscribe linux-admin" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

Re: Scripting question

[rich+ml]

Oops, change the "$1,$2,$3" to "$@" == Rich

On Thu, 23 Jan 2003 rich+ml@lclogic.com wrote:

> Date: Thu, 23 Jan 2003 16:46:51 -0800 (PST)
> From: rich+ml@lclogic.com
> To: Michael French <mfrench@ashevillemail.com>
> Cc: linux-admin@vger.kernel.org
> Subject: Re: Scripting question
> 
> Got Perl?
> ---
> #!/usr/bin/perl
> 
> format STDOUT_TOP =
> Nodes        Customer        MB
> ----------------------------------
> .
> 
> format =
> @<<<<<<<<<<< @<<<<<<<<<<<<<< @>>>>
> $1,$2,$3
> .
> 
> (open A,$ARGV[0]) && (open B,$ARGV[1]) or die $!;
> write while split ' ',<A>.<B>;
> ---
> 
> Invoke as one of:
> script nodeinfo.txt mbtotals.txt 
> script - mbtotals.txt < nodeinfo.txt 
> script nodeinfo.txt - < mbtotals.txt
> 
> == Rich
> 
> On Wed, 22 Jan 2003, Michael French wrote:
> 
> > Date: Wed, 22 Jan 2003 21:14:15 -0800
> > From: Michael French <mfrench@ashevillemail.com>
> > To: linux-admin@vger.kernel.org
> > Subject: Scripting question
> > 
> >     I have a couple of scripts that I am working on that pull data from an
> > application and print a human readable report from the data.  I have all of
> > the data pulled and stored in variables, but I am stumped on how to put in
> > all in one file.  I hope that I can clearly explain this, here goes.
> > 
> >     For one script, I have three pieces of info to report: node name,
> > customer name, and total data stored.  The first two bits of data are
> > getting pulled out together and stored in one file.  The third bit is being
> > calculated and then stored in a second file.  I then get the data in like
> > this:
> > 
> > NODES=`cat nodeinfo.txt | awk '{print $1}'`
> > CUSTOMER=`cat nodeinfo.txt | awk '{print $2}'`
> > MBTOTALS=`cat mbtotals.txt`
> > 
> > I then need to print out a report like:
> > 
> > Nodes        Customer        MB
> > ----------------------------------
> > node1           customer1        20.0
> > 
> > How can I do this?  I can't seem to figure out how to do it with one for
> > loop.
> > 
> >     I have another little script I am working on to report restore data and
> > it has one temp file holding all of the info I need and is greping out about
> > 10 different pieces of data I need before overwriting the temp file with the
> > info on the next node.  The problem I have run into is that some of the
> > restores have duplicate data in them so I am going to have to rewrite the
> > report to put the data in variables and then loop through them to generate a
> > report just like the one above, except with more variables so you can see
> > why I am trying to figure out how to do this as cleanly as possible.  Maybe
> > I am starting off all wrong so feel free to redirect me.  Also, I am using
> > Korn shell to do this (my only option).
> > 
> > Thanks!
> > 
> > Michael French
> > 
> > -
> > To unsubscribe from this list: send the line "unsubscribe linux-admin" in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> > 
> 
> 
> 

Re: Scripting question

[Michael French]

    Thanks for the help everyone, I was able to do it with John Julian's
while loop, worked like a champ!

Michael

In case you missed, here's the code:

i=0
while [ -n "$cust[$i]" ]
do print "$node[$i] $cust[$i] $mb[$i]
   i=$(( i + 1 ))
done

----- Original Message -----
From: <rich+ml@lclogic.com>
To: "Michael French" <mfrench@ashevillemail.com>
Cc: <linux-admin@vger.kernel.org>
Sent: Thursday, January 23, 2003 4:50 PM
Subject: Re: Scripting question


> Oops, change the "$1,$2,$3" to "$@" == Rich
>
> On Thu, 23 Jan 2003 rich+ml@lclogic.com wrote:
>
> > Date: Thu, 23 Jan 2003 16:46:51 -0800 (PST)
> > From: rich+ml@lclogic.com
> > To: Michael French <mfrench@ashevillemail.com>
> > Cc: linux-admin@vger.kernel.org
> > Subject: Re: Scripting question
> >
> > Got Perl?
> > ---
> > #!/usr/bin/perl
> >
> > format STDOUT_TOP =
> > Nodes        Customer        MB
> > ----------------------------------
> > .
> >
> > format =
> > @<<<<<<<<<<< @<<<<<<<<<<<<<< @>>>>
> > $1,$2,$3
> > .
> >
> > (open A,$ARGV[0]) && (open B,$ARGV[1]) or die $!;
> > write while split ' ',<A>.<B>;
> > ---
> >
> > Invoke as one of:
> > script nodeinfo.txt mbtotals.txt
> > script - mbtotals.txt < nodeinfo.txt
> > script nodeinfo.txt - < mbtotals.txt
> >
> > == Rich
> >
> > On Wed, 22 Jan 2003, Michael French wrote:
> >
> > > Date: Wed, 22 Jan 2003 21:14:15 -0800
> > > From: Michael French <mfrench@ashevillemail.com>
> > > To: linux-admin@vger.kernel.org
> > > Subject: Scripting question
> > >
> > >     I have a couple of scripts that I am working on that pull data
from an
> > > application and print a human readable report from the data.  I have
all of
> > > the data pulled and stored in variables, but I am stumped on how to
put in
> > > all in one file.  I hope that I can clearly explain this, here goes.
> > >
> > >     For one script, I have three pieces of info to report: node name,
> > > customer name, and total data stored.  The first two bits of data are
> > > getting pulled out together and stored in one file.  The third bit is
being
> > > calculated and then stored in a second file.  I then get the data in
like
> > > this:
> > >
> > > NODES=`cat nodeinfo.txt | awk '{print $1}'`
> > > CUSTOMER=`cat nodeinfo.txt | awk '{print $2}'`
> > > MBTOTALS=`cat mbtotals.txt`
> > >
> > > I then need to print out a report like:
> > >
> > > Nodes        Customer        MB
> > > ----------------------------------
> > > node1           customer1        20.0
> > >
> > > How can I do this?  I can't seem to figure out how to do it with one
for
> > > loop.
> > >
> > >     I have another little script I am working on to report restore
data and
> > > it has one temp file holding all of the info I need and is greping out
about
> > > 10 different pieces of data I need before overwriting the temp file
with the
> > > info on the next node.  The problem I have run into is that some of
the
> > > restores have duplicate data in them so I am going to have to rewrite
the
> > > report to put the data in variables and then loop through them to
generate a
> > > report just like the one above, except with more variables so you can
see
> > > why I am trying to figure out how to do this as cleanly as possible.
Maybe
> > > I am starting off all wrong so feel free to redirect me.  Also, I am
using
> > > Korn shell to do this (my only option).
> > >
> > > Thanks!
> > >
> > > Michael French
> > >
> > > -
> > > To unsubscribe from this list: send the line "unsubscribe linux-admin"
in
> > > the body of a message to majordomo@vger.kernel.org
> > > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> > >
> >
> >
> >
>
>

RE: Scripting question

[johnjulian1]

I didn't understand all that you were trying to do so here are some general pointers.

Korn shell supports arrays. You could pull your data in seperate arrays for node, cust and mb then do a loop on the array counter.

while loops often work better than for loops.
i=0
while [ -n "$cust[$i]" ]
do print "$node[$i] $cust[$i] $mb[$i]
   i=$(( i + 1 ))
done
"Michael French" <mfrench@ashevillemail.com> wrote:

>    I have a couple of scripts that I am working on that pull data from an
>application and print a human readable report from the data.  I have all of
>the data pulled and stored in variables, but I am stumped on how to put in
>all in one file.  I hope that I can clearly explain this, here goes.
>
>    For one script, I have three pieces of info to report: node name,
>customer name, and total data stored.  The first two bits of data are
>getting pulled out together and stored in one file.  The third bit is being
>calculated and then stored in a second file.  I then get the data in like
>this:
>
>NODES=`cat nodeinfo.txt | awk '{print $1}'`
>CUSTOMER=`cat nodeinfo.txt | awk '{print $2}'`
>MBTOTALS=`cat mbtotals.txt`
>
>I then need to print out a report like:
>
>Nodes        Customer        MB
>----------------------------------
>node1           customer1        20.0
>
>How can I do this?  I can't seem to figure out how to do it with one for
>loop.
>
>    I have another little script I am working on to report restore data and
>it has one temp file holding all of the info I need and is greping out about
>10 different pieces of data I need before overwriting the temp file with the
>info on the next node.  The problem I have run into is that some of the
>restores have duplicate data in them so I am going to have to rewrite the
>report to put the data in variables and then loop through them to generate a
>report just like the one above, except with more variables so you can see
>why I am trying to figure out how to do this as cleanly as possible.  Maybe
>I am starting off all wrong so feel free to redirect me.  Also, I am using
>Korn shell to do this (my only option).
>
>Thanks!
>
>Michael French
>
>-
>To unsubscribe from this list: send the line "unsubscribe linux-admin" in
>the body of a message to majordomo@vger.kernel.org
>More majordomo info at  http://vger.kernel.org/majordomo-info.html
>

__________________________________________________________________
The NEW Netscape 7.0 browser is now available. Upgrade now! http://channels.netscape.com/ns/browsers/download.jsp 

Get your own FREE, personal Netscape Mail account today at http://webmail.netscape.com/

Re: Scripting question

[Mikhail Romanenko]

23.01.03 18:49:24, johnjulian1@netscape.net wrote:

[...]
>Korn shell supports arrays. You could pull your data in seperate arrays for node,
>cust and mb then do a loop on the array counter.
[...]

Not only Korn shell, bash (2.x) does it either.

liana:~$ bash --version
GNU bash, version 2.05b.0(1)-release (i386-pc-linux-gnu)
Copyright (C) 2002 Free Software Foundation, Inc.

liana:~$ man bash
[...]
   Arrays
       Bash  provides  one-dimensional array variables.  Any variable may be
       used as an array; the declare  builtin  will  explicitly  declare  an
[...]

Scripting Question

[Scott@Charter]

[-- Attachment #1: Type: text/plain, Size: 459 bytes --]

Thanks for the answers everyone.  Now I need to get a comparison between a
bash script and a Perl script.  I know there probably is no comparison but
it will help me.

Can I get a short script, one in Perl and one in bash that, let's say,
prints the odd numbers between 1 and 10.  That should be pretty short and
sweet.  I don't know Perl, unfortunately.  It's been a while since I
scripted bash too.

So please let me know.

Thanks Again.
Scott  -  Reno, NV

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: Scott Smallsreed.vcf --]
[-- Type: text/x-vcard; name="Scott Smallsreed.vcf", Size: 366 bytes --]

BEGIN:VCARD
VERSION:2.1
N:Smallsreed;Scott
FN:Scott Smallsreed
TEL;HOME;VOICE:775-849-8411
TEL;HOME;FAX:775-849-8412
ADR;HOME:;;3030 Chipmunk Dr.;Washoe Valley;Nevada;89704;US
LABEL;HOME;ENCODING=QUOTED-PRINTABLE:3030 Chipmunk Dr.=0D=0AWashoe Valley, Nevada 89704=0D=0AUS
EMAIL;PREF;INTERNET:scott.smallsreed@mindspring.com
REV:20040331T211509Z
END:VCARD

Re: Scripting Question

[Richard Nairn]

Scott, Why does it seem like we are doing homework for you? It doesn't 
seem like you have done any research yourself... Maybe you can provide 
some background to help you out.

On Wed, 31 Mar 2004 13:15:09 -0800, Scott@Charter 
<scott.smallsreed@charter.net> wrote:

> Thanks for the answers everyone.  Now I need to get a comparison between 
> a
> bash script and a Perl script.  I know there probably is no comparison 
> but
> it will help me.
>
> Can I get a short script, one in Perl and one in bash that, let's say,
> prints the odd numbers between 1 and 10.  That should be pretty short and
> sweet.  I don't know Perl, unfortunately.  It's been a while since I
> scripted bash too.
>
> So please let me know.
>
> Thanks Again.
> Scott  -  Reno, NV



-- 
|       Richard Nairn          Specializing in Linux
|     Nairn Consulting         Web / Database Solutions
|        Calgary, AB
  | Richard@NairnConsulting.ca