APRS Parser

APRS Parser

[Chuck Hast]

Folks,
Was poking around trying to find something to parse aprs data and poke it
into mysql, thought that I had found something from aprsworld but when I
went to look at it, it looked like it was only the pieces needed to get the data
out of the database and into shape files...

I see a lot of comments about such code but the links are dead. Any rec-
omendations?

-- 
Chuck Hast  -- KP4DJT --
To paraphrase my flight instructor;
"the only dumb question is the one you DID NOT ask resulting in my going
out and having to identify your bits and pieces in the midst of torn
and twisted metal."

Re: APRS Parser

[Jeff Laughlin]

I started on an APRS parser written in perl. It handles most of the
major bits of the standard and I used it to dump APRS data into
postgresql and it kept up with the global APRS internet feeds no
problem, in fact I was suprised at how fast it was. It turned out that
PostgreSQL consumed vastly more system resources than the parser and
that was mostly disk IO, CPU load was relatively light. It could
certainly still use some work but it's functional and well documented
and I included example code. You can get it from
http://sourceforge.net/projects/ham-aprs-parser/


On 6/19/06, Chuck Hast <wchast@gmail.com> wrote:
> Folks,
> Was poking around trying to find something to parse aprs data and poke it
> into mysql, thought that I had found something from aprsworld but when I
> went to look at it, it looked like it was only the pieces needed to get the data
> out of the database and into shape files...
>
> I see a lot of comments about such code but the links are dead. Any rec-
> omendations?
>
> --
> Chuck Hast  -- KP4DJT --
> To paraphrase my flight instructor;
> "the only dumb question is the one you DID NOT ask resulting in my going
> out and having to identify your bits and pieces in the midst of torn
> and twisted metal."
> -
> To unsubscribe from this list: send the line "unsubscribe linux-hams" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>


-- 
73 de n1ywb

Re: APRS Parser

[Curt, WE7U]

On Mon, 19 Jun 2006, Jeff Laughlin wrote:

> I started on an APRS parser written in perl. It handles most of the
> major bits of the standard and I used it to dump APRS data into
> postgresql and it kept up with the global APRS internet feeds no
> problem, in fact I was suprised at how fast it was. It turned out that
> PostgreSQL consumed vastly more system resources than the parser and
> that was mostly disk IO, CPU load was relatively light. It could
> certainly still use some work but it's functional and well documented
> and I included example code. You can get it from
> http://sourceforge.net/projects/ham-aprs-parser/

There's also the Perl APRS code that Ian wrote (the APRS spec
editor) which validates packets.  I should have a copy of it around
somewhere if you can't find it on the 'net.  That would be excellent
code to have around as an example, just because it was at one time
the most complete Perl decoder implementation.

On SourceForge I believe there are C++ classes and perhaps Java code
for parsing APRS sentences, and of course the Xastir project
(SourceForge again) has a bunch of C code.  It's a _bunch_ of C code
though!

I also have Perl code for authenticating on the 'net if you'd like
that.  It's a direct Perl translation of the C-code that Steve Dimse
published and I use it extensively in my Perl scripts which inject
objects into Firenet.

--
Curt, WE7U.   APRS Client Comparisons: http://www.eskimo.com/~archer
"Lotto:    A tax on people who are bad at math." -- unknown
"Windows:  Microsoft's tax on computer illiterates." -- WE7U
"The world DOES revolve around me:  I picked the coordinate system!"

Re: APRS Parser

[Chuck Hast]

On 6/20/06, Curt, WE7U <archer@eskimo.com> wrote:
> On Mon, 19 Jun 2006, Jeff Laughlin wrote:
>
> > I started on an APRS parser written in perl. It handles most of the
> > major bits of the standard and I used it to dump APRS data into
> > postgresql and it kept up with the global APRS internet feeds no
> > problem, in fact I was suprised at how fast it was. It turned out that
> > PostgreSQL consumed vastly more system resources than the parser and
> > that was mostly disk IO, CPU load was relatively light. It could
> > certainly still use some work but it's functional and well documented
> > and I included example code. You can get it from
> > http://sourceforge.net/projects/ham-aprs-parser/
>
> There's also the Perl APRS code that Ian wrote (the APRS spec
> editor) which validates packets.  I should have a copy of it around
> somewhere if you can't find it on the 'net.  That would be excellent
> code to have around as an example, just because it was at one time
> the most complete Perl decoder implementation.
>
> On SourceForge I believe there are C++ classes and perhaps Java code
> for parsing APRS sentences, and of course the Xastir project
> (SourceForge again) has a bunch of C code.  It's a _bunch_ of C code
> though!
>
> I also have Perl code for authenticating on the 'net if you'd like
> that.  It's a direct Perl translation of the C-code that Steve Dimse
> published and I use it extensively in my Perl scripts which inject
> objects into Firenet.
>

Curt,
Thank you, I will go dig it up too, I am not a coder, but will try anything if
I have enough samples!!

-- 
Chuck Hast  -- KP4DJT --
To paraphrase my flight instructor;
"the only dumb question is the one you DID NOT ask resulting in my going
out and having to identify your bits and pieces in the midst of torn
and twisted metal."

Re: APRS Parser

[Curt, WE7U]

On Tue, 20 Jun 2006, Chuck Hast wrote:

> Thank you, I will go dig it up too, I am not a coder, but will try anything if
> I have enough samples!!

Try this in Google:

    perl ian aprs parser

Looks like Jeff has a Perl parser already written!

--
Curt, WE7U.   APRS Client Comparisons: http://www.eskimo.com/~archer
"Lotto:    A tax on people who are bad at math." -- unknown
"Windows:  Microsoft's tax on computer illiterates." -- WE7U
"The world DOES revolve around me:  I picked the coordinate system!"

Re: APRS Parser

[Curt, WE7U]

On Tue, 20 Jun 2006, Curt, WE7U wrote:

> On Tue, 20 Jun 2006, Chuck Hast wrote:
>
> > Thank you, I will go dig it up too, I am not a coder, but will try anything if
> > I have enough samples!!
>
> Try this in Google:
>
>     perl ian aprs parser
>
> Looks like Jeff has a Perl parser already written!

And if I could actually _read_ this morning I wouldn't have had to
say that!  Time to go hit the pepsi machine I guess.

This looks to be a description of the newish version of Ian Wade's
packet decoder program, with a link at the bottom to the code which
doesn't work:

    http://db0sif.darc.de/cgi-bin/dpcmd?R%20SOFTWARE%203309

Put "aprsdecu.tar" into Google and you'll find sites where it's
available though.

--
Curt, WE7U.   APRS Client Comparisons: http://www.eskimo.com/~archer
"Lotto:    A tax on people who are bad at math." -- unknown
"Windows:  Microsoft's tax on computer illiterates." -- WE7U
"The world DOES revolve around me:  I picked the coordinate system!"

Re: APRS Parser

[Curt, WE7U]

Here's another link:

    http://www.tapr.org/~g3nrw/

--
Curt, WE7U.   APRS Client Comparisons: http://www.eskimo.com/~archer
"Lotto:    A tax on people who are bad at math." -- unknown
"Windows:  Microsoft's tax on computer illiterates." -- WE7U
"The world DOES revolve around me:  I picked the coordinate system!"

Re: APRS Parser

[Chuck Hast]

On 6/20/06, Curt, WE7U <archer@eskimo.com> wrote:
>
> Here's another link:
>
>     http://www.tapr.org/~g3nrw/

Just drove into Ft Lauderdale for the night... I will go look at it all a soon
as I get settled into this room or tomorrow prior to driving back to Tampa.

Thanks again for the info, and am going to look and poke at it all.

-- 
Chuck Hast  -- KP4DJT --
To paraphrase my flight instructor;
"the only dumb question is the one you DID NOT ask resulting in my going
out and having to identify your bits and pieces in the midst of torn
and twisted metal."

Re: APRS Parser

[Chuck Hast]

On 6/20/06, Curt, WE7U <archer@eskimo.com> wrote:
>
> Here's another link:
>
>     http://www.tapr.org/~g3nrw/
>

OK, went and found them all and pulled them down. How would you reco-
mend that I put the data into a db? Or is there a piece for that too? I though
that the aprsworld site had one but what I found was the piece that converts
the data to shp files. (sql2shp).

Once I have it poked into something like mysql then I will be able to do what
I really want with it.


-- 
Chuck Hast  -- KP4DJT --
To paraphrase my flight instructor;
"the only dumb question is the one you DID NOT ask resulting in my going
out and having to identify your bits and pieces in the midst of torn
and twisted metal."

Re: APRS Parser

[Curt, WE7U]

On Wed, 21 Jun 2006, Chuck Hast wrote:

> OK, went and found them all and pulled them down. How would you reco-
> mend that I put the data into a db? Or is there a piece for that too? I though
> that the aprsworld site had one but what I found was the piece that converts
> the data to shp files. (sql2shp).

    http://sourceforge.net/projects/aprsworld


> Once I have it poked into something like mysql then I will be able to do what
> I really want with it.

That's what the aprsworld code is stated to do.

--
Curt, WE7U.   APRS Client Comparisons: http://www.eskimo.com/~archer
"Lotto:    A tax on people who are bad at math." -- unknown
"Windows:  Microsoft's tax on computer illiterates." -- WE7U
"The world DOES revolve around me:  I picked the coordinate system!"

Re: APRS Parser

[Chuck Hast]

On 6/22/06, Curt, WE7U <archer@eskimo.com> wrote:
> On Wed, 21 Jun 2006, Chuck Hast wrote:
>
> > OK, went and found them all and pulled them down. How would you reco-
> > mend that I put the data into a db? Or is there a piece for that too? I though
> > that the aprsworld site had one but what I found was the piece that converts
> > the data to shp files. (sql2shp).
>
>     http://sourceforge.net/projects/aprsworld
>
>
> > Once I have it poked into something like mysql then I will be able to do what
> > I really want with it.
>
> That's what the aprsworld code is stated to do.

That is what the short description says about the download but when you go
and grab it what you get is something called sql2shp, and when you look
at it (at least this is what I understood) it says it is the piece
that takes the
data out of the qsl and creates shp files... I did not see anything about
stuffing it into the db, even though the descripton does say that on the
download page.

-- 
Chuck Hast  -- KP4DJT --
To paraphrase my flight instructor;
"the only dumb question is the one you DID NOT ask resulting in my going
out and having to identify your bits and pieces in the midst of torn
and twisted metal."

Re: APRS Parser

[Curt, WE7U]

On Thu, 22 Jun 2006, Chuck Hast wrote:

> That is what the short description says about the download but when you go
> and grab it what you get is something called sql2shp, and when you look
> at it (at least this is what I understood) it says it is the piece
> that takes the
> data out of the qsl and creates shp files... I did not see anything about
> stuffing it into the db, even though the descripton does say that on the
> download page.

Apologies.  You're correct that the released files consist of only
that one.

Look in CVS however.  The Browse CVS section has a directory called
"Parse".

I'd suggest doing an anon CVS checkout of the pieces that look
interesting.

You can also e-mail James.  He's usually very helpful.

--
Curt, WE7U.   APRS Client Comparisons: http://www.eskimo.com/~archer
"Lotto:    A tax on people who are bad at math." -- unknown
"Windows:  Microsoft's tax on computer illiterates." -- WE7U
"The world DOES revolve around me:  I picked the coordinate system!"

Re: APRS Parser

[Chuck Hast]

On 6/22/06, Curt, WE7U <archer@eskimo.com> wrote:
> On Thu, 22 Jun 2006, Chuck Hast wrote:
>
> > That is what the short description says about the download but when you go
> > and grab it what you get is something called sql2shp, and when you look
> > at it (at least this is what I understood) it says it is the piece
> > that takes the
> > data out of the qsl and creates shp files... I did not see anything about
> > stuffing it into the db, even though the descripton does say that on the
> > download page.
>
> Apologies.  You're correct that the released files consist of only
> that one.
>
> Look in CVS however.  The Browse CVS section has a directory called
> "Parse".
>
> I'd suggest doing an anon CVS checkout of the pieces that look
> interesting.
>
> You can also e-mail James.  He's usually very helpful.

Curt,
thank you I will do so. Trying to build up a system to capture some WX and
also water level monitors like the one on my dock which can be seen at
map.findu.com/kp4djt-6

Indeed what I want to do is capture the data from a group of those devices
so I can rapidly dispay it locally and graph it, when Alberto went by here I
observed some interesting water level changes, and want to capture that
data into a db somewhere for later processing, and also want to do so for
other such devices.

I have done this for rf coverage data now it is time to try my hand at this
stuff.


-- 
Chuck Hast  -- KP4DJT --
To paraphrase my flight instructor;
"the only dumb question is the one you DID NOT ask resulting in my going
out and having to identify your bits and pieces in the midst of torn
and twisted metal."

Re: APRS Parser

[Curt, WE7U]

On Thu, 22 Jun 2006, Chuck Hast wrote:

> Indeed what I want to do is capture the data from a group of those devices
> so I can rapidly dispay it locally and graph it, when Alberto went by here I
> observed some interesting water level changes, and want to capture that
> data into a db somewhere for later processing, and also want to do so for
> other such devices.

Are you connected to Firenet?  I'm posting thousands of objects
there for water level.  Might be of interest.

--
Curt, WE7U.   APRS Client Comparisons: http://www.eskimo.com/~archer
"Lotto:    A tax on people who are bad at math." -- unknown
"Windows:  Microsoft's tax on computer illiterates." -- WE7U
"The world DOES revolve around me:  I picked the coordinate system!"

Re: APRS Parser

[Chuck Hast]

On 6/22/06, Curt, WE7U <archer@eskimo.com> wrote:
> On Thu, 22 Jun 2006, Chuck Hast wrote:
>
> > Indeed what I want to do is capture the data from a group of those devices
> > so I can rapidly dispay it locally and graph it, when Alberto went by here I
> > observed some interesting water level changes, and want to capture that
> > data into a db somewhere for later processing, and also want to do so for
> > other such devices.
>
> Are you connected to Firenet?  I'm posting thousands of objects
> there for water level.  Might be of interest.
>

No though Bob B. contacted firenet for the 'to' field ID that is used in the
FloodAdvisor devices I am using.

How do we go about this?

-- 
Chuck Hast  -- KP4DJT --
To paraphrase my flight instructor;
"the only dumb question is the one you DID NOT ask resulting in my going
out and having to identify your bits and pieces in the midst of torn
and twisted metal."

Re: APRS Parser

[Curt, WE7U]

On Thu, 22 Jun 2006, Chuck Hast wrote:

> > Are you connected to Firenet?  I'm posting thousands of objects
> > there for water level.  Might be of interest.
> >
>
> No though Bob B. contacted firenet for the 'to' field ID that is used in the
> FloodAdvisor devices I am using.
>
> How do we go about this?

Try starting at the APRS Wiki pages:

    http://info.aprs.net/

Click on "Related Systems" and then "Firenet"

I'm one of the Firenet members/contributors.  We generate a LOT of
objects for Firenet that you never see on APRS-IS.  In fact I have
35753 objects/stations in my Xastir database here right now, for
just the last 24 hours.

--
Curt, WE7U.   APRS Client Comparisons: http://www.eskimo.com/~archer
"Lotto:    A tax on people who are bad at math." -- unknown
"Windows:  Microsoft's tax on computer illiterates." -- WE7U
"The world DOES revolve around me:  I picked the coordinate system!"