Lost ACL

Lost ACL

[Joachim Reichelt]

Dear all,

on SuSE 8.1 we have a fileserver with acl's on 500GB on a hardware raid.
Now we had to powerdown the system. The controler seems to have not
properly written all data to disk. So i had to do a
reiserfsck --fix-fixable /dev/sda8

This did nearly the whole job, but left me with a tree
./.reiserfs_privat/xattr/ (size of dir is ~38MB)
The files thereis seems to be two hex numbers seperated by a dot e.g. 
12E63C.24C58
and no acl.
What can I do to get acl back?

-- 
Mit freundlichen Gruessen                         Best Regards
 
         Joachim Reichelt

WWW: http://www.gbf.de         _/_/_/   _/_/_/   _/_/_/_/
WWW: http://www.gbf.de/sb    _/    _/  _/   _/  _/
                            _/        _/   _/  _/
Mascheroder Weg 1          _/  _/    _/_/_/   _/_/_/
D-38124 Braunschweig      _/    _/  _/   _/  _/
Tel: +(49) 531 6181 352  _/    _/  _/   _/  _/
FAX: +(49) 531 2612 388   _/_/_/  _/_/_/   _/

			SB  - Strukturbiologie
              GBF - Gesellschaft fuer Biotechnologische Forschung
                    German Research Centre for Biotechnology

See me at:
EMAIL: REICHELT@gbf.de    WWW:  http://www.gbf.de/sb/Reichelt.htm

-- Disclaimer --
Standard > Keyword : Opinions, my own, nobody else's, whatsoever ...

Man muss sich notfalls jemand mieten,
hat man an Geist selbst nichts zu bieten!     (Heinz Erhardt)

Re: Lost ACL

[Jeff Mahoney]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Joachim Reichelt wrote:
| Dear all,
|
| on SuSE 8.1 we have a fileserver with acl's on 500GB on a hardware raid.
| Now we had to powerdown the system. The controler seems to have not
| properly written all data to disk. So i had to do a
| reiserfsck --fix-fixable /dev/sda8
|
| This did nearly the whole job, but left me with a tree
| ./.reiserfs_privat/xattr/ (size of dir is ~38MB)
| The files thereis seems to be two hex numbers seperated by a dot e.g.
| 12E63C.24C58
| and no acl.
| What can I do to get acl back?
|

The .reiserfs_priv/xattr hierarchy is how my xattr/acl code stores the
ACLs without a disk format change. The hex numbers are
<objectid>.<generation number>, and then the individual xattrs are
stored inside that directory with their name as the filenames.

This directory is hidden (and used to find ACLs) when ACLs or xattrs are
enabled. Is your filesystem mounted with -oacl?

- -Jeff

- --
Jeff Mahoney
SuSE Labs
jeffm@suse.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.2 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFALRslLPWxlyuTD7IRApbCAJ9f3B9rMpyv0Q56SRsMWsWuyTBA8ACgk6Uc
wp668pLEYc8+fFvKFqzJ27M=
=nqru
-----END PGP SIGNATURE-----

Re: Lost ACL

[Nikita Danilov]

Jeff Mahoney writes:
 > -----BEGIN PGP SIGNED MESSAGE-----
 > Hash: SHA1
 > 
 > Joachim Reichelt wrote:
 > | Dear all,
 > |
 > | on SuSE 8.1 we have a fileserver with acl's on 500GB on a hardware raid.
 > | Now we had to powerdown the system. The controler seems to have not
 > | properly written all data to disk. So i had to do a
 > | reiserfsck --fix-fixable /dev/sda8
 > |
 > | This did nearly the whole job, but left me with a tree
 > | ./.reiserfs_privat/xattr/ (size of dir is ~38MB)
 > | The files thereis seems to be two hex numbers seperated by a dot e.g.
 > | 12E63C.24C58
 > | and no acl.
 > | What can I do to get acl back?
 > |
 > 
 > The .reiserfs_priv/xattr hierarchy is how my xattr/acl code stores the
 > ACLs without a disk format change. The hex numbers are
 > <objectid>.<generation number>, and then the individual xattrs are
 > stored inside that directory with their name as the filenames.
 > 
 > This directory is hidden (and used to find ACLs) when ACLs or xattrs are
 > enabled. Is your filesystem mounted with -oacl?

As Vladimir suggested, it may be fsck that "restored" .reiserfs_priv and
made it visible.

 > 
 > - -Jeff
 > 

Nikita.

 > - --
 > Jeff Mahoney
 > SuSE Labs
 > jeffm@suse.com

Re: Lost ACL

[Jeff Mahoney]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Nikita Danilov wrote:
|  > The .reiserfs_priv/xattr hierarchy is how my xattr/acl code stores the
|  > ACLs without a disk format change. The hex numbers are
|  > <objectid>.<generation number>, and then the individual xattrs are
|  > stored inside that directory with their name as the filenames.
|  >
|  > This directory is hidden (and used to find ACLs) when ACLs or
xattrs are
|  > enabled. Is your filesystem mounted with -oacl?
|
| As Vladimir suggested, it may be fsck that "restored" .reiserfs_priv and
| made it visible.

No, the fact that it may have been "restored" is irrelevant. The
.reiserfs_priv directory doesn't employ reiserfs hidden directory
entries - it's hidden by loading the directory entry at filesystem
mount, and then poisoning the results of reiserfs_lookup() and
reiserfs_readdir().

- -Jeff

- --
Jeff Mahoney
SuSE Labs
jeffm@suse.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.2 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFALTf1LPWxlyuTD7IRAv/XAJ474Bpj9DuSXAQy2lAbB/e30ZXEHgCeO8u3
DkP+rb7X9c5nRBJPS1DUOd4=
=EdYz
-----END PGP SIGNATURE-----

Re: Lost ACL

[Joachim Reichelt]

Jeff Mahoney schrieb am 02/13/2004 09:47 PM:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Nikita Danilov wrote:
> |  > The .reiserfs_priv/xattr hierarchy is how my xattr/acl code 
> stores the
> |  > ACLs without a disk format change. The hex numbers are
> |  > <objectid>.<generation number>, and then the individual xattrs are
> |  > stored inside that directory with their name as the filenames.
> |  >
> |  > This directory is hidden (and used to find ACLs) when ACLs or
> xattrs are
> |  > enabled. Is your filesystem mounted with -oacl?
> |
> | As Vladimir suggested, it may be fsck that "restored" .reiserfs_priv 
> and
> | made it visible.
>
> No, the fact that it may have been "restored" is irrelevant. The
> .reiserfs_priv directory doesn't employ reiserfs hidden directory
> entries - it's hidden by loading the directory entry at filesystem
> mount, and then poisoning the results of reiserfs_lookup() and
> reiserfs_readdir().

Dear all,

i just got 2.4.25 up.
But there is no ACL anywhere in the kernel.
Do I have to patch something
I found ACL in ext3, xfs....
And in fs/reiserfs/super.c is:
~617:
    opt_desc_t opts[] = {
                {"tails", 't', tails, 0, 0},
                /* Compatibility stuff, so that -o notail
                   for old setups still work */
                {"notail", 0, 0, 0, 
(1<<REISERFS_LARGETAIL)|(1<<REISERFS_SMALLTAIL)},
                {"conv", 0, 0, 1<<REISERFS_CONVERT, 0},
                {"nolog", 0, 0, 0, 0}, /* This is unsupported */
                {"replayonly", 0, 0, 1<<REPLAYONLY, 0},

                {"block-allocator", 'a', balloc, 0, 0},
                {"hash", 'h', hash, 1<<FORCE_HASH_DETECT, 0},

                {"resize", 'r', 0, 0, 0},
                {"attrs", 0, 0, 1<<REISERFS_ATTRS, 0},
                {"noattrs", 0, 0, 0, 1<<REISERFS_ATTRS},
                {NULL, 0, 0, 0, 0}

So there are NO ACLs in the code?????????

>
> - -Jeff
>
> - --
> Jeff Mahoney
> SuSE Labs
> jeffm@suse.com
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.2.2 (GNU/Linux)
> Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
>
> iD8DBQFALTf1LPWxlyuTD7IRAv/XAJ474Bpj9DuSXAQy2lAbB/e30ZXEHgCeO8u3
> DkP+rb7X9c5nRBJPS1DUOd4=
> =EdYz
> -----END PGP SIGNATURE-----


-- 
Mit freundlichen Gruessen                         Best Regards
 
         Joachim Reichelt

WWW: http://www.gbf.de         _/_/_/   _/_/_/   _/_/_/_/
WWW: http://www.gbf.de/sb    _/    _/  _/   _/  _/
                            _/        _/   _/  _/
Mascheroder Weg 1          _/  _/    _/_/_/   _/_/_/
D-38124 Braunschweig      _/    _/  _/   _/  _/
Tel: +(49) 531 6181 352  _/    _/  _/   _/  _/
FAX: +(49) 531 2612 388   _/_/_/  _/_/_/   _/

			SB  - Strukturbiologie
              GBF - Gesellschaft fuer Biotechnologische Forschung
                    German Research Centre for Biotechnology

See me at:
EMAIL: REICHELT@gbf.de    WWW:  http://www.gbf.de/sb/Reichelt.htm

-- Disclaimer --
Standard > Keyword : Opinions, my own, nobody else's, whatsoever ...

Man muss sich notfalls jemand mieten,
hat man an Geist selbst nichts zu bieten!     (Heinz Erhardt)

Re: Lost ACL

[Jeff Mahoney]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Joachim Reichelt wrote:
|> i just got 2.4.25 up.
|> But there is no ACL anywhere in the kernel.
|> Do I have to patch something
|> I found ACL in ext3, xfs....
|> So there are NO ACLs in the code?????????

ACLs and Extended Attributes are an external patch. The SuSE kernels
have them by default, which is why you were able to use them with your
SuSE install. Periodically, I sync up the ACL code with the mainline
kernels.

Expect an updated version for 2.4.25 later today on my ftp site:
ftp://ftp.suse.com/pub/people/jeffm/reiserfs/aclea/

- -Jeff

- --
Jeff Mahoney
SuSE Labs
jeffm@suse.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.2 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFANO6xLPWxlyuTD7IRAu5IAJ97+B9WONZcHLIhdsnZKPpBgnbbJQCeIKlT
UG3CroWtW/w6Ffg3StT/zG8=
=QdJX
-----END PGP SIGNATURE-----

Re: Lost ACL

[Jeff Mahoney]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Jeff Mahoney wrote:
| Joachim Reichelt wrote:
| |> i just got 2.4.25 up.
| |> But there is no ACL anywhere in the kernel.
| |> Do I have to patch something
| |> I found ACL in ext3, xfs....
| |> So there are NO ACLs in the code?????????
|
| ACLs and Extended Attributes are an external patch. The SuSE kernels
| have them by default, which is why you were able to use them with your
| SuSE install. Periodically, I sync up the ACL code with the mainline
| kernels.
|
| Expect an updated version for 2.4.25 later today on my ftp site:
| ftp://ftp.suse.com/pub/people/jeffm/reiserfs/aclea/

To follow up; The 2.4.23 patches apply cleanly to 2.4.24 and 2.4.25.

- -Jeff

- --
Jeff Mahoney
SuSE Labs
jeffm@suse.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.2 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFANPNxLPWxlyuTD7IRAt5XAKCVksCWf0+xWwJazaIlqLT5UiXfRQCeJrbx
5HZlQuQiM/AwfeJQ0Xqjl1k=
=ww5l
-----END PGP SIGNATURE-----

Re: Lost ACL

[Joachim Reichelt]

Jeff Mahoney schrieb am 02/19/2004 06:33 PM:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Jeff Mahoney wrote:
> | Joachim Reichelt wrote:
> | |> i just got 2.4.25 up.
> | |> But there is no ACL anywhere in the kernel.
> | |> Do I have to patch something
> | |> I found ACL in ext3, xfs....
> | |> So there are NO ACLs in the code?????????
> |
> | ACLs and Extended Attributes are an external patch. The SuSE kernels
> | have them by default, which is why you were able to use them with your
> | SuSE install. Periodically, I sync up the ACL code with the mainline
> | kernels.
> |
> | Expect an updated version for 2.4.25 later today on my ftp site:
> | ftp://ftp.suse.com/pub/people/jeffm/reiserfs/aclea/
>
> To follow up; The 2.4.23 patches apply cleanly to 2.4.24 and 2.4.25.
>
Yes, thats true, but :
make config
make dep
make bzImage
gives
...
In file included from namei.c:9:
/usr/src/linux-2.4.25/include/linux/reiserfs_acl.h:2: linux/posix_acl.h: 
Datei oder Verzeichnis nicht gefunden
/usr/src/linux-2.4.25/include/linux/reiserfs_acl.h:3: linux/xattr_acl.h: 
Datei oder Verzeichnis nicht gefunden
namei.c:1320: warning: initialization from incompatible pointer type
namei.c:1335: warning: initialization from incompatible pointer type
...
AND
sbjre:/usr/src/linux # find .. -name posix_acl.h -o -name xattr_acl.h
../linux-2.4.18.SuSE/include/linux/posix_acl.h

btw:
I have a 2.4.23 source tree there too.

> - -Jeff
>
> - --
> Jeff Mahoney
> SuSE Labs
> jeffm@suse.com
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.2.2 (GNU/Linux)
> Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
>
> iD8DBQFANPNxLPWxlyuTD7IRAt5XAKCVksCWf0+xWwJazaIlqLT5UiXfRQCeJrbx
> 5HZlQuQiM/AwfeJQ0Xqjl1k=
> =ww5l
> -----END PGP SIGNATURE-----


-- 
Mit freundlichen Gruessen                         Best Regards
 
         Joachim Reichelt

WWW: http://www.gbf.de         _/_/_/   _/_/_/   _/_/_/_/
WWW: http://www.gbf.de/sb    _/    _/  _/   _/  _/
                            _/        _/   _/  _/
Mascheroder Weg 1          _/  _/    _/_/_/   _/_/_/
D-38124 Braunschweig      _/    _/  _/   _/  _/
Tel: +(49) 531 6181 352  _/    _/  _/   _/  _/
FAX: +(49) 531 2612 388   _/_/_/  _/_/_/   _/

			SB  - Strukturbiologie
              GBF - Gesellschaft fuer Biotechnologische Forschung
                    German Research Centre for Biotechnology

See me at:
EMAIL: REICHELT@gbf.de    WWW:  http://www.gbf.de/sb/Reichelt.htm

-- Disclaimer --
Standard > Keyword : Opinions, my own, nobody else's, whatsoever ...

Man muss sich notfalls jemand mieten,
hat man an Geist selbst nichts zu bieten!     (Heinz Erhardt)

Re: Lost ACL

[Joachim Reichelt]

Joachim Reichelt schrieb am 02/20/2004 09:03 AM:

>
>
> Jeff Mahoney schrieb am 02/19/2004 06:33 PM:
>
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
>>
>> Jeff Mahoney wrote:
>> | Joachim Reichelt wrote:
>> | |> i just got 2.4.25 up.
>> | |> But there is no ACL anywhere in the kernel.
>> | |> Do I have to patch something
>> | |> I found ACL in ext3, xfs....
>> | |> So there are NO ACLs in the code?????????
>> |
>> | ACLs and Extended Attributes are an external patch. The SuSE kernels
>> | have them by default, which is why you were able to use them with your
>> | SuSE install. Periodically, I sync up the ACL code with the mainline
>> | kernels.
>> |
>> | Expect an updated version for 2.4.25 later today on my ftp site:
>> | ftp://ftp.suse.com/pub/people/jeffm/reiserfs/aclea/
>>
>> To follow up; The 2.4.23 patches apply cleanly to 2.4.24 and 2.4.25.
>>
> Yes, thats true, but :
> make config
> make dep
> make bzImage
> gives
> ...
> In file included from namei.c:9:
> /usr/src/linux-2.4.25/include/linux/reiserfs_acl.h:2: 
> linux/posix_acl.h: Datei oder Verzeichnis nicht gefunden
> /usr/src/linux-2.4.25/include/linux/reiserfs_acl.h:3: 
> linux/xattr_acl.h: Datei oder Verzeichnis nicht gefunden
> namei.c:1320: warning: initialization from incompatible pointer type
> namei.c:1335: warning: initialization from incompatible pointer type
> ...
> AND
> sbjre:/usr/src/linux # find .. -name posix_acl.h -o -name xattr_acl.h
> ../linux-2.4.18.SuSE/include/linux/posix_acl.h
>
> btw:
> I have a 2.4.23 source tree there too.
>
O.K.
I forgot to read README!
These patches apply after Andreas Gruenbacher's ACL/EA patches from
http://acl.bestbits.at

>> - -Jeff
>>
>> - --
>> Jeff Mahoney
>> SuSE Labs
>> jeffm@suse.com
>> -----BEGIN PGP SIGNATURE-----
>> Version: GnuPG v1.2.2 (GNU/Linux)
>> Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
>>
>> iD8DBQFANPNxLPWxlyuTD7IRAt5XAKCVksCWf0+xWwJazaIlqLT5UiXfRQCeJrbx
>> 5HZlQuQiM/AwfeJQ0Xqjl1k=
>> =ww5l
>> -----END PGP SIGNATURE-----
>
>
>

-- 
Mit freundlichen Gruessen                         Best Regards
 
         Joachim Reichelt

WWW: http://www.gbf.de         _/_/_/   _/_/_/   _/_/_/_/
WWW: http://www.gbf.de/sb    _/    _/  _/   _/  _/
                            _/        _/   _/  _/
Mascheroder Weg 1          _/  _/    _/_/_/   _/_/_/
D-38124 Braunschweig      _/    _/  _/   _/  _/
Tel: +(49) 531 6181 352  _/    _/  _/   _/  _/
FAX: +(49) 531 2612 388   _/_/_/  _/_/_/   _/

			SB  - Strukturbiologie
              GBF - Gesellschaft fuer Biotechnologische Forschung
                    German Research Centre for Biotechnology

See me at:
EMAIL: REICHELT@gbf.de    WWW:  http://www.gbf.de/sb/Reichelt.htm

-- Disclaimer --
Standard > Keyword : Opinions, my own, nobody else's, whatsoever ...

Man muss sich notfalls jemand mieten,
hat man an Geist selbst nichts zu bieten!     (Heinz Erhardt)

Re: Lost ACL

[Joachim Reichelt]

Jeff Mahoney schrieb am 02/13/2004 07:44 PM:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Joachim Reichelt wrote:
> | Dear all,
> |
> | on SuSE 8.1 we have a fileserver with acl's on 500GB on a hardware 
> raid.
> | Now we had to powerdown the system. The controler seems to have not
> | properly written all data to disk. So i had to do a
> | reiserfsck --fix-fixable /dev/sda8
> |
> | This did nearly the whole job, but left me with a tree
> | ./.reiserfs_privat/xattr/ (size of dir is ~38MB)
> | The files thereis seems to be two hex numbers seperated by a dot e.g.
> | 12E63C.24C58
> | and no acl.
> | What can I do to get acl back?
> |
>
> The .reiserfs_priv/xattr hierarchy is how my xattr/acl code stores the
> ACLs without a disk format change. The hex numbers are
> <objectid>.<generation number>, and then the individual xattrs are
> stored inside that directory with their name as the filenames.
>
> This directory is hidden (and used to find ACLs) when ACLs or xattrs are
> enabled. Is your filesystem mounted with -oacl?
>
Dear all,

when i do
# mount -treiserfs -o acl /dev/sda9 /home/
mount: wrong fs type, bad option, bad superblock on /dev/sda9,
       or too many mounted file systems

So I tried:
# mount /home
mount: wrong fs type, bad option, bad superblock on /dev/sda9,
       or too many mounted file systems

# grep sda9 /etc/fstab
/dev/sda9            /home                reiserfs   
defaults,noatime,acl          1 2

# mount /dev/sda9 /home
-> successs

# uname -a
Linux zibsrv34 2.4.19-4GB #1 Fri Sep 13 13:14:56 UTC 2002 i686 unknown

It is a default SuSE kernel. I cannot update at now, couse I have a 
IDE-Raid with binary only driver.

> - -Jeff
>
> - --
> Jeff Mahoney
> SuSE Labs
> jeffm@suse.com
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.2.2 (GNU/Linux)
> Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
>
> iD8DBQFALRslLPWxlyuTD7IRApbCAJ9f3B9rMpyv0Q56SRsMWsWuyTBA8ACgk6Uc
> wp668pLEYc8+fFvKFqzJ27M=
> =nqru
> -----END PGP SIGNATURE-----


-- 
Mit freundlichen Gruessen                         Best Regards
 
         Joachim Reichelt

WWW: http://www.gbf.de         _/_/_/   _/_/_/   _/_/_/_/
WWW: http://www.gbf.de/sb    _/    _/  _/   _/  _/
                            _/        _/   _/  _/
Mascheroder Weg 1          _/  _/    _/_/_/   _/_/_/
D-38124 Braunschweig      _/    _/  _/   _/  _/
Tel: +(49) 531 6181 352  _/    _/  _/   _/  _/
FAX: +(49) 531 2612 388   _/_/_/  _/_/_/   _/

			SB  - Strukturbiologie
              GBF - Gesellschaft fuer Biotechnologische Forschung
                    German Research Centre for Biotechnology

See me at:
EMAIL: REICHELT@gbf.de    WWW:  http://www.gbf.de/sb/Reichelt.htm

-- Disclaimer --
Standard > Keyword : Opinions, my own, nobody else's, whatsoever ...

Man muss sich notfalls jemand mieten,
hat man an Geist selbst nichts zu bieten!     (Heinz Erhardt)

Re: Lost ACL

[Jeff Mahoney]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Joachim Reichelt wrote:

| when i do
| # mount -treiserfs -o acl /dev/sda9 /home/
| mount: wrong fs type, bad option, bad superblock on /dev/sda9,
|       or too many mounted file systems
|
| So I tried:
| # mount /home
| mount: wrong fs type, bad option, bad superblock on /dev/sda9,
|       or too many mounted file systems
|
| # grep sda9 /etc/fstab
| /dev/sda9            /home                reiserfs
| defaults,noatime,acl          1 2
|
| # mount /dev/sda9 /home
| -> successs
|
| # uname -a
| Linux zibsrv34 2.4.19-4GB #1 Fri Sep 13 13:14:56 UTC 2002 i686 unknown
|
| It is a default SuSE kernel. I cannot update at now, couse I have a
| IDE-Raid with binary only driver.

Sorry for the late reply, for some reason this didn't make it into my inbox.

If you're using a SuSE kernel from that time frame, it should definately
have ACLs built in to the reiserfs module.

What is the result of "zgrep CONFIG_REISERFS_FS_POSIX_ACL /proc/config.gz" ?

- -Jeff

- --
Jeff Mahoney
SuSE Labs
jeffm@suse.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.2 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFANPJuLPWxlyuTD7IRAk7sAJ9jpmUfbwyRiZyH2kzXNEIJgjZcOACfVIXP
haa/H1iKoHBqfZxEPecPmws=
=ElL5
-----END PGP SIGNATURE-----