korgalore: Mail directory keeps empty?

korgalore: Mail directory keeps empty?

[Dirk Behme]

Hi,

using korgalore 0.4 I'm trying to setup a maildir target. From [1] I 
learned that the initial pull is supposed to keep the maildir empty as 
its some kind of "initial subscription" (note #1).

But even a second pull some time later when new mails arrived on the 
tracked list still leaves it empty. See full log below [2]. There are 
some errors "maildir ~/Mail/rfl/tmp/ doesn't exist". Of course, because 
it was not created in the first run.

What have I missed?

My basic idea was to create a ~/Mail/rfl/ with the mailing list traffic 
and feed this to Thunderbird. Is this idea wrong?

Best regards

Dirk

Note #1: Does the argument for this behaviour given in [1] regarding 
gmail count for maildir as well?

[1] 
https://lore.kernel.org/tools/20260123-brawny-gregarious-pig-edcca1@lemur/

[2]

~$ kgl --version
kgl, version 0.4
~$ cat .config/korgalore/korgalore.toml
### Targets ###

[targets.local]
type = 'maildir'
path = '/home/dirk/Mail/rfl'

### Feeds ###

[feeds.rfl]
url = 'https://lore.kernel.org/rust-for-linux/'

### Deliveries ###

[deliveries.rfl]
feed = 'rfl'
target = 'local'
labels = []

~$ kgl -v DEBUG pull rfl
debug: Loading config from /home/dirk/.config/korgalore/korgalore.toml
debug: Config loaded with 1 targets, 1 deliveries, and 1 feeds
debug: Data directory: /home/dirk/.local/share/korgalore
debug: Mapping deliveries to their feeds and targets
debug: Resolved feed "rfl" to URL: https://lore.kernel.org/rust-for-linux/
debug: Acquired lock for feed 
'/home/dirk/.local/share/korgalore/rust-for-linux'.
debug: No failed commits to retry for delivery: rfl
debug: No failed commits to retry for any delivery.
debug: Running git command: git clone --mirror 
--shallow-since=1.week.ago 
https://lore.kernel.org/rust-for-linux/git/0.git 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git symbolic-ref 
-q HEAD
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
master
Initialized new feed: rust-for-linux
debug: Updated feeds:
debug: Deliveries to run:
debug: Released lock for feed 
'/home/dirk/.local/share/korgalore/rust-for-linux'.
Pull complete with no updates.
~$ ll Mail/rfl/
total 8
drwxr-xr-x 2 dirk dirk 4096 Jan 28 09:25 ./                     // <= EMPTY!
drwxr-xr-x 3 dirk dirk 4096 Jan 28 09:25 ../
~$ cd .local/share/korgalore/rust-for-linux/git/0.git/
~/.local/share/korgalore/rust-for-linux/git/0.git$ git log --oneline
164d6a6 (HEAD -> master) Re: [PATCH v2 2/4] gpu: nova-core: gsp: clarify 
comments about invariants and pointer roles
4bc11e2 Re: [PATCH v2 1/5] gpu: nova-core: use checked arithmetic in 
FWSEC firmware parsing
4f7c0aa Re: [PATCH v2 0/5] gpu: nova-core: use checked arithmetic for 
firmware parsing robustness
...
~/.local/share/korgalore/rust-for-linux/git/0.git$ cd
~$

// <= wait some time until new mails arrive ...


~$ kgl -v DEBUG pull rfl
debug: Loading config from /home/dirk/.config/korgalore/korgalore.toml
debug: Config loaded with 1 targets, 1 deliveries, and 1 feeds
debug: Data directory: /home/dirk/.local/share/korgalore
debug: Mapping deliveries to their feeds and targets
debug: Resolved feed "rfl" to URL: https://lore.kernel.org/rust-for-linux/
debug: Acquired lock for feed 
'/home/dirk/.local/share/korgalore/rust-for-linux'.
debug: No failed commits to retry for delivery: rfl
debug: No failed commits to retry for any delivery.
debug: Highest local epoch: 0
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git fetch origin 
--shallow-since=1.week.ago --update-shallow
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git symbolic-ref 
-q HEAD
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
master
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
master
debug: Highest remote epoch: 0
debug: No new epochs detected for feed 
/home/dirk/.local/share/korgalore/rust-for-linux
debug: Updated feeds: rust-for-linux
debug: Deliveries to run: rfl
debug: Processing deliveries for target: local
debug: Highest known epoch for delivery rfl: 0
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git cat-file -e 
1ff83f17d35ac13b6499d0e7f886be0e6f0e97e1^
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list 
--reverse --ancestry-path 1ff83f17d35ac13b6499d0e7f886be0e6f0e97e1..HEAD
debug: Delivering 2 messages to target: local
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git show 
8a69a61c23d6c9dc97eef8f681b49aaa6c0a0687:m
debug: Maildir target ready at /home/dirk/Mail/rfl
debug:  -> Re: [PATCH v2 2/4] gpu: nova-core: gsp: clarify comments 
about invariants and pointer roles
debug: Failed to deliver commit 8a69a61c23d6c9dc97eef8f681b49aaa6c0a0687 
from epoch 0: Failed to deliver to maildir: [Errno 2] No such file or 
directory: '/home/dirk/Mail/rfl/tmp/1769598446.M953385P720Q1.HI-C-005GF'
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git show -s 
--format=%ci 8a69a61c23d6c9dc97eef8f681b49aaa6c0a0687
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git show 
a09f7ec1930a534152d2a57082752b9f1c47b625:m
debug: Maildir target ready at /home/dirk/Mail/rfl
debug:  -> Re: [PATCH v2 1/5] gpu: nova-core: use checked arithmetic in 
FWSEC firmware parsing
debug: Failed to deliver commit a09f7ec1930a534152d2a57082752b9f1c47b625 
from epoch 0: Failed to deliver to maildir: [Errno 2] No such file or 
directory: '/home/dirk/Mail/rfl/tmp/1769598446.M957766P720Q2.HI-C-005GF'
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git show -s 
--format=%ci a09f7ec1930a534152d2a57082752b9f1c47b625
debug: Released lock for feed 
'/home/dirk/.local/share/korgalore/rust-for-linux'.
debug: No tracking manifest found, starting fresh
Pull complete with no updates.
~$ ll Mail/rfl/
total 8
drwxr-xr-x 2 dirk dirk 4096 Jan 28 09:25 ./                         // 
<= EMPTY!
drwxr-xr-x 3 dirk dirk 4096 Jan 28 09:25 ../
~$ cd .local/share/korgalore/rust-for-linux/git/0.git/
~/.local/share/korgalore/rust-for-linux/git/0.git$ git log --oneline
a09f7ec (HEAD -> master) Re: [PATCH v2 1/5] gpu: nova-core: use checked 
arithmetic in FWSEC firmware parsing   // <= New!
8a69a61 Re: [PATCH v2 2/4] gpu: nova-core: gsp: clarify comments about 
invariants and pointer roles            // <= New!
1ff83f1 Re: [PATCH 2/2] rust_binder: add binder_transaction tracepoint
164d6a6 Re: [PATCH v2 2/4] gpu: nova-core: gsp: clarify comments about 
invariants and pointer roles
4bc11e2 Re: [PATCH v2 1/5] gpu: nova-core: use checked arithmetic in 
FWSEC firmware parsing
4f7c0aa Re: [PATCH v2 0/5] gpu: nova-core: use checked arithmetic for 
firmware parsing robustness
....

Re: korgalore: Mail directory keeps empty?

[Konstantin Ryabitsev]

On Wed, Jan 28, 2026 at 12:29:05PM +0100, Dirk Behme wrote:
> But even a second pull some time later when new mails arrived on the
> tracked list still leaves it empty. See full log below [2]. There are
> some errors "maildir ~/Mail/rfl/tmp/ doesn't exist". Of course,
> because it was not created in the first run.

Thanks for the report. This was a bug in how we initialize maildir
targets. Python's mailbox.Maildir with create=True only creates the
maildir structure itself (cur/new/tmp subdirectories), but not the
parent directories leading up to it. So if you specify ~/Mail/rfl and
~/Mail/ exists but rfl/ doesn't, the initialization fails silently and
subsequent deliveries error out.

You can make things work with 0.4 if you run:

    mkdir ~/Mail/rfl/{cur,new,tmp}

This creates a valid maildir.

I've pushed a fix to master that ensures parent directories are created
before initializing the Maildir. I hope to have v0.5 out today or tomorrow,
which should contain this fix.

> My basic idea was to create a ~/Mail/rfl/ with the mailing list
> traffic and feed this to Thunderbird. Is this idea wrong?

No, that's exactly how it's supposed to work, we just didn't have enough
testing for the brand new Maildir target as opposed to existing one.

-K

Re: korgalore: Mail directory keeps empty?

[Dirk Behme]

Hi Konstantin,

On 28/01/2026 14:26, Konstantin Ryabitsev wrote:
> On Wed, Jan 28, 2026 at 12:29:05PM +0100, Dirk Behme wrote:
>> But even a second pull some time later when new mails arrived on the
>> tracked list still leaves it empty. See full log below [2]. There are
>> some errors "maildir ~/Mail/rfl/tmp/ doesn't exist". Of course,
>> because it was not created in the first run.
> 
> Thanks for the report. This was a bug in how we initialize maildir
> targets. Python's mailbox.Maildir with create=True only creates the
> maildir structure itself (cur/new/tmp subdirectories), but not the
> parent directories leading up to it. So if you specify ~/Mail/rfl and
> ~/Mail/ exists but rfl/ doesn't, the initialization fails silently and
> subsequent deliveries error out.
> 
> You can make things work with 0.4 if you run:
> 
>      mkdir ~/Mail/rfl/{cur,new,tmp}
> 
> This creates a valid maildir.
> 
> I've pushed a fix to master that ensures parent directories are created
> before initializing the Maildir. I hope to have v0.5 out today or tomorrow,
> which should contain this fix.

Many thanks for fixing this that fast!

I switched to 0.5.1, deleted the .local/share/korgalore from yesterday 
and with this started from scratch. There are no obvious errors any 
more! But even though there are new mails (commits) the second pull reports

~$ kgl -v DEBUG pull rfl // 2nd pull
...
debug: No new commits for delivery: rfl
debug: No deliveries with new commits for target: local
...
debug: No tracking manifest found, starting fresh
Pull complete with no updates.

and the existing maildir Mail/rfl/ keeps empty.

Full log below [1].

Best regards

Dirk

[1]

~$ kgl --version
kgl, version 0.5.1
~$ cd .local/share/
~/.local/share$ rm -rf korgalore/
~/.local/share$ cd
~$ kgl -v DEBUG pull rfl
debug: Loading config from /home/dirk/.config/korgalore/korgalore.toml
debug: Config loaded with 1 targets, 1 deliveries, and 1 feeds
debug: Set GIT_HTTP_USER_AGENT to: git/2.43.0 (korgalore/0.5.1)
debug: Data directory: /home/dirk/.local/share/korgalore
debug: Mapping deliveries to their feeds and targets
debug: Resolved feed "rfl" to URL: https://lore.kernel.org/rust-for-linux/
debug: Acquired lock for feed 
'/home/dirk/.local/share/korgalore/rust-for-linux'.
debug: No failed commits to retry for delivery: rfl
debug: No failed commits to retry for any delivery.
debug: Running git command: git clone --mirror 
--shallow-since=1.week.ago 
https://lore.kernel.org/rust-for-linux/git/0.git 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
--all
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git symbolic-ref 
-q HEAD
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
master
Initialized new feed: rust-for-linux
debug: Updated feeds:
debug: Deliveries to run:
debug: Released lock for feed 
'/home/dirk/.local/share/korgalore/rust-for-linux'.
Pull complete with no updates.
~$ ll Mail/rfl/
total 8
drwxr-xr-x 2 dirk dirk 4096 Jan 28 09:25 ./     // <= Empty
drwxr-xr-x 3 dirk dirk 4096 Jan 28 09:25 ../
~$ cd .local/share/korgalore/rust-for-linux/git/0.git/
~/.local/share/korgalore/rust-for-linux/git/0.git$ git log --oneline
74f78e9 (HEAD -> master) Re: [PATCH v2] rust: block: use pin_init::zeroed
3ae1de6 Re: [PATCH v2] rust: block: use pin_init::zeroed
...
~/.local/share/korgalore/rust-for-linux/git/0.git$ cd
~$

// <= wait some time until new mails arrive

~$ kgl -v DEBUG pull rfl
debug: Loading config from /home/dirk/.config/korgalore/korgalore.toml
debug: Config loaded with 1 targets, 1 deliveries, and 1 feeds
debug: Set GIT_HTTP_USER_AGENT to: git/2.43.0 (korgalore/0.5.1)
debug: Data directory: /home/dirk/.local/share/korgalore
debug: Mapping deliveries to their feeds and targets
debug: Resolved feed "rfl" to URL: https://lore.kernel.org/rust-for-linux/
debug: Acquired lock for feed 
'/home/dirk/.local/share/korgalore/rust-for-linux'.
debug: No failed commits to retry for delivery: rfl
debug: No failed commits to retry for any delivery.
debug: Highest local epoch: 0
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git fetch origin 
--shallow-since=1.week.ago --update-shallow
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
--all
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git symbolic-ref 
-q HEAD
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
master
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
--all
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
master
debug: Highest remote epoch: 0
debug: No new epochs detected for feed 
/home/dirk/.local/share/korgalore/rust-for-linux
debug: Updated feeds: rust-for-linux
debug: Deliveries to run: rfl
debug: Processing deliveries for target: local
debug: Initializing new state file for delivery: rfl
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
--all
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list -n 1 
master
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git show -s 
--format=%ci 06f5fc10d237ca604f26ac12aeef6f95f289f5c7
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git show 
06f5fc10d237ca604f26ac12aeef6f95f289f5c7:m
debug: Highest known epoch for delivery rfl: 0
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git cat-file -e 
06f5fc10d237ca604f26ac12aeef6f95f289f5c7^
debug: Running git command: git --git-dir 
/home/dirk/.local/share/korgalore/rust-for-linux/git/0.git rev-list 
--reverse --ancestry-path 06f5fc10d237ca604f26ac12aeef6f95f289f5c7..HEAD
debug: No new commits for delivery: rfl
debug: No deliveries with new commits for target: local
debug: Released lock for feed 
'/home/dirk/.local/share/korgalore/rust-for-linux'.
debug: No tracking manifest found, starting fresh
Pull complete with no updates.
~$ ll Mail/rfl/
total 8
drwxr-xr-x 2 dirk dirk 4096 Jan 28 09:25 ./      // <= Still empty !
drwxr-xr-x 3 dirk dirk 4096 Jan 28 09:25 ../
~$ cd .local/share/korgalore/rust-for-linux/git/0.git
~/.local/share/korgalore/rust-for-linux/git/0.git$ git log --oneline
06f5fc1 (HEAD -> master) Re: [PATCH v4 4/7] rust: num: add `into_inner` 
method to `Bounded`
d201eba Re: [PATCH v4 6/7] sample: rust: pci: use `register!` macro
4ffb2b7 Re: [PATCH v4 5/7] rust: io: add `register!` macro
48e8660 [PATCH v3 5/5] gpu: nova-core: gsp: fix improper indexing in 
driver_read_area
bae86e3 [PATCH v3 4/5] gpu: nova-core: gsp: fix improper handling of 
empty slot in cmdq
f9c9433 [PATCH v3 3/5] gpu: nova-core: gsp: use empty slices instead of 
[0..0] ranges
0694cf2 [PATCH v3 2/5] gpu: nova-core: gsp: clarify comments about 
invariants and pointer roles
d1f4ab2 [PATCH v3 1/5] gpu: nova-core: gsp: fix incorrect advancing of 
write pointer
7f6f4e2 [PATCH v3 0/5] gpu: nova-core: gsp: fix command queue ring 
buffer bugs
74f78e9 Re: [PATCH v2] rust: block: use pin_init::zeroed
3ae1de6 Re: [PATCH v2] rust: block: use pin_init::zeroed
....
~/.local/share/korgalore/rust-for-linux/git/0.git$ cd
~$

Re: korgalore: Mail directory keeps empty?

[Konstantin Ryabitsev]

On Thu, Jan 29, 2026 at 10:22:48AM +0100, Dirk Behme wrote:
> I switched to 0.5.1, deleted the .local/share/korgalore from yesterday and
> with this started from scratch. There are no obvious errors any more! But
> even though there are new mails (commits) the second pull reports
> 
> ~$ kgl -v DEBUG pull rfl // 2nd pull
> ...
> debug: No new commits for delivery: rfl
> debug: No deliveries with new commits for target: local
> ...
> debug: No tracking manifest found, starting fresh
> Pull complete with no updates.
> 
> and the existing maildir Mail/rfl/ keeps empty.

I see where this is happening:

- first pull clones the repository but doesn't initialize any state
- second pull initializes the state per delivery
- third pull starts actually delivering new messages

The good news is that it will work on the third pull, but we need to have it
start working after the first pull, not the second pull.

You don't need to change anything -- it should work for you now, but I will
see how we can make it work after one step, not two.

Thanks for the report,
-K

Re: korgalore: Mail directory keeps empty?

[Konstantin Ryabitsev]

On Thu, Jan 29, 2026 at 09:41:10AM -0500, Konstantin Ryabitsev wrote:
> You don't need to change anything -- it should work for you now, but I will
> see how we can make it work after one step, not two.

There is a fix for this now in both master and stable-0.5.y -- the deliveries
will start happening after the second pull, not third.

Best wishes,
-K

Re: korgalore: Mail directory keeps empty?

[Dirk Behme]

On 29/01/2026 16:26, Konstantin Ryabitsev wrote:
> On Thu, Jan 29, 2026 at 09:41:10AM -0500, Konstantin Ryabitsev wrote:
>> You don't need to change anything -- it should work for you now, but I will
>> see how we can make it work after one step, not two.
> 
> There is a fix for this now in both master and stable-0.5.y -- the deliveries
> will start happening after the second pull, not third.

Many thanks!

Would it be possible to tag a v0.5.2 so that pip sees a new version and 
updates?

Thanks

Dirk