* [PATCH] UBI: fix refill_wl_user_pool() @ 2013-08-26 10:08 Richard Weinberger 2013-09-04 8:20 ` Richard Weinberger 0 siblings, 1 reply; 8+ messages in thread From: Richard Weinberger @ 2013-08-26 10:08 UTC (permalink / raw) To: dedekind1 Cc: richard.genoud, linux-mtd, dwmw2, linux-kernel, Richard Weinberger If no free PEBs are available refill_wl_user_pool() must not return with -ENOSPC immediately. It has to block till produce_free_peb() produced a free PEB. Reported-and-Tested-by: Richard Genoud <richard.genoud@gmail.com> Signed-off-by: Richard Weinberger <richard@nod.at> --- drivers/mtd/ubi/wl.c | 4 ---- 1 file changed, 4 deletions(-) diff --git a/drivers/mtd/ubi/wl.c b/drivers/mtd/ubi/wl.c index c95bfb1..02317c1 100644 --- a/drivers/mtd/ubi/wl.c +++ b/drivers/mtd/ubi/wl.c @@ -599,10 +599,6 @@ static void refill_wl_user_pool(struct ubi_device *ubi) return_unused_pool_pebs(ubi, pool); for (pool->size = 0; pool->size < pool->max_size; pool->size++) { - if (!ubi->free.rb_node || - (ubi->free_count - ubi->beb_rsvd_pebs < 1)) - break; - pool->pebs[pool->size] = __wl_get_peb(ubi); if (pool->pebs[pool->size] < 0) break; -- 1.8.1.4 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* Re: [PATCH] UBI: fix refill_wl_user_pool() 2013-08-26 10:08 [PATCH] UBI: fix refill_wl_user_pool() Richard Weinberger @ 2013-09-04 8:20 ` Richard Weinberger 2013-09-04 15:50 ` David Mosberger-Tang 2013-09-20 16:09 ` richard -rw- weinberger 0 siblings, 2 replies; 8+ messages in thread From: Richard Weinberger @ 2013-09-04 8:20 UTC (permalink / raw) To: Richard Weinberger Cc: richard.genoud, linux-mtd, dwmw2, linux-kernel, dedekind1 Am 26.08.2013 12:08, schrieb Richard Weinberger: > If no free PEBs are available refill_wl_user_pool() must not > return with -ENOSPC immediately. > It has to block till produce_free_peb() produced a free PEB. > > Reported-and-Tested-by: Richard Genoud <richard.genoud@gmail.com> > Signed-off-by: Richard Weinberger <richard@nod.at> > --- > drivers/mtd/ubi/wl.c | 4 ---- > 1 file changed, 4 deletions(-) > > diff --git a/drivers/mtd/ubi/wl.c b/drivers/mtd/ubi/wl.c > index c95bfb1..02317c1 100644 > --- a/drivers/mtd/ubi/wl.c > +++ b/drivers/mtd/ubi/wl.c > @@ -599,10 +599,6 @@ static void refill_wl_user_pool(struct ubi_device *ubi) > return_unused_pool_pebs(ubi, pool); > > for (pool->size = 0; pool->size < pool->max_size; pool->size++) { > - if (!ubi->free.rb_node || > - (ubi->free_count - ubi->beb_rsvd_pebs < 1)) > - break; > - > pool->pebs[pool->size] = __wl_get_peb(ubi); > if (pool->pebs[pool->size] < 0) > break; > Artem, please don't forget do apply this patch. Thanks, //richard ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [PATCH] UBI: fix refill_wl_user_pool() 2013-09-04 8:20 ` Richard Weinberger @ 2013-09-04 15:50 ` David Mosberger-Tang 2013-09-04 16:01 ` Richard Weinberger 2013-09-20 16:09 ` richard -rw- weinberger 1 sibling, 1 reply; 8+ messages in thread From: David Mosberger-Tang @ 2013-09-04 15:50 UTC (permalink / raw) To: Richard Weinberger; +Cc: linux-mtd@lists.infradead.org Richard, Is there more background on the bug this patch fixes? We are working on root-causing an issue where a UBIFS write fails with ENOSPC, even though there is no plausible reason that the filesystem should be out of space. The ENOSPC errors persist across multiple reboots, only to disappear magically later on. We haven't found a reliable way to reproduce this so far, so we're still tapping a bit in the dark. --david On Wed, Sep 4, 2013 at 2:20 AM, Richard Weinberger <richard@nod.at> wrote: > Am 26.08.2013 12:08, schrieb Richard Weinberger: >> If no free PEBs are available refill_wl_user_pool() must not >> return with -ENOSPC immediately. >> It has to block till produce_free_peb() produced a free PEB. >> >> Reported-and-Tested-by: Richard Genoud <richard.genoud@gmail.com> >> Signed-off-by: Richard Weinberger <richard@nod.at> >> --- >> drivers/mtd/ubi/wl.c | 4 ---- >> 1 file changed, 4 deletions(-) >> >> diff --git a/drivers/mtd/ubi/wl.c b/drivers/mtd/ubi/wl.c >> index c95bfb1..02317c1 100644 >> --- a/drivers/mtd/ubi/wl.c >> +++ b/drivers/mtd/ubi/wl.c >> @@ -599,10 +599,6 @@ static void refill_wl_user_pool(struct ubi_device *ubi) >> return_unused_pool_pebs(ubi, pool); >> >> for (pool->size = 0; pool->size < pool->max_size; pool->size++) { >> - if (!ubi->free.rb_node || >> - (ubi->free_count - ubi->beb_rsvd_pebs < 1)) >> - break; >> - >> pool->pebs[pool->size] = __wl_get_peb(ubi); >> if (pool->pebs[pool->size] < 0) >> break; >> > > Artem, please don't forget do apply this patch. > > Thanks, > //richard > > ______________________________________________________ > Linux MTD discussion mailing list > http://lists.infradead.org/mailman/listinfo/linux-mtd/ ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [PATCH] UBI: fix refill_wl_user_pool() 2013-09-04 15:50 ` David Mosberger-Tang @ 2013-09-04 16:01 ` Richard Weinberger 2013-09-04 16:03 ` David Mosberger-Tang 0 siblings, 1 reply; 8+ messages in thread From: Richard Weinberger @ 2013-09-04 16:01 UTC (permalink / raw) To: David Mosberger-Tang; +Cc: linux-mtd@lists.infradead.org David, Am 04.09.2013 17:50, schrieb David Mosberger-Tang: > Richard, > > Is there more background on the bug this patch fixes? > We are working on root-causing an issue where a UBIFS write fails with > ENOSPC, even though there is no plausible reason that the filesystem > should be out of space. The ENOSPC errors persist across multiple > reboots, only to disappear magically later on. We haven't found a > reliable way to reproduce this so far, so we're still tapping a bit in > the dark. The said patch fixes an issue if your Kernel was build with experimental Fastmap support. If you have CONFIG_MTD_UBI_FASTMAP=n you are not affected. Fastmap uses two pools of available PEBs. Every time a pool is filled with used PEBs it writes out a new fastmap to the flash. The bug in refill_wl_user_pool() was that the function did not try hard enough to get a free PEB and failed too early with -ENOSPC. Thanks, //richard > --david > > On Wed, Sep 4, 2013 at 2:20 AM, Richard Weinberger <richard@nod.at> wrote: >> Am 26.08.2013 12:08, schrieb Richard Weinberger: >>> If no free PEBs are available refill_wl_user_pool() must not >>> return with -ENOSPC immediately. >>> It has to block till produce_free_peb() produced a free PEB. >>> >>> Reported-and-Tested-by: Richard Genoud <richard.genoud@gmail.com> >>> Signed-off-by: Richard Weinberger <richard@nod.at> >>> --- >>> drivers/mtd/ubi/wl.c | 4 ---- >>> 1 file changed, 4 deletions(-) >>> >>> diff --git a/drivers/mtd/ubi/wl.c b/drivers/mtd/ubi/wl.c >>> index c95bfb1..02317c1 100644 >>> --- a/drivers/mtd/ubi/wl.c >>> +++ b/drivers/mtd/ubi/wl.c >>> @@ -599,10 +599,6 @@ static void refill_wl_user_pool(struct ubi_device *ubi) >>> return_unused_pool_pebs(ubi, pool); >>> >>> for (pool->size = 0; pool->size < pool->max_size; pool->size++) { >>> - if (!ubi->free.rb_node || >>> - (ubi->free_count - ubi->beb_rsvd_pebs < 1)) >>> - break; >>> - >>> pool->pebs[pool->size] = __wl_get_peb(ubi); >>> if (pool->pebs[pool->size] < 0) >>> break; >>> >> >> Artem, please don't forget do apply this patch. >> >> Thanks, >> //richard >> >> ______________________________________________________ >> Linux MTD discussion mailing list >> http://lists.infradead.org/mailman/listinfo/linux-mtd/ ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [PATCH] UBI: fix refill_wl_user_pool() 2013-09-04 16:01 ` Richard Weinberger @ 2013-09-04 16:03 ` David Mosberger-Tang 2013-09-05 6:09 ` Richard Weinberger 0 siblings, 1 reply; 8+ messages in thread From: David Mosberger-Tang @ 2013-09-04 16:03 UTC (permalink / raw) To: Richard Weinberger; +Cc: linux-mtd@lists.infradead.org Richard, Thanks for the info. We are not using FASTMAP, so it doesn't explain what we're seeing. Best regards, --david On Wed, Sep 4, 2013 at 10:01 AM, Richard Weinberger <richard@nod.at> wrote: > David, > > Am 04.09.2013 17:50, schrieb David Mosberger-Tang: >> Richard, >> >> Is there more background on the bug this patch fixes? >> We are working on root-causing an issue where a UBIFS write fails with >> ENOSPC, even though there is no plausible reason that the filesystem >> should be out of space. The ENOSPC errors persist across multiple >> reboots, only to disappear magically later on. We haven't found a >> reliable way to reproduce this so far, so we're still tapping a bit in >> the dark. > > The said patch fixes an issue if your Kernel was build with experimental Fastmap support. > If you have CONFIG_MTD_UBI_FASTMAP=n you are not affected. > > Fastmap uses two pools of available PEBs. Every time a pool is filled with used PEBs > it writes out a new fastmap to the flash. > The bug in refill_wl_user_pool() was that the function did not try hard enough to get a free PEB > and failed too early with -ENOSPC. > > Thanks, > //richard > >> --david >> >> On Wed, Sep 4, 2013 at 2:20 AM, Richard Weinberger <richard@nod.at> wrote: >>> Am 26.08.2013 12:08, schrieb Richard Weinberger: >>>> If no free PEBs are available refill_wl_user_pool() must not >>>> return with -ENOSPC immediately. >>>> It has to block till produce_free_peb() produced a free PEB. >>>> >>>> Reported-and-Tested-by: Richard Genoud <richard.genoud@gmail.com> >>>> Signed-off-by: Richard Weinberger <richard@nod.at> >>>> --- >>>> drivers/mtd/ubi/wl.c | 4 ---- >>>> 1 file changed, 4 deletions(-) >>>> >>>> diff --git a/drivers/mtd/ubi/wl.c b/drivers/mtd/ubi/wl.c >>>> index c95bfb1..02317c1 100644 >>>> --- a/drivers/mtd/ubi/wl.c >>>> +++ b/drivers/mtd/ubi/wl.c >>>> @@ -599,10 +599,6 @@ static void refill_wl_user_pool(struct ubi_device *ubi) >>>> return_unused_pool_pebs(ubi, pool); >>>> >>>> for (pool->size = 0; pool->size < pool->max_size; pool->size++) { >>>> - if (!ubi->free.rb_node || >>>> - (ubi->free_count - ubi->beb_rsvd_pebs < 1)) >>>> - break; >>>> - >>>> pool->pebs[pool->size] = __wl_get_peb(ubi); >>>> if (pool->pebs[pool->size] < 0) >>>> break; >>>> >>> >>> Artem, please don't forget do apply this patch. >>> >>> Thanks, >>> //richard >>> >>> ______________________________________________________ >>> Linux MTD discussion mailing list >>> http://lists.infradead.org/mailman/listinfo/linux-mtd/ > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [PATCH] UBI: fix refill_wl_user_pool() 2013-09-04 16:03 ` David Mosberger-Tang @ 2013-09-05 6:09 ` Richard Weinberger 2013-09-05 17:16 ` David Mosberger-Tang 0 siblings, 1 reply; 8+ messages in thread From: Richard Weinberger @ 2013-09-05 6:09 UTC (permalink / raw) To: David Mosberger-Tang; +Cc: linux-mtd@lists.infradead.org David, Am 04.09.2013 18:03, schrieb David Mosberger-Tang: > Thanks for the info. We are not using FASTMAP, so it doesn't explain > what we're seeing. Maybe you are suffering from the issue fixed by: http://git.infradead.org/linux-ubi.git/commit/5ef4414f4bc26a19cfd5cd11aee9697a863e4d51 This patch will hopefully make it into 3.12-rc1 and then back into -stable as soon as possible. Thanks, //richard > Best regards, > > --david > > On Wed, Sep 4, 2013 at 10:01 AM, Richard Weinberger <richard@nod.at> wrote: >> David, >> >> Am 04.09.2013 17:50, schrieb David Mosberger-Tang: >>> Richard, >>> >>> Is there more background on the bug this patch fixes? >>> We are working on root-causing an issue where a UBIFS write fails with >>> ENOSPC, even though there is no plausible reason that the filesystem >>> should be out of space. The ENOSPC errors persist across multiple >>> reboots, only to disappear magically later on. We haven't found a >>> reliable way to reproduce this so far, so we're still tapping a bit in >>> the dark. >> >> The said patch fixes an issue if your Kernel was build with experimental Fastmap support. >> If you have CONFIG_MTD_UBI_FASTMAP=n you are not affected. >> >> Fastmap uses two pools of available PEBs. Every time a pool is filled with used PEBs >> it writes out a new fastmap to the flash. >> The bug in refill_wl_user_pool() was that the function did not try hard enough to get a free PEB >> and failed too early with -ENOSPC. >> >> Thanks, >> //richard >> >>> --david >>> >>> On Wed, Sep 4, 2013 at 2:20 AM, Richard Weinberger <richard@nod.at> wrote: >>>> Am 26.08.2013 12:08, schrieb Richard Weinberger: >>>>> If no free PEBs are available refill_wl_user_pool() must not >>>>> return with -ENOSPC immediately. >>>>> It has to block till produce_free_peb() produced a free PEB. >>>>> >>>>> Reported-and-Tested-by: Richard Genoud <richard.genoud@gmail.com> >>>>> Signed-off-by: Richard Weinberger <richard@nod.at> >>>>> --- >>>>> drivers/mtd/ubi/wl.c | 4 ---- >>>>> 1 file changed, 4 deletions(-) >>>>> >>>>> diff --git a/drivers/mtd/ubi/wl.c b/drivers/mtd/ubi/wl.c >>>>> index c95bfb1..02317c1 100644 >>>>> --- a/drivers/mtd/ubi/wl.c >>>>> +++ b/drivers/mtd/ubi/wl.c >>>>> @@ -599,10 +599,6 @@ static void refill_wl_user_pool(struct ubi_device *ubi) >>>>> return_unused_pool_pebs(ubi, pool); >>>>> >>>>> for (pool->size = 0; pool->size < pool->max_size; pool->size++) { >>>>> - if (!ubi->free.rb_node || >>>>> - (ubi->free_count - ubi->beb_rsvd_pebs < 1)) >>>>> - break; >>>>> - >>>>> pool->pebs[pool->size] = __wl_get_peb(ubi); >>>>> if (pool->pebs[pool->size] < 0) >>>>> break; >>>>> >>>> >>>> Artem, please don't forget do apply this patch. >>>> >>>> Thanks, >>>> //richard >>>> >>>> ______________________________________________________ >>>> Linux MTD discussion mailing list >>>> http://lists.infradead.org/mailman/listinfo/linux-mtd/ >> ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [PATCH] UBI: fix refill_wl_user_pool() 2013-09-05 6:09 ` Richard Weinberger @ 2013-09-05 17:16 ` David Mosberger-Tang 0 siblings, 0 replies; 8+ messages in thread From: David Mosberger-Tang @ 2013-09-05 17:16 UTC (permalink / raw) To: Richard Weinberger; +Cc: linux-mtd@lists.infradead.org The platform we're seeing this on is running an old kernel: 2.6.27.10. We don't know yet whether it happens on newer kernels (we are trying to reproduce the issue on both older and newer kernels, but that may take a month; so far, we have only seen the issue on systems in the field). --david On Thu, Sep 5, 2013 at 12:09 AM, Richard Weinberger <richard@nod.at> wrote: > David, > > Am 04.09.2013 18:03, schrieb David Mosberger-Tang: >> Thanks for the info. We are not using FASTMAP, so it doesn't explain >> what we're seeing. > > Maybe you are suffering from the issue fixed by: > http://git.infradead.org/linux-ubi.git/commit/5ef4414f4bc26a19cfd5cd11aee9697a863e4d51 > > This patch will hopefully make it into 3.12-rc1 and then back into -stable as soon as possible. > > Thanks, > //richard > >> Best regards, >> >> --david >> >> On Wed, Sep 4, 2013 at 10:01 AM, Richard Weinberger <richard@nod.at> wrote: >>> David, >>> >>> Am 04.09.2013 17:50, schrieb David Mosberger-Tang: >>>> Richard, >>>> >>>> Is there more background on the bug this patch fixes? >>>> We are working on root-causing an issue where a UBIFS write fails with >>>> ENOSPC, even though there is no plausible reason that the filesystem >>>> should be out of space. The ENOSPC errors persist across multiple >>>> reboots, only to disappear magically later on. We haven't found a >>>> reliable way to reproduce this so far, so we're still tapping a bit in >>>> the dark. >>> >>> The said patch fixes an issue if your Kernel was build with experimental Fastmap support. >>> If you have CONFIG_MTD_UBI_FASTMAP=n you are not affected. >>> >>> Fastmap uses two pools of available PEBs. Every time a pool is filled with used PEBs >>> it writes out a new fastmap to the flash. >>> The bug in refill_wl_user_pool() was that the function did not try hard enough to get a free PEB >>> and failed too early with -ENOSPC. >>> >>> Thanks, >>> //richard >>> >>>> --david >>>> >>>> On Wed, Sep 4, 2013 at 2:20 AM, Richard Weinberger <richard@nod.at> wrote: >>>>> Am 26.08.2013 12:08, schrieb Richard Weinberger: >>>>>> If no free PEBs are available refill_wl_user_pool() must not >>>>>> return with -ENOSPC immediately. >>>>>> It has to block till produce_free_peb() produced a free PEB. >>>>>> >>>>>> Reported-and-Tested-by: Richard Genoud <richard.genoud@gmail.com> >>>>>> Signed-off-by: Richard Weinberger <richard@nod.at> >>>>>> --- >>>>>> drivers/mtd/ubi/wl.c | 4 ---- >>>>>> 1 file changed, 4 deletions(-) >>>>>> >>>>>> diff --git a/drivers/mtd/ubi/wl.c b/drivers/mtd/ubi/wl.c >>>>>> index c95bfb1..02317c1 100644 >>>>>> --- a/drivers/mtd/ubi/wl.c >>>>>> +++ b/drivers/mtd/ubi/wl.c >>>>>> @@ -599,10 +599,6 @@ static void refill_wl_user_pool(struct ubi_device *ubi) >>>>>> return_unused_pool_pebs(ubi, pool); >>>>>> >>>>>> for (pool->size = 0; pool->size < pool->max_size; pool->size++) { >>>>>> - if (!ubi->free.rb_node || >>>>>> - (ubi->free_count - ubi->beb_rsvd_pebs < 1)) >>>>>> - break; >>>>>> - >>>>>> pool->pebs[pool->size] = __wl_get_peb(ubi); >>>>>> if (pool->pebs[pool->size] < 0) >>>>>> break; >>>>>> >>>>> >>>>> Artem, please don't forget do apply this patch. >>>>> >>>>> Thanks, >>>>> //richard >>>>> >>>>> ______________________________________________________ >>>>> Linux MTD discussion mailing list >>>>> http://lists.infradead.org/mailman/listinfo/linux-mtd/ >>> > ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [PATCH] UBI: fix refill_wl_user_pool() 2013-09-04 8:20 ` Richard Weinberger 2013-09-04 15:50 ` David Mosberger-Tang @ 2013-09-20 16:09 ` richard -rw- weinberger 1 sibling, 0 replies; 8+ messages in thread From: richard -rw- weinberger @ 2013-09-20 16:09 UTC (permalink / raw) To: Richard Weinberger Cc: richard.genoud, David Woodhouse, linux-mtd@lists.infradead.org, LKML, Artem Bityutskiy On Wed, Sep 4, 2013 at 10:20 AM, Richard Weinberger <richard@nod.at> wrote: > Am 26.08.2013 12:08, schrieb Richard Weinberger: >> If no free PEBs are available refill_wl_user_pool() must not >> return with -ENOSPC immediately. >> It has to block till produce_free_peb() produced a free PEB. >> >> Reported-and-Tested-by: Richard Genoud <richard.genoud@gmail.com> >> Signed-off-by: Richard Weinberger <richard@nod.at> >> --- >> drivers/mtd/ubi/wl.c | 4 ---- >> 1 file changed, 4 deletions(-) >> >> diff --git a/drivers/mtd/ubi/wl.c b/drivers/mtd/ubi/wl.c >> index c95bfb1..02317c1 100644 >> --- a/drivers/mtd/ubi/wl.c >> +++ b/drivers/mtd/ubi/wl.c >> @@ -599,10 +599,6 @@ static void refill_wl_user_pool(struct ubi_device *ubi) >> return_unused_pool_pebs(ubi, pool); >> >> for (pool->size = 0; pool->size < pool->max_size; pool->size++) { >> - if (!ubi->free.rb_node || >> - (ubi->free_count - ubi->beb_rsvd_pebs < 1)) >> - break; >> - >> pool->pebs[pool->size] = __wl_get_peb(ubi); >> if (pool->pebs[pool->size] < 0) >> break; >> > > Artem, please don't forget do apply this patch. *ping* -- Thanks, //richard ^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2013-09-20 16:09 UTC | newest] Thread overview: 8+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2013-08-26 10:08 [PATCH] UBI: fix refill_wl_user_pool() Richard Weinberger 2013-09-04 8:20 ` Richard Weinberger 2013-09-04 15:50 ` David Mosberger-Tang 2013-09-04 16:01 ` Richard Weinberger 2013-09-04 16:03 ` David Mosberger-Tang 2013-09-05 6:09 ` Richard Weinberger 2013-09-05 17:16 ` David Mosberger-Tang 2013-09-20 16:09 ` richard -rw- weinberger
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox