From: John Snow <jsnow@redhat.com>
To: Stefan Hajnoczi <stefanha@gmail.com>
Cc: famz@redhat.com, qemu-block@nongnu.org, qemu-devel@nongnu.org,
armbru@redhat.com, vsementsov@parallels.com, stefanha@redhat.com,
mreitz@redhat.com
Subject: Re: [Qemu-devel] [Qemu-block] [PATCH v4 15/20] block: Resize bitmaps on bdrv_truncate
Date: Thu, 02 Apr 2015 11:57:59 -0400 [thread overview]
Message-ID: <551D6707.20501@redhat.com> (raw)
In-Reply-To: <20150402133724.GJ25244@stefanha-thinkpad.redhat.com>
On 04/02/2015 09:37 AM, Stefan Hajnoczi wrote:
> On Fri, Mar 20, 2015 at 03:16:58PM -0400, John Snow wrote:
>> +void hbitmap_truncate(HBitmap *hb, uint64_t size)
>> +{
>> + bool shrink;
>> + unsigned i;
>> + uint64_t num_elements = size;
>> + uint64_t old;
>> +
>> + /* Size comes in as logical elements, adjust for granularity. */
>> + size = (size + (1ULL << hb->granularity) - 1) >> hb->granularity;
>> + assert(size <= ((uint64_t)1 << HBITMAP_LOG_MAX_SIZE));
>> + shrink = size < hb->size;
>> +
>> + /* bit sizes are identical; nothing to do. */
>> + if (size == hb->size) {
>> + return;
>> + }
>> +
>> + /* If we're losing bits, let's clear those bits before we invalidate all of
>> + * our invariants. This helps keep the bitcount consistent, and will prevent
>> + * us from carrying around garbage bits beyond the end of the map.
>> + *
>> + * Because clearing bits past the end of map might reset bits we care about
>> + * within the array, record the current value of the last bit we're keeping.
>> + */
>> + if (shrink) {
>> + bool set = hbitmap_get(hb, num_elements - 1);
>> + uint64_t fix_count = (hb->size << hb->granularity) - num_elements;
>> +
>> + assert(fix_count);
>> + hbitmap_reset(hb, num_elements, fix_count);
>> + if (set) {
>> + hbitmap_set(hb, num_elements - 1, 1);
>> + }
>
> Why is it necessary to set the last bit (if it was set)? The comment
> isn't clear to me.
>
Sure. The granularity of the bitmap provides us with virtual bit groups.
for a granularity of say g=2, we have 2^2 virtual bits per every real bit:
101 in memory is treated, virtually, as 1111 0000 1111.
The get/set calls operate on virtual bits, not concrete ones, so if we
were to reset virtual bits 2-11:
11|11 0000 1111
We'd set the real bits to '000', because we clear or set the entire
virtual group.
This is probably not what we really want, so as a shortcut I just read
and then re-set the final bit.
It is programmatically avoidable (Are we truncating into a granularity
group?) but in the case that we are, I'd need to read/reset the bit
anyway, so it seemed fine to just unconditionally apply the fix.
next prev parent reply other threads:[~2015-04-02 15:58 UTC|newest]
Thread overview: 54+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-03-20 19:16 [Qemu-devel] [PATCH v4 00/20] block: transactionless incremental backup series John Snow
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 01/20] docs: incremental backup documentation John Snow
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 02/20] qapi: Add optional field "name" to block dirty bitmap John Snow
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 03/20] qmp: Ensure consistent granularity type John Snow
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 04/20] qmp: Add block-dirty-bitmap-add and block-dirty-bitmap-remove John Snow
2015-03-20 19:39 ` Max Reitz
2015-04-02 9:57 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 05/20] block: Introduce bdrv_dirty_bitmap_granularity() John Snow
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 06/20] hbitmap: cache array lengths John Snow
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 07/20] hbitmap: add hbitmap_merge John Snow
2015-04-02 12:19 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 08/20] block: Add bitmap disabled status John Snow
2015-04-02 12:21 ` Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 09/20] block: Add bitmap successors John Snow
2015-04-02 12:23 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 10/20] qmp: Add support of "dirty-bitmap" sync mode for drive-backup John Snow
2015-04-02 12:44 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-04-02 16:55 ` John Snow
2015-04-08 2:15 ` John Snow
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 11/20] qmp: add block-dirty-bitmap-clear John Snow
2015-04-02 12:49 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 12/20] qmp: Add dirty bitmap status field in query-block John Snow
2015-04-02 12:49 ` Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 13/20] block: add BdrvDirtyBitmap documentation John Snow
2015-04-02 12:50 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 14/20] block: Ensure consistent bitmap function prototypes John Snow
2015-04-02 12:50 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 15/20] block: Resize bitmaps on bdrv_truncate John Snow
2015-04-02 13:37 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-04-02 15:57 ` John Snow [this message]
2015-04-07 12:57 ` Stefan Hajnoczi
2015-04-07 16:45 ` John Snow
2015-04-08 8:44 ` Stefan Hajnoczi
2015-03-20 19:16 ` [Qemu-devel] [PATCH v4 16/20] hbitmap: truncate tests John Snow
2015-03-20 19:43 ` Max Reitz
2015-04-02 13:43 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:17 ` [Qemu-devel] [PATCH v4 17/20] iotests: add invalid input incremental backup tests John Snow
2015-03-20 19:49 ` Max Reitz
2015-04-02 13:44 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:17 ` [Qemu-devel] [PATCH v4 18/20] iotests: add QMP event waiting queue John Snow
2015-04-02 13:57 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-04-02 17:19 ` John Snow
2015-03-20 19:17 ` [Qemu-devel] [PATCH v4 19/20] iotests: add simple incremental backup case John Snow
2015-03-20 19:50 ` Max Reitz
2015-04-02 14:27 ` Stefan Hajnoczi
2015-04-06 21:49 ` John Snow
2015-04-07 13:00 ` Stefan Hajnoczi
2015-04-13 16:51 ` Max Reitz
2015-03-20 19:17 ` [Qemu-devel] [PATCH v4 20/20] iotests: add incremental backup failure recovery test John Snow
2015-03-20 19:51 ` Max Reitz
2015-04-02 14:52 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
2015-03-20 19:52 ` [Qemu-devel] [PATCH v4 00/20] block: transactionless incremental backup series Max Reitz
2015-03-20 19:57 ` John Snow
2015-04-02 14:53 ` [Qemu-devel] [Qemu-block] " Stefan Hajnoczi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=551D6707.20501@redhat.com \
--to=jsnow@redhat.com \
--cc=armbru@redhat.com \
--cc=famz@redhat.com \
--cc=mreitz@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@gmail.com \
--cc=stefanha@redhat.com \
--cc=vsementsov@parallels.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).