From: Eric Blake <eblake@redhat.com>
To: Markus Armbruster <armbru@redhat.com>
Cc: qemu-devel@nongnu.org, lcapitulino@redhat.com
Subject: Re: [Qemu-devel] [PATCH 4/4] json-streamer: Limit number of tokens in addition to total size
Date: Fri, 30 Oct 2015 09:22:22 -0600 [thread overview]
Message-ID: <56338B2E.50004@redhat.com> (raw)
In-Reply-To: <87bnbgpzcw.fsf@blackfin.pond.sub.org>
[-- Attachment #1: Type: text/plain, Size: 1275 bytes --]
On 10/30/2015 01:52 AM, Markus Armbruster wrote:
>>>> I'm assuming you temporarily patched check-qjson to use larger constants
>>>> when you hit your ~100K token testing? Because I am definitely seeing a
>>>> lot of execution time spent on large_dict when running tests/check-qjson
>>>> by hand, in relation to all the other tests of that file, but not
>>>> minutes worth. Care to post the diff you played with?
>>>
>>> I tested on a slow machine.
>>
>> I guess it was all the malloc pressure on a low-memory system that would
>> make it so much slower than what I'm seeing, if you stuck with the
>> default gen_test_json(gstr, 10, 100).
>
> Something must have been wrong with this machine yesterday, because
> today it runs the exact same test much, much faster. Computers...
Or maybe you had still reverted 65c0f1e9 to figure out where the
regression was at asserting rather than gracefully failing as fixed by
patch 2/4? Still, even if it is much faster, it is noticeably slow
enough to wonder if we have some inefficiencies beyond the poor memory
usage.
>
> I'll update the commit message. Thanks for your sanity check!
>
--
Eric Blake eblake redhat com +1-919-301-3266
Libvirt virtualization library http://libvirt.org
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 604 bytes --]
prev parent reply other threads:[~2015-10-30 15:22 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-10-29 12:44 [Qemu-devel] [PATCH 0/4] json-streamer: Fix up code to limit nesting and size Markus Armbruster
2015-10-29 12:44 ` [Qemu-devel] [PATCH 1/4] json-streamer: Apply nesting limit more sanely Markus Armbruster
2015-10-29 16:22 ` Eric Blake
2015-10-29 12:44 ` [Qemu-devel] [PATCH 2/4] json-streamer: Don't crash when input exceeds nesting limit Markus Armbruster
2015-10-29 16:25 ` Eric Blake
2015-11-23 17:21 ` Markus Armbruster
2015-10-29 12:44 ` [Qemu-devel] [PATCH 3/4] check-qjson: Add test for JSON nesting depth limit Markus Armbruster
2015-10-29 16:36 ` Eric Blake
2015-10-29 18:33 ` Markus Armbruster
2015-10-29 12:44 ` [Qemu-devel] [PATCH 4/4] json-streamer: Limit number of tokens in addition to total size Markus Armbruster
2015-10-29 16:43 ` Eric Blake
2015-10-29 18:27 ` Markus Armbruster
2015-10-29 23:35 ` Eric Blake
2015-10-30 7:52 ` Markus Armbruster
2015-10-30 15:22 ` Eric Blake [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=56338B2E.50004@redhat.com \
--to=eblake@redhat.com \
--cc=armbru@redhat.com \
--cc=lcapitulino@redhat.com \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).