From: Thomas Petazzoni via buildroot <buildroot@buildroot.org>
To: "buildroot@buildroot.org" <buildroot@buildroot.org>
Subject: Re: [Buildroot] [PATCH 4/4] support/scripts/pkg-stats: reimplement CPE parsing in pkg-stats
Date: Sat, 2 Apr 2022 16:17:35 +0200 [thread overview]
Message-ID: <20220402161735.3510233f@windsurf> (raw)
In-Reply-To: <20220402141531.1320584-4-thomas.petazzoni@bootlin.com>
Hello,
On Sat, 2 Apr 2022 16:15:30 +0200
Thomas Petazzoni via buildroot <buildroot@buildroot.org> wrote:
> This commit reimplements the XML parsing needed to do the CPE matching
> directly in pkg-stats, using the XmlParser functionality of
> ElementTree, also called "streaming parsing". Thanks to this, we never
> load the entire XML tree in RAM, but only stream it through the
> parser, and construct a very simple list of all CPE identifiers. The
> max memory consumption of pkg-stats is now:
[...]
I forgot to mention that the JSON output of pkg-stats for the full
package set, before and after this commit, is exactly identical.
Thomas
--
Thomas Petazzoni, co-owner and CEO, Bootlin
Embedded Linux and Kernel engineering and training
https://bootlin.com
_______________________________________________
buildroot mailing list
buildroot@buildroot.org
https://lists.buildroot.org/mailman/listinfo/buildroot
next prev parent reply other threads:[~2022-04-02 14:17 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-04-02 14:15 [Buildroot] [PATCH 1/4] support/script/pkg-stats: allow disabling CPE matching Thomas Petazzoni via buildroot
2022-04-02 14:15 ` [Buildroot] [PATCH 2/4] support/scripts/pkg-stats: allow disabling package warnings retrieval Thomas Petazzoni via buildroot
2022-04-04 12:40 ` Peter Korsgaard
2022-04-02 14:15 ` [Buildroot] [PATCH 3/4] support/scripts/pkg-stats: add a timeout on HTTP requests for upstream URLs Thomas Petazzoni via buildroot
2022-04-04 12:40 ` Peter Korsgaard
2022-04-02 14:15 ` [Buildroot] [PATCH 4/4] support/scripts/pkg-stats: reimplement CPE parsing in pkg-stats Thomas Petazzoni via buildroot
2022-04-02 14:17 ` Thomas Petazzoni via buildroot [this message]
2022-04-02 17:20 ` Yann E. MORIN
2022-04-03 8:05 ` Thomas Petazzoni via buildroot
2022-04-04 12:40 ` Peter Korsgaard
2022-04-02 14:42 ` [Buildroot] [PATCH 1/4] support/script/pkg-stats: allow disabling CPE matching Yann E. MORIN
2022-04-04 12:40 ` Peter Korsgaard
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220402161735.3510233f@windsurf \
--to=buildroot@buildroot.org \
--cc=thomas.petazzoni@bootlin.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.