From: CAI Qian <caiqian@redhat.com>
To: lsf-pc@lists.linuxfoundation.org
Cc: linux-mm@kvack.org
Subject: [LSF/MM TOPIC] sustainable upstream testing
Date: Tue, 25 Jan 2011 20:38:50 -0500 (EST) [thread overview]
Message-ID: <1570419329.157209.1296005930142.JavaMail.root@zmail06.collab.prod.int.phx2.redhat.com> (raw)
In-Reply-To: <645973813.157189.1296005440082.JavaMail.root@zmail06.collab.prod.int.phx2.redhat.com>
The benefit:
By regularly testing kernel upstream, we can identify problems and get the feeling of the status of enterprise user cases earlier before the bad code found a way into enterprise-distro kernel. We can also use this opportunity to drive a testing community around the kernel upstream which will even benefit enterprise-distro kernel further by gathering more testing knowledge, tools/testing code around features/subsystems, and establishing working relationships with upstream developers.
The challenge:
Upstream code have many different code bases (git trees) and release cycles. Internal automation system may not support easy installation/integration of upstream kernel yet. It could be time-consuming to clone those external upstream git trees. There is no guarantee that upstream developers will fix/debug bug/regression or help you to understand requirements for features. The requirement and usage documents for upstream code is more developer-bias and rely on code reading/work-through to understand. Those exposed new challenges for testers both technically and socially.
Main differences between upstream and enterprise-distro kernel testing:
1) more chances to find regression upstream.
2) more debugging, technical and communication skills required to get closures for the issues found.
3) no fixable release cycles.
4) different testing infrastructures upstream; hard to push/use internal tests upstream.
5) some enterprise use-cases/features may not well-accepted upstream.
Some sample questions to discuss:
1) how to choose the right git tree as a base to test?
2) how to efficiently/sustainably push more internal tests upstream?
3) how to get more tests passed as a part of release criteria?
4) how to efficiently get the issues found upstream fixed?
Thanks.
CAI Qian
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom policy in Canada: sign http://dissolvethecrtc.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
parent reply other threads:[~2011-01-26 1:38 UTC|newest]
Thread overview: expand[flat|nested] mbox.gz Atom feed
[parent not found: <645973813.157189.1296005440082.JavaMail.root@zmail06.collab.prod.int.phx2.redhat.com>]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1570419329.157209.1296005930142.JavaMail.root@zmail06.collab.prod.int.phx2.redhat.com \
--to=caiqian@redhat.com \
--cc=linux-mm@kvack.org \
--cc=lsf-pc@lists.linuxfoundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).