From: Bernd Kuhls <bernd.kuhls@t-online.de>
To: buildroot@busybox.net
Subject: [Buildroot] [PATCH v2 04/20] python3: make it exclusive from python
Date: Sat, 08 Oct 2016 17:57:39 +0200 [thread overview]
Message-ID: <jkhncdxdku.ln2@ID-313208.user.individual.net> (raw)
In-Reply-To: 20161008160228.71f9e08f@free-electrons.com
Hi Thomas, hi Yann,
Am Sat, 08 Oct 2016 16:02:28 +0200 schrieb Thomas Petazzoni:
>> Plain and simple: if a python module supports both python and python3,
>> and both are enabled, that python module is built for both python and
>> python3.
>
> Well, that's horrible from a filesystem size point of view, and I'm not
> really sure this would solve Bernd's issue. I'm pretty sure Bernd would
> like to have a given set of modules built for Python 2, and another set
> of modules built for Python 3.
actually I solved the dependency problem by copying python2 and python3
to my target system ;) This is possible for me because I do not use a
filesystem created by buildroot but use files from output/target/ stored
as optional packages for the fli4l project, which then creates the
filesystem image for the target machine by including these packages.
To achieve this I am building with one .config which has python2 + kodi/
mwscrape and later another .config build is done with python3 +
mwscrape2slob.
To clarify:
mwscrape[1] downloads articles from mediawiki-based sites, stores them on
a couchdb server and has runtime dependencies to the following python
modules: couchdb, futures, mwclient and pylru. Because mwclient is
python2-only so is mwscrape.
mwscrape2slob[2] downloads the stored mediawiki articles from the couchdb
server and creates files in .slob format for use in the Android app aard2
[3], which is a offline-reader. It depends on the following python
modules: couchdb, cssselect, cssutils, lxml and slob. The modules slob
and mwscrape2slob are python3-only.
Luckily no module with a python version restriction depends on a module
with a different python version restriction :)
So yes, there are some modules which I only need in python2, others only
in python3, for this purpose I am using two different .config files and
build python2 and python3 seperately. Filesystem space is not a problem
for me, my target system is not an embedded device, therefore my solution
may not be suitable for the general use in the buildroot project.
I expect to send the mwscrape2slob patch series in the coming days after
testing a self-build .slob file. Currently I am busy with downloading
Wikipedia data ;) The CouchDB server built with buildroot runs rock-solid.
Regards, Bernd
[1] https://github.com/itkach/mwscrape
[2] https://github.com/itkach/mwscrape2slob
[3] https://github.com/itkach/aard2-android
next prev parent reply other threads:[~2016-10-08 15:57 UTC|newest]
Thread overview: 47+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-02-18 20:39 [Buildroot] [PATCH v2 00/20] Python 2 and 3 bumps, support for Python 3 external modules Thomas Petazzoni
2014-02-18 20:39 ` [Buildroot] [PATCH v2 01/20] pkg-python: no longer use distutilscross for setuptools Thomas Petazzoni
2014-02-18 21:57 ` Peter Korsgaard
2014-02-18 20:39 ` [Buildroot] [PATCH v2 02/20] python-distutilscross: remove package that is no longer needed Thomas Petazzoni
2014-02-18 21:58 ` Peter Korsgaard
2014-02-18 20:39 ` [Buildroot] [PATCH v2 03/20] python3: removal of *.py/*.pyc is now done globally Thomas Petazzoni
2014-02-18 21:58 ` Peter Korsgaard
2014-02-18 20:39 ` [Buildroot] [PATCH v2 04/20] python3: make it exclusive from python Thomas Petazzoni
2014-02-18 21:58 ` Peter Korsgaard
2016-10-05 18:00 ` Bernd Kuhls
2016-10-05 19:30 ` Thomas Petazzoni
2016-10-08 12:24 ` Yann E. MORIN
2016-10-08 12:51 ` Thomas Petazzoni
2016-10-08 13:51 ` Yann E. MORIN
2016-10-08 14:02 ` Thomas Petazzoni
2016-10-08 15:57 ` Bernd Kuhls [this message]
2016-10-08 18:23 ` Yegor Yefremov
2016-10-09 7:55 ` Bernd Kuhls
2016-10-09 9:44 ` Yegor Yefremov
2016-10-09 11:29 ` Yegor Yefremov
2016-10-08 16:55 ` Yann E. MORIN
2014-02-18 20:39 ` [Buildroot] [PATCH v2 05/20] python3: add python -> python3 symlink for the host variant Thomas Petazzoni
2014-02-18 21:58 ` Peter Korsgaard
2014-02-18 20:39 ` [Buildroot] [PATCH v2 06/20] python3: add config directory symbolic link Thomas Petazzoni
2014-02-18 21:56 ` Peter Korsgaard
2014-02-18 22:17 ` Thomas Petazzoni
2014-02-18 22:21 ` Peter Korsgaard
2014-02-18 20:40 ` [Buildroot] [PATCH v2 07/20] python3: use proper PYTHON3_VERSION_MAJOR instead of harcoding 3.3 Thomas Petazzoni
2014-02-18 22:22 ` Peter Korsgaard
2014-02-18 20:40 ` [Buildroot] [PATCH v2 08/20] python3: bump to 3.4.0rc1 Thomas Petazzoni
2014-02-18 22:23 ` Peter Korsgaard
2014-02-18 20:40 ` [Buildroot] [PATCH v2 09/20] python3: provide a PYTHON3_PATH Thomas Petazzoni
2014-02-18 22:29 ` Peter Korsgaard
2014-02-18 22:33 ` Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 10/20] package: add python3 support in the package infrastructure Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 11/20] package: allow Python packages with Python3 Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 12/20] python, python3: enable unicodedata for host-python, needed by setuptools Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 13/20] python-setuptools: bump version to 2.1.2 Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 14/20] python, python3: fix to ensure libpython is stripped Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 15/20] python-pyasn: use the real upstream Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 16/20] python-bottle: allow to build with Python 3 Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 17/20] python-serial: " Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 18/20] python-pyasn: " Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 19/20] python-pycrypto: " Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 20/20] python-pysnmp{, -apps, -mibs}: " Thomas Petazzoni
2014-02-19 8:03 ` [Buildroot] [PATCH v2 00/20] Python 2 and 3 bumps, support for Python 3 external modules Peter Korsgaard
2014-02-19 8:23 ` Thomas Petazzoni
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=jkhncdxdku.ln2@ID-313208.user.individual.net \
--to=bernd.kuhls@t-online.de \
--cc=buildroot@busybox.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox