Buildroot Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: Bernd Kuhls <bernd.kuhls@t-online.de>
To: buildroot@busybox.net
Subject: [Buildroot] [PATCH v2 04/20] python3: make it exclusive from python
Date: Sat, 08 Oct 2016 17:57:39 +0200	[thread overview]
Message-ID: <jkhncdxdku.ln2@ID-313208.user.individual.net> (raw)
In-Reply-To: 20161008160228.71f9e08f@free-electrons.com

Hi Thomas, hi Yann,

Am Sat, 08 Oct 2016 16:02:28 +0200 schrieb Thomas Petazzoni:

>> Plain and simple: if a python module supports both python and python3,
>> and both are enabled, that python module is built for both python and
>> python3.
> 
> Well, that's horrible from a filesystem size point of view, and I'm not
> really sure this would solve Bernd's issue. I'm pretty sure Bernd would
> like to have a given set of modules built for Python 2, and another set
> of modules built for Python 3.

actually I solved the dependency problem by copying python2 and python3 
to my target system ;) This is possible for me because I do not use a 
filesystem created by buildroot but use files from output/target/ stored 
as optional packages for the fli4l project, which then creates the 
filesystem image for the target machine by including these packages.

To achieve this I am building with one .config which has python2 + kodi/
mwscrape and later another .config build is done with python3 + 
mwscrape2slob.

To clarify:
mwscrape[1] downloads articles from mediawiki-based sites, stores them on 
a couchdb server and has runtime dependencies to the following python 
modules: couchdb, futures, mwclient and pylru. Because mwclient is 
python2-only so is mwscrape.

mwscrape2slob[2] downloads the stored mediawiki articles from the couchdb 
server and creates files in .slob format for use in the Android app aard2
[3], which is a offline-reader. It depends on the following python 
modules: couchdb, cssselect, cssutils, lxml and slob. The modules slob 
and mwscrape2slob are python3-only.

Luckily no module with a python version restriction depends on a module 
with a different python version restriction :)

So yes, there are some modules which I only need in python2, others only 
in python3, for this purpose I am using two different .config files and 
build python2 and python3 seperately. Filesystem space is not a problem 
for me, my target system is not an embedded device, therefore my solution 
may not be suitable for the general use in the buildroot project.

I expect to send the mwscrape2slob patch series in the coming days after 
testing a self-build .slob file. Currently I am busy with downloading 
Wikipedia data ;) The CouchDB server built with buildroot runs rock-solid.

Regards, Bernd

[1] https://github.com/itkach/mwscrape
[2] https://github.com/itkach/mwscrape2slob
[3] https://github.com/itkach/aard2-android

  reply	other threads:[~2016-10-08 15:57 UTC|newest]

Thread overview: 47+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-02-18 20:39 [Buildroot] [PATCH v2 00/20] Python 2 and 3 bumps, support for Python 3 external modules Thomas Petazzoni
2014-02-18 20:39 ` [Buildroot] [PATCH v2 01/20] pkg-python: no longer use distutilscross for setuptools Thomas Petazzoni
2014-02-18 21:57   ` Peter Korsgaard
2014-02-18 20:39 ` [Buildroot] [PATCH v2 02/20] python-distutilscross: remove package that is no longer needed Thomas Petazzoni
2014-02-18 21:58   ` Peter Korsgaard
2014-02-18 20:39 ` [Buildroot] [PATCH v2 03/20] python3: removal of *.py/*.pyc is now done globally Thomas Petazzoni
2014-02-18 21:58   ` Peter Korsgaard
2014-02-18 20:39 ` [Buildroot] [PATCH v2 04/20] python3: make it exclusive from python Thomas Petazzoni
2014-02-18 21:58   ` Peter Korsgaard
2016-10-05 18:00   ` Bernd Kuhls
2016-10-05 19:30     ` Thomas Petazzoni
2016-10-08 12:24       ` Yann E. MORIN
2016-10-08 12:51         ` Thomas Petazzoni
2016-10-08 13:51           ` Yann E. MORIN
2016-10-08 14:02             ` Thomas Petazzoni
2016-10-08 15:57               ` Bernd Kuhls [this message]
2016-10-08 18:23                 ` Yegor Yefremov
2016-10-09  7:55                   ` Bernd Kuhls
2016-10-09  9:44                     ` Yegor Yefremov
2016-10-09 11:29                       ` Yegor Yefremov
2016-10-08 16:55               ` Yann E. MORIN
2014-02-18 20:39 ` [Buildroot] [PATCH v2 05/20] python3: add python -> python3 symlink for the host variant Thomas Petazzoni
2014-02-18 21:58   ` Peter Korsgaard
2014-02-18 20:39 ` [Buildroot] [PATCH v2 06/20] python3: add config directory symbolic link Thomas Petazzoni
2014-02-18 21:56   ` Peter Korsgaard
2014-02-18 22:17     ` Thomas Petazzoni
2014-02-18 22:21       ` Peter Korsgaard
2014-02-18 20:40 ` [Buildroot] [PATCH v2 07/20] python3: use proper PYTHON3_VERSION_MAJOR instead of harcoding 3.3 Thomas Petazzoni
2014-02-18 22:22   ` Peter Korsgaard
2014-02-18 20:40 ` [Buildroot] [PATCH v2 08/20] python3: bump to 3.4.0rc1 Thomas Petazzoni
2014-02-18 22:23   ` Peter Korsgaard
2014-02-18 20:40 ` [Buildroot] [PATCH v2 09/20] python3: provide a PYTHON3_PATH Thomas Petazzoni
2014-02-18 22:29   ` Peter Korsgaard
2014-02-18 22:33     ` Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 10/20] package: add python3 support in the package infrastructure Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 11/20] package: allow Python packages with Python3 Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 12/20] python, python3: enable unicodedata for host-python, needed by setuptools Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 13/20] python-setuptools: bump version to 2.1.2 Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 14/20] python, python3: fix to ensure libpython is stripped Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 15/20] python-pyasn: use the real upstream Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 16/20] python-bottle: allow to build with Python 3 Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 17/20] python-serial: " Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 18/20] python-pyasn: " Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 19/20] python-pycrypto: " Thomas Petazzoni
2014-02-18 20:40 ` [Buildroot] [PATCH v2 20/20] python-pysnmp{, -apps, -mibs}: " Thomas Petazzoni
2014-02-19  8:03 ` [Buildroot] [PATCH v2 00/20] Python 2 and 3 bumps, support for Python 3 external modules Peter Korsgaard
2014-02-19  8:23   ` Thomas Petazzoni

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=jkhncdxdku.ln2@ID-313208.user.individual.net \
    --to=bernd.kuhls@t-online.de \
    --cc=buildroot@busybox.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox