* [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up.
@ 2014-05-29 5:24 vomlehn at canopus-us.com
2014-05-29 5:24 ` [Buildroot] [PATCH 1/3] Add the capability to create sub-filesystems from the target filesystem vomlehn at canopus-us.com
` (3 more replies)
0 siblings, 4 replies; 8+ messages in thread
From: vomlehn at canopus-us.com @ 2014-05-29 5:24 UTC (permalink / raw)
To: buildroot
From: David VomLehn <vomlehn@canopus-us.com>
These patches are not as tightly coupled as the usually series of patches,
but I think the pieces make more sense when viewed in the context of the
whole patchset. The problem to be solved is that Python is big and my root
filesystem has to fit in a little flash device. So, I:
1. Created the ability to break the target filesystem into multiple
filesystems,
2. Enhanced autotools so that I could specify the --prefix and
--exec-prefix values. This allowed me to install packages in
their own directory, which the above patch lets me split into a
filesystem I can store on a much bigger flash device, and
3. I modified the Python package so that the installation directory
is a configurable.
With these in place, I configure Python to be in /usr/local and make that
a separate filesystem, which I can deploy in a nice big flash device. Problem
solved.
David VomLehn (3):
Add the capability to create sub-filesystems from the target
filesystem.
Allow specification of values for --prefix and --exec-prefix in
autotools.
Support installation of Python in a different directory.
Makefile | 5 +-
docs/manual/adding-packages-autotools.txt | 8 ++
docs/manual/customize-rootfs.txt | 74 ++++++++++
fs/Config.in | 25 ++++
fs/cloop/Config.in | 12 ++
fs/cloop/cloop-post.mk | 13 ++
fs/cloop/cloop-pre.mk | 7 +
fs/common.mk | 224 ++++++++++++++++++++++++++---
fs/cpio/Config.in | 12 ++
fs/cpio/cpio-post.mk | 42 ++++++
fs/cpio/cpio-pre.mk | 7 +
fs/cramfs/Config.in | 12 ++
fs/cramfs/cramfs-post.mk | 19 +++
fs/cramfs/cramfs-pre.mk | 7 +
fs/ext2/Config.in | 12 ++
fs/ext2/ext2-post.mk | 37 +++++
fs/ext2/ext2-pre.mk | 6 +
fs/initramfs/initramfs-post.mk | 22 +++
fs/initramfs/initramfs-pre.mk | 5 +
fs/iso9660/iso9660-post.mk | 51 +++++++
fs/iso9660/iso9660-pre.mk | 9 ++
fs/jffs2/Config.in | 12 ++
fs/jffs2/jffs2-post.mk | 49 +++++++
fs/jffs2/jffs2-pre.mk | 7 +
fs/romfs/Config.in | 12 ++
fs/romfs/romfs-post.mk | 15 ++
fs/romfs/romfs-pre.mk | 7 +
fs/squashfs/Config.in | 12 ++
fs/squashfs/squashfs-post.mk | 29 ++++
fs/squashfs/squashfs-pre.mk | 7 +
fs/tar/Config.in | 12 ++
fs/tar/tar-post.mk | 13 ++
fs/tar/tar-pre.mk | 7 +
fs/ubifs/Config.in | 12 ++
fs/ubifs/ubi-post.mk | 30 ++++
fs/ubifs/ubi-pre.mk | 7 +
fs/ubifs/ubifs-post.mk | 27 ++++
fs/ubifs/ubifs-pre.mk | 7 +
fs/yaffs2/Config.in | 12 ++
fs/yaffs2/yaffs-post.mk | 13 ++
fs/yaffs2/yaffs-pre.mk | 7 +
package/pkg-autotools.mk | 7 +-
package/python/Config.in | 7 +
package/python/python.mk | 26 ++--
44 files changed, 911 insertions(+), 35 deletions(-)
create mode 100644 fs/cloop/cloop-post.mk
create mode 100644 fs/cloop/cloop-pre.mk
create mode 100644 fs/cpio/cpio-post.mk
create mode 100644 fs/cpio/cpio-pre.mk
create mode 100644 fs/cramfs/cramfs-post.mk
create mode 100644 fs/cramfs/cramfs-pre.mk
create mode 100644 fs/ext2/ext2-post.mk
create mode 100644 fs/ext2/ext2-pre.mk
create mode 100644 fs/initramfs/initramfs-post.mk
create mode 100644 fs/initramfs/initramfs-pre.mk
create mode 100644 fs/iso9660/iso9660-post.mk
create mode 100644 fs/iso9660/iso9660-pre.mk
create mode 100644 fs/jffs2/jffs2-post.mk
create mode 100644 fs/jffs2/jffs2-pre.mk
create mode 100644 fs/romfs/romfs-post.mk
create mode 100644 fs/romfs/romfs-pre.mk
create mode 100644 fs/squashfs/squashfs-post.mk
create mode 100644 fs/squashfs/squashfs-pre.mk
create mode 100644 fs/tar/tar-post.mk
create mode 100644 fs/tar/tar-pre.mk
create mode 100644 fs/ubifs/ubi-post.mk
create mode 100644 fs/ubifs/ubi-pre.mk
create mode 100644 fs/ubifs/ubifs-post.mk
create mode 100644 fs/ubifs/ubifs-pre.mk
create mode 100644 fs/yaffs2/yaffs-post.mk
create mode 100644 fs/yaffs2/yaffs-pre.mk
--
1.7.9.5
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Buildroot] [PATCH 1/3] Add the capability to create sub-filesystems from the target filesystem.
2014-05-29 5:24 [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up vomlehn at canopus-us.com
@ 2014-05-29 5:24 ` vomlehn at canopus-us.com
2014-05-29 9:21 ` Jérôme Pouiller
2014-05-29 5:24 ` [Buildroot] [PATCH 2/3] Allow specification of values for --prefix and --exec-prefix in autotools vomlehn at canopus-us.com
` (2 subsequent siblings)
3 siblings, 1 reply; 8+ messages in thread
From: vomlehn at canopus-us.com @ 2014-05-29 5:24 UTC (permalink / raw)
To: buildroot
From: David VomLehn <vomlehn@canopus-us.com>
For example, say that the the root filesystem has a set of files and
directories that are critical to being able to control, recover, and
install software on an embedded system. These are redundantly stored in a
small but reliable memory. The rest of the system is written in Python,
which is huge (too big to fit in the reliable memory) but not a critical
part of the system. It can, if necessary, be reloaded remotely, so it is
stored without redundancy, in NAND flash.
This patch allows these two pieces to be split up so that the reliable core
can be an initramfs filesystem (in cpio format) and a JFFS2 image can hold
the rest of the root filesystem. It supports an arbitrary division of the
root filesystem among one or more of the available filesystem formats.
Signed-off-by: David VomLehn <vomlehn@canopus-us.com>
---
Makefile | 5 +-
docs/manual/customize-rootfs.txt | 74 +++++++++++++
fs/Config.in | 25 +++++
fs/cloop/Config.in | 12 ++
fs/cloop/cloop-post.mk | 13 +++
fs/cloop/cloop-pre.mk | 7 ++
fs/common.mk | 224 ++++++++++++++++++++++++++++++++++----
fs/cpio/Config.in | 12 ++
fs/cpio/cpio-post.mk | 42 +++++++
fs/cpio/cpio-pre.mk | 7 ++
fs/cramfs/Config.in | 12 ++
fs/cramfs/cramfs-post.mk | 19 ++++
fs/cramfs/cramfs-pre.mk | 7 ++
fs/ext2/Config.in | 12 ++
fs/ext2/ext2-post.mk | 37 +++++++
fs/ext2/ext2-pre.mk | 6 +
fs/initramfs/initramfs-post.mk | 22 ++++
fs/initramfs/initramfs-pre.mk | 5 +
fs/iso9660/iso9660-post.mk | 51 +++++++++
fs/iso9660/iso9660-pre.mk | 9 ++
fs/jffs2/Config.in | 12 ++
fs/jffs2/jffs2-post.mk | 49 +++++++++
fs/jffs2/jffs2-pre.mk | 7 ++
fs/romfs/Config.in | 12 ++
fs/romfs/romfs-post.mk | 15 +++
fs/romfs/romfs-pre.mk | 7 ++
fs/squashfs/Config.in | 12 ++
fs/squashfs/squashfs-post.mk | 29 +++++
fs/squashfs/squashfs-pre.mk | 7 ++
fs/tar/Config.in | 12 ++
fs/tar/tar-post.mk | 13 +++
fs/tar/tar-pre.mk | 7 ++
fs/ubifs/Config.in | 12 ++
fs/ubifs/ubi-post.mk | 30 +++++
fs/ubifs/ubi-pre.mk | 7 ++
fs/ubifs/ubifs-post.mk | 27 +++++
fs/ubifs/ubifs-pre.mk | 7 ++
fs/yaffs2/Config.in | 12 ++
fs/yaffs2/yaffs-post.mk | 13 +++
fs/yaffs2/yaffs-pre.mk | 7 ++
40 files changed, 876 insertions(+), 22 deletions(-)
create mode 100644 fs/cloop/cloop-post.mk
create mode 100644 fs/cloop/cloop-pre.mk
create mode 100644 fs/cpio/cpio-post.mk
create mode 100644 fs/cpio/cpio-pre.mk
create mode 100644 fs/cramfs/cramfs-post.mk
create mode 100644 fs/cramfs/cramfs-pre.mk
create mode 100644 fs/ext2/ext2-post.mk
create mode 100644 fs/ext2/ext2-pre.mk
create mode 100644 fs/initramfs/initramfs-post.mk
create mode 100644 fs/initramfs/initramfs-pre.mk
create mode 100644 fs/iso9660/iso9660-post.mk
create mode 100644 fs/iso9660/iso9660-pre.mk
create mode 100644 fs/jffs2/jffs2-post.mk
create mode 100644 fs/jffs2/jffs2-pre.mk
create mode 100644 fs/romfs/romfs-post.mk
create mode 100644 fs/romfs/romfs-pre.mk
create mode 100644 fs/squashfs/squashfs-post.mk
create mode 100644 fs/squashfs/squashfs-pre.mk
create mode 100644 fs/tar/tar-post.mk
create mode 100644 fs/tar/tar-pre.mk
create mode 100644 fs/ubifs/ubi-post.mk
create mode 100644 fs/ubifs/ubi-pre.mk
create mode 100644 fs/ubifs/ubifs-post.mk
create mode 100644 fs/ubifs/ubifs-pre.mk
create mode 100644 fs/yaffs2/yaffs-post.mk
create mode 100644 fs/yaffs2/yaffs-pre.mk
diff --git a/Makefile b/Makefile
index 8ccfbd8..b69ee57 100644
--- a/Makefile
+++ b/Makefile
@@ -332,7 +332,7 @@ TARGET_SKELETON = $(TOPDIR)/system/skeleton
# Location of a file giving a big fat warning that output/target
# should not be used as the root filesystem.
-TARGET_DIR_WARNING_FILE = $(TARGET_DIR)/THIS_IS_NOT_YOUR_ROOT_FILESYSTEM
+TARGET_DIR_WARNING_FILE = THIS_IS_NOT_YOUR_ROOT_FILESYSTEM
ifeq ($(BR2_CCACHE),y)
CCACHE := $(HOST_DIR)/usr/bin/ccache
@@ -488,7 +488,8 @@ $(BUILD_DIR)/.root:
rsync -a --ignore-times $(RSYNC_VCS_EXCLUSIONS) \
--chmod=Du+w --exclude .empty --exclude '*~' \
$(TARGET_SKELETON)/ $(TARGET_DIR)/
- $(INSTALL) -m 0644 support/misc/target-dir-warning.txt $(TARGET_DIR_WARNING_FILE)
+ $(INSTALL) -m 0644 support/misc/target-dir-warning.txt \
+ $(TARGET_DIR)/$(TARGET_DIR_WARNING_FILE)
@ln -snf lib $(TARGET_DIR)/$(LIB_SYMLINK)
@mkdir -p $(TARGET_DIR)/usr
@ln -snf lib $(TARGET_DIR)/usr/$(LIB_SYMLINK)
diff --git a/docs/manual/customize-rootfs.txt b/docs/manual/customize-rootfs.txt
index 8ae1403..701f275 100644
--- a/docs/manual/customize-rootfs.txt
+++ b/docs/manual/customize-rootfs.txt
@@ -86,3 +86,77 @@ Additionally, each of the +BR2_ROOTFS_POST_BUILD_SCRIPT+ and
specified in +BR2_ROOTFS_POST_SCRIPT_ARGS+ (if that is not empty).
All the scripts will be passed the exact same set of arguments, it
is not possible to pass different sets of arguments to each script.
+
+[[subfs]]
+==== Using sub-filesystems
+
+It can helpful to split the generated target filesystem into
+two or more sub-filesystems. There are several reasons for this, such as:
+
+* The target filesystem will not fit on a single device.
+
+* The reliability requirements for different parts of the filesystem may
+ differ. For example, in a system with high reliability requirements, there
+ may be a core part of the target filesystem that is duplicated and a boot
+ loader used that will try a backup copy if the first copy was corrupted.
+ If the rest of the filesystem can be re-loaded by the reliable core, it
+ can be stored without redundancy, perhaps on a device with less reliability.
+
+Using sub-filesystem is more complex than having a single filesystem, so
+it must be specifically enabled. Under the Filesystem Images menu, select
+Build sub-filesystems:
+
+-----
+[*] Build sub-filesystems
+-----
+
+Then, under each filesystem image type that supports sub-filesystems, an
+additional line will appear allowing specification of the part of the
+target filesystem to build. So, if a JFFS2 filesytem is selected, you might
+see:
+
+-----
+[*] jffs2 root filesystem
+(/usr/local) Sub-filesystems to build with JFFS2
+-----
+
+Multiple filesystems of each type may be built.
+
+One use case might be to use a cpio filesystem image for the root of the
+filesystems, a read-only SquashFS filesystem for most of /home, and writeable
+JFFS2 filesystems for /home/wuser and /var. This might look like (with
+unrelated portions deleted):
+
+-----
+[*] cpio the root filesystem (for use as an initial RAM filesyste
+(/) Sub-filesystems to build with cpio
+ Compression method (gzip) --->
+...
+[*] jffs2 root filesystem
+(/home/wuser /var) Sub-filesystems to build with JFFS2
+...
+[*] squashfs root filesystem
+(/home) Sub-filesystems to build with squashfs
+-----
+This is processed by first combining all of the specified directories, in this
+case /, /home/wuser, /var, and /home. Then, each directory marks the root
+of a sub-filesystem, which excludes all specified directories below it. For
+example, /home is specified as a SquashFS filesystem, but that filesystem
+image will not have anything below /home/wuser (though it will include the
+wuser directory itself as a mountpoint for the Squashfs filesystem).
+
+A given directory can be specified under multiple filesystem image types, if
+desired. So, it is possible to build /var as a JFFS2 filesystem image and
+as a tar file just by listed /var under each.
+
+The filesystem images generated will be stored under output/images with a name
+that includes the path, starting with "root", followed the the directory
+name, and ending with "fs" and suffix
+that indicates the filesystem type. Slashes in the directory names are
+replaced by hyphens. The four filesystem images in the example from the
+previous section will be named:
+
+* rootfs.cpio
+* root-home-wuserfs.jffs2
+* root-varfs.jffs2
+* root-homefs.squashfs
diff --git a/fs/Config.in b/fs/Config.in
index 5853113..22df250 100644
--- a/fs/Config.in
+++ b/fs/Config.in
@@ -1,5 +1,30 @@
menu "Filesystem images"
+config BR2_BUILD_SUB_FILESYSTEMS
+ bool "Build sub-filesystems"
+ help
+ Normally, all target files will be put into a single root filesystem.
+ Choosing this option allows sub-directories of the root filesystem
+ to be split into sub-filesystems, possible of different types.
+ These filesystems can then be written to different devices and
+ mounted at boot time to create the original view of the root
+ filesystem.
+
+ Note that this will split up the root filesystems based on the
+ concatenation of filesystems listed under all filesystems types.
+ So, if "/ and /usr" are listed under cpio and "/ /usr/share" are
+ listed under JFFS2, four filesystem images will be created:
+ o rootfs.cpio: A cpio image containing everything under the
+ original root filesystem except for /usr
+ o rootfs.jffs: A JFFS2 image with everything under the original
+ root filesystem except for /usr, i.e the same contents as
+ rootfs.cpio, but as a different filesystem image type.
+ o rootfs-usrfs.cpio: Everything under the original /usr directory
+ except for files under /usr/share, but including the /usr/share
+ directory.
+ o rootfs-usr-sharefs.jffs2: Everything under the original
+ /usr/share directory.
+
source "fs/cloop/Config.in"
source "fs/cpio/Config.in"
source "fs/cramfs/Config.in"
diff --git a/fs/cloop/Config.in b/fs/cloop/Config.in
index 3e01067..5900cb2 100644
--- a/fs/cloop/Config.in
+++ b/fs/cloop/Config.in
@@ -8,3 +8,15 @@ config BR2_TARGET_ROOTFS_CLOOP
compressed filesystem like a block device and seamlessly
decompress its data while accessing it. The majority of the
software on an LNX-BBC is accessed in this fashion.
+
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_CLOOP_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with cloop"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_CLOOP
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
diff --git a/fs/cloop/cloop-post.mk b/fs/cloop/cloop-post.mk
new file mode 100644
index 0000000..a3dd5d4
--- /dev/null
+++ b/fs/cloop/cloop-post.mk
@@ -0,0 +1,13 @@
+################################################################################
+#
+# Build the compressed loop root filesystem image
+#
+################################################################################
+
+ROOTFS_CLOOP_DEPENDENCIES = host-cloop host-cdrkit
+
+define ROOTFS_CLOOP_CMD
+ $(HOST_DIR)/usr/bin/genisoimage -r $(1) | $(HOST_DIR)/usr/bin/create_compressed_fs - 65536 > $@
+endef
+
+$(eval $(call ROOTFS_TARGETS,cloop,$(CLOOP_SUBFS)))
diff --git a/fs/cloop/cloop-pre.mk b/fs/cloop/cloop-pre.mk
new file mode 100644
index 0000000..ffef696
--- /dev/null
+++ b/fs/cloop/cloop-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define cloop filesystems
+#
+################################################################################
+
+CLOOP_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_CLOOP_SUB_FILESYSTEMS),/)
diff --git a/fs/common.mk b/fs/common.mk
index 919db25..4a06a08 100644
--- a/fs/common.mk
+++ b/fs/common.mk
@@ -28,6 +28,7 @@
# BR2_TARGET_ROOTFS_$(FSTYPE)_LZMA exist and are enabled, then the
# macro will automatically generate a compressed filesystem image.
+SUBFS_DIR = $(BINARIES_DIR)/subfs
FAKEROOT_SCRIPT = $(BUILD_DIR)/_fakeroot.fs
FULL_DEVICE_TABLE = $(BUILD_DIR)/_device_table.txt
ROOTFS_DEVICE_TABLES = $(call qstrip,$(BR2_ROOTFS_DEVICE_TABLE) \
@@ -35,6 +36,151 @@ ROOTFS_DEVICE_TABLES = $(call qstrip,$(BR2_ROOTFS_DEVICE_TABLE) \
USERS_TABLE = $(BUILD_DIR)/_users_table.txt
ROOTFS_USERS_TABLES = $(call qstrip,$(BR2_ROOTFS_USERS_TABLES))
+# A complete list of filesystems to be built
+include $(sort $(wildcard fs/*/*-pre.mk))
+ALL_FILESYSTEMS = $(sort $(call qstrip,\
+ $(CLOOP_SUBFS) \
+ $(CPIO_SUBFS) \
+ $(CRAMFS_SUBFS) \
+ $(EXT2_SUBFS) \
+ $(JFFS2_SUBFS) \
+ $(ROMFS_SUBFS) \
+ $(SQUASHFS_SUBFS) \
+ $(TAR_SUBFS) \
+ $(UBIFS_SUBFS) \
+ $(UBI_SUBFS) \
+ $(YAFFS2_SUBFS)))
+
+# Translate from a full pathname to a tag.
+# $(1) Pathname. This must start with a slash
+define SUBFS_TAG
+$(if $(findstring $(1),/),,$(subst /,-,$(1)))
+endef
+
+# Add a leading slash to each of the subdirectory names
+# slashes
+# $(1) List of directories to which the leading slash should be added
+define ADD_LEADING_SLASH
+$(patsubst //,/,$(addprefix /,$(1)))
+endef
+
+# Add a trailing slash to each of the subdirectory names
+# slashes
+# $(1) List of directories to which the trailing slash should be added
+define ADD_TRAILING_SLASH
+$(patsubst //,/,$(addsuffix /,$(1)))
+endef
+
+# Pull out all of the subdirectories of a given directory and make them
+# relative to the given directory, using normalized directory names. Normalized
+# directory names all end with exactly one trailing slash
+# $(1) Directory
+# $(2) List of possible subdirectories
+define SUB_FILESYSTEMS_NORMALIZED
+$(call ADD_LEADING_SLASH,$(patsubst $(1)%,%,$(filter $(1)%,$(2))))
+endef
+
+# This is given a list of directory names and a starting directory. It pulls
+# out all of the directories properly under the starting directory and makes
+# The result is a list of relative pathnames, each of which ends with a slash.
+# $(1) Root directory, must start with slash (/)
+define SUB_FILESYSTEMS
+$(patsubst //%,/%,$(call SUB_FILESYSTEMS_NORMALIZED,$(call ADD_TRAILING_SLASH,$(1)),\
+$(call ADD_TRAILING_SLASH,$(sort $(ALL_FILESYSTEMS)))))
+endef
+
+# Create a "-prune" clause for the find command to prune the list of
+# subdirectories.
+# $(1) List of subdirectories. These are relative pathnames, so they must no
+# start with a slash (/) but must end with a slash.
+define FIND_PRUNE_SUBDIRECTORIES
+$(if $(1),\( \( $(subst |-o ,,|$(addprefix -o -path '.,$(addsuffix *',$(1)))) \) -prune \),-false)
+endef
+
+# Put together a set of options to the find command that can be used to
+# prune off subdirectories
+# $(1) Directory at which to start. This must start with a slash (/) character
+# We do a little odd processing to remove the -o from the first name; a
+# better way would be welcome.
+define FIND_PRUNE
+$(call FIND_PRUNE_SUBDIRECTORIES,$(call SUB_FILESYSTEMS,$(1)))
+endef
+
+# Message about sub-filesystem pruning
+# $(1) Directory being generated
+define PRUNING_MSG
+$(if $(strip $(1)),$(1),nothing)
+endef
+
+# Generate rules for one sub-filesystem target
+# $(1) Filesystem image type
+# $(2) Uppercase version of $(1)
+# $(3) Directory for which to generate the filesystem image
+# $(4) Location in which to place the directory tree
+define GEN_SUBFS_RULES_TAGGED
+
+$$(BINARIES_DIR)/root$(call SUBFS_TAG,$(3))fs.$(1): \
+ $(SUBFS_DIR)/root-all-$(1)
+ @echo
+ @echo "Creating $(1) directory tree for $(3)" \
+ "(pruning $(call PRUNING_MSG,$(call SUB_FILESYSTEMS,$(3))))"
+ rm -f $$(FAKEROOT_SCRIPT)
+ echo "set -x" >> $$(FAKEROOT_SCRIPT)
+ echo "set -e" >> $$(FAKEROOT_SCRIPT)
+ifeq ($$(ALL_FILESYSTEMS),/)
+ echo "$$(call ROOTFS_$(2)_CMD,$(TARGET_DIR))" >> $$(FAKEROOT_SCRIPT)
+else
+ echo "rm -f $(4)/$$(TARGET_DIR_WARNING_FILE)" >> $$(FAKEROOT_SCRIPT)
+ echo "cd $$(TARGET_DIR)$(3)" >> $$(FAKEROOT_SCRIPT)
+ echo "rm -rf $(4).tmp" >> $$(FAKEROOT_SCRIPT)
+ echo "mkdir -p $(4).tmp" >> $$(FAKEROOT_SCRIPT)
+ echo "find $(call FIND_PRUNE,$(3)) -o -print |" \
+ "cpio --quiet -p --make-directories $(4).tmp" \
+ >> $$(FAKEROOT_SCRIPT)
+ echo "rm -rf $(4)" >> $$(FAKEROOT_SCRIPT)
+ echo "mv $(4).tmp $(4)" >> $$(FAKEROOT_SCRIPT)
+ echo "cd - >/dev/null" >> $$(FAKEROOT_SCRIPT)
+ echo "$$(call ROOTFS_$(2)_CMD,$(4))" >> $$(FAKEROOT_SCRIPT)
+endif
+ chmod a+x $$(FAKEROOT_SCRIPT)
+ PATH=$(BR_PATH) $$(HOST_DIR)/usr/bin/fakeroot -s $$(FAKEROOT_$(2)_ENV) \
+ -i $$(FAKEROOT_$(2)_ENV) -- $$(FAKEROOT_SCRIPT)
+ifneq ($$(ROOTFS_$(2)_COMPRESS_CMD),)
+ $$(ROOTFS_$(2)_COMPRESS_CMD) $$@ > $$@$$(ROOTFS_$(2)_COMPRESS_EXT)
+endif
+ if [ '$$(ALL_FILESYSTEMS)' != '/' ]; then \
+ $(INSTALL) -m 0644 support/misc/target-dir-warning.txt \
+ $(4)/$$(TARGET_DIR_WARNING_FILE); \
+ fi
+endef
+
+# Generate rules for one sub-filesystem target
+# $(1) Filesystem image type
+# $(2) Uppercase version of $(1)
+# $(3) Directory for which to generate the filesystem image
+define GEN_SUBFS_RULES
+$(call GEN_SUBFS_RULES_TAGGED,$(1),$(2),$(3),$(SUBFS_DIR)/root$(call SUBFS_TAG,$(3))fs-$(1))
+endef
+
+# Generate rules for a list of sub-filesystem targets
+# $(1) Filesystem image type
+# $(2) Uppercase version of $(1)
+# $(3) Directories at the top of filesystems
+define GEN_SUBFS_RULES_LIST
+$(foreach fs,$(3),$(call GEN_SUBFS_RULES,$(1),$(2),$(fs)))
+endef
+
+# List of all of the generated images for a given type
+# $(1) Image type
+# $(2) List of all of the filesystems for this type
+define SUBFS_ALL
+$(foreach subfs,$(2),$$(BINARIES_DIR)/root$(call SUBFS_TAG,$(subfs))fs.$(1))
+endef
+
+# Define targets for building a filesystem image of a particular type
+# $(1) Filesystem image type
+# $(2) Uppercased $(1)
+# $(3) Directories to build
define ROOTFS_TARGET_INTERNAL
# extra deps
@@ -64,47 +210,85 @@ ROOTFS_$(2)_COMPRESS_EXT = .xz
ROOTFS_$(2)_COMPRESS_CMD = $$(XZ) -9 -C crc32 -c
endif
-$$(BINARIES_DIR)/rootfs.$(1): target-finalize $$(ROOTFS_$(2)_DEPENDENCIES)
- @$$(call MESSAGE,"Generating root filesystem image rootfs.$(1)")
+FAKEROOT_$(2)_ENV := $$(SUBFS_DIR)/fakeroot-env-$(1)
+
+$(SUBFS_DIR)/root-all-$(1): target-finalize $$(ROOTFS_$(2)_DEPENDENCIES) \
+ $(SUBFS_DIR)
+ @$$(call MESSAGE,"Generating $(1) filesystem image/images")
$$(foreach hook,$$(ROOTFS_$(2)_PRE_GEN_HOOKS),$$(call $$(hook))$$(sep))
rm -f $$(FAKEROOT_SCRIPT)
- rm -f $$(TARGET_DIR_WARNING_FILE)
+ rm -f $(TARGET_DIR)/$$(TARGET_DIR_WARNING_FILE)
rm -f $(USERS_TABLE)
- echo "chown -R 0:0 $$(TARGET_DIR)" >> $$(FAKEROOT_SCRIPT)
+ # Create the device tables
ifneq ($$(ROOTFS_DEVICE_TABLES),)
- cat $$(ROOTFS_DEVICE_TABLES) > $$(FULL_DEVICE_TABLE)
+ cat $$(ROOTFS_DEVICE_TABLES) >> $$(FULL_DEVICE_TABLE)
ifeq ($$(BR2_ROOTFS_DEVICE_CREATION_STATIC),y)
- printf '$$(subst $$(sep),\n,$$(PACKAGES_DEVICES_TABLE))' >> $$(FULL_DEVICE_TABLE)
+ printf '$$(subst $$(sep),\n,$$(PACKAGES_DEVICES_TABLE))' \
+ >> $$(FULL_DEVICE_TABLE)
endif
- printf '$$(subst $$(sep),\n,$$(PACKAGES_PERMISSIONS_TABLE))' >> $$(FULL_DEVICE_TABLE)
- echo "$$(HOST_DIR)/usr/bin/makedevs -d $$(FULL_DEVICE_TABLE) $$(TARGET_DIR)" >> $$(FAKEROOT_SCRIPT)
+ printf '$$(subst $$(sep),\n,$$(PACKAGES_PERMISSIONS_TABLE))' \
+ >> $$(FULL_DEVICE_TABLE)
endif
+ # Create the users table
ifneq ($$(ROOTFS_USERS_TABLES),)
cat $$(ROOTFS_USERS_TABLES) >> $(USERS_TABLE)
endif
printf '$(subst $(sep),\n,$(PACKAGES_USERS))' >> $(USERS_TABLE)
- PATH=$(BR_PATH) $(TOPDIR)/support/scripts/mkusers $(USERS_TABLE) $(TARGET_DIR) >> $(FAKEROOT_SCRIPT)
- echo "$$(ROOTFS_$(2)_CMD)" >> $$(FAKEROOT_SCRIPT)
- chmod a+x $$(FAKEROOT_SCRIPT)
- PATH=$(BR_PATH) $$(HOST_DIR)/usr/bin/fakeroot -- $$(FAKEROOT_SCRIPT)
- $(INSTALL) -m 0644 support/misc/target-dir-warning.txt $$(TARGET_DIR_WARNING_FILE)
- - at rm -f $$(FAKEROOT_SCRIPT) $$(FULL_DEVICE_TABLE)
-ifneq ($$(ROOTFS_$(2)_COMPRESS_CMD),)
- $$(ROOTFS_$(2)_COMPRESS_CMD) $$@ > $$@$$(ROOTFS_$(2)_COMPRESS_EXT)
+ # Create the script to be run under fakeroot
+ echo "set -e" >> $(FAKEROOT_SCRIPT)
+ echo "chown -R 0:0 $$(TARGET_DIR)" >> $(FAKEROOT_SCRIPT)
+ifneq ($$(ROOTFS_DEVICE_TABLES),)
+ echo "$$(HOST_DIR)/usr/bin/makedevs -d $$(FULL_DEVICE_TABLE)" \
+ "$$(TARGET_DIR)" >> $(FAKEROOT_SCRIPT)
endif
+ PATH=$(BR_PATH) $(TOPDIR)/support/scripts/mkusers $(USERS_TABLE) \
+ $(TARGET_DIR) >> $(FAKEROOT_SCRIPT)
+ chmod a+x $$(FAKEROOT_SCRIPT)
+ PATH=$(BR_PATH) $$(HOST_DIR)/usr/bin/fakeroot -s \
+ $$(FAKEROOT_$(2)_ENV) -- $$(FAKEROOT_SCRIPT)
rootfs-$(1)-show-depends:
@echo $$(ROOTFS_$(2)_DEPENDENCIES)
-rootfs-$(1): $$(BINARIES_DIR)/rootfs.$(1) $$(ROOTFS_$(2)_POST_TARGETS)
+$(call GEN_SUBFS_RULES_LIST,$(1),$(2),$(3))
+
+fs-finish-$(1):
+ $(INSTALL) -m 0644 support/misc/target-dir-warning.txt \
+ $(TARGET_DIR)/$$(TARGET_DIR_WARNING_FILE)
+ - at rm -f $$(FAKEROOT_SCRIPT) $$(FULL_DEVICE_TABLE)
+
+rootfs-$(1): $(call SUBFS_ALL,$(1),$(3)) fs-finish-$(1) \
+ $$(ROOTFS_$(2)_POST_TARGETS)
ifeq ($$(BR2_TARGET_ROOTFS_$(2)),y)
TARGETS_ROOTFS += rootfs-$(1)
endif
endef
-define ROOTFS_TARGET
-$(call ROOTFS_TARGET_INTERNAL,$(1),$(call UPPERCASE,$(1)))
+# This is the directory in which all of the non-final work produces are
+# placed
+$(SUBFS_DIR):
+ mkdir -p $(SUBFS_DIR)
+
+# Make sure all filesystems specified start with / and do not end with /
+# $(1) Filesystem image type
+# $(2) Filesystem directory names
+define VALIDATE_FILESYSTEM_NAMES
+$(if $(2),
+$(if $(filter-out /%,$(2)),
+$(error All $(1) filesystem directory names ($(2))
+must start with slash character))
+$(if $(filter %/,$(filter-out /,$(2))),
+$(error No $(1) filesystem directory names ($(2))
+may end with slash character)))
+endef
+
+# Make the root filesystem image and all sub-filesystems of a given type
+# $(1) Filesystem image type
+# $(2) List of directories for which filesystem images are to be made
+define ROOTFS_TARGETS
+$(call VALIDATE_FILESYSTEM_NAMES,$(1),$(call qstrip,$(2)))
+$(if $(2),$(call ROOTFS_TARGET_INTERNAL,$(1),$(call UPPERCASE,$(1)),$(sort $(call qstrip,$(2)))))
endef
-include $(sort $(wildcard fs/*/*.mk))
+include $(sort $(wildcard fs/*/*-post.mk))
diff --git a/fs/cpio/Config.in b/fs/cpio/Config.in
index 206baca..7c79bd1 100644
--- a/fs/cpio/Config.in
+++ b/fs/cpio/Config.in
@@ -5,6 +5,18 @@ config BR2_TARGET_ROOTFS_CPIO
used for an initial RAM filesystem that is passed to the kernel
by the bootloader.
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_CPIO_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with cpio"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_CPIO
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
+
if BR2_TARGET_ROOTFS_CPIO
choice
diff --git a/fs/cpio/cpio-post.mk b/fs/cpio/cpio-post.mk
new file mode 100644
index 0000000..4561e49
--- /dev/null
+++ b/fs/cpio/cpio-post.mk
@@ -0,0 +1,42 @@
+################################################################################
+#
+# cpio to archive target filesystem
+#
+################################################################################
+
+ifeq ($(BR2_ROOTFS_DEVICE_CREATION_STATIC),y)
+
+define ROOTFS_CPIO_ADD_INIT
+ if [ ! -e $(TARGET_DIR)/init ]; then \
+ ln -sf sbin/init $(TARGET_DIR)/init; \
+ fi
+endef
+
+else
+# devtmpfs does not get automounted when initramfs is used.
+# Add a pre-init script to mount it before running init
+define ROOTFS_CPIO_ADD_INIT
+ if [ ! -e $(TARGET_DIR)/init ]; then \
+ $(INSTALL) -m 0755 fs/cpio/init $(TARGET_DIR)/init; \
+ fi
+endef
+
+PACKAGES_PERMISSIONS_TABLE += /dev/console c 622 0 0 5 1 - - -$(sep)
+
+endif # BR2_ROOTFS_DEVICE_CREATION_STATIC
+
+ROOTFS_CPIO_PRE_GEN_HOOKS += ROOTFS_CPIO_ADD_INIT
+
+define ROOTFS_CPIO_CMD
+ cd $(1) && find . | cpio --quiet -o -H newc > $@
+endef
+
+$(BINARIES_DIR)/rootfs.cpio.uboot: $(BINARIES_DIR)/rootfs.cpio host-uboot-tools
+ $(MKIMAGE) -A $(MKIMAGE_ARCH) -T ramdisk \
+ -C none -d $<$(ROOTFS_CPIO_COMPRESS_EXT) $@
+
+ifeq ($(BR2_TARGET_ROOTFS_CPIO_UIMAGE),y)
+ROOTFS_CPIO_POST_TARGETS += $(BINARIES_DIR)/rootfs.cpio.uboot
+endif
+
+$(eval $(call ROOTFS_TARGETS,cpio,$(CPIO_SUBFS)))
diff --git a/fs/cpio/cpio-pre.mk b/fs/cpio/cpio-pre.mk
new file mode 100644
index 0000000..6792979
--- /dev/null
+++ b/fs/cpio/cpio-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define cpio filesystems
+#
+################################################################################
+
+CPIO_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_CPIO_SUB_FILESYSTEMS),/)
diff --git a/fs/cramfs/Config.in b/fs/cramfs/Config.in
index 1a4e326..0ab687f 100644
--- a/fs/cramfs/Config.in
+++ b/fs/cramfs/Config.in
@@ -4,3 +4,15 @@ config BR2_TARGET_ROOTFS_CRAMFS
Build a cramfs root filesystem
http://sourceforge.net/projects/cramfs/
+
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_CRAMFS_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with cramfs"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_CRAMFS
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
diff --git a/fs/cramfs/cramfs-post.mk b/fs/cramfs/cramfs-post.mk
new file mode 100644
index 0000000..aa27363
--- /dev/null
+++ b/fs/cramfs/cramfs-post.mk
@@ -0,0 +1,19 @@
+################################################################################
+#
+# Build the cramfs root filesystem image
+#
+################################################################################
+
+ifeq ($(BR2_ENDIAN),"BIG")
+CRAMFS_OPTS = -b
+else
+CRAMFS_OPTS = -l
+endif
+
+define ROOTFS_CRAMFS_CMD
+ $(HOST_DIR)/usr/bin/mkcramfs $(CRAMFS_OPTS) $(1) $@
+endef
+
+ROOTFS_CRAMFS_DEPENDENCIES = host-cramfs
+
+$(eval $(call ROOTFS_TARGETS,cramfs,$(CRAMFS_SUBFS)))
diff --git a/fs/cramfs/cramfs-pre.mk b/fs/cramfs/cramfs-pre.mk
new file mode 100644
index 0000000..3aff37c
--- /dev/null
+++ b/fs/cramfs/cramfs-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define cramfs filesystems
+#
+################################################################################
+
+CRAMFS_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_CRAMFS_SUB_FILESYSTEMS),/)
diff --git a/fs/ext2/Config.in b/fs/ext2/Config.in
index adba6f3..b2c18ee 100644
--- a/fs/ext2/Config.in
+++ b/fs/ext2/Config.in
@@ -5,6 +5,18 @@ config BR2_TARGET_ROOTFS_EXT2
help
Build an ext2/3/4 root filesystem
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_EXT2_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with ext2/3/4"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_EXT2
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
+
if BR2_TARGET_ROOTFS_EXT2
config BR2_TARGET_ROOTFS_EXT2_2
diff --git a/fs/ext2/ext2-post.mk b/fs/ext2/ext2-post.mk
new file mode 100644
index 0000000..a577b56
--- /dev/null
+++ b/fs/ext2/ext2-post.mk
@@ -0,0 +1,37 @@
+################################################################################
+#
+# Build the ext2 root filesystem image
+#
+################################################################################
+
+EXT2_OPTS :=
+
+ifneq ($(strip $(BR2_TARGET_ROOTFS_EXT2_BLOCKS)),0)
+EXT2_OPTS += -b $(BR2_TARGET_ROOTFS_EXT2_BLOCKS)
+endif
+
+ifneq ($(strip $(BR2_TARGET_ROOTFS_EXT2_INODES)),0)
+EXT2_OPTS += -N $(BR2_TARGET_ROOTFS_EXT2_INODES)
+endif
+
+ifneq ($(strip $(BR2_TARGET_ROOTFS_EXT2_RESBLKS)),0)
+EXT2_OPTS += -m $(BR2_TARGET_ROOTFS_EXT2_RESBLKS)
+endif
+
+ROOTFS_EXT2_DEPENDENCIES = host-genext2fs host-e2fsprogs
+
+EXT2_ENV = GEN=$(BR2_TARGET_ROOTFS_EXT2_GEN)
+EXT2_ENV += REV=$(BR2_TARGET_ROOTFS_EXT2_REV)
+
+define ROOTFS_EXT2_CMD
+ PATH=$(BR_PATH) $(EXT2_ENV) fs/ext2/genext2fs.sh -d $(1) $(EXT2_OPTS) $@
+endef
+
+rootfs-ext2-symlink:
+ ln -sf rootfs.ext2$(ROOTFS_EXT2_COMPRESS_EXT) $(BINARIES_DIR)/rootfs.ext$(BR2_TARGET_ROOTFS_EXT2_GEN)$(ROOTFS_EXT2_COMPRESS_EXT)
+
+ifneq ($(BR2_TARGET_ROOTFS_EXT2_GEN),2)
+ROOTFS_EXT2_POST_TARGETS += rootfs-ext2-symlink
+endif
+
+$(eval $(call ROOTFS_TARGETS,ext2,$(EXT2_SUBFS)))
diff --git a/fs/ext2/ext2-pre.mk b/fs/ext2/ext2-pre.mk
new file mode 100644
index 0000000..5c937f4
--- /dev/null
+++ b/fs/ext2/ext2-pre.mk
@@ -0,0 +1,6 @@
+################################################################################
+#
+# Define ext2/3/4 filesystems
+#
+################################################################################
+EXT2_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_EXT2_SUB_FILESYSTEMS),/)
diff --git a/fs/initramfs/initramfs-post.mk b/fs/initramfs/initramfs-post.mk
new file mode 100644
index 0000000..5d3ea89
--- /dev/null
+++ b/fs/initramfs/initramfs-post.mk
@@ -0,0 +1,22 @@
+################################################################################
+#
+# Build a kernel with an integrated initial ramdisk
+# filesystem based on cpio.
+#
+################################################################################
+
+ROOTFS_INITRAMFS_DEPENDENCIES += rootfs-cpio
+
+ROOTFS_INITRAMFS_POST_TARGETS += linux26-rebuild-with-initramfs
+
+
+# The generic fs infrastructure isn't very useful here.
+
+rootfs-initramfs: $(ROOTFS_INITRAMFS_DEPENDENCIES) $(ROOTFS_INITRAMFS_POST_TARGETS)
+
+rootfs-initramfs-show-depends:
+ @echo $(ROOTFS_INITRAMFS_DEPENDENCIES)
+
+ifeq ($(BR2_TARGET_ROOTFS_INITRAMFS),y)
+TARGETS_ROOTFS += rootfs-initramfs
+endif
diff --git a/fs/initramfs/initramfs-pre.mk b/fs/initramfs/initramfs-pre.mk
new file mode 100644
index 0000000..e637d4b
--- /dev/null
+++ b/fs/initramfs/initramfs-pre.mk
@@ -0,0 +1,5 @@
+################################################################################
+#
+# Define initramfs filesystems, which doesn't really fit in quite right
+#
+################################################################################
diff --git a/fs/iso9660/iso9660-post.mk b/fs/iso9660/iso9660-post.mk
new file mode 100644
index 0000000..6c8ace0
--- /dev/null
+++ b/fs/iso9660/iso9660-post.mk
@@ -0,0 +1,51 @@
+################################################################################
+#
+# Build the iso96600 root filesystem image
+#
+# Cannot be converted to the ROOTFS_TARGET infrastructure, because of
+# the temporary construction in ISO9660_TARGET_DIR.
+#
+################################################################################
+
+ISO9660_TARGET_DIR = $(BUILD_DIR)/iso9660
+ISO9660_BOOT_MENU := $(call qstrip,$(BR2_TARGET_ROOTFS_ISO9660_BOOT_MENU))
+
+$(BINARIES_DIR)/rootfs.iso9660: host-cdrkit host-fakeroot linux rootfs-cpio grub
+ @$(call MESSAGE,"Generating root filesystem image rootfs.iso9660")
+ mkdir -p $(ISO9660_TARGET_DIR)
+ mkdir -p $(ISO9660_TARGET_DIR)/boot/grub
+ cp $(GRUB_DIR)/stage2/stage2_eltorito $(ISO9660_TARGET_DIR)/boot/grub/
+ cp $(ISO9660_BOOT_MENU) $(ISO9660_TARGET_DIR)/boot/grub/menu.lst
+ifeq ($(BR2_TARGET_GRUB_SPLASH),)
+ $(SED) '/^splashimage/d' $(ISO9660_TARGET_DIR)/boot/grub/menu.lst
+else
+ cp boot/grub/splash.xpm.gz $(ISO9660_TARGET_DIR)/
+endif
+ cp $(LINUX_IMAGE_PATH) $(ISO9660_TARGET_DIR)/kernel
+ifeq ($(BR2_TARGET_ROOTFS_INITRAMFS),y)
+ $(SED) '/initrd/d' $(ISO9660_TARGET_DIR)/boot/grub/menu.lst
+else
+ cp $(BINARIES_DIR)/rootfs.cpio$(ROOTFS_CPIO_COMPRESS_EXT) $(ISO9660_TARGET_DIR)/initrd
+endif
+ # Use fakeroot to pretend all target binaries are owned by root
+ rm -f $(FAKEROOT_SCRIPT)
+ echo "chown -R 0:0 $(ISO9660_TARGET_DIR)" >> $(FAKEROOT_SCRIPT)
+ # Use fakeroot so mkisofs believes the previous fakery
+ echo "$(HOST_DIR)/usr/bin/genisoimage -R -b boot/grub/stage2_eltorito -no-emul-boot " \
+ "-boot-load-size 4 -boot-info-table -o $@ $(ISO9660_TARGET_DIR)" \
+ >> $(FAKEROOT_SCRIPT)
+ chmod a+x $(FAKEROOT_SCRIPT)
+ $(HOST_DIR)/usr/bin/fakeroot -- $(FAKEROOT_SCRIPT)
+ - at rm -f $(FAKEROOT_SCRIPT)
+ - at rm -rf $(ISO9660_TARGET_DIR)
+
+rootfs-iso9660: $(BINARIES_DIR)/rootfs.iso9660
+
+################################################################################
+#
+# Toplevel Makefile options
+#
+################################################################################
+ifeq ($(BR2_TARGET_ROOTFS_ISO9660),y)
+TARGETS_ROOTFS += rootfs-iso9660
+endif
diff --git a/fs/iso9660/iso9660-pre.mk b/fs/iso9660/iso9660-pre.mk
new file mode 100644
index 0000000..f1edaf5
--- /dev/null
+++ b/fs/iso9660/iso9660-pre.mk
@@ -0,0 +1,9 @@
+################################################################################
+#
+# Build ISO9660 filesystems
+#
+# Cannot be converted to the ROOTFS_TARGET infrastructure, because of
+# the temporary construction in ISO9660_TARGET_DIR.
+#
+################################################################################
+
diff --git a/fs/jffs2/Config.in b/fs/jffs2/Config.in
index e2a3ee9..2e8a008 100644
--- a/fs/jffs2/Config.in
+++ b/fs/jffs2/Config.in
@@ -3,6 +3,18 @@ config BR2_TARGET_ROOTFS_JFFS2
help
Build a jffs2 root filesystem
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_JFFS2_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with JFFS2"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_JFFS2
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
+
if BR2_TARGET_ROOTFS_JFFS2
choice
diff --git a/fs/jffs2/jffs2-post.mk b/fs/jffs2/jffs2-post.mk
new file mode 100644
index 0000000..f8e6548
--- /dev/null
+++ b/fs/jffs2/jffs2-post.mk
@@ -0,0 +1,49 @@
+################################################################################
+#
+# Build the jffs2 root filesystem image
+#
+################################################################################
+
+JFFS2_OPTS := -e $(BR2_TARGET_ROOTFS_JFFS2_EBSIZE)
+SUMTOOL_OPTS := $(JFFS2_OPTS)
+
+ifeq ($(BR2_TARGET_ROOTFS_JFFS2_PAD),y)
+ifneq ($(strip $(BR2_TARGET_ROOTFS_JFFS2_PADSIZE)),0x0)
+JFFS2_OPTS += --pad=$(strip $(BR2_TARGET_ROOTFS_JFFS2_PADSIZE))
+else
+JFFS2_OPTS += -p
+endif
+SUMTOOL_OPTS += -p
+endif
+
+ifeq ($(BR2_TARGET_ROOTFS_JFFS2_LE),y)
+JFFS2_OPTS += -l
+SUMTOOL_OPTS += -l
+endif
+
+ifeq ($(BR2_TARGET_ROOTFS_JFFS2_BE),y)
+JFFS2_OPTS += -b
+SUMTOOL_OPTS += -b
+endif
+
+JFFS2_OPTS += -s $(BR2_TARGET_ROOTFS_JFFS2_PAGESIZE)
+ifeq ($(BR2_TARGET_ROOTFS_JFFS2_NOCLEANMARKER),y)
+JFFS2_OPTS += -n
+SUMTOOL_OPTS += -n
+endif
+
+ROOTFS_JFFS2_DEPENDENCIES = host-mtd
+
+ifneq ($(BR2_TARGET_ROOTFS_JFFS2_SUMMARY),)
+define ROOTFS_JFFS2_CMD
+ $(MKFS_JFFS2) $(JFFS2_OPTS) -d $(1) -o $@.nosummary && \
+ $(SUMTOOL) $(SUMTOOL_OPTS) -i $@.nosummary -o $@ && \
+ rm $@.nosummary
+endef
+else
+define ROOTFS_JFFS2_CMD
+ $(MKFS_JFFS2) $(JFFS2_OPTS) -d $(TARGET_DIR) -o $@
+endef
+endif
+
+$(eval $(call ROOTFS_TARGETS,jffs2,$(JFFS2_SUBFS)))
diff --git a/fs/jffs2/jffs2-pre.mk b/fs/jffs2/jffs2-pre.mk
new file mode 100644
index 0000000..e647cce
--- /dev/null
+++ b/fs/jffs2/jffs2-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define JFFS2 filesystems
+#
+################################################################################
+
+JFFS2_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_JFFS2_SUB_FILESYSTEMS),/)
diff --git a/fs/romfs/Config.in b/fs/romfs/Config.in
index 84944a0..5db5c3b 100644
--- a/fs/romfs/Config.in
+++ b/fs/romfs/Config.in
@@ -2,3 +2,15 @@ config BR2_TARGET_ROOTFS_ROMFS
bool "romfs root filesystem"
help
Build a romfs image of the root filesystem.
+
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_ROMFS_SUB_FILESYSTEMS
+ string "Sub-filesystems to build as a ROMFS filesystem"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_ROMFS
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
diff --git a/fs/romfs/romfs-post.mk b/fs/romfs/romfs-post.mk
new file mode 100644
index 0000000..2c93740
--- /dev/null
+++ b/fs/romfs/romfs-post.mk
@@ -0,0 +1,15 @@
+################################################################################
+#
+# Build the romfs root filesystem image
+#
+################################################################################
+
+ROMFS_TARGET=$(IMAGE).romfs
+
+ROOTFS_ROMFS_DEPENDENCIES = host-genromfs
+
+define ROOTFS_ROMFS_CMD
+ $(HOST_DIR)/usr/bin/genromfs -d $(1) -f $@
+endef
+
+$(eval $(call ROOTFS_TARGETS,romfs,$(ROMFS_SUBFS)))
diff --git a/fs/romfs/romfs-pre.mk b/fs/romfs/romfs-pre.mk
new file mode 100644
index 0000000..ce5d279
--- /dev/null
+++ b/fs/romfs/romfs-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define romfs filesystems
+#
+################################################################################
+
+ROMFS_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_ROMFS_SUB_FILESYSTEMS),/)
diff --git a/fs/squashfs/Config.in b/fs/squashfs/Config.in
index 817909d..f4b27c0 100644
--- a/fs/squashfs/Config.in
+++ b/fs/squashfs/Config.in
@@ -3,6 +3,18 @@ config BR2_TARGET_ROOTFS_SQUASHFS
help
Build a squashfs root filesystem
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_SQUASHFS_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with squashfs"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_SQUASHFS
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
+
if BR2_TARGET_ROOTFS_SQUASHFS
choice
diff --git a/fs/squashfs/squashfs-post.mk b/fs/squashfs/squashfs-post.mk
new file mode 100644
index 0000000..9c8fe3f
--- /dev/null
+++ b/fs/squashfs/squashfs-post.mk
@@ -0,0 +1,29 @@
+################################################################################
+#
+# Build the squashfs root filesystem image
+#
+################################################################################
+
+ROOTFS_SQUASHFS_DEPENDENCIES = host-squashfs
+
+ifeq ($(BR2_TARGET_ROOTFS_SQUASHFS4_LZO),y)
+ROOTFS_SQUASHFS_ARGS += -comp lzo
+else
+ifeq ($(BR2_TARGET_ROOTFS_SQUASHFS4_LZMA),y)
+ROOTFS_SQUASHFS_ARGS += -comp lzma
+else
+ifeq ($(BR2_TARGET_ROOTFS_SQUASHFS4_XZ),y)
+ROOTFS_SQUASHFS_ARGS += -comp xz
+else
+ROOTFS_SQUASHFS_ARGS += -comp gzip
+endif
+endif
+endif
+
+define ROOTFS_SQUASHFS_CMD
+ $(HOST_DIR)/usr/bin/mksquashfs $(1) $@ -noappend \
+ $(ROOTFS_SQUASHFS_ARGS) && \
+ chmod 0644 $@
+endef
+
+$(eval $(call ROOTFS_TARGETS,squashfs,$(SQUASHFS_SUBFS)))
diff --git a/fs/squashfs/squashfs-pre.mk b/fs/squashfs/squashfs-pre.mk
new file mode 100644
index 0000000..be95a96
--- /dev/null
+++ b/fs/squashfs/squashfs-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define squashfs filesystems
+#
+################################################################################
+
+SQUASHFS_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_SQUASHFS_SUB_FILESYSTEMS),/)
diff --git a/fs/tar/Config.in b/fs/tar/Config.in
index 63663ec..e65b3fa 100644
--- a/fs/tar/Config.in
+++ b/fs/tar/Config.in
@@ -4,6 +4,18 @@ config BR2_TARGET_ROOTFS_TAR
help
Build a tar archive of the root filesystem
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_TAR_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with tar"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_TAR
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
+
choice
prompt "Compression method"
default BR2_TARGET_ROOTFS_TAR_NONE
diff --git a/fs/tar/tar-post.mk b/fs/tar/tar-post.mk
new file mode 100644
index 0000000..9acf8d4
--- /dev/null
+++ b/fs/tar/tar-post.mk
@@ -0,0 +1,13 @@
+################################################################################
+#
+# tar to archive target filesystem
+#
+################################################################################
+
+TAR_OPTS := $(BR2_TARGET_ROOTFS_TAR_OPTIONS)
+
+define ROOTFS_TAR_CMD
+ tar -c$(TAR_OPTS)f $@ -C $(1) .
+endef
+
+$(eval $(call ROOTFS_TARGETS,tar,$(TAR_SUBFS)))
diff --git a/fs/tar/tar-pre.mk b/fs/tar/tar-pre.mk
new file mode 100644
index 0000000..771c5c4
--- /dev/null
+++ b/fs/tar/tar-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define tar-archived filesystems
+#
+################################################################################
+
+TAR_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_TAR_SUB_FILESYSTEMS),/)
diff --git a/fs/ubifs/Config.in b/fs/ubifs/Config.in
index ff604c5..1aeca86 100644
--- a/fs/ubifs/Config.in
+++ b/fs/ubifs/Config.in
@@ -3,6 +3,18 @@ config BR2_TARGET_ROOTFS_UBIFS
help
Build a ubifs root filesystem
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_UBIFS_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with ubifs"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_UBIFS
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
+
if BR2_TARGET_ROOTFS_UBIFS
config BR2_TARGET_ROOTFS_UBIFS_LEBSIZE
diff --git a/fs/ubifs/ubi-post.mk b/fs/ubifs/ubi-post.mk
new file mode 100644
index 0000000..aa9af24
--- /dev/null
+++ b/fs/ubifs/ubi-post.mk
@@ -0,0 +1,30 @@
+################################################################################
+#
+# Embed the ubifs image into an ubi image
+#
+################################################################################
+
+UBI_UBINIZE_OPTS := -m $(BR2_TARGET_ROOTFS_UBIFS_MINIOSIZE)
+UBI_UBINIZE_OPTS += -p $(BR2_TARGET_ROOTFS_UBI_PEBSIZE)
+ifneq ($(BR2_TARGET_ROOTFS_UBI_SUBSIZE),0)
+UBI_UBINIZE_OPTS += -s $(BR2_TARGET_ROOTFS_UBI_SUBSIZE)
+endif
+
+UBI_UBINIZE_OPTS += $(call qstrip,$(BR2_TARGET_ROOTFS_UBI_OPTS))
+
+ROOTFS_UBI_DEPENDENCIES = rootfs-ubifs
+
+ifeq ($(BR2_TARGET_ROOTFS_UBI_USE_CUSTOM_CONFIG),y)
+UBINIZE_CONFIG_FILE_PATH = $(call qstrip,$(BR2_TARGET_ROOTFS_UBI_CUSTOM_CONFIG_FILE))
+else
+UBINIZE_CONFIG_FILE_PATH = fs/ubifs/ubinize.cfg
+endif
+
+define ROOTFS_UBI_CMD
+ $(INSTALL) -m 0644 $(UBINIZE_CONFIG_FILE_PATH) $(BUILD_DIR)/ubinize.cfg ;\
+ $(SED) 's;BR2_ROOTFS_UBIFS_PATH;$@fs;' $(BUILD_DIR)/ubinize.cfg ;\
+ $(HOST_DIR)/usr/sbin/ubinize -o $@ $(UBI_UBINIZE_OPTS) $(BUILD_DIR)/ubinize.cfg ;\
+ rm $(BUILD_DIR)/ubinize.cfg
+endef
+
+$(eval $(call ROOTFS_TARGETS,ubi,$(UBI_SUBFS)))
diff --git a/fs/ubifs/ubi-pre.mk b/fs/ubifs/ubi-pre.mk
new file mode 100644
index 0000000..da6b800
--- /dev/null
+++ b/fs/ubifs/ubi-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define embedded UBI filesystems
+#
+################################################################################
+
+UBI_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_UBI_SUB_FILESYSTEMS),/)
diff --git a/fs/ubifs/ubifs-post.mk b/fs/ubifs/ubifs-post.mk
new file mode 100644
index 0000000..7e5d88e
--- /dev/null
+++ b/fs/ubifs/ubifs-post.mk
@@ -0,0 +1,27 @@
+################################################################################
+#
+# Build the ubifs root filesystem image
+#
+################################################################################
+
+UBIFS_OPTS := -e $(BR2_TARGET_ROOTFS_UBIFS_LEBSIZE) -c $(BR2_TARGET_ROOTFS_UBIFS_MAXLEBCNT) -m $(BR2_TARGET_ROOTFS_UBIFS_MINIOSIZE)
+
+ifeq ($(BR2_TARGET_ROOTFS_UBIFS_RT_ZLIB),y)
+UBIFS_OPTS += -x zlib
+endif
+ifeq ($(BR2_TARGET_ROOTFS_UBIFS_RT_LZO),y)
+UBIFS_OPTS += -x lzo
+endif
+ifeq ($(BR2_TARGET_ROOTFS_UBIFS_RT_NONE),y)
+UBIFS_OPTS += -x none
+endif
+
+UBIFS_OPTS += $(call qstrip,$(BR2_TARGET_ROOTFS_UBIFS_OPTS))
+
+ROOTFS_UBIFS_DEPENDENCIES = host-mtd
+
+define ROOTFS_UBIFS_CMD
+ $(HOST_DIR)/usr/sbin/mkfs.ubifs -d $(1) $(UBIFS_OPTS) -o $@
+endef
+
+$(eval $(call ROOTFS_TARGETS,ubifs,$(UBIFS_SUBFS)))
diff --git a/fs/ubifs/ubifs-pre.mk b/fs/ubifs/ubifs-pre.mk
new file mode 100644
index 0000000..25a8fde
--- /dev/null
+++ b/fs/ubifs/ubifs-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define ubifs filesystems
+#
+################################################################################
+
+UBIFS_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_UBIFS_SUB_FILESYSTEMS),/)
diff --git a/fs/yaffs2/Config.in b/fs/yaffs2/Config.in
index 27da4ba..23fe6fb 100644
--- a/fs/yaffs2/Config.in
+++ b/fs/yaffs2/Config.in
@@ -2,3 +2,15 @@ config BR2_TARGET_ROOTFS_YAFFS2
bool "yaffs2 root filesystem"
help
Build a yaffs2 root filesystem
+
+if BR2_BUILD_SUB_FILESYSTEMS
+config BR2_YAFFS2_SUB_FILESYSTEMS
+ string "Sub-filesystems to build with YAFFS2"
+ default "/"
+ depends on BR2_TARGET_ROOTFS_YAFFS2
+ help
+ Provide a space-separated list of the root directories of all
+ filesystems. For example to build a root filesystem with a
+ separate /usr filesystem, enter:
+ / /usr
+endif # BR2_BUILD_SUB_FILESYSTEMS
diff --git a/fs/yaffs2/yaffs-post.mk b/fs/yaffs2/yaffs-post.mk
new file mode 100644
index 0000000..84a1072
--- /dev/null
+++ b/fs/yaffs2/yaffs-post.mk
@@ -0,0 +1,13 @@
+################################################################################
+#
+# Build the yaffs2 root filesystem image
+#
+################################################################################
+
+ROOTFS_YAFFS2_DEPENDENCIES = host-yaffs2utils
+
+define ROOTFS_YAFFS2_CMD
+ $(HOST_DIR)/usr/bin/mkyaffs2 --all-root $(1) $@
+endef
+
+$(eval $(call ROOTFS_TARGETS,yaffs2,$(YAFFS2_SUBFS)))
diff --git a/fs/yaffs2/yaffs-pre.mk b/fs/yaffs2/yaffs-pre.mk
new file mode 100644
index 0000000..2f96b95
--- /dev/null
+++ b/fs/yaffs2/yaffs-pre.mk
@@ -0,0 +1,7 @@
+################################################################################
+#
+# Define YAFFS2 filesystems
+#
+################################################################################
+
+YAFFS2_SUBFS = $(if $(BR2_BUILD_SUB_FILESYSTEMS),$(BR2_YAFFS2_SUB_FILESYSTEMS),/)
--
1.7.9.5
^ permalink raw reply related [flat|nested] 8+ messages in thread
* [Buildroot] [PATCH 2/3] Allow specification of values for --prefix and --exec-prefix in autotools.
2014-05-29 5:24 [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up vomlehn at canopus-us.com
2014-05-29 5:24 ` [Buildroot] [PATCH 1/3] Add the capability to create sub-filesystems from the target filesystem vomlehn at canopus-us.com
@ 2014-05-29 5:24 ` vomlehn at canopus-us.com
2014-05-29 5:24 ` [Buildroot] [PATCH 3/3] Support installation of Python in a different directory vomlehn at canopus-us.com
2014-10-11 14:49 ` [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up Arnout Vandecappelle
3 siblings, 0 replies; 8+ messages in thread
From: vomlehn at canopus-us.com @ 2014-05-29 5:24 UTC (permalink / raw)
To: buildroot
From: David VomLehn <vomlehn@canopus-us.com>
The --prefix and --exec-prefix arguments to autotools configuration files
allow the installation location to be specified. This is particularly
useful when a package must be located in another directory so that it
can be split into a separate filesystem image.
Signed-off-by: David VomLehn <vomlehn@canopus-us.com>
---
docs/manual/adding-packages-autotools.txt | 8 ++++++++
package/pkg-autotools.mk | 7 ++++---
2 files changed, 12 insertions(+), 3 deletions(-)
diff --git a/docs/manual/adding-packages-autotools.txt b/docs/manual/adding-packages-autotools.txt
index c7e797f..7cac94e 100644
--- a/docs/manual/adding-packages-autotools.txt
+++ b/docs/manual/adding-packages-autotools.txt
@@ -99,6 +99,14 @@ cases, typical packages will therefore only use a few of them.
* +LIBFOO_CONF_OPT+, to specify additional configure
options to pass to the configure script. By default, empty.
+* +LIBFOO_CONF_PREFIX+, to specify the installation directory for
+ architecture-independent files, i.e. the argument to --prefix.
+ By default, /usr.
+
+* +LIBFOO_CONF_EXEC_PREFIX+, to specify the installation directory for
+ architecture-dependent files, i.e. the argument to --exec-prefix.
+ By default, the value given for +LIBFOO_CONF_PREFIX+.
+
* +LIBFOO_MAKE+, to specify an alternate +make+
command. This is typically useful when parallel make is enabled in
the configuration (using +BR2_JLEVEL+) but that this
diff --git a/package/pkg-autotools.mk b/package/pkg-autotools.mk
index a646612..5cb0f20 100644
--- a/package/pkg-autotools.mk
+++ b/package/pkg-autotools.mk
@@ -95,7 +95,8 @@ $(2)_AUTORECONF_OPT ?= $($(3)_AUTORECONF_OPT)
$(2)_INSTALL_OPT ?= install
$(2)_INSTALL_STAGING_OPT ?= DESTDIR=$$(STAGING_DIR) install
$(2)_INSTALL_TARGET_OPT ?= DESTDIR=$$(TARGET_DIR) install
-
+$(2)_CONF_PREFIX ?= /usr
+$(2)_CONF_EXEC_PREFIX ?= $$($(2)_CONF_PREFIX)
#
# Configure step. Only define it if not already defined by the package
@@ -115,8 +116,8 @@ define $(2)_CONFIGURE_CMDS
--target=$$(GNU_TARGET_NAME) \
--host=$$(GNU_TARGET_NAME) \
--build=$$(GNU_HOST_NAME) \
- --prefix=/usr \
- --exec-prefix=/usr \
+ --prefix=$$($$(PKG)_CONF_PREFIX) \
+ --exec-prefix=$$($$(PKG)_CONF_EXEC_PREFIX) \
--sysconfdir=/etc \
--program-prefix="" \
--disable-gtk-doc \
--
1.7.9.5
^ permalink raw reply related [flat|nested] 8+ messages in thread
* [Buildroot] [PATCH 3/3] Support installation of Python in a different directory.
2014-05-29 5:24 [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up vomlehn at canopus-us.com
2014-05-29 5:24 ` [Buildroot] [PATCH 1/3] Add the capability to create sub-filesystems from the target filesystem vomlehn at canopus-us.com
2014-05-29 5:24 ` [Buildroot] [PATCH 2/3] Allow specification of values for --prefix and --exec-prefix in autotools vomlehn at canopus-us.com
@ 2014-05-29 5:24 ` vomlehn at canopus-us.com
2014-05-29 9:56 ` Thomas Petazzoni
2014-10-11 14:49 ` [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up Arnout Vandecappelle
3 siblings, 1 reply; 8+ messages in thread
From: vomlehn at canopus-us.com @ 2014-05-29 5:24 UTC (permalink / raw)
To: buildroot
From: David VomLehn <vomlehn@canopus-us.com>
Python is both useful and large. This patch allows installation in a
different directory, which can then be installed on its own device
by packaging it as part of a separated filesystem.
Signed-off-by: David VomLehn <vomlehn@canopus-us.com>
---
package/python/Config.in | 7 +++++++
package/python/python.mk | 26 ++++++++++++++++----------
2 files changed, 23 insertions(+), 10 deletions(-)
diff --git a/package/python/Config.in b/package/python/Config.in
index a0c78c6..58666e7 100644
--- a/package/python/Config.in
+++ b/package/python/Config.in
@@ -15,6 +15,13 @@ comment "python needs a toolchain w/ wchar"
if BR2_PACKAGE_PYTHON
+config BR2_PACKAGE_PYTHON_PREFIX
+ string "Directory for generated files (executables, libraries, etc.)"
+ default "/usr"
+ help
+ Python is big! Installing Python in a different directory allows
+ it to be packaged as a separate filesystem.
+
choice
prompt "python module format to install"
default BR2_PACKAGE_PYTHON_PYC_ONLY
diff --git a/package/python/python.mk b/package/python/python.mk
index 8a2ba65..9e4843d 100644
--- a/package/python/python.mk
+++ b/package/python/python.mk
@@ -11,6 +11,9 @@ PYTHON_SITE = http://python.org/ftp/python/$(PYTHON_VERSION)
PYTHON_LICENSE = Python software foundation license v2, others
PYTHON_LICENSE_FILES = LICENSE
+# Relocate to the desired location
+PYTHON_CONF_PREFIX = $(BR2_PACKAGE_PYTHON_PREFIX)
+
# Python needs itself to be built, so in order to cross-compile
# Python, we need to build a host Python first. This host Python is
# also installed in $(HOST_DIR), as it is needed when cross-compiling
@@ -153,12 +156,12 @@ PYTHON_POST_PATCH_HOOKS += PYTHON_TOUCH_GRAMMAR_FILES
# idle & smtpd.py have bad shebangs and are mostly samples
#
define PYTHON_REMOVE_USELESS_FILES
- rm -f $(TARGET_DIR)/usr/bin/idle
- rm -f $(TARGET_DIR)/usr/bin/python$(PYTHON_VERSION_MAJOR)-config
- rm -f $(TARGET_DIR)/usr/bin/python2-config
- rm -f $(TARGET_DIR)/usr/bin/python-config
- rm -f $(TARGET_DIR)/usr/bin/smtpd.py
- for i in `find $(TARGET_DIR)/usr/lib/python$(PYTHON_VERSION_MAJOR)/config/ \
+ rm -f $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/bin/idle
+ rm -f $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/bin/python$(PYTHON_VERSION_MAJOR)-config
+ rm -f $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/bin/python2-config
+ rm -f $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/bin/python-config
+ rm -f $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/bin/smtpd.py
+ for i in `find $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/lib/python$(PYTHON_VERSION_MAJOR)/config/ \
-type f -not -name pyconfig.h -a -not -name Makefile` ; do \
rm -f $$i ; \
done
@@ -170,21 +173,24 @@ PYTHON_POST_INSTALL_TARGET_HOOKS += PYTHON_REMOVE_USELESS_FILES
# Make sure libpython gets stripped out on target
#
define PYTHON_ENSURE_LIBPYTHON_STRIPPED
- chmod u+w $(TARGET_DIR)/usr/lib/libpython$(PYTHON_VERSION_MAJOR)*.so
+ mkdir -p $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/lib
+ chmod u+w $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/lib/libpython$(PYTHON_VERSION_MAJOR)*.so
endef
PYTHON_POST_INSTALL_TARGET_HOOKS += PYTHON_ENSURE_LIBPYTHON_STRIPPED
# Always install the python symlink in the target tree
define PYTHON_INSTALL_TARGET_PYTHON_SYMLINK
- ln -sf python2 $(TARGET_DIR)/usr/bin/python
+ mkdir -p $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/bin
+ ln -sf python2 $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/bin/python
endef
PYTHON_POST_INSTALL_TARGET_HOOKS += PYTHON_INSTALL_TARGET_PYTHON_SYMLINK
# Always install the python-config symlink in the staging tree
define PYTHON_INSTALL_STAGING_PYTHON_CONFIG_SYMLINK
- ln -sf python2-config $(STAGING_DIR)/usr/bin/python-config
+ mkdir -p $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/bin
+ ln -sf python2-config $(STAGING_DIR)$(PYTHON_CONF_PREFIX)/bin/python-config
endef
PYTHON_POST_INSTALL_STAGING_HOOKS += PYTHON_INSTALL_STAGING_PYTHON_CONFIG_SYMLINK
@@ -204,7 +210,7 @@ HOST_PYTHON_POST_INSTALL_HOOKS += HOST_PYTHON_INSTALL_PYTHON_SYMLINK
endif
# Provided to other packages
-PYTHON_PATH = $(TARGET_DIR)/usr/lib/python$(PYTHON_VERSION_MAJOR)/sysconfigdata/:$(TARGET_DIR)/usr/lib/python$(PYTHON_VERSION_MAJOR)/site-packages/
+PYTHON_PATH = $(TARGET_DIR)$(PYTHON_CONF_PREFIX)/lib/python$(PYTHON_VERSION_MAJOR)/sysconfigdata/:$(TARGET_DIR)$(PYTHON_CONF_PREFIX)/lib/python$(PYTHON_VERSION_MAJOR)/site-packages/
$(eval $(autotools-package))
$(eval $(host-autotools-package))
--
1.7.9.5
^ permalink raw reply related [flat|nested] 8+ messages in thread
* [Buildroot] [PATCH 1/3] Add the capability to create sub-filesystems from the target filesystem.
2014-05-29 5:24 ` [Buildroot] [PATCH 1/3] Add the capability to create sub-filesystems from the target filesystem vomlehn at canopus-us.com
@ 2014-05-29 9:21 ` Jérôme Pouiller
2014-05-29 19:08 ` David VomLehn
0 siblings, 1 reply; 8+ messages in thread
From: Jérôme Pouiller @ 2014-05-29 9:21 UTC (permalink / raw)
To: buildroot
Hello David,
On Wednesday 28 May 2014 22:24:12 vomlehn at canopus-us.com wrote:
> For example, say that the the root filesystem has a set of files and
> directories that are critical to being able to control, recover, and
> install software on an embedded system. These are redundantly stored in a
> small but reliable memory. The rest of the system is written in Python,
> which is huge (too big to fit in the reliable memory) but not a critical
> part of the system. It can, if necessary, be reloaded remotely, so it is
> stored without redundancy, in NAND flash.
>
> This patch allows these two pieces to be split up so that the reliable core
> can be an initramfs filesystem (in cpio format) and a JFFS2 image can hold
> the rest of the root filesystem. It supports an arbitrary division of the
> root filesystem among one or more of the available filesystem formats.
Did you check features of "genimage" tool? It looks like it do similar work.
Maybe it would be better to add missing features to genimage?
BR,
--
J?r?me Pouiller, Sysmic
Embedded Linux specialist
http://www.sysmic.fr
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Buildroot] [PATCH 3/3] Support installation of Python in a different directory.
2014-05-29 5:24 ` [Buildroot] [PATCH 3/3] Support installation of Python in a different directory vomlehn at canopus-us.com
@ 2014-05-29 9:56 ` Thomas Petazzoni
0 siblings, 0 replies; 8+ messages in thread
From: Thomas Petazzoni @ 2014-05-29 9:56 UTC (permalink / raw)
To: buildroot
Hello,
On Wed, 28 May 2014 22:24:14 -0700, vomlehn at canopus-us.com wrote:
> From: David VomLehn <vomlehn@canopus-us.com>
>
> Python is both useful and large. This patch allows installation in a
> different directory, which can then be installed on its own device
> by packaging it as part of a separated filesystem.
>
> Signed-off-by: David VomLehn <vomlehn@canopus-us.com>
> ---
> package/python/Config.in | 7 +++++++
> package/python/python.mk | 26 ++++++++++++++++----------
> 2 files changed, 23 insertions(+), 10 deletions(-)
The problem with this approach is that we would have to replicate this
in *all* packages. You are personally interested by changing the
installation location of Python. But I might be interested in changing
the installation location of Qt. And then the next guy the installation
location of X.org, and so on and so on.
That's a limitation of Kconfig: there is no way of creating
"properties" that would apply to all packages without creating one
option for each package. We have the same issue to define which package
should be built statically or dynamically, which package should be
built with debug symbols or not, and so on.
So I would prefer to see such advanced customization done by means of
the BR2_PACKAGE_OVERRIDE_FILE option. It would avoid cluttering the
Config.in files of packages with lots and lots of options.
Best regards,
Thomas
--
Thomas Petazzoni, CTO, Free Electrons
Embedded Linux, Kernel and Android engineering
http://free-electrons.com
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Buildroot] [PATCH 1/3] Add the capability to create sub-filesystems from the target filesystem.
2014-05-29 9:21 ` Jérôme Pouiller
@ 2014-05-29 19:08 ` David VomLehn
0 siblings, 0 replies; 8+ messages in thread
From: David VomLehn @ 2014-05-29 19:08 UTC (permalink / raw)
To: buildroot
An HTML attachment was scrubbed...
URL: <http://lists.busybox.net/pipermail/buildroot/attachments/20140529/25c57a76/attachment.html>
^ permalink raw reply [flat|nested] 8+ messages in thread
* [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up.
2014-05-29 5:24 [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up vomlehn at canopus-us.com
` (2 preceding siblings ...)
2014-05-29 5:24 ` [Buildroot] [PATCH 3/3] Support installation of Python in a different directory vomlehn at canopus-us.com
@ 2014-10-11 14:49 ` Arnout Vandecappelle
3 siblings, 0 replies; 8+ messages in thread
From: Arnout Vandecappelle @ 2014-10-11 14:49 UTC (permalink / raw)
To: buildroot
On 29/05/14 07:24, vomlehn at canopus-us.com wrote:
> From: David VomLehn <vomlehn@canopus-us.com>
Hi David,
We've discussed this series at the Buildroot developer meeting, and we decided
to reject it. This is why:
> These patches are not as tightly coupled as the usually series of patches,
> but I think the pieces make more sense when viewed in the context of the
> whole patchset. The problem to be solved is that Python is big and my root
> filesystem has to fit in a little flash device. So, I:
>
> 1. Created the ability to break the target filesystem into multiple
> filesystems,
Although we do want to support the possibility to break down the target
filesystem into partitions, we don't want to add so many config options to do
it. Basically, we want to keep buildroot as simple as possible. So instead, we
want to provide the tools that are required to do this, like genpart, and then
allow the user to do it in a post-build and post-image script.
> 2. Enhanced autotools so that I could specify the --prefix and
> --exec-prefix values. This allowed me to install packages in
> their own directory, which the above patch lets me split into a
> filesystem I can store on a much bigger flash device, and
> 3. I modified the Python package so that the installation directory
> is a configurable.
The problem with this is that it adds a user-visible feature that is only
useful for autotools packages. It is a bit similar to FOO_OVERRIDE_SRCDIR, but
for that one we can guarantee that it works for all packages. The CONF_PREFIX
only works for autotools packages and for python, we would need many many more
changes to have it for all possible packages.
In addition, this is something that will break down easily, because it is not
tested. E.g. if a .mk file installs 10 files, and we forget to add the
CONF_PREFIX for one of them, that's easy to miss.
Therefore we decided to reject these two patches as well.
That said, thank you for your contribution and thank you for using buildroot!
Regards,
Arnout
[snip]
--
Arnout Vandecappelle arnout at mind be
Senior Embedded Software Architect +32-16-286500
Essensium/Mind http://www.mind.be
G.Geenslaan 9, 3001 Leuven, Belgium BE 872 984 063 RPR Leuven
LinkedIn profile: http://www.linkedin.com/in/arnoutvandecappelle
GPG fingerprint: 7CB5 E4CC 6C2E EFD4 6E3D A754 F963 ECAB 2450 2F1F
^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2014-10-11 14:49 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-05-29 5:24 [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up vomlehn at canopus-us.com
2014-05-29 5:24 ` [Buildroot] [PATCH 1/3] Add the capability to create sub-filesystems from the target filesystem vomlehn at canopus-us.com
2014-05-29 9:21 ` Jérôme Pouiller
2014-05-29 19:08 ` David VomLehn
2014-05-29 5:24 ` [Buildroot] [PATCH 2/3] Allow specification of values for --prefix and --exec-prefix in autotools vomlehn at canopus-us.com
2014-05-29 5:24 ` [Buildroot] [PATCH 3/3] Support installation of Python in a different directory vomlehn at canopus-us.com
2014-05-29 9:56 ` Thomas Petazzoni
2014-10-11 14:49 ` [Buildroot] [PATCH 0/3] Manage big root directory trees by breaking them up Arnout Vandecappelle
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox