* [PATCH] compat: add compat kernel checker and downloader
@ 2012-02-03 23:43 Luis R. Rodriguez
2012-02-06 10:57 ` Andy Whitcroft
2012-02-06 16:07 ` John W. Linville
0 siblings, 2 replies; 11+ messages in thread
From: Luis R. Rodriguez @ 2012-02-03 23:43 UTC (permalink / raw)
To: mcgrof; +Cc: linux-kernel, linux-wireless, kernel-team, hauke
This adds get-compat-kernels, a utility that is intended
to be Linux distribution agnostic that downloads and installs
all kernel headers for all supported kernel releases of compat.
You also have the option of specifying you want to also install
the actual kernel image (get-compat-kernels -i).
We start off by adding support for Ubuntu on x86_64 as that
is what a few of us maintaining compat and compat-wireless run.
Just for kernel headers (default run of get-compat-kernels),
you'll need currently 205 M of hard drive space.
Once done with running get-compat-kernels, you can then
start running ckmake to verify your compat kernel changes
won't bust compilation against any known supported kernel.
I'd like to start requiring runs against this script for
patch submissions. Eventually we can try to add the same
runs against compat-wireless so we can verify integrity
against compilation for different kernel versions.
Support for different Linux distributios is welcomed.
Debug log goes out to ckmake.log
Example output:
mcgrof@tux ~/compat (git::master)$ ckmake
Trying kernel 3.3.0-030300rc2-generic [OK]
Trying kernel 3.2.2-030202-generic [OK]
Trying kernel 3.1.10-030110-generic [OK]
Trying kernel 3.0.18-030018-generic [OK]
Trying kernel 2.6.39-02063904-generic [OK]
Trying kernel 2.6.38-8-generic [OK]
Trying kernel 2.6.38-13-generic [OK]
Trying kernel 2.6.38-12-generic [OK]
Trying kernel 2.6.38-11-generic [OK]
Trying kernel 2.6.38-10-generic [OK]
Trying kernel 2.6.38-02063808-generic [OK]
Trying kernel 2.6.37-02063706-generic [OK]
Trying kernel 2.6.36-02063604-generic [OK]
Trying kernel 2.6.35-02063512-generic [OK]
Trying kernel 2.6.34-02063410-generic [OK]
Trying kernel 2.6.33-02063305-generic [OK]
Trying kernel 2.6.32-02063255-generic [OK]
Trying kernel 2.6.31-22-generic [OK]
Trying kernel 2.6.31-02063113-generic [OK]
Trying kernel 2.6.30-02063010-generic [OK]
Trying kernel 2.6.29-02062906-generic [OK]
Trying kernel 2.6.28-02062810-generic [OK]
Trying kernel 2.6.27-020627-generic [OK]
Trying kernel 2.6.26-020626-generic [OK]
Trying kernel 2.6.25-020625-generic [OK]
Trying kernel 2.6.24-020624-generic [OK]
Cc: kernel-team@lists.ubuntu.com
Signed-off-by: Luis R. Rodriguez <mcgrof@frijolero.org>
---
.gitignore | 1 +
bin/ckmake | 65 ++++++++++++++++++++
bin/get-compat-kernels | 154 ++++++++++++++++++++++++++++++++++++++++++++++++
3 files changed, 220 insertions(+), 0 deletions(-)
create mode 100755 bin/ckmake
create mode 100755 bin/get-compat-kernels
diff --git a/.gitignore b/.gitignore
index 0f4ebc6..e27f6c2 100644
--- a/.gitignore
+++ b/.gitignore
@@ -2,3 +2,4 @@
Module.symvers
module.order
.pc
+ckmake.log
diff --git a/bin/ckmake b/bin/ckmake
new file mode 100755
index 0000000..4d45fb9
--- /dev/null
+++ b/bin/ckmake
@@ -0,0 +1,65 @@
+#!/bin/bash
+#
+# Copyright (C) 2012, Luis R. Rodriguez <mcgrof@frijolero.org>
+# Copyright (C) 2012, Hauke Mehrtens <hauke@hauke-m.de>
+#
+# This program is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License version 2 as
+# published by the Free Software Foundation.
+#
+# You can use this to compile a module accross all installed kernels
+# found. This relies on distribution specific kernels, but can handle
+# your own custom list of target kernels. Log is setnt to LOG variable.
+
+# Pretty colors
+GREEN="\033[01;32m"
+YELLOW="\033[01;33m"
+NORMAL="\033[00m"
+BLUE="\033[34m"
+RED="\033[31m"
+PURPLE="\033[35m"
+CYAN="\033[36m"
+UNDERLINE="\033[02m"
+
+#export KCFLAGS="-Wno-unused-but-set-variable"
+KERNEL_DIR="/lib/modules"
+KLIBS=""
+LOG="ckmake.log"
+
+LSB_RED_ID=$(/usr/bin/lsb_release -i -s)
+case $LSB_RED_ID in
+"Ubuntu")
+ for i in $(find /lib/modules/ -type d -name \*generic\* | sort -n -r); do
+ KLIBS="$KLIBS $i"
+ done
+ ;;
+*)
+ echo -e "Unsupported distribution"
+ exit
+ ;;
+esac
+
+nice make clean 2>&1 > $LOG
+
+for i in $KLIBS; do
+ KERNEL=$(basename $i)
+ DIR=${i}/build/
+ echo -e "--------------------------------------------" >> $LOG
+
+ if [[ ! -d $DIR ]]; then
+ continue
+ fi
+
+ echo -en "Trying kernel ${BLUE}" | tee -a $LOG
+ printf "%40s\t" "${KERNEL}" | tee -a $LOG
+ echo -en "${NORMAL}" | tee -a $LOG
+
+ ionice -c 3 nice -n 20 make KLIB=$DIR KLIB_BUILD=$DIR -j6 -Wunused-but-set-variable &>> $LOG
+ if [[ $? -eq 0 ]]; then
+ echo -e "${GREEN}[OK]${NORMAL}" | tee -a $LOG
+ else
+ echo -e "${RED}[FAILED]${NORMAL}" | tee -a $LOG
+ fi
+
+ nice make clean KLIB=$DIR KLIB_BUILD=$DIR 2>&1 >> $LOG
+done
diff --git a/bin/get-compat-kernels b/bin/get-compat-kernels
new file mode 100755
index 0000000..07ac17b
--- /dev/null
+++ b/bin/get-compat-kernels
@@ -0,0 +1,154 @@
+#!/bin/bash
+#
+# Copyright (C) 2012, Luis R. Rodriguez <mcgrof@frijolero.org>
+#
+# This program is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License version 2 as
+# published by the Free Software Foundation.
+#
+# You can use this script to install all mainline kernels used
+# to test compile the Linux kernel compatibility module. You can
+# then use ckmake to cross compile against all supported kernels.
+
+function get_ubuntu_kernels() {
+ KERNELS=""
+
+ KPATH="http://kernel.ubuntu.com/~kernel-ppa/mainline/"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.24/linux-headers-2.6.24-020624_2.6.24-020624_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.24/linux-headers-2.6.24-020624-generic_2.6.24-020624_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.24/linux-image-2.6.24-020624-generic_2.6.24-020624_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.25/linux-headers-2.6.25-020625_2.6.25-020625_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.25/linux-headers-2.6.25-020625-generic_2.6.25-020625_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.25/linux-image-2.6.25-020625-generic_2.6.25-020625_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.26/linux-headers-2.6.26-020626_2.6.26-020626_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.26/linux-headers-2.6.26-020626-generic_2.6.26-020626_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.26/linux-image-2.6.26-020626-generic_2.6.26-020626_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.27/linux-headers-2.6.27-020627_2.6.27-020627_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.27/linux-headers-2.6.27-020627-generic_2.6.27-020627_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.27/linux-image-2.6.27-020627-generic_2.6.27-020627_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.28.10/linux-headers-2.6.28-02062810_2.6.28-02062810_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.28.10/linux-headers-2.6.28-02062810-generic_2.6.28-02062810_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.28.10/linux-image-2.6.28-02062810-generic_2.6.28-02062810_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.29.6/linux-headers-2.6.29-02062906_2.6.29-02062906_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.29.6/linux-headers-2.6.29-02062906-generic_2.6.29-02062906_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.29.6/linux-image-2.6.29-02062906-generic_2.6.29-02062906_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.30.10/linux-headers-2.6.30-02063010_2.6.30-02063010_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.30.10/linux-headers-2.6.30-02063010-generic_2.6.30-02063010_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.30.10/linux-image-2.6.30-02063010-generic_2.6.30-02063010_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.31.13-karmic/linux-headers-2.6.31-02063113_2.6.31-02063113_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.31.13-karmic/linux-headers-2.6.31-02063113-generic_2.6.31-02063113_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.31.13-karmic/linux-image-2.6.31-02063113-generic_2.6.31-02063113_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.32.55-lucid/linux-headers-2.6.32-02063255_2.6.32-02063255.201201251735_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.32.55-lucid/linux-headers-2.6.32-02063255-generic_2.6.32-02063255.201201251735_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.32.55-lucid/linux-image-2.6.32-02063255-generic_2.6.32-02063255.201201251735_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.33.5-lucid/linux-headers-2.6.33-02063305_2.6.33-02063305_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.33.5-lucid/linux-headers-2.6.33-02063305-generic_2.6.33-02063305_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.33.5-lucid/linux-image-2.6.33-02063305-generic_2.6.33-02063305_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.34.10-maverick/linux-headers-2.6.34-02063410_2.6.34-02063410.201111101535_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.34.10-maverick/linux-headers-2.6.34-02063410-generic_2.6.34-02063410.201111101535_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.34.10-maverick/linux-image-2.6.34-02063410-generic_2.6.34-02063410.201111101535_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.35.13-maverick/linux-headers-2.6.35-02063512_2.6.35-02063512.201111232118_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.35.13-maverick/linux-headers-2.6.35-02063512-generic_2.6.35-02063512.201111232118_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.35.13-maverick/linux-image-2.6.35-02063512-generic_2.6.35-02063512.201111232118_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.36.4-natty/linux-headers-2.6.36-02063604_2.6.36-02063604.201102180911_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.36.4-natty/linux-headers-2.6.36-02063604-generic_2.6.36-02063604.201102180911_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.36.4-natty/linux-image-2.6.36-02063604-generic_2.6.36-02063604.201102180911_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.37.6-natty/linux-headers-2.6.37-02063706_2.6.37-02063706.201103281005_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.37.6-natty/linux-headers-2.6.37-02063706-generic_2.6.37-02063706.201103281005_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.37.6-natty/linux-image-2.6.37-02063706-generic_2.6.37-02063706.201103281005_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.38.8-natty/linux-headers-2.6.38-02063808_2.6.38-02063808.201106040910_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.38.8-natty/linux-headers-2.6.38-02063808-generic_2.6.38-02063808.201106040910_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.38.8-natty/linux-image-2.6.38-02063808-generic_2.6.38-02063808.201106040910_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v2.6.39.4-oneiric/linux-headers-2.6.39-02063904_2.6.39-02063904.201108040905_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.39.4-oneiric/linux-headers-2.6.39-02063904-generic_2.6.39-02063904.201108040905_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v2.6.39.4-oneiric/linux-image-2.6.39-02063904-generic_2.6.39-02063904.201108040905_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v3.0.18-oneiric/linux-headers-3.0.18-030018_3.0.18-030018.201201252135_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v3.0.18-oneiric/linux-headers-3.0.18-030018-generic_3.0.18-030018.201201252135_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v3.0.18-oneiric/linux-image-3.0.18-030018-generic_3.0.18-030018.201201252135_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v3.1.10-precise/linux-headers-3.1.10-030110_3.1.10-030110.201201181135_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v3.1.10-precise/linux-headers-3.1.10-030110-generic_3.1.10-030110.201201181135_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v3.1.10-precise/linux-image-3.1.10-030110-generic_3.1.10-030110.201201181135_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v3.2.2-precise/linux-headers-3.2.2-030202_3.2.2-030202.201201252035_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v3.2.2-precise/linux-headers-3.2.2-030202-generic_3.2.2-030202.201201252035_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v3.2.2-precise/linux-image-3.2.2-030202-generic_3.2.2-030202.201201252035_amd64.deb"
+
+ KERNELS="$KERNELS ${KPATH}/v3.3-rc2-precise/linux-headers-3.3.0-030300rc2_3.3.0-030300rc2.201201311735_all.deb"
+ KERNELS="$KERNELS ${KPATH}/v3.3-rc2-precise/linux-headers-3.3.0-030300rc2-generic_3.3.0-030300rc2.201201311735_amd64.deb"
+ KERNELS="$KERNELS ${KPATH}/v3.3-rc2-precise/linux-image-3.3.0-030300rc2-generic_3.3.0-030300rc2.201201311735_amd64.deb"
+
+ for i in $KERNELS; do
+ FILE=$(basename $i)
+ PKG=$(echo $FILE | awk -F"_" '{print $1}')
+
+ echo "$i" | grep image 2>&1 > /dev/null
+ if [[ $? = 0 && $INSTALL_IMAGES != "y" ]]; then
+ continue
+ fi
+
+ if [[ ! -f $FILE ]]; then
+ wget -c $i
+ fi
+ done
+
+ # Let dpkg figure out dependency magic.
+ #
+ # XXX: I tried adding some magic to not install a package if
+ # if its already presently installed but then had to deal
+ # with the dependency mess. I welcome someone else to
+ # figure this out. Running this can come in handy once
+ # a new public kernel gets released.
+ sudo dpkg -i *.deb
+}
+
+function usage() {
+ echo -e "Usage: $0 [ -i ]"
+ echo -e ""
+ echo -e "If you specify [ -i ] you will also download all kernel images and install them"
+}
+
+INSTALL_IMAGES="n"
+
+if [[ $# -gt 1 ]]; then
+ usage
+ exit
+fi
+
+if [[ $# -eq 1 && $1 != "-i" ]]; then
+ usage
+ exit
+fi
+
+if [[ $# -eq 1 && $1 = "-i" ]]; then
+ INSTALL_IMAGES="y"
+fi
+
+
+LSB_RED_ID=$(/usr/bin/lsb_release -i -s)
+case $LSB_RED_ID in
+"Ubuntu")
+ get_ubuntu_kernels
+ ;;
+*)
+ echo -e "Unsupported distribution"
+ exit
+ ;;
+esac
--
1.7.4.15.g7811d
^ permalink raw reply related [flat|nested] 11+ messages in thread* Re: [PATCH] compat: add compat kernel checker and downloader
2012-02-03 23:43 [PATCH] compat: add compat kernel checker and downloader Luis R. Rodriguez
@ 2012-02-06 10:57 ` Andy Whitcroft
2012-02-06 16:07 ` John W. Linville
1 sibling, 0 replies; 11+ messages in thread
From: Andy Whitcroft @ 2012-02-06 10:57 UTC (permalink / raw)
To: Luis R. Rodriguez; +Cc: hauke, kernel-team, linux-wireless, linux-kernel
On Fri, Feb 03, 2012 at 03:43:14PM -0800, Luis R. Rodriguez wrote:
> This adds get-compat-kernels, a utility that is intended
> to be Linux distribution agnostic that downloads and installs
> all kernel headers for all supported kernel releases of compat.
> You also have the option of specifying you want to also install
> the actual kernel image (get-compat-kernels -i).
>
> We start off by adding support for Ubuntu on x86_64 as that
> is what a few of us maintaining compat and compat-wireless run.
> Just for kernel headers (default run of get-compat-kernels),
> you'll need currently 205 M of hard drive space.
>
> Once done with running get-compat-kernels, you can then
> start running ckmake to verify your compat kernel changes
> won't bust compilation against any known supported kernel.
This sounds like very reasonable plan.
[...]
> + KERNELS="$KERNELS ${KPATH}/v2.6.24/linux-headers-2.6.24-020624_2.6.24-020624_all.deb"
> + KERNELS="$KERNELS ${KPATH}/v2.6.24/linux-headers-2.6.24-020624-generic_2.6.24-020624_amd64.deb"
> + KERNELS="$KERNELS ${KPATH}/v2.6.24/linux-image-2.6.24-020624-generic_2.6.24-020624_amd64.deb"
If its any help, the snippet below is how we encode the official version
number as the abi number, the base version is always the first three
digits of the version. It might let you turn this into a list of
versions:
abinum=`echo "$abinum" | awk -F'[.-]' '{
for (i = 1; i <= NF; i++) {
if ($i ~ /^[0-9][0-9]*$/) {
printf("%02d", $i);
} else {
printf("%s", $i);
}
}
}'`
-apw
^ permalink raw reply [flat|nested] 11+ messages in thread* Re: [PATCH] compat: add compat kernel checker and downloader
2012-02-03 23:43 [PATCH] compat: add compat kernel checker and downloader Luis R. Rodriguez
2012-02-06 10:57 ` Andy Whitcroft
@ 2012-02-06 16:07 ` John W. Linville
2012-02-07 4:19 ` Luis R. Rodriguez
1 sibling, 1 reply; 11+ messages in thread
From: John W. Linville @ 2012-02-06 16:07 UTC (permalink / raw)
To: Luis R. Rodriguez; +Cc: hauke, kernel-team, linux-wireless, linux-kernel
On Fri, Feb 03, 2012 at 03:43:14PM -0800, Luis R. Rodriguez wrote:
> This adds get-compat-kernels, a utility that is intended
> to be Linux distribution agnostic that downloads and installs
> all kernel headers for all supported kernel releases of compat.
> You also have the option of specifying you want to also install
> the actual kernel image (get-compat-kernels -i).
>
> We start off by adding support for Ubuntu on x86_64 as that
> is what a few of us maintaining compat and compat-wireless run.
> Just for kernel headers (default run of get-compat-kernels),
> you'll need currently 205 M of hard drive space.
>
> Once done with running get-compat-kernels, you can then
> start running ckmake to verify your compat kernel changes
> won't bust compilation against any known supported kernel.
>
> I'd like to start requiring runs against this script for
> patch submissions. Eventually we can try to add the same
> runs against compat-wireless so we can verify integrity
> against compilation for different kernel versions.
>
> Support for different Linux distributios is welcomed.
>
> Debug log goes out to ckmake.log
>
> Example output:
>
> mcgrof@tux ~/compat (git::master)$ ckmake
> Trying kernel 3.3.0-030300rc2-generic [OK]
> Trying kernel 3.2.2-030202-generic [OK]
> Trying kernel 3.1.10-030110-generic [OK]
> Trying kernel 3.0.18-030018-generic [OK]
> Trying kernel 2.6.39-02063904-generic [OK]
> Trying kernel 2.6.38-8-generic [OK]
> Trying kernel 2.6.38-13-generic [OK]
> Trying kernel 2.6.38-12-generic [OK]
> Trying kernel 2.6.38-11-generic [OK]
> Trying kernel 2.6.38-10-generic [OK]
> Trying kernel 2.6.38-02063808-generic [OK]
> Trying kernel 2.6.37-02063706-generic [OK]
> Trying kernel 2.6.36-02063604-generic [OK]
> Trying kernel 2.6.35-02063512-generic [OK]
> Trying kernel 2.6.34-02063410-generic [OK]
> Trying kernel 2.6.33-02063305-generic [OK]
> Trying kernel 2.6.32-02063255-generic [OK]
> Trying kernel 2.6.31-22-generic [OK]
> Trying kernel 2.6.31-02063113-generic [OK]
> Trying kernel 2.6.30-02063010-generic [OK]
> Trying kernel 2.6.29-02062906-generic [OK]
> Trying kernel 2.6.28-02062810-generic [OK]
> Trying kernel 2.6.27-020627-generic [OK]
> Trying kernel 2.6.26-020626-generic [OK]
> Trying kernel 2.6.25-020625-generic [OK]
> Trying kernel 2.6.24-020624-generic [OK]
>
> Cc: kernel-team@lists.ubuntu.com
> Signed-off-by: Luis R. Rodriguez <mcgrof@frijolero.org>
I'm not sure this makes any sense. I thought the point of the compat
project was to support upstream kernels, not distro ones? I'm not
even sure I know how to replicate the above process in Fedora, since
we would only have kernels available from a given release in each
release's repository.
John
--
John W. Linville Someday the world will need a hero, and you
linville@tuxdriver.com might be all we have. Be ready.
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [PATCH] compat: add compat kernel checker and downloader
2012-02-06 16:07 ` John W. Linville
@ 2012-02-07 4:19 ` Luis R. Rodriguez
2012-02-07 4:56 ` Luis R. Rodriguez
0 siblings, 1 reply; 11+ messages in thread
From: Luis R. Rodriguez @ 2012-02-07 4:19 UTC (permalink / raw)
To: John W. Linville
Cc: Luis R. Rodriguez, hauke, kernel-team, linux-wireless,
linux-kernel
On Mon, Feb 06, 2012 at 11:07:28AM -0500, John W. Linville wrote:
> On Fri, Feb 03, 2012 at 03:43:14PM -0800, Luis R. Rodriguez wrote:
> > This adds get-compat-kernels, a utility that is intended
> > to be Linux distribution agnostic that downloads and installs
> > all kernel headers for all supported kernel releases of compat.
> > You also have the option of specifying you want to also install
> > the actual kernel image (get-compat-kernels -i).
> >
> > We start off by adding support for Ubuntu on x86_64 as that
> > is what a few of us maintaining compat and compat-wireless run.
> > Just for kernel headers (default run of get-compat-kernels),
> > you'll need currently 205 M of hard drive space.
> >
> > Once done with running get-compat-kernels, you can then
> > start running ckmake to verify your compat kernel changes
> > won't bust compilation against any known supported kernel.
> >
> > I'd like to start requiring runs against this script for
> > patch submissions. Eventually we can try to add the same
> > runs against compat-wireless so we can verify integrity
> > against compilation for different kernel versions.
> >
> > Support for different Linux distributios is welcomed.
> >
> > Debug log goes out to ckmake.log
> >
> > Example output:
> >
> > mcgrof@tux ~/compat (git::master)$ ckmake
> > Trying kernel 3.3.0-030300rc2-generic [OK]
> > Trying kernel 3.2.2-030202-generic [OK]
> > Trying kernel 3.1.10-030110-generic [OK]
> > Trying kernel 3.0.18-030018-generic [OK]
> > Trying kernel 2.6.39-02063904-generic [OK]
> > Trying kernel 2.6.38-8-generic [OK]
> > Trying kernel 2.6.38-13-generic [OK]
> > Trying kernel 2.6.38-12-generic [OK]
> > Trying kernel 2.6.38-11-generic [OK]
> > Trying kernel 2.6.38-10-generic [OK]
> > Trying kernel 2.6.38-02063808-generic [OK]
> > Trying kernel 2.6.37-02063706-generic [OK]
> > Trying kernel 2.6.36-02063604-generic [OK]
> > Trying kernel 2.6.35-02063512-generic [OK]
> > Trying kernel 2.6.34-02063410-generic [OK]
> > Trying kernel 2.6.33-02063305-generic [OK]
> > Trying kernel 2.6.32-02063255-generic [OK]
> > Trying kernel 2.6.31-22-generic [OK]
> > Trying kernel 2.6.31-02063113-generic [OK]
> > Trying kernel 2.6.30-02063010-generic [OK]
> > Trying kernel 2.6.29-02062906-generic [OK]
> > Trying kernel 2.6.28-02062810-generic [OK]
> > Trying kernel 2.6.27-020627-generic [OK]
> > Trying kernel 2.6.26-020626-generic [OK]
> > Trying kernel 2.6.25-020625-generic [OK]
> > Trying kernel 2.6.24-020624-generic [OK]
> >
> > Cc: kernel-team@lists.ubuntu.com
> > Signed-off-by: Luis R. Rodriguez <mcgrof@frijolero.org>
>
> I'm not sure this makes any sense. I thought the point of the compat
> project was to support upstream kernels, not distro ones?
Absolutely but distributions also build kernels for us so if we're lazy
we don't have to do anything but just install some sort of package.
The get-compat-kernels takes advantage of this fact and lists a way
to let us get all known supported kernels from Ubuntu's PPA repository
that has mainline kernels. That is, these are kernels from mainline
without any Ubuntu jazz on it.
> I'm not
> even sure I know how to replicate the above process in Fedora, since
> we would only have kernels available from a given release in each
> release's repository.
The Ubuntu PPA was special, it was put in place to help users tests
kernel issues on a mainline kernel without any ubuntu jazz when
there were concerns that perhaps the issues on bugzilla.kernel.org
may have been cause by some of the deltas.
The scripts can be explanded to use general kernels though:
diff --git a/bin/ckmake b/bin/ckmake
index 4d45fb9..3b49347 100755
--- a/bin/ckmake
+++ b/bin/ckmake
@@ -34,8 +34,11 @@ case $LSB_RED_ID in
done
;;
*)
- echo -e "Unsupported distribution"
- exit
+ for i in $(find /lib/modules/ -type d | sort -n -r); do
+ if [[ -d $i/build/ && -f $i/build/Makefile ]]; then
+ KLIBS="$KLIBS $i"
+ fi
+ done
;;
esac
diff --git a/bin/get-compat-kernels b/bin/get-compat-kernels
index 07ac17b..9bb9f39 100755
--- a/bin/get-compat-kernels
+++ b/bin/get-compat-kernels
@@ -148,7 +148,14 @@ case $LSB_RED_ID in
get_ubuntu_kernels
;;
*)
- echo -e "Unsupported distribution"
- exit
+ echo -e "Using your available kernels. We recommend to have "
+ echo -e "all supported asupported kernels listed on kernel.org."
+ echo -e "Currently our target is to at least support all kernels "
+ echo -e "in the range 2.6.27 - 3.3. You have:\n":
+ for i in $(find /lib/modules/ -type d | sort -n -r); do
+ if [[ -d $i/build/ && -f $i/build/Makefile ]]; then
+ echo -e " * $(basename $i))"
+ fi
+ done
;;
esac
This could be improved to ensure that ckmake will not run for any
case unless at least one kernel for each suppoted kernel release is
present to test.
Thoughts?
Luis
^ permalink raw reply related [flat|nested] 11+ messages in thread
* Re: [PATCH] compat: add compat kernel checker and downloader
2012-02-07 4:19 ` Luis R. Rodriguez
@ 2012-02-07 4:56 ` Luis R. Rodriguez
2012-02-08 1:19 ` Luis R. Rodriguez
0 siblings, 1 reply; 11+ messages in thread
From: Luis R. Rodriguez @ 2012-02-07 4:56 UTC (permalink / raw)
To: Luis R. Rodriguez
Cc: John W. Linville, hauke, kernel-team, linux-wireless,
linux-kernel
On Mon, Feb 6, 2012 at 8:19 PM, Luis R. Rodriguez
<mcgrof@bombadil.infradead.org> wrote:
> On Mon, Feb 06, 2012 at 11:07:28AM -0500, John W. Linville wrote:
>> On Fri, Feb 03, 2012 at 03:43:14PM -0800, Luis R. Rodriguez wrote:
>> > This adds get-compat-kernels, a utility that is intended
>> > to be Linux distribution agnostic that downloads and installs
>> > all kernel headers for all supported kernel releases of compat.
>> > You also have the option of specifying you want to also install
>> > the actual kernel image (get-compat-kernels -i).
>> >
>> > We start off by adding support for Ubuntu on x86_64 as that
>> > is what a few of us maintaining compat and compat-wireless run.
>> > Just for kernel headers (default run of get-compat-kernels),
>> > you'll need currently 205 M of hard drive space.
>> >
>> > Once done with running get-compat-kernels, you can then
>> > start running ckmake to verify your compat kernel changes
>> > won't bust compilation against any known supported kernel.
>> >
>> > I'd like to start requiring runs against this script for
>> > patch submissions. Eventually we can try to add the same
>> > runs against compat-wireless so we can verify integrity
>> > against compilation for different kernel versions.
>> >
>> > Support for different Linux distributios is welcomed.
>> >
>> > Debug log goes out to ckmake.log
>> >
>> > Example output:
>> >
>> > mcgrof@tux ~/compat (git::master)$ ckmake
>> > Trying kernel 3.3.0-030300rc2-generic [OK]
>> > Trying kernel 3.2.2-030202-generic [OK]
>> > Trying kernel 3.1.10-030110-generic [OK]
>> > Trying kernel 3.0.18-030018-generic [OK]
>> > Trying kernel 2.6.39-02063904-generic [OK]
>> > Trying kernel 2.6.38-8-generic [OK]
>> > Trying kernel 2.6.38-13-generic [OK]
>> > Trying kernel 2.6.38-12-generic [OK]
>> > Trying kernel 2.6.38-11-generic [OK]
>> > Trying kernel 2.6.38-10-generic [OK]
>> > Trying kernel 2.6.38-02063808-generic [OK]
>> > Trying kernel 2.6.37-02063706-generic [OK]
>> > Trying kernel 2.6.36-02063604-generic [OK]
>> > Trying kernel 2.6.35-02063512-generic [OK]
>> > Trying kernel 2.6.34-02063410-generic [OK]
>> > Trying kernel 2.6.33-02063305-generic [OK]
>> > Trying kernel 2.6.32-02063255-generic [OK]
>> > Trying kernel 2.6.31-22-generic [OK]
>> > Trying kernel 2.6.31-02063113-generic [OK]
>> > Trying kernel 2.6.30-02063010-generic [OK]
>> > Trying kernel 2.6.29-02062906-generic [OK]
>> > Trying kernel 2.6.28-02062810-generic [OK]
>> > Trying kernel 2.6.27-020627-generic [OK]
>> > Trying kernel 2.6.26-020626-generic [OK]
>> > Trying kernel 2.6.25-020625-generic [OK]
>> > Trying kernel 2.6.24-020624-generic [OK]
>> >
>> > Cc: kernel-team@lists.ubuntu.com
>> > Signed-off-by: Luis R. Rodriguez <mcgrof@frijolero.org>
>>
>> I'm not sure this makes any sense. I thought the point of the compat
>> project was to support upstream kernels, not distro ones?
>
> Absolutely but distributions also build kernels for us so if we're lazy
> we don't have to do anything but just install some sort of package.
> The get-compat-kernels takes advantage of this fact and lists a way
> to let us get all known supported kernels from Ubuntu's PPA repository
> that has mainline kernels. That is, these are kernels from mainline
> without any Ubuntu jazz on it.
>
>> I'm not
>> even sure I know how to replicate the above process in Fedora, since
>> we would only have kernels available from a given release in each
>> release's repository.
>
> The Ubuntu PPA was special, it was put in place to help users tests
> kernel issues on a mainline kernel without any ubuntu jazz when
> there were concerns that perhaps the issues on bugzilla.kernel.org
> may have been cause by some of the deltas.
>
> The scripts can be explanded to use general kernels though:
>
> diff --git a/bin/ckmake b/bin/ckmake
> index 4d45fb9..3b49347 100755
> --- a/bin/ckmake
> +++ b/bin/ckmake
> @@ -34,8 +34,11 @@ case $LSB_RED_ID in
> done
> ;;
> *)
> - echo -e "Unsupported distribution"
> - exit
> + for i in $(find /lib/modules/ -type d | sort -n -r); do
> + if [[ -d $i/build/ && -f $i/build/Makefile ]]; then
> + KLIBS="$KLIBS $i"
> + fi
> + done
> ;;
> esac
>
> diff --git a/bin/get-compat-kernels b/bin/get-compat-kernels
> index 07ac17b..9bb9f39 100755
> --- a/bin/get-compat-kernels
> +++ b/bin/get-compat-kernels
> @@ -148,7 +148,14 @@ case $LSB_RED_ID in
> get_ubuntu_kernels
> ;;
> *)
> - echo -e "Unsupported distribution"
> - exit
> + echo -e "Using your available kernels. We recommend to have "
> + echo -e "all supported asupported kernels listed on kernel.org."
> + echo -e "Currently our target is to at least support all kernels "
> + echo -e "in the range 2.6.27 - 3.3. You have:\n":
> + for i in $(find /lib/modules/ -type d | sort -n -r); do
> + if [[ -d $i/build/ && -f $i/build/Makefile ]]; then
> + echo -e " * $(basename $i))"
> + fi
> + done
> ;;
> esac
>
>
> This could be improved to ensure that ckmake will not run for any
> case unless at least one kernel for each suppoted kernel release is
> present to test.
>
> Thoughts?
Come to think of it.. we could bastardize Ubuntu's PPA packages for
mainline kernels, translate the deb packages into tar files and some
sort of grub-update or whatever scrip to run in the end? That still
seems like a lot of work.
The current option allows us to use either distro kernels or whatever
you have installed.. not sure how else to improve this. Didn't we have
some sort of distro agnostic package crap? Maybe?
Luis
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [PATCH] compat: add compat kernel checker and downloader
2012-02-07 4:56 ` Luis R. Rodriguez
@ 2012-02-08 1:19 ` Luis R. Rodriguez
2012-02-08 2:55 ` Luis R. Rodriguez
0 siblings, 1 reply; 11+ messages in thread
From: Luis R. Rodriguez @ 2012-02-08 1:19 UTC (permalink / raw)
To: Luis R. Rodriguez, Andy Whitcroft
Cc: John W. Linville, hauke, kernel-team, linux-wireless,
linux-kernel
On Mon, Feb 6, 2012 at 8:56 PM, Luis R. Rodriguez <mcgrof@frijolero.org> wrote:
> Come to think of it.. we could bastardize Ubuntu's PPA packages for
> mainline kernels, translate the deb packages into tar files and some
> sort of grub-update or whatever scrip to run in the end? That still
> seems like a lot of work.
>
> The current option allows us to use either distro kernels or whatever
> you have installed.. not sure how else to improve this. Didn't we have
> some sort of distro agnostic package crap? Maybe?
Or -- Andy -- any chance we can get some of the deb contents unpacked
into a distro-agostic tarball of some sort that we can use ? I ask
given that you guys already host the sources and all that.
Luis
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [PATCH] compat: add compat kernel checker and downloader
2012-02-08 1:19 ` Luis R. Rodriguez
@ 2012-02-08 2:55 ` Luis R. Rodriguez
2012-02-08 2:58 ` Luis R. Rodriguez
0 siblings, 1 reply; 11+ messages in thread
From: Luis R. Rodriguez @ 2012-02-08 2:55 UTC (permalink / raw)
To: Luis R. Rodriguez, Andy Whitcroft
Cc: John W. Linville, hauke, kernel-team, linux-wireless,
linux-kernel
On Tue, Feb 7, 2012 at 5:19 PM, Luis R. Rodriguez <mcgrof@frijolero.org> wrote:
> On Mon, Feb 6, 2012 at 8:56 PM, Luis R. Rodriguez <mcgrof@frijolero.org> wrote:
>> Come to think of it.. we could bastardize Ubuntu's PPA packages for
>> mainline kernels, translate the deb packages into tar files and some
>> sort of grub-update or whatever scrip to run in the end? That still
>> seems like a lot of work.
>>
>> The current option allows us to use either distro kernels or whatever
>> you have installed.. not sure how else to improve this. Didn't we have
>> some sort of distro agnostic package crap? Maybe?
>
> Or -- Andy -- any chance we can get some of the deb contents unpacked
> into a distro-agostic tarball of some sort that we can use ? I ask
> given that you guys already host the sources and all that.
Just to not waste anyone's time it seems pkgadd from IRC has a
distro-agnostic dpkg -x type of solution in the works, that could use
these same debs.
http://paste.debian.net/155521/
Luis
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [PATCH] compat: add compat kernel checker and downloader
2012-02-08 2:55 ` Luis R. Rodriguez
@ 2012-02-08 2:58 ` Luis R. Rodriguez
2012-03-31 0:23 ` Luis R. Rodriguez
0 siblings, 1 reply; 11+ messages in thread
From: Luis R. Rodriguez @ 2012-02-08 2:58 UTC (permalink / raw)
To: Luis R. Rodriguez, Andy Whitcroft
Cc: John W. Linville, hauke, kernel-team, linux-wireless,
linux-kernel
On Tue, Feb 7, 2012 at 6:55 PM, Luis R. Rodriguez <mcgrof@frijolero.org> wrote:
> On Tue, Feb 7, 2012 at 5:19 PM, Luis R. Rodriguez <mcgrof@frijolero.org> wrote:
>> On Mon, Feb 6, 2012 at 8:56 PM, Luis R. Rodriguez <mcgrof@frijolero.org> wrote:
>>> Come to think of it.. we could bastardize Ubuntu's PPA packages for
>>> mainline kernels, translate the deb packages into tar files and some
>>> sort of grub-update or whatever scrip to run in the end? That still
>>> seems like a lot of work.
>>>
>>> The current option allows us to use either distro kernels or whatever
>>> you have installed.. not sure how else to improve this. Didn't we have
>>> some sort of distro agnostic package crap? Maybe?
>>
>> Or -- Andy -- any chance we can get some of the deb contents unpacked
>> into a distro-agostic tarball of some sort that we can use ? I ask
>> given that you guys already host the sources and all that.
>
> Just to not waste anyone's time it seems pkgadd from IRC has a
> distro-agnostic dpkg -x type of solution in the works, that could use
> these same debs.
>
> http://paste.debian.net/155521/
Disclaimer: (no error handling)
02:57 < pkgadd> and no support for different compression methods that
gzip for now (Debian is using xz for >= 3.2 kernel packages)
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [PATCH] compat: add compat kernel checker and downloader
2012-02-08 2:58 ` Luis R. Rodriguez
@ 2012-03-31 0:23 ` Luis R. Rodriguez
2012-04-04 11:10 ` Andy Whitcroft
0 siblings, 1 reply; 11+ messages in thread
From: Luis R. Rodriguez @ 2012-03-31 0:23 UTC (permalink / raw)
To: Luis R. Rodriguez, Andy Whitcroft
Cc: John W. Linville, hauke, kernel-team, linux-wireless,
linux-kernel, lf_driver_backport
Andy, so I just noticed that on all Ubuntu PPA (and generic) kernels
you guys have a broken symlink >= 2.6.33.
/lib/modules/2.6.33-02063305-generic/build/include/asm
points to asm-x86 and that is no longer present after 2.6.33 so any
module requiring those header files will break now on Ubuntu. I just
spotted this as some file from asm is now included in the modules were
are building. I guess not many external kernel modules include asm dir
otherwise you guys would have noticed this a long time ago.
Luis
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [PATCH] compat: add compat kernel checker and downloader
2012-03-31 0:23 ` Luis R. Rodriguez
@ 2012-04-04 11:10 ` Andy Whitcroft
2012-04-05 20:19 ` Tim Gardner
0 siblings, 1 reply; 11+ messages in thread
From: Andy Whitcroft @ 2012-04-04 11:10 UTC (permalink / raw)
To: Luis R. Rodriguez
Cc: Luis R. Rodriguez, hauke, linux-wireless, linux-kernel,
kernel-team, lf_driver_backport
On Fri, Mar 30, 2012 at 05:23:46PM -0700, Luis R. Rodriguez wrote:
> Andy, so I just noticed that on all Ubuntu PPA (and generic) kernels
> you guys have a broken symlink >= 2.6.33.
>
> /lib/modules/2.6.33-02063305-generic/build/include/asm
>
> points to asm-x86 and that is no longer present after 2.6.33 so any
> module requiring those header files will break now on Ubuntu. I just
> spotted this as some file from asm is now included in the modules were
> are building. I guess not many external kernel modules include asm dir
> otherwise you guys would have noticed this a long time ago.
Luis, I concur that the link is now broken. However that link is actually
simply superfulous now. Anything correctly using kernel 'external
module' support will be using the -I path from the kernel Makefiles.
They will therefore be including from /usr/src/<version>/include _and_
/usr/src/<version>/arch/x86/include. I presume this is why we have not
noticed it.
I will get that link removed however as it is simply bogus.
-apw
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [PATCH] compat: add compat kernel checker and downloader
2012-04-04 11:10 ` Andy Whitcroft
@ 2012-04-05 20:19 ` Tim Gardner
0 siblings, 0 replies; 11+ messages in thread
From: Tim Gardner @ 2012-04-05 20:19 UTC (permalink / raw)
To: Andy Whitcroft
Cc: Luis R. Rodriguez, hauke, Luis R. Rodriguez, linux-wireless,
linux-kernel, kernel-team, lf_driver_backport, tim.gardner
On 04/04/2012 05:10 AM, Andy Whitcroft wrote:
> On Fri, Mar 30, 2012 at 05:23:46PM -0700, Luis R. Rodriguez wrote:
>> Andy, so I just noticed that on all Ubuntu PPA (and generic) kernels
>> you guys have a broken symlink >= 2.6.33.
>>
>> /lib/modules/2.6.33-02063305-generic/build/include/asm
>>
>> points to asm-x86 and that is no longer present after 2.6.33 so any
>> module requiring those header files will break now on Ubuntu. I just
>> spotted this as some file from asm is now included in the modules were
>> are building. I guess not many external kernel modules include asm dir
>> otherwise you guys would have noticed this a long time ago.
>
> Luis, I concur that the link is now broken. However that link is actually
> simply superfulous now. Anything correctly using kernel 'external
> module' support will be using the -I path from the kernel Makefiles.
> They will therefore be including from /usr/src/<version>/include _and_
> /usr/src/<version>/arch/x86/include. I presume this is why we have not
> noticed it.
>
> I will get that link removed however as it is simply bogus.
>
> -apw
>
I just corrected the invalid link so that it points at asm-generic.
http://bugs.launchpad.net/bugs/974403
rtg
--
Tim Gardner tim.gardner@canonical.com
^ permalink raw reply [flat|nested] 11+ messages in thread
end of thread, other threads:[~2012-04-05 20:19 UTC | newest]
Thread overview: 11+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-02-03 23:43 [PATCH] compat: add compat kernel checker and downloader Luis R. Rodriguez
2012-02-06 10:57 ` Andy Whitcroft
2012-02-06 16:07 ` John W. Linville
2012-02-07 4:19 ` Luis R. Rodriguez
2012-02-07 4:56 ` Luis R. Rodriguez
2012-02-08 1:19 ` Luis R. Rodriguez
2012-02-08 2:55 ` Luis R. Rodriguez
2012-02-08 2:58 ` Luis R. Rodriguez
2012-03-31 0:23 ` Luis R. Rodriguez
2012-04-04 11:10 ` Andy Whitcroft
2012-04-05 20:19 ` Tim Gardner
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).