[PGNd]

Building Kodi 18 Leia / master, build fails at groovey/swig code generation

==> https://pastebin.com/2JBw45hW

[Martijn]

How about you use pastebin.com instead of dumping logs on the forum

[PGNd]

How about you use pastebin.com instead of dumping logs on the forum

No complaining, then, about having to use pastebin ...

[asavah]

I don't get it ...
How exactly are you building?
Why you have Phenom II in your cpuinfo? and suse x64 over there too ...
Is it a qemu-user-arm VM?

[PGNd]

How exactly are you building?

It's a chroot env --  Raspbian 9 qemu/arm chroot, on an OpenSUSE x86_64 host.

As much as possible, it's an identical env to my RPi2s running Raspbian 9 -- except for the obvious difference of the chroot. Been doing it this way for several Kodi versions, now.

Currently, with Leia, I Cmake config/build using native compiler/deps in the Raspbian env.

Few months ago, all was well ... this appears to be a recent problem.

[asavah]

It's a chroot env --  Raspbian 9 qemu/arm chroot, on an OpenSUSE x86_64 host.
Few months ago, all was well ... this appears to be a recent problem.

Been there, done that ...

Honestly I don't think it's Kodi issue, but qemu or host OS issue,
can't offer any help or insight here, currently I only use qemu-arm as a last resort when I need to run a binary or two while crosscompiling some effed-up packages.

[PGNd]

Honestly I don't think it's Kodi issue, but qemu or host OS issue,
can't offer any help or insight here, currently I only use qemu-arm as a last resort when I need to run a binary or two while crosscompiling some effed-up packages. 

Entirely possible ...

'tho I've now replicated the problem on a number of different hostOS, with their respective qemu-arm/static bins in place.

Working on an alternative, switching over to an attempt with a cross-compile on x86_64 host, no chroot, I'm trying to figure out the CMAKE cross-build procedure/options for deps, then the main build.

The instructions @

https://github.com/xbmc/xbmc/blob/master...aspberrypi

still refer to an auto-foo deps build.  Which, initially, is failing for me: https://pastebin.com/6rKr4wkD

Are you doing an x-build?  Do you know of a how-to doc for a clean, all-cmake kodi build, including deps?

[asavah]

Are you doing an x-build?  Do you know of a how-to doc for a clean, all-cmake kodi build, including deps?  

Yes, I do full cross, but I don't have a doc and I don't use Kodi depends system, never even tried to figure it out, I build all the deps myself (my scripts do).
I have my own hobby os, so I build everything from scratch, it's a massive set of crap, scripts and hacks actually ...

The error log you linked is probably due to library search path being set wrong for a 64bit os

Here is where liblzo2.a is installed (notice lib64)

Code:

 /usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native/lib64/liblzo2.a

And here is where python native searches for libs (notice lib and not lib64 in -L/usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native/lib )

Code:

    /usr/bin/g++ -DTARGET_POSIX -DTARGET_POSIX -DTARGET_LINUX -D_LINUX -std=c++0x -I/usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native/include  -llzo2 -ljpeg -lgif  -lpng16 -lm -lz -lm  -static -L/usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native/lib  -o TexturePacker md5.o XBTFWriter.o TexturePacker.o DecoderManager.o decoder/PNGDecoder.o decoder/JPGDecoder.o decoder/GifHelper.o decoder/GIFDecoder.o XBTF.o  -llzo2 -ljpeg -lgif  -lpng16 -lm -lz -lm

That's why it can't find the libs.
Not sure if this is a depends buildsystem bug or your suse does something funky (or ubuntu does something funky and we are used to it, x64 ubuntu does not use /lib64, only god knows who is right ...) .

[PGNd]

The error log you linked is probably due to library search path being set wrong for a 64bit os
...
Not sure if this is a depends buildsystem bug or your suse does something funky (or ubuntu does something funky and we are used to it, x64 ubuntu does not use /lib64, only god knows who is right ...) . 

Missed that here.  The lib vs lib64 'mess' is nicely managed in a native/x86_64 cmake build, with my config.  autofoo's always been a challenge ...

Which is why I was hoping there's a doc'd all-cmake procedure for the depends-build as well.

I suspect you may be right ...

[wsnipex]

    /usr/bin/gcc -pthread -fPIC -fno-strict-aliasing -I/usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native/include -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -I. -IInclude -I./Include -I/usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native/include -I/usr/local/include -I/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/python27-native/x86_64-linux-native/Include -I/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/python27-native/x86_64-linux-native -c /usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/python27-native/x86_64-linux-native/Modules/cStringIO.c -o build/temp.linux-x86_64-2.7/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/python27-native/x86_64-linux-native/Modules/cStringIO.o    /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: cannot find -llzo2    /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: cannot find -ljpeg    /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: cannot find -lgif    /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: cannot find -lpng16    /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: cannot find -llzo2    /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: cannot find -ljpeg    /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: cannot find -lgif    /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: cannot find -lpng16    collect2: error: ld returned 1 exit status    Makefile:421: recipe for target 'TexturePacker' failed    make[4]: *** [TexturePacker] Error 1

You need some dependencies (native system):
https://github.com/xbmc/xbmc/blob/master...txt#L7-L10


Also:

Code:

--host=armv7-rpi2-linux-gnueabihf \

is wrong, why not stick to the docs?

[PGNd]

You need some dependencies (native system):
https://github.com/xbmc/xbmc/blob/master...txt#L7-L10

On my host

    rpm -qa | egrep -i "lzo|png|gif|jpg|jpeg" | sort
        giflib-devel-5.1.4-112.2.x86_64
        libgif6-5.0.5-13.13.x86_64
        libgif7-5.1.4-112.2.x86_64
        libjpeg62-62.2.0-108.6.x86_64
        libjpeg62-turbo-1.5.1-108.6.x86_64
        libjpeg8-8.1.2-108.6.x86_64
        libjpeg8-devel-8.1.2-108.6.x86_64
        liblzo2-2-2.08-7.3.x86_64
        libopenjpeg1-1.5.2-48.6.x86_64
        libpng12-0-1.2.50-12.3.x86_64
        libpng12-devel-1.2.50-12.3.x86_64
        libpng15-15-1.5.22-7.3.x86_64
        libpng16-16-1.6.8-11.3.x86_64
        libpng16-compat-devel-1.6.8-11.3.x86_64
        libpng16-devel-1.6.8-11.3.x86_64
        libpng16-tools-1.6.8-11.3.x86_64
        libturbojpeg0-8.1.2-108.6.x86_64
        lzo-devel-2.08-7.3.x86_64
        lzop-1.03-20.3.x86_64
        openjpeg-1.5.2-48.6.x86_64
        openjpeg2-2.1.2-32.6.x86_64
        openjpeg2-devel-2.1.2-32.6.x86_64
        openjpeg-devel-1.5.2-48.6.x86_64
        pngcheck-2.3.0-12.4.x86_64
        pngcrush-1.7.92-12.4.x86_64

What dep is missing?

As for

    --host=arm-linux-gnueabihf \

that's been corrected and in use since immediately after the OP.  The issue remains as reported.

[wsnipex]

well, we ship all needed libs in tools/depends/native. So either you didn't build them or they failed. You're log doesn't show that...

Code:

cd tools/depends/
make

To just build Texturepacker with system libs instead: go to tools/depends/native/TexturePacker/src

Code:

./autogen.sh
./configure

[PGNd]

well, we ship all needed libs in tools/depends/native. So either you didn't build them or they failed. You're log doesn't show that...

Code:

cd tools/depends/
make

Starting over, clean ...

Code:

    cd /usr/local/x-tools/armv7-rpi2-linux-gnueabihf/bin
    ls -al

        total 33M
        drwxr-xr-x 2 pgnd users  4.0K Nov 12 06:06 ./
        drwxr-xr-x 9 pgnd users  4.0K Nov 12 06:07 ../
        -rwxr-xr-x 1 pgnd users  834K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-addr2line*
        -rwxr-xr-x 2 pgnd users  862K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-ar*
        -rwxr-xr-x 2 pgnd users  1.5M Nov 12 06:06 armv7-rpi2-linux-gnueabihf-as*
        -rwxr-xr-x 2 pgnd users  895K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-c++*
        lrwxrwxrwx 1 pgnd users    30 Nov 12 06:00 armv7-rpi2-linux-gnueabihf-cc -> armv7-rpi2-linux-gnueabihf-gcc*
        -rwxr-xr-x 1 pgnd users  834K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-c++filt*
        -rwxr-xr-x 1 pgnd users  891K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-cpp*
        -rwxr-xr-x 1 pgnd users  4.0K Nov 12 05:20 armv7-rpi2-linux-gnueabihf-ct-ng.config*
        -rwxr-xr-x 1 pgnd users  3.0M Nov 12 06:06 armv7-rpi2-linux-gnueabihf-dwp*
        -rwxr-xr-x 1 pgnd users   27K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-elfedit*
        -rwxr-xr-x 2 pgnd users  895K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-g++*
        -rwxr-xr-x 2 pgnd users  891K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gcc*
        -rwxr-xr-x 2 pgnd users  891K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gcc-7.2.0*
        -rwxr-xr-x 1 pgnd users   27K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gcc-ar*
        -rwxr-xr-x 1 pgnd users   27K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gcc-nm*
        -rwxr-xr-x 1 pgnd users   27K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gcc-ranlib*
        -rwxr-xr-x 1 pgnd users  480K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gcov*
        -rwxr-xr-x 1 pgnd users  412K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gcov-dump*
        -rwxr-xr-x 1 pgnd users  432K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gcov-tool*
        -rwxr-xr-x 1 pgnd users  5.6M Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gdb*
        -rwxr-xr-x 1 pgnd users  899K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-gprof*
        -rwxr-xr-x 1 pgnd users   143 Nov 12 05:29 armv7-rpi2-linux-gnueabihf-ld*
        -rwxr-xr-x 2 pgnd users  1.3M Nov 12 06:06 armv7-rpi2-linux-gnueabihf-ld.bfd*
        -rwxr-xr-x 1 pgnd users   15K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-ldd*
        -rwxr-xr-x 2 pgnd users  5.0M Nov 12 06:06 armv7-rpi2-linux-gnueabihf-ld.gold*
        -rwxr-xr-x 2 pgnd users  847K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-nm*
        -rwxr-xr-x 2 pgnd users 1022K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-objcopy*
        -rwxr-xr-x 2 pgnd users  1.3M Nov 12 06:06 armv7-rpi2-linux-gnueabihf-objdump*
        -rwxr-xr-x 1 pgnd users   11K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-populate*
        -rwxr-xr-x 2 pgnd users  862K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-ranlib*
        -rwxr-xr-x 2 pgnd users  523K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-readelf*
        -rwxr-xr-x 1 pgnd users  834K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-size*
        -rwxr-xr-x 1 pgnd users  834K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-strings*
        -rwxr-xr-x 2 pgnd users 1022K Nov 12 06:06 armv7-rpi2-linux-gnueabihf-strip*

    export PATH=/usr/local/x-tools/armv7-rpi2-linux-gnueabihf/bin:$PATH

    armv7-rpi2-linux-gnueabihf-gcc -v
        Using built-in specs.
        COLLECT_GCC=armv7-rpi2-linux-gnueabihf-gcc
        COLLECT_LTO_WRAPPER=/usr/local/x-tools/armv7-rpi2-linux-gnueabihf/libexec/gcc/armv7-rpi2-linux-gnueabihf/7.2.0/lto-wrapper
        Target: armv7-rpi2-linux-gnueabihf
        Configured with: /usr/local/TEMP/crosstool-ng/.build/armv7-rpi2-linux-gnueabihf/src/gcc/configure --build=x86_64-build_pc-linux-gnu --host=x86_64-build_pc-linux-gnu --target=armv7-rpi2-linux-gnueabihf --prefix=/usr/local/x-tools/armv7-rpi2-linux-gnueabihf --with-sysroot=/usr/local/x-tools/armv7-rpi2-linux-gnueabihf/armv7-rpi2-linux-gnueabihf/sysroot --enable-languages=c,c++ --with-cpu=cortex-a7 --with-fpu=neon-vfpv4 --with-float=hard --with-pkgversion='crosstool-NG crosstool-ng-1.23.0-244-g7a1e90c3' --enable-__cxa_atexit --disable-libmudflap --disable-libgomp --disable-libssp --disable-libquadmath --disable-libquadmath-support --disable-libsanitizer --disable-libmpx --with-gmp=/usr/local/TEMP/crosstool-ng/.build/armv7-rpi2-linux-gnueabihf/buildtools --with-mpfr=/usr/local/TEMP/crosstool-ng/.build/armv7-rpi2-linux-gnueabihf/buildtools --with-mpc=/usr/local/TEMP/crosstool-ng/.build/armv7-rpi2-linux-gnueabihf/buildtools --with-isl=/usr/local/TEMP/crosstool-ng/.build/armv7-rpi2-linux-gnueabihf/buildtools --enable-lto --with-host-libstdcxx='-static-libgcc -Wl,-Bstatic,-lstdc++,-Bdynamic -lm' --enable-threads=posix --enable-target-optspace --enable-plugin --enable-gold --disable-nls --disable-multilib --with-local-prefix=/usr/local/x-tools/armv7-rpi2-linux-gnueabihf/armv7-rpi2-linux-gnueabihf/sysroot --enable-long-long
        Thread model: posix
        gcc version 7.2.0 (crosstool-NG crosstool-ng-1.23.0-244-g7a1e90c3)

testing

Code:

    echo 'int main(){}' > /tmp/dummy.c
    armv7-rpi2-linux-gnueabihf-gcc /tmp/dummy.c
    readelf -l a.out | grep interpreter
          [Requesting program interpreter: /lib/ld-linux-armhf.so.3]

configuring

Code:

    export RPI_DEV=/usr/local/src/kodi-xbuild/RPi2
    export PYTHONHOME=/usr
    cd xbmc/tools/depends
    ./bootstrap
    ./configure \
     --prefix=$RPI_DEV/build \
     --libdir=$prefix/lib64 \
     --with-platform=raspberry-pi2 \
     --host=arm-linux-gnueabihf \
     --build=x86_64-linux \
     --with-toolchain=/usr/local/x-tools/armv7-rpi2-linux-gnueabihf \
     --with-firmware=$RPI_DEV/firmware \
     --disable-debug \
     --disable-ccache

results:
==> https://pastebin.com/vDegLiYw

, looks OK.

building

Code:

    make V=1

results:
==> https://pastebin.com/kyczMcrb

, FAILs @ line #25785

Code:

    ...
    ImportError: No module named site
    ...

But, checking, module 'site' is installed,

Code:

    pip2 list --format=columns | grep site
        site                         0.0.1

[wsnipex]

You use a non-standard toolchain armv7-rpi2-linux-gnueabihf, so you didn't follow the docs again. Configure doesn't find the correct cross toolchain and building target/* will fail.

But this isn't the reason for native/distribute-native failing to install(ImportError: No module named site). Can you check if site.py has been installed in /usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native?

I suspect that some path is not setup correctly for lib64 library paths used by suse and co.

[PGNd]

>  Can you check if site.py has been installed in /usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native?

In my build, it has:

Code:

    find  /usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native | grep /site.py$
        /usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native/lib/python2.7/site.py

> You use a non-standard toolchain armv7-rpi2-linux-gnueabihf, so you didn't follow the docs again.

Are you suggesting that kodi's only x-buildable with Kodi's bundled compiler toolchain? Crosstool-ng generated toolchains, which mine is (https://www.diffchecker.com/REl3jl0b), are well documented and widely used.

The docs SAY

Code:

    sudo apt-get install git autoconf curl g++ zlib1g-dev libcurl4-openssl-dev gawk gperf libtool autopoint swig default-jre

does that mean ONLY apt-retrieved packages are to be used? Is kodi suddenly to be considered debain-variant only?

Those are hardly "standard" ...

If the kodi toolchain is NON-standard, and needs specific customizations beyond a standard crosstool-ng x-chain, where are those required customizations documented?

It'd be useful to know the specific 'what' behind your claims re: toolchains.  If only to not have this procedure be a black box.

Putting the doc bikeshedding to rest; "Following the docs" @ https://github.com/xbmc/xbmc/blob/master...aspberrypi

Code:

    cd /usr/local/src/kodi-xbuild/RPi2
    RPI_DEV=$PWD
    git clone https://github.com/raspberrypi/tools
    git clone https://github.com/raspberrypi/firmware
    git clone https://github.com/xbmc/xbmc

    mkdir kodi-bcm
    cd xbmc/tools/depends
    ./bootstrap
    ./configure --host=arm-linux-gnueabihf \
    --prefix=$RPI_DEV/kodi-bcm \
    --with-toolchain=$RPI_DEV/tools/arm-bcm2708/arm-rpi-4.9.3-linux-gnueabihf \
    --with-firmware=$RPI_DEV/firmware \
    --with-platform=raspberry-pi2 \
    --build=i686-linux

again

Code:

    make

FAILs in familiar fashion

Code:

    ...
    make -C distribute-native
    make[2]: Entering directory '/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/distribute-native'
    cd /usr/local/src/kodi-xbuild/RPi2/kodi-bcm/xbmc-tarballs; /usr/local/bin/curl -Ls --create-dirs -f -O http://mirrors.kodi.tv/build-deps/sources/distribute-0.6.21.tar.gz
    cd /usr/local/src/kodi-xbuild/RPi2/kodi-bcm/xbmc-tarballs; chmod +x distribute-0.6.21.tar.gz
    rm -rf i686-linux-native/*; mkdir -p i686-linux-native
    cd i686-linux-native; /bin/tar --strip-components=1 -xf /usr/local/src/kodi-xbuild/RPi2/kodi-bcm/xbmc-tarballs/distribute-0.6.21.tar.gz
    cd i686-linux-native; /usr/local/src/kodi-xbuild/RPi2/kodi-bcm/i686-linux-gnu-native/bin/python setup.py install --prefix=/usr/local/src/kodi-xbuild/RPi2/kodi-bcm/i686-linux-gnu-native
    Could not find platform dependent libraries <exec_prefix>
    Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]
    Traceback (most recent call last):
      File "setup.py", line 37, in <module>
        exec(open(init_path).read(), d)
      File "<string>", line 8, in <module>
      File "/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/distribute-native/i686-linux-native/setuptools/__init__.py", line 2, in <module>
        from setuptools.extension import Extension, Library
      File "/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/distribute-native/i686-linux-native/setuptools/extension.py", line 2, in <module>
        from setuptools.dist import _get_unpatched
      File "/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/distribute-native/i686-linux-native/setuptools/dist.py", line 6, in <module>
        from setuptools.command.install import install
      File "/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/distribute-native/i686-linux-native/setuptools/command/__init__.py", line 8, in <module>
        from setuptools.command import install_scripts
      File "/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/distribute-native/i686-linux-native/setuptools/command/install_scripts.py", line 3, in <module>
        from pkg_resources import Distribution, PathMetadata, ensure_directory
      File "/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/distribute-native/i686-linux-native/pkg_resources.py", line 16, in <module>
        import sys, os, zipimport, time, re, imp, types
    ImportError: No module named time
    Makefile:22: recipe for target '.installed-i686-linux-native' failed
    make[2]: *** [.installed-i686-linux-native] Error 1
    make[2]: Leaving directory '/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native/distribute-native'
    Makefile:52: recipe for target 'distribute-native' failed
    make[1]: *** [distribute-native] Error 2
    make[1]: Leaving directory '/usr/local/src/kodi-xbuild/RPi2/xbmc/tools/depends/native'
    Makefile:8: recipe for target 'native/.installed-i686-linux-native' failed
    make: *** [native/.installed-i686-linux-native] Error 2

and for this build,

>  Can you check if site.py has been installed in /usr/local/src/kodi-xbuild/RPi2/build/x86_64-linux-gnu-native?

Code:

    find /usr/local/src/kodi-xbuild/RPi2/kodi-bcm/i686-linux-gnu-native | grep /site.py$
        /usr/local/src/kodi-xbuild/RPi2/kodi-bcm/i686-linux-gnu-native/lib/python2.7/site.py