Page MenuHomePhabricator

fix gitian-win build
ClosedPublic

Authored by PiRK on Nov 27 2021, 09:47.

Details

Reviewers
Fabien
Group Reviewers
Restricted Project
Commits
rABC773715dcbd1b: fix gitian-win build
Summary

Move the quotes to the correct block of code. In D10584, I didn't put them in the same place as they were put in the original commit https://github.com/bitcoin/bitcoin/pull/19077/commits/e87df8258090138d5c22ac46b8602b618620e8a1

Without the quotes, the build fails when building sqlite:

Building sqlite...
make[1]: Entering directory '/home/debian/build/bitcoin/depends/work/build/x86_64-w64-mingw32/sqlite/3320100-143af3b03b1'
make[1]: warning: -j13 forced in submake: resetting jobserver mode.
/bin/bash ./libtool  --tag=CC   --mode=compile x86_64-w64-mingw32-gcc -DPACKAGE_NAME=\"sqlite\" -DPACKAGE_TARNAME=\"sqlite\" -DPACKAGE_VERSION=\"3.32.1\" -DPACKAGE_STRING=\"sqlite\ 3.32.1\" -DPACKAGE_BUGREPORT=\"http://www.sqlite.org\" -DPACKAGE_URL=\"\" -DPACKAGE=\"sqlite\" -DVERSION=\"3.32.1\" -D_FILE_OFFSET_BITS=64 -DSTDC_HEADERS=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_MEMORY_H=1 -DHAVE_STRINGS_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_UNISTD_H=1 -DLT_OBJDIR=\".libs/\" -DHAVE_USLEEP=1 -DHAVE_DECL_STRERROR_R=0 -I.   -I/home/debian/build/bitcoin/depends/x86_64-w64-mingw32/include     -D_REENTRANT=1 -DSQLITE_THREADSAFE=1 -DSQLITE_OMIT_LOAD_EXTENSION=1 -DSQLITE_ENABLE_FTS4 -DSQLITE_ENABLE_FTS5 -DSQLITE_ENABLE_JSON1 -DSQLITE_ENABLE_RTREE -DSQLITE_ENABLE_GEOPOLY  -pipe -O2     -MT sqlite3.lo -MD -MP -MF .deps/sqlite3.Tpo -c -o sqlite3.lo sqlite3.c
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
libtool: compile:  x86_64-w64-mingw32-gcc -DPACKAGE_NAME=\"sqlite\" -DPACKAGE_TARNAME=\"sqlite\" -DPACKAGE_VERSION=\"3.32.1\" "-DPACKAGE_STRING=\"sqlite 3.32.1\"" -DPACKAGE_BUGREPORT=\"http://www.sqlite.org\" -DPACKAGE_URL=\"\" -DPACKAGE=\"sqlite\" -DVERSION=\"3.32.1\" -D_FILE_OFFSET_BITS=64 -DSTDC_HEADERS=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_MEMORY_H=1 -DHAVE_STRINGS_H=1 -DHAVE_INTTYPES_H=1 -DHAVE_STDINT_H=1 -DHAVE_UNISTD_H=1 -DLT_OBJDIR=\".libs/\" -DHAVE_USLEEP=1 -DHAVE_DECL_STRERROR_R=0 -I. -I/home/debian/build/bitcoin/depends/x86_64-w64-mingw32/include -D_REENTRANT=1 -DSQLITE_THREADSAFE=1 -DSQLITE_OMIT_LOAD_EXTENSION=1 -DSQLITE_ENABLE_FTS4 -DSQLITE_ENABLE_FTS5 -DSQLITE_ENABLE_JSON1 -DSQLITE_ENABLE_RTREE -DSQLITE_ENABLE_GEOPOLY -pipe -O2 -MT sqlite3.lo -MD -MP -MF .deps/sqlite3.Tpo -c sqlite3.c -o sqlite3.o
./libtool: line 1760: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
x86_64-w64-mingw32-gcc-posix: error: 3.32.1": No such file or directory
make[1]: Leaving directory '/home/debian/build/bitcoin/depends/work/build/x86_64-w64-mingw32/sqlite/3320100-143af3b03b1'
make[1]: *** [Makefile:533: sqlite3.lo] Error 1
make: Leaving directory '/home/debian/build/bitcoin/depends'
make: *** [funcs.mk:253: /home/debian/build/bitcoin/depends/work/build/x86_64-w64-mingw32/sqlite/3320100-143af3b03b1/./.stamp_built] Error 2

Note that there is a missing backport (core#16667) that explains the difference in gitian-win.yml. I will sort this in a different commit, after the build is unbroken.

Test Plan

@bot gitian-win gitian-linux

Diff Detail

Repository
rABC Bitcoin ABC
Branch
fix_win_build
Lint
Lint Passed
Unit
No Test Coverage
Build Status
Buildable 17429
Build 34686: Build Diff
Build 34685: arc lint + arc unit

Event Timeline

Tail of the build log:

[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31091 -> phabricator/diff/31091
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31092 -> phabricator/diff/31092
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31094 -> phabricator/diff/31094
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31100 -> phabricator/diff/31100
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31103 -> phabricator/diff/31103
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31106 -> phabricator/diff/31106
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31115 -> phabricator/diff/31115
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31116 -> phabricator/diff/31116
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31118 -> phabricator/diff/31118
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31119 -> phabricator/diff/31119
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31120 -> phabricator/diff/31120
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31121 -> phabricator/diff/31121
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31122 -> phabricator/diff/31122
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31123 -> phabricator/diff/31123
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/31124 -> phabricator/diff/31124
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/8992  -> phabricator/diff/8992
[10:39:06] :	 [Step 1/1]  * [new tag]             phabricator/diff/8993  -> phabricator/diff/8993
[10:39:06] :	 [Step 1/1]  * [new branch]          master                 -> master
[10:39:06] :	 [Step 1/1] --- Building for buster amd64 ---
[10:39:06] :	 [Step 1/1] Stopping target if it is up
[10:39:06] :	 [Step 1/1] Error response from daemon: No such container: gitian-target
[10:39:06] :	 [Step 1/1] Error: No such container: gitian-target
[10:39:06] :	 [Step 1/1] Making a new image copy
[10:39:06] :	 [Step 1/1] Starting target
[10:39:06] :	 [Step 1/1] Checking if target is up.
[10:39:06] :	 [Step 1/1] Preparing build environment
[10:39:06] :	 [Step 1/1] Adding repositories to the sources list (log in var/install.log)
[10:39:06] :	 [Step 1/1] Updating apt-get repository (log in var/install.log)
[10:39:06] :	 [Step 1/1] Installing additional packages (log in var/install.log)
[10:39:06] :	 [Step 1/1] Installing additional packages from repository buster-backports (log in var/install.log)
[10:39:06] :	 [Step 1/1] Upgrading system, may take a while (log in var/install.log)
[10:39:06] :	 [Step 1/1] Creating package manifest
[10:39:06] :	 [Step 1/1] Creating build script (var/build-script)
[10:39:06] :	 [Step 1/1] Running build script (log in var/build.log)
[10:39:06] :	 [Step 1/1] ./bin/gbuild:23:in `system!': failed to run on-target setarch x86_64 bash -x < var/build-script > var/build.log 2>&1 (RuntimeError)
[10:39:06] :	 [Step 1/1] 	from ./bin/gbuild:185:in `build_one_configuration'
[10:39:06] :	 [Step 1/1] 	from ./bin/gbuild:339:in `block (2 levels) in <main>'
[10:39:06] :	 [Step 1/1] 	from ./bin/gbuild:334:in `each'
[10:39:06] :	 [Step 1/1] 	from ./bin/gbuild:334:in `block in <main>'
[10:39:06] :	 [Step 1/1] 	from ./bin/gbuild:332:in `each'
[10:39:06] :	 [Step 1/1] 	from ./bin/gbuild:332:in `<main>'
[10:39:06] :	 [Step 1/1] Build gitian-win failed with exit code 1
[10:39:06]W:	 [Step 1/1] Process exited with code 1
[10:39:06]E:	 [Step 1/1] Process exited with code 1 (Step: Command Line)
[10:39:06] :	 [Step 1/1] Waiting for 1 service processes to complete
[10:39:07]E:	 [Step 1/1] Ant JUnit report watcher
[10:39:07]E:		 [Ant JUnit report watcher] No reports found for paths:
[10:39:07]E:		 [Ant JUnit report watcher] /home/teamcity/buildAgent/work/jailed-build/results/artifacts/junit/*.xml
[10:39:07]E:	 [Step 1/1] Step Command Line failed
[10:39:07]E: Ant JUnit report watcher
[10:39:07]E:	 [Ant JUnit report watcher] No reports found for paths:
[10:39:07]E:	 [Ant JUnit report watcher] +:results/test_bitcoin.xml
[10:39:07]E:	 [Ant JUnit report watcher] +:results/**/junit_results*.xml
[10:39:07] : Publishing internal artifacts (4s)
[10:39:12] :	 [Publishing internal artifacts] Publishing 1 file using [WebPublisher]
[10:39:12] :	 [Publishing internal artifacts] Publishing 1 file using [ArtifactsCachePublisher]
[10:39:07]W: Publishing artifacts (4s)
[10:39:07] :	 [Publishing artifacts] Collecting files to publish: [+:results/**/junit_results*.xml]
[10:39:07]W:	 [Publishing artifacts] Artifacts path 'results/**/junit_results*.xml' not found
[10:39:12] : Build finished

Tail of the build log:

[337/511] Building CXX object src/CMakeFiles/util.dir/util/settings.cpp.o
[338/511] Building CXX object src/CMakeFiles/bitcoinconsensus.dir/primitives/transaction.cpp.o
[339/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/str.cpp.o
[340/511] Building CXX object src/CMakeFiles/bitcoinconsensus.dir/consensus/tx_check.cpp.o
[341/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/logging.cpp.o
[342/511] Building CXX object src/CMakeFiles/bitcoin-tx.dir/bitcoin-tx.cpp.o
[343/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/context.cpp.o
[344/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/blockfilter.cpp.o
[345/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/transaction_utils.cpp.o
[346/511] Building CXX object src/CMakeFiles/util.dir/util/time.cpp.o
[347/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/coincontrol.cpp.o
[348/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/net.cpp.o
[349/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/mining.cpp.o
[350/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/db.cpp.o
[351/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/crypter.cpp.o
[352/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/coinselection.cpp.o
[353/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/wallet.cpp.o
[354/511] Building CXX object src/CMakeFiles/util.dir/util/system.cpp.o
[355/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/bdb.cpp.o
[356/511] Linking CXX static library src/libutil.a
[357/511] Linking CXX static library src/librpcclient.a
[358/511] Linking CXX static library src/libbitcoinconsensus.a
[359/511] Linking CXX static library src/libscript.a
[360/511] Linking CXX static library src/libcommon.a
[361/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o
FAILED: src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o 
/usr/bin/ccache /usr/bin/clang++ -DBOOST_AC_USE_STD_ATOMIC -DBOOST_SP_USE_STD_ATOMIC -DBUILD_BITCOIN_INTERNAL -DENABLE_AVX2 -DENABLE_SHANI -DENABLE_SSE41 -DHAVE_BUILD_INFO -DHAVE_CONFIG_H -DHAVE_CONSENSUS_LIB -I../../src/. -Isrc -I../../src/univalue/include -Isrc/crypto/.. -I../../src/secp256k1/include -isystem /usr/include/jemalloc -Werror -g -O2 -fPIC -fvisibility=hidden -fstack-protector-all -Wstack-protector -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wextra -Wformat -Wgnu -Wvla -Wcast-align -Wunused-parameter -Wmissing-braces -Wthread-safety -Wrange-loop-analysis -Wredundant-decls -Wunreachable-code-loop-increment -Wsign-compare -Wconditional-uninitialized -Wformat-security -Wredundant-move -Woverloaded-virtual -Wshadow -Wshadow-field -Wno-unused-parameter -Wno-implicit-fallthrough -pthread -std=gnu++17 -MD -MT src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o -MF src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o.d -o src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o -c ../../src/wallet/sqlite.cpp
In file included from ../../src/wallet/sqlite.cpp:5:
../../src/./wallet/sqlite.h:10:10: fatal error: 'sqlite3.h' file not found
#include <sqlite3.h>
         ^~~~~~~~~~~
1 error generated.
[362/511] Linking CXX shared library src/libbitcoinconsensus.so.0.24.7
[363/511] Creating library symlink src/libbitcoinconsensus.so.0 src/libbitcoinconsensus.so
[364/511] Linking CXX executable src/bitcoin-cli
[365/511] Linking CXX executable src/bitcoin-tx
[366/511] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqabstractnotifier.cpp.o
[367/511] Building CXX object src/wallet/CMakeFiles/wallet-tool.dir/wallettool.cpp.o
[368/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/setup_common.cpp.o
[369/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/fees.cpp.o
[370/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/load.cpp.o
[371/511] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqnotificationinterface.cpp.o
[372/511] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqutil.cpp.o
[373/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/walletutil.cpp.o
[374/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/dns.cpp.o
[375/511] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqpublishnotifier.cpp.o
[376/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/salvage.cpp.o
[377/511] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqrpc.cpp.o
[378/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/db.cpp.o
[379/511] Linking CXX static library src/zmq/libzmq.a
[380/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/__/interfaces/wallet.cpp.o
[381/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/bitcoin.cpp.o
[382/511] Building CXX object src/seeder/CMakeFiles/bitcoin-seeder.dir/main.cpp.o
[383/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/scriptpubkeyman.cpp.o
[384/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/walletdb.cpp.o
[385/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/rpcdump.cpp.o
[386/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/wallet.cpp.o
[387/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/rpcwallet.cpp.o
ninja: build stopped: cannot make progress due to previous errors.
Build build-clang failed with exit code 1

Tail of the build log:

popd

RESULTS_DIR=$(pwd)/results

echo "Building base image for: ${HASH}..."

# Note: ERROR_PREFIX needs to be broken up here because this script gets copied into the build log.
# Not doing this results in all errors being treated as infra failures.
ERROR_PREFIX=$(echo "[Infrastructure" "Error]")
export ERROR_PREFIX

~/infra/ci-wrappers/build-abc-base-image.sh -c ./bitcoin-abc \
  --cachetagname abc-base-image-"${CACHE_HASH}" \
  -t abc-base-image-"${HASH}" debian:buster

(cat <<EOF
results() {
  set +e
  shopt -s dotglob nullglob
  mv /work/abc-ci-builds/"gitian-win"/* /results
  chown -R ${ME} /work
  chown -R ${ME} /results
  chown -R ${ME} /root/.ccache
}
trap "results" EXIT
export TEAMCITY_VERSION="2019.2.4 (build 72059)"
export BASE_CACHE="/root/abc-depends/cache"
export SDK_ARCHIVE_DIR="/root/abc-depends/osx-sdk"
export SOURCES_PATH="/root/abc-depends/sources"
export SDK_DL_REMOTE="http://ci.fabien.cash"
mkdir -p "/root/abc-depends/cache" "/root/abc-depends/osx-sdk" "/root/abc-depends/sources"
./contrib/teamcity/build-configurations.py "gitian-win"
EOF
) > run-command.sh
chmod +x run-command.sh

~/infra/docker/docker-run.sh \
  -a "-v /home/teamcity/.ccache:/root/.ccache -v /home/teamcity/.abc-depends:/root/abc-depends -v "${RESULTS_DIR}":/results" \
  -c run-command.sh /work/run-command.sh abc-base-image-"${HASH}" ./run-command.sh

[08:41:36] :	 [Step 1/1] Starting: /home/teamcity/buildAgent/temp/agentTmp/custom_script7677794248966178841
[08:41:36] :	 [Step 1/1] in directory: /home/teamcity/buildAgent/work/jailed-build
[08:41:36]W:	 [Step 1/1] Traceback (most recent call last):
[08:41:36]W:	 [Step 1/1]   File "./contrib/teamcity/build-configurations.py", line 8, in <module>
[08:41:36]W:	 [Step 1/1]     from deepmerge import always_merger
[08:41:36]W:	 [Step 1/1] ModuleNotFoundError: No module named 'deepmerge'
[08:41:36]W:	 [Step 1/1] Process exited with code 1
[08:41:36]E:	 [Step 1/1] Process exited with code 1 (Step: Command Line)
[08:41:36]E:	 [Step 1/1] Step Command Line failed
[08:41:37]E: Ant JUnit report watcher
[08:41:37]E:	 [Ant JUnit report watcher] No reports found for paths:
[08:41:37]E:	 [Ant JUnit report watcher] +:results/test_bitcoin.xml
[08:41:37]E:	 [Ant JUnit report watcher] +:results/**/junit_results*.xml
[08:41:37] : Publishing internal artifacts (4s)
[08:41:41] :	 [Publishing internal artifacts] Publishing 1 file using [WebPublisher]
[08:41:41] :	 [Publishing internal artifacts] Publishing 1 file using [ArtifactsCachePublisher]
[08:41:37]W: Publishing artifacts (4s)
[08:41:37] :	 [Publishing artifacts] Collecting files to publish: [+:results/**/junit_results*.xml]
[08:41:37]W:	 [Publishing artifacts] Artifacts path 'results/**/junit_results*.xml' not found
[08:41:41] : Build finished

Tail of the build log:

[344/511] Linking C executable src/secp256k1/ecmult-bench
[345/511] Linking C executable src/secp256k1/internal-bench
[346/511] Building CXX object src/CMakeFiles/script.dir/script/signingprovider.cpp.o
[347/511] Building CXX object src/CMakeFiles/script.dir/script/descriptor.cpp.o
[348/511] Linking C executable src/secp256k1/sign-bench
[349/511] Linking C executable src/secp256k1/verify-bench
[350/511] Linking C executable src/secp256k1/recover-bench
[351/511] Installing component secp256k1
-- Install configuration: "Debug"
-- Install component: "secp256k1"
-- Installing: /results/artifacts/lib/libsecp256k1.a
-- Installing: /results/artifacts/include/secp256k1.h
-- Installing: /results/artifacts/include/secp256k1_preallocated.h
-- Installing: /results/artifacts/include/secp256k1_recovery.h
-- Installing: /results/artifacts/include/secp256k1_schnorr.h
[352/511] Building CXX object src/CMakeFiles/bitcoin-wallet.dir/bitcoin-wallet.cpp.o
[353/511] Linking CXX static library src/libscript.a
[354/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/context.cpp.o
[355/511] Linking CXX static library src/libcommon.a
[356/511] Linking CXX shared library src/libbitcoinconsensus.so.0.24.7
[357/511] Creating library symlink src/libbitcoinconsensus.so.0 src/libbitcoinconsensus.so
[358/511] Linking CXX executable src/bitcoin-cli
[359/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/blockfilter.cpp.o
[360/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/transaction_utils.cpp.o
[361/511] Building CXX object src/CMakeFiles/bitcoin-tx.dir/bitcoin-tx.cpp.o
[362/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/net.cpp.o
[363/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/mining.cpp.o
[364/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/coinselection.cpp.o
[365/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/db.cpp.o
[366/511] Linking CXX executable src/bitcoin-tx
[367/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/bdb.cpp.o
[368/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/coincontrol.cpp.o
[369/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o
FAILED: src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o 
/usr/bin/ccache /usr/bin/c++ -DABORT_ON_FAILED_ASSUME -DBOOST_AC_USE_STD_ATOMIC -DBOOST_SP_USE_STD_ATOMIC -DBUILD_BITCOIN_INTERNAL -DDEBUG -DDEBUG_LOCKORDER -DENABLE_AVX2 -DENABLE_SHANI -DENABLE_SSE41 -DHAVE_BUILD_INFO -DHAVE_CONFIG_H -DHAVE_CONSENSUS_LIB -I../../src/. -Isrc -I../../src/univalue/include -Isrc/crypto/.. -I../../src/secp256k1/include -isystem /usr/include/jemalloc -Werror -O0 -fPIC -fvisibility=hidden -g3 -ftrapv -fstack-reuse=none -fstack-protector-all -Wstack-protector -U_FORTIFY_SOURCE -Wall -Wextra -Wformat -Wvla -Wcast-align -Wunused-parameter -Wmissing-braces -Wredundant-decls -Wsign-compare -Wduplicated-branches -Wduplicated-cond -Wlogical-op -Wformat-security -Woverloaded-virtual -Wno-unused-parameter -Wno-implicit-fallthrough -pthread -std=gnu++17 -MD -MT src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o -MF src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o.d -o src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o -c ../../src/wallet/sqlite.cpp
In file included from ../../src/wallet/sqlite.cpp:5:
../../src/./wallet/sqlite.h:10:10: fatal error: sqlite3.h: No such file or directory
 #include <sqlite3.h>
          ^~~~~~~~~~~
compilation terminated.
[370/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/crypter.cpp.o
[371/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/wallet.cpp.o
[372/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/setup_common.cpp.o
[373/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/dns.cpp.o
[374/511] Building CXX object src/wallet/CMakeFiles/wallet-tool.dir/wallettool.cpp.o
[375/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/db.cpp.o
[376/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/walletutil.cpp.o
[377/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/fees.cpp.o
[378/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/load.cpp.o
[379/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/bitcoin.cpp.o
[380/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/__/interfaces/wallet.cpp.o
[381/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/salvage.cpp.o
[382/511] Building CXX object src/seeder/CMakeFiles/bitcoin-seeder.dir/main.cpp.o
[383/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/rpcdump.cpp.o
[384/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/scriptpubkeyman.cpp.o
[385/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/walletdb.cpp.o
[386/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/rpcwallet.cpp.o
[387/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/wallet.cpp.o
ninja: build stopped: cannot make progress due to previous errors.
Build build-debug failed with exit code 1

Tail of the build log:

[344/511] Linking C executable src/secp256k1/ecmult-bench
[345/511] Linking C executable src/secp256k1/internal-bench
[346/511] Linking C executable src/secp256k1/sign-bench
[347/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/logging.cpp.o
[348/511] Linking C executable src/secp256k1/verify-bench
[349/511] Linking C executable src/secp256k1/recover-bench
[350/511] Installing component secp256k1
-- Install configuration: "RelWithDebInfo"
-- Install component: "secp256k1"
-- Installing: /results/artifacts/lib/libsecp256k1.a
-- Installing: /results/artifacts/include/secp256k1.h
-- Installing: /results/artifacts/include/secp256k1_preallocated.h
-- Installing: /results/artifacts/include/secp256k1_recovery.h
-- Installing: /results/artifacts/include/secp256k1_schnorr.h
[351/511] Building CXX object src/CMakeFiles/script.dir/script/descriptor.cpp.o
[352/511] Linking CXX static library src/libscript.a
[353/511] Linking CXX static library src/libcommon.a
[354/511] Linking CXX shared library src/libbitcoinconsensus.so.0.24.7
[355/511] Creating library symlink src/libbitcoinconsensus.so.0 src/libbitcoinconsensus.so
[356/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/context.cpp.o
[357/511] Building CXX object src/CMakeFiles/bitcoin-cli.dir/bitcoin-cli.cpp.o
[358/511] Linking CXX executable src/bitcoin-cli
[359/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/blockfilter.cpp.o
[360/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/transaction_utils.cpp.o
[361/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/net.cpp.o
[362/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/mining.cpp.o
[363/511] Building CXX object src/CMakeFiles/bitcoin-tx.dir/bitcoin-tx.cpp.o
[364/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/db.cpp.o
[365/511] Linking CXX executable src/bitcoin-tx
[366/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/coincontrol.cpp.o
[367/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o
FAILED: src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o 
/usr/bin/ccache /usr/bin/c++ -DBOOST_AC_USE_STD_ATOMIC -DBOOST_SP_USE_STD_ATOMIC -DBUILD_BITCOIN_INTERNAL -DENABLE_AVX2 -DENABLE_SHANI -DENABLE_SSE41 -DHAVE_BUILD_INFO -DHAVE_CONFIG_H -DHAVE_CONSENSUS_LIB -I../../src/. -Isrc -I../../src/univalue/include -Isrc/crypto/.. -I../../src/secp256k1/include -isystem /usr/include/jemalloc -Werror -g -O2 -fPIC -fvisibility=hidden -fstack-reuse=none -fstack-protector-all -Wstack-protector -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wextra -Wformat -Wvla -Wcast-align -Wunused-parameter -Wmissing-braces -Wredundant-decls -Wsign-compare -Wduplicated-branches -Wduplicated-cond -Wlogical-op -Wformat-security -Woverloaded-virtual -Wno-unused-parameter -Wno-implicit-fallthrough -pthread -std=gnu++17 -MD -MT src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o -MF src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o.d -o src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o -c ../../src/wallet/sqlite.cpp
In file included from ../../src/wallet/sqlite.cpp:5:
../../src/./wallet/sqlite.h:10:10: fatal error: sqlite3.h: No such file or directory
 #include <sqlite3.h>
          ^~~~~~~~~~~
compilation terminated.
[368/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/crypter.cpp.o
[369/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/wallet.cpp.o
[370/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/coinselection.cpp.o
[371/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/bdb.cpp.o
[372/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/db.cpp.o
[373/511] Building CXX object src/test/CMakeFiles/testutil.dir/util/setup_common.cpp.o
[374/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/fees.cpp.o
[375/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/dns.cpp.o
[376/511] Building CXX object src/wallet/CMakeFiles/wallet-tool.dir/wallettool.cpp.o
[377/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/load.cpp.o
[378/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/walletutil.cpp.o
[379/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/salvage.cpp.o
[380/511] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/bitcoin.cpp.o
[381/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/__/interfaces/wallet.cpp.o
[382/511] Building CXX object src/seeder/CMakeFiles/bitcoin-seeder.dir/main.cpp.o
[383/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/scriptpubkeyman.cpp.o
[384/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/walletdb.cpp.o
[385/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/rpcdump.cpp.o
[386/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/wallet.cpp.o
[387/511] Building CXX object src/wallet/CMakeFiles/wallet.dir/rpcwallet.cpp.o
ninja: build stopped: cannot make progress due to previous errors.
Build build-diff failed with exit code 1

Tail of the build log:

[339/509] Building CXX object src/test/CMakeFiles/testutil.dir/util/str.cpp.o
[340/509] Building CXX object src/CMakeFiles/bitcoin-tx.dir/bitcoin-tx.cpp.o
[341/509] Building CXX object src/test/CMakeFiles/testutil.dir/util/logging.cpp.o
[342/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/context.cpp.o
[343/509] Building CXX object src/CMakeFiles/util.dir/util/time.cpp.o
[344/509] Building CXX object src/test/CMakeFiles/testutil.dir/util/blockfilter.cpp.o
[345/509] Building CXX object src/test/CMakeFiles/testutil.dir/util/transaction_utils.cpp.o
[346/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/coincontrol.cpp.o
[347/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/coinselection.cpp.o
[348/509] Building CXX object src/test/CMakeFiles/testutil.dir/util/net.cpp.o
[349/509] Building CXX object src/CMakeFiles/util.dir/util/system.cpp.o
[350/509] Linking CXX static library src/libutil.a
[351/509] Linking CXX static library src/librpcclient.a
[352/509] Linking CXX static library src/libbitcoinconsensus.a
[353/509] Linking CXX static library src/libscript.a
[354/509] Linking CXX static library src/libcommon.a
[355/509] Building CXX object src/test/CMakeFiles/testutil.dir/util/mining.cpp.o
[356/509] Linking CXX shared library src/libbitcoinconsensus.so.0.24.7
[357/509] Creating library symlink src/libbitcoinconsensus.so.0 src/libbitcoinconsensus.so
[358/509] Linking CXX executable src/bitcoin-cli
[359/509] Linking CXX executable src/bitcoin-tx
[360/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/bdb.cpp.o
[361/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/db.cpp.o
[362/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/crypter.cpp.o
[363/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o
FAILED: src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o 
/usr/bin/cmake -E __run_co_compile --launcher=/usr/bin/ccache --tidy="/usr/bin/clang-tidy-10;-warnings-as-errors=*;--extra-arg-before=--driver-mode=g++" --source=../../src/wallet/sqlite.cpp -- /usr/bin/clang++ -DBOOST_AC_USE_STD_ATOMIC -DBOOST_SP_USE_STD_ATOMIC -DBUILD_BITCOIN_INTERNAL -DENABLE_AVX2 -DENABLE_SHANI -DENABLE_SSE41 -DHAVE_BUILD_INFO -DHAVE_CONFIG_H -DHAVE_CONSENSUS_LIB -I../../src/. -Isrc -I../../src/univalue/include -Isrc/crypto/.. -I../../src/secp256k1/include -isystem /usr/include/jemalloc -g -O2 -fPIC -fvisibility=hidden -fstack-protector-all -Wstack-protector -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wextra -Wformat -Wgnu -Wvla -Wcast-align -Wunused-parameter -Wmissing-braces -Wthread-safety -Wrange-loop-analysis -Wredundant-decls -Wunreachable-code-loop-increment -Wsign-compare -Wconditional-uninitialized -Wformat-security -Wredundant-move -Woverloaded-virtual -Wshadow -Wshadow-field -Wno-unused-parameter -Wno-implicit-fallthrough -pthread -std=gnu++17 -MD -MT src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o -MF src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o.d -o src/wallet/CMakeFiles/wallet.dir/sqlite.cpp.o -c ../../src/wallet/sqlite.cpp
../../src/./wallet/sqlite.h:10:10: error: 'sqlite3.h' file not found [clang-diagnostic-error]
#include <sqlite3.h>
         ^
1870 warnings and 1 error generated.
Error while processing /work/abc-ci-builds/build-clang-tidy/../../src/wallet/sqlite.cpp.
Suppressed 1870 warnings (1870 in non-user code).
Use -header-filter=.* to display errors from all non-system headers. Use -system-headers to display errors from system headers as well.
Found compiler error(s).
[364/509] Building CXX object src/test/CMakeFiles/testutil.dir/util/wallet.cpp.o
[365/509] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqabstractnotifier.cpp.o
[366/509] Building CXX object src/wallet/CMakeFiles/wallet-tool.dir/wallettool.cpp.o
[367/509] Building CXX object src/test/CMakeFiles/testutil.dir/util/setup_common.cpp.o
[368/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/fees.cpp.o
[369/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/walletutil.cpp.o
[370/509] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqnotificationinterface.cpp.o
[371/509] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqutil.cpp.o
[372/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/load.cpp.o
[373/509] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/dns.cpp.o
[374/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/__/interfaces/wallet.cpp.o
[375/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/salvage.cpp.o
[376/509] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqpublishnotifier.cpp.o
[377/509] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/db.cpp.o
[378/509] Building CXX object src/zmq/CMakeFiles/zmq.dir/zmqrpc.cpp.o
[379/509] Linking CXX static library src/zmq/libzmq.a
[380/509] Building CXX object src/seeder/CMakeFiles/bitcoin-seeder.dir/main.cpp.o
[381/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/scriptpubkeyman.cpp.o
[382/509] Building CXX object src/seeder/CMakeFiles/seeder-base.dir/bitcoin.cpp.o
[383/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/walletdb.cpp.o
[384/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/rpcdump.cpp.o
[385/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/wallet.cpp.o
[386/509] Building CXX object src/wallet/CMakeFiles/wallet.dir/rpcwallet.cpp.o
ninja: build stopped: cannot make progress due to previous errors.
Build build-clang-tidy failed with exit code 1

Tail of the build log:

popd

RESULTS_DIR=$(pwd)/results

echo "Building base image for: ${HASH}..."

# Note: ERROR_PREFIX needs to be broken up here because this script gets copied into the build log.
# Not doing this results in all errors being treated as infra failures.
ERROR_PREFIX=$(echo "[Infrastructure" "Error]")
export ERROR_PREFIX

~/infra/ci-wrappers/build-abc-base-image.sh -c ./bitcoin-abc \
  --cachetagname abc-base-image-"${CACHE_HASH}" \
  -t abc-base-image-"${HASH}" debian:buster

(cat <<EOF
results() {
  set +e
  shopt -s dotglob nullglob
  mv /work/abc-ci-builds/"gitian-win"/* /results
  chown -R ${ME} /work
  chown -R ${ME} /results
  chown -R ${ME} /root/.ccache
}
trap "results" EXIT
export TEAMCITY_VERSION="2019.2.4 (build 72059)"
export BASE_CACHE="/root/abc-depends/cache"
export SDK_ARCHIVE_DIR="/root/abc-depends/osx-sdk"
export SOURCES_PATH="/root/abc-depends/sources"
export SDK_DL_REMOTE="http://ci.fabien.cash"
mkdir -p "/root/abc-depends/cache" "/root/abc-depends/osx-sdk" "/root/abc-depends/sources"
./contrib/teamcity/build-configurations.py "gitian-win"
EOF
) > run-command.sh
chmod +x run-command.sh

~/infra/docker/docker-run.sh \
  -a "-v /home/teamcity/.ccache:/root/.ccache -v /home/teamcity/.abc-depends:/root/abc-depends -v "${RESULTS_DIR}":/results" \
  -c run-command.sh /work/run-command.sh abc-base-image-"${HASH}" ./run-command.sh

[09:47:48] :	 [Step 1/1] Starting: /home/teamcity/buildAgent/temp/agentTmp/custom_script855819379078920691
[09:47:48] :	 [Step 1/1] in directory: /home/teamcity/buildAgent/work/jailed-build
[09:47:49]W:	 [Step 1/1] Traceback (most recent call last):
[09:47:49]W:	 [Step 1/1]   File "./contrib/teamcity/build-configurations.py", line 8, in <module>
[09:47:49]W:	 [Step 1/1]     from deepmerge import always_merger
[09:47:49]W:	 [Step 1/1] ModuleNotFoundError: No module named 'deepmerge'
[09:47:49]W:	 [Step 1/1] Process exited with code 1
[09:47:49]E:	 [Step 1/1] Process exited with code 1 (Step: Command Line)
[09:47:49]E:	 [Step 1/1] Step Command Line failed
[09:47:49]E: Ant JUnit report watcher
[09:47:49]E:	 [Ant JUnit report watcher] No reports found for paths:
[09:47:49]E:	 [Ant JUnit report watcher] +:results/test_bitcoin.xml
[09:47:49]E:	 [Ant JUnit report watcher] +:results/**/junit_results*.xml
[09:47:49] : Publishing internal artifacts (4s)
[09:47:54] :	 [Publishing internal artifacts] Publishing 1 file using [WebPublisher]
[09:47:54] :	 [Publishing internal artifacts] Publishing 1 file using [ArtifactsCachePublisher]
[09:47:49]W: Publishing artifacts (4s)
[09:47:49] :	 [Publishing artifacts] Collecting files to publish: [+:results/**/junit_results*.xml]
[09:47:49]W:	 [Publishing artifacts] Artifacts path 'results/**/junit_results*.xml' not found
[09:47:54] : Build finished
PiRK edited the summary of this revision. (Show Details)
PiRK edited the test plan for this revision. (Show Details)

move the quotes to correct code blocks

@bot gitian-win gitian-linux

Tail of the build log:

popd

RESULTS_DIR=$(pwd)/results

echo "Building base image for: ${HASH}..."

# Note: ERROR_PREFIX needs to be broken up here because this script gets copied into the build log.
# Not doing this results in all errors being treated as infra failures.
ERROR_PREFIX=$(echo "[Infrastructure" "Error]")
export ERROR_PREFIX

~/infra/ci-wrappers/build-abc-base-image.sh -c ./bitcoin-abc \
  --cachetagname abc-base-image-"${CACHE_HASH}" \
  -t abc-base-image-"${HASH}" debian:buster

(cat <<EOF
results() {
  set +e
  shopt -s dotglob nullglob
  mv /work/abc-ci-builds/"gitian-win"/* /results
  chown -R ${ME} /work
  chown -R ${ME} /results
  chown -R ${ME} /root/.ccache
}
trap "results" EXIT
export TEAMCITY_VERSION="2019.2.4 (build 72059)"
export BASE_CACHE="/root/abc-depends/cache"
export SDK_ARCHIVE_DIR="/root/abc-depends/osx-sdk"
export SOURCES_PATH="/root/abc-depends/sources"
export SDK_DL_REMOTE="http://ci.fabien.cash"
mkdir -p "/root/abc-depends/cache" "/root/abc-depends/osx-sdk" "/root/abc-depends/sources"
./contrib/teamcity/build-configurations.py "gitian-win"
EOF
) > run-command.sh
chmod +x run-command.sh

~/infra/docker/docker-run.sh \
  -a "-v /home/teamcity/.ccache:/root/.ccache -v /home/teamcity/.abc-depends:/root/abc-depends -v "${RESULTS_DIR}":/results" \
  -c run-command.sh /work/run-command.sh abc-base-image-"${HASH}" ./run-command.sh

[10:45:36] :	 [Step 1/1] Starting: /home/teamcity/buildAgent/temp/agentTmp/custom_script7021604733001159362
[10:45:36] :	 [Step 1/1] in directory: /home/teamcity/buildAgent/work/jailed-build
[10:45:36]W:	 [Step 1/1] Traceback (most recent call last):
[10:45:36]W:	 [Step 1/1]   File "./contrib/teamcity/build-configurations.py", line 8, in <module>
[10:45:36]W:	 [Step 1/1]     from deepmerge import always_merger
[10:45:36]W:	 [Step 1/1] ModuleNotFoundError: No module named 'deepmerge'
[10:45:36]W:	 [Step 1/1] Process exited with code 1
[10:45:36]E:	 [Step 1/1] Process exited with code 1 (Step: Command Line)
[10:45:36]E:	 [Step 1/1] Step Command Line failed
[10:45:37]E: Ant JUnit report watcher
[10:45:37]E:	 [Ant JUnit report watcher] No reports found for paths:
[10:45:37]E:	 [Ant JUnit report watcher] +:results/test_bitcoin.xml
[10:45:37]E:	 [Ant JUnit report watcher] +:results/**/junit_results*.xml
[10:45:37] : Publishing internal artifacts (2s)
[10:45:40] :	 [Publishing internal artifacts] Publishing 1 file using [WebPublisher]
[10:45:40] :	 [Publishing internal artifacts] Publishing 1 file using [ArtifactsCachePublisher]
[10:45:37]W: Publishing artifacts (2s)
[10:45:37] :	 [Publishing artifacts] Collecting files to publish: [+:results/**/junit_results*.xml]
[10:45:37]W:	 [Publishing artifacts] Artifacts path 'results/**/junit_results*.xml' not found
[10:45:40] : Build finished
PiRK published this revision for review.Nov 29 2021, 14:18
PiRK retitled this revision from troubleshooting windows build to fix gitian-win build.
PiRK edited the summary of this revision. (Show Details)
This revision is now accepted and ready to land.Nov 29 2021, 14:24
This revision was automatically updated to reflect the committed changes.