Differential D15145

fuzz: Link all targets once
ClosedPublic
Actions

Authored by Fabien on Jan 12 2024, 13:43.

Tags

None

Subscribers

Details

Reviewers

Group Reviewers

Restricted Project

Commits

rABCf90e4a9477bc: fuzz: Link all targets once

Summary

Dramatically reduce the build time and the disk space consumption.

Backport of core#20560.
https://github.com/bitcoin/bitcoin/pull/20560/commits/44444ba759480237172d83f42374c5c29c76eda0

The second commit is not backported because it brings no value.

Also a backport of core#20733 otherwise the build fails due to duplicated symbols.

Test Plan

Follow the doc from fuzzing.md, build with AFL and LibFuzzer, run the
fuzzer directly and via test_runner.py for LibFuzzer.

Diff Detail

Repository

rABC Bitcoin ABC

Lint

Lint Not Applicable

Unit

Tests Not Applicable

Event Timeline

Fabien created this revision.Jan 12 2024, 13:43

Herald added a reviewer: Restricted Project. · View Herald TranscriptJan 12 2024, 13:43

Fabien requested review of this revision.Jan 12 2024, 13:43

teamcity edited the summary of this revision. (Show Details)Jan 12 2024, 13:43

Harbormaster completed remote builds in B26288: Diff 44091.Jan 12 2024, 14:01

I can compile it. I'm still having issues when trying to run a specific target, but that's likely something wrong on my

config.

$ FUZZ=${FUZZ_TARGET} ${AFLPATH}/afl-fuzz -i ${DIR_FUZZ_IN}/${FUZZ_TARGET} -o ${AFLOUT}/${FUZZ_TARGET} -m80 -- src/test/fuzz/fuzz
afl-fuzz 2.52b by <lcamtuf@google.com>
[+] You have 24 CPU cores and 1 runnable tasks (utilization: 4%).
[+] Try parallel jobs - see docs/parallel_fuzzing.txt.
[*] Checking CPU core loadout...
[+] Found a free CPU core, binding to #0.
[*] Checking core_pattern...
[*] Setting up output directories...
[+] Output directory exists but deemed OK to reuse.
[*] Deleting old session data...
[+] Output dir cleanup successful.
[*] Scanning '/home/pierre/dev/qa-assets/fuzz_seed_corpus/eval_script'...
[+] No auto-generated dictionary tokens to reuse.
[*] Creating hard links for all input files...
[*] Validating target binary...
[+] Persistent mode binary detected.
[+] Deferred forkserver binary detected.
[*] Attempting dry run with 'id:000000,orig:005709280a876bb0cbeb7f1ebff602ee2de340d5'...
[*] Spinning up the fork server...
[+] All right - fork server is up.

[-] PROGRAM ABORT : Unable to request new process from fork server (OOM?)
         Location : run_target(), afl-fuzz.c:2377

This revision is now accepted and ready to land.Jan 12 2024, 15:51

Closed by commit rABCf90e4a9477bc: fuzz: Link all targets once (authored by MarcoFalke <falke.marco@gmail.com>, committed by Fabien). · Explain WhyJan 12 2024, 17:38

This revision was automatically updated to reflect the committed changes.

Fabien added a commit: rABCf90e4a9477bc: fuzz: Link all targets once.

Revision Contents
Changeset List

Path

Size

doc/

4 lines

src/

test/

fuzz/

353 lines

addition_overflow.cpp

2 lines

2 lines

2 lines

asmap_direct.cpp

4 lines

2 lines

4 lines

base_encode_decode.cpp

2 lines

4 lines

block_header.cpp

2 lines

blockfilter.cpp

2 lines

bloom_filter.cpp

2 lines

buffered_file.cpp

2 lines

2 lines

2 lines

2 lines

4 lines

4 lines

2 lines

crypto_aes256.cpp

2 lines

crypto_aes256cbc.cpp

2 lines

crypto_chacha20.cpp

2 lines

crypto_chacha20_poly1305_aead.cpp

2 lines

crypto_common.cpp

2 lines

crypto_hkdf_hmac_sha256_l32.cpp

2 lines

crypto_poly1305.cpp

2 lines

cuckoocache.cpp

2 lines

descriptor_parse.cpp

6 lines

deserialize.cpp

444 lines

eval_script.cpp

4 lines

2 lines

2 lines

2 lines

2 lines

22 lines

40 lines

golomb_rice.cpp

2 lines

4 lines

http_request.cpp

2 lines

4 lines

4 lines

4 lines

kitchen_sink.cpp

2 lines

load_external_block_file.cpp

5 lines

2 lines

merkleblock.cpp

2 lines

4 lines

multiplication_overflow.cpp

2 lines

4 lines

net_permissions.cpp

2 lines

2 lines

p2p_transport_deserializer.cpp

5 lines

parse_hd_keypath.cpp

2 lines

parse_iso8601.cpp

2 lines

parse_numbers.cpp

2 lines

parse_script.cpp

2 lines

parse_univalue.cpp

4 lines

4 lines

2 lines

primitives_transaction.cpp

2 lines

process_message.cpp

91 lines

process_messages.cpp

4 lines

2 lines

4 lines

2 lines

rolling_bloom_filter.cpp

2 lines

4 lines

script_bitcoin_consensus.cpp

2 lines

script_descriptor_cache.cpp

2 lines

script_flags.cpp

4 lines

script_interpreter.cpp

2 lines

2 lines

script_sigcache.cpp

4 lines

script_sign.cpp

4 lines

scriptnum_ops.cpp

2 lines

secp256k1_ec_seckey_import_export_der.cpp

2 lines

secp256k1_ecdsa_signature_parse_der_lax.cpp

2 lines

signature_checker.cpp

4 lines

2 lines

spanparsing.cpp

2 lines

2 lines

2 lines

2 lines

2 lines

transaction.cpp

4 lines

2 lines

2 lines

4 lines

14 lines

test/

fuzz/

65 lines

Diff 44106

doc/fuzzing.md

Loading...

src/test/fuzz/CMakeLists.txt

Loading...

src/test/fuzz/addition_overflow.cpp

Loading...

src/test/fuzz/addrdb.cpp

Loading...

src/test/fuzz/asmap.cpp

Loading...

src/test/fuzz/asmap_direct.cpp

Loading...

src/test/fuzz/autofile.cpp

Loading...

src/test/fuzz/banman.cpp

Loading...

src/test/fuzz/base_encode_decode.cpp

Loading...

src/test/fuzz/block.cpp

Loading...

src/test/fuzz/block_header.cpp

Loading...

src/test/fuzz/blockfilter.cpp

Loading...

src/test/fuzz/bloom_filter.cpp

Loading...

src/test/fuzz/buffered_file.cpp

Loading...

src/test/fuzz/cashaddr.cpp

Loading...

src/test/fuzz/chain.cpp

Loading...

src/test/fuzz/checkqueue.cpp

Loading...

src/test/fuzz/coins_view.cpp

Loading...

src/test/fuzz/connman.cpp

Loading...

src/test/fuzz/crypto.cpp

Loading...

src/test/fuzz/crypto_aes256.cpp

Loading...

src/test/fuzz/crypto_aes256cbc.cpp

Loading...

src/test/fuzz/crypto_chacha20.cpp

Loading...

src/test/fuzz/crypto_chacha20_poly1305_aead.cpp

Loading...

src/test/fuzz/crypto_common.cpp

Loading...

src/test/fuzz/crypto_hkdf_hmac_sha256_l32.cpp

Loading...

src/test/fuzz/crypto_poly1305.cpp

Loading...

src/test/fuzz/cuckoocache.cpp

Loading...

src/test/fuzz/descriptor_parse.cpp

Loading...

src/test/fuzz/deserialize.cpp

Loading...

src/test/fuzz/eval_script.cpp

Loading...

src/test/fuzz/fee_rate.cpp

Loading...

src/test/fuzz/fees.cpp

Loading...

src/test/fuzz/flatfile.cpp

Loading...

src/test/fuzz/float.cpp

Loading...

src/test/fuzz/fuzz.h

Loading...

src/test/fuzz/fuzz.cpp

Loading...

src/test/fuzz/golomb_rice.cpp

Loading...

src/test/fuzz/hex.cpp

Loading...

src/test/fuzz/http_request.cpp

Loading...

src/test/fuzz/integer.cpp

Loading...

src/test/fuzz/key.cpp

Loading...

src/test/fuzz/key_io.cpp

Loading...

src/test/fuzz/kitchen_sink.cpp

Loading...

src/test/fuzz/load_external_block_file.cpp

Loading...

src/test/fuzz/locale.cpp

Loading...

src/test/fuzz/merkleblock.cpp

Loading...

src/test/fuzz/message.cpp

Loading...

src/test/fuzz/multiplication_overflow.cpp

Loading...

src/test/fuzz/net.cpp

Loading...

src/test/fuzz/net_permissions.cpp

Loading...

src/test/fuzz/netaddress.cpp

Loading...

src/test/fuzz/p2p_transport_deserializer.cpp

Loading...

src/test/fuzz/parse_hd_keypath.cpp

Loading...

src/test/fuzz/parse_iso8601.cpp

Loading...

src/test/fuzz/parse_numbers.cpp

Loading...

src/test/fuzz/parse_script.cpp

Loading...

src/test/fuzz/parse_univalue.cpp

Loading...

src/test/fuzz/pow.cpp

Loading...

src/test/fuzz/prevector.cpp

Loading...

src/test/fuzz/primitives_transaction.cpp

Loading...

src/test/fuzz/process_message.cpp

Loading...

src/test/fuzz/process_messages.cpp

Loading...

src/test/fuzz/protocol.cpp

Loading...

src/test/fuzz/psbt.cpp

Loading...

src/test/fuzz/random.cpp

Loading...

src/test/fuzz/rolling_bloom_filter.cpp

Loading...

src/test/fuzz/script.cpp

Loading...

src/test/fuzz/script_bitcoin_consensus.cpp

Loading...

src/test/fuzz/script_descriptor_cache.cpp

Loading...

src/test/fuzz/script_flags.cpp

Loading...

src/test/fuzz/script_interpreter.cpp

Loading...

src/test/fuzz/script_ops.cpp

Loading...

src/test/fuzz/script_sigcache.cpp

Loading...

src/test/fuzz/script_sign.cpp

Loading...

src/test/fuzz/scriptnum_ops.cpp

Loading...

src/test/fuzz/secp256k1_ec_seckey_import_export_der.cpp

Loading...

src/test/fuzz/secp256k1_ecdsa_signature_parse_der_lax.cpp

Loading...

src/test/fuzz/signature_checker.cpp

Loading...

src/test/fuzz/span.cpp

Loading...

src/test/fuzz/spanparsing.cpp

Loading...

src/test/fuzz/string.cpp

Loading...

src/test/fuzz/strprintf.cpp

Loading...

src/test/fuzz/system.cpp

Loading...

src/test/fuzz/timedata.cpp

Loading...

src/test/fuzz/transaction.cpp

Loading...

src/test/fuzz/tx_in.cpp

Loading...

src/test/fuzz/tx_out.cpp

Loading...

src/test/fuzz/txrequest.cpp

Loading...

src/test/fuzz/util.h

Loading...

test/fuzz/test_runner.py

Loading...