Paths

Table of Contentst

Differential D14397

perf
ClosedPublic
Actions

Authored by tobias_ruck on Aug 22 2023, 11:03.

Details

Reviewers

Fabien

Group Reviewers

Restricted Project

Commits

rABCf4f86f57510d: [Chronik] Add `-chronikperfstats` flag to write performance stats into…

Summary

Collect performance stats for TxWriter, SpentByWriter, GroupUtxoWriter and GroupHistoryWriter, which are the biggest culprits regarding performance at the moment.

Add *Stats structs for each of them, but also *MemData structs, which allows later optimizations to store in-memory caches etc.

Bundle all of them in MemData, which can be mapped to StatsData to obtain just the stats.

After resync_indexer completed, write the collected data to perf/resync_stats.txt. In the future, we might add other kinds of files.

Test Plan

Resync indexer using -chronikperfstats, verify perf/resync_stats.txt is created.

Diff Detail

Repository

rABC Bitcoin ABC

Lint

Lint Not Applicable

Unit

Tests Not Applicable

Event Timeline

tobias_ruck created this revision.Aug 22 2023, 11:03

Herald added a reviewer: Restricted Project. · View Herald TranscriptAug 22 2023, 11:03

tobias_ruck requested review of this revision.Aug 22 2023, 11:03

Harbormaster completed remote builds in B24812: Diff 41886.Aug 22 2023, 11:24

Fabien accepted this revision.Aug 22 2023, 12:39

This revision is now accepted and ready to land.Aug 22 2023, 12:39

Write full stats to resync_stats.txt, round seconds to 3 digits, add missing n_total for GroupUtxoWriter

This revision was landed with ongoing or failed builds.Aug 22 2023, 15:15

Closed by commit rABCf4f86f57510d: [Chronik] Add `-chronikperfstats` flag to write performance stats into… (authored by tobias_ruck). · Explain Why

This revision was automatically updated to reflect the committed changes.

tobias_ruck added a commit: rABCf4f86f57510d: [Chronik] Add `-chronikperfstats` flag to write performance stats into….

Harbormaster completed remote builds in B24816: Diff 41893.Aug 22 2023, 15:28

Revision Contents
Changeset List

Path

Size

chronik/

chronik-cpp/

chronik.cpp

1 line

chronik-db/

src/

index_tx.rs

4 lines

io/

4 lines

69 lines

77 lines

67 lines

57 lines

mem/

data.rs

60 lines

mod.rs

2 lines

chronik-indexer/

src/

indexer.rs

81 lines

chronik-lib/

src/

bridge.rs

1 line

ffi.rs

3 lines

src/

init.cpp

4 lines

Diff 41894

View Options

chronik/chronik-cpp/chronik.cpp

View Options

chronik/chronik-db/src/index_tx.rs

View Options

chronik/chronik-db/src/io/block_stats.rs

View Options

chronik/chronik-db/src/io/group_history.rs

View Options

chronik/chronik-db/src/io/group_utxos.rs

View Options

chronik/chronik-db/src/io/spent_by.rs

View Options

chronik/chronik-db/src/io/txs.rs

View Options

chronik/chronik-db/src/mem/data.rs

View Options

chronik/chronik-db/src/mem/mod.rs

View Options

chronik/chronik-indexer/src/indexer.rs

View Options

chronik/chronik-lib/src/bridge.rs

View Options

chronik/chronik-lib/src/ffi.rs

View Options

[Chronik] Add `-chronikperfstats` flag to write performance stats into <datadir>/perfClosedPublicActions

Details

Diff Detail

Event Timeline

Revision ContentsChangeset List

Diff 41894

chronik/chronik-cpp/chronik.cpp

chronik/chronik-db/src/index_tx.rs

chronik/chronik-db/src/io/block_stats.rs

chronik/chronik-db/src/io/group_history.rs

chronik/chronik-db/src/io/group_utxos.rs

chronik/chronik-db/src/io/spent_by.rs

chronik/chronik-db/src/io/txs.rs

chronik/chronik-db/src/mem/data.rs

chronik/chronik-db/src/mem/mod.rs

chronik/chronik-indexer/src/indexer.rs

chronik/chronik-lib/src/bridge.rs

chronik/chronik-lib/src/ffi.rs

src/init.cpp

[Chronik] Add `-chronikperfstats` flag to write performance stats into <datadir>/perf
ClosedPublic
Actions

Revision Contents
Changeset List