Page MenuHomePhabricator
Differential D14397

[Chronik] Add `-chronikperfstats` flag to write performance stats into <datadir>/perf
ClosedPublic
Actions

Authored by tobias_ruck on Aug 22 2023, 11:03.

Details

Reviewers
Fabien
Group Reviewers
Restricted Project
Commits
rABCf4f86f57510d: [Chronik] Add `-chronikperfstats` flag to write performance stats into…
Summary

Collect performance stats for TxWriter, SpentByWriter, GroupUtxoWriter and GroupHistoryWriter, which are the biggest culprits regarding performance at the moment.

Add *Stats structs for each of them, but also *MemData structs, which allows later optimizations to store in-memory caches etc.

Bundle all of them in MemData, which can be mapped to StatsData to obtain just the stats.

After resync_indexer completed, write the collected data to perf/resync_stats.txt. In the future, we might add other kinds of files.

Test Plan

Resync indexer using -chronikperfstats, verify perf/resync_stats.txt is created.

Diff Detail

Event Timeline

tobias_ruck created this revision.Aug 22 2023, 11:03
Herald added a reviewer: Restricted Project. · View Herald TranscriptAug 22 2023, 11:03
tobias_ruck requested review of this revision.Aug 22 2023, 11:03
Harbormaster completed remote builds in B24812: Diff 41886.Aug 22 2023, 11:24
Fabien accepted this revision.Aug 22 2023, 12:39
This revision is now accepted and ready to land.Aug 22 2023, 12:39
tobias_ruck updated this revision to Diff 41893.Aug 22 2023, 15:12

Write full stats to resync_stats.txt, round seconds to 3 digits, add missing n_total for GroupUtxoWriter

This revision was landed with ongoing or failed builds.Aug 22 2023, 15:15
Closed by commit rABCf4f86f57510d: [Chronik] Add `-chronikperfstats` flag to write performance stats into… (authored by tobias_ruck). · Explain Why
This revision was automatically updated to reflect the committed changes.
tobias_ruck added a commit: rABCf4f86f57510d: [Chronik] Add `-chronikperfstats` flag to write performance stats into….
Harbormaster completed remote builds in B24816: Diff 41893.Aug 22 2023, 15:28

Revision Contents
Changeset List

PathSize
chronik/
chronik-cpp/
1 line
chronik-db/
src/
4 lines
io/
4 lines
69 lines
77 lines
67 lines
57 lines
mem/
60 lines
2 lines
chronik-indexer/
src/
81 lines
chronik-lib/
src/
1 line
3 lines
src/
4 lines

Diff 41893

View Options

chronik/chronik-cpp/chronik.cpp

Loading...
View Options

chronik/chronik-db/src/index_tx.rs

Loading...
View Options

chronik/chronik-db/src/io/block_stats.rs

Loading...
View Options

chronik/chronik-db/src/io/group_history.rs

Loading...
View Options

chronik/chronik-db/src/io/group_utxos.rs

Loading...
View Options

chronik/chronik-db/src/io/spent_by.rs

Loading...
View Options

chronik/chronik-db/src/io/txs.rs

Loading...
View Options

chronik/chronik-db/src/mem/data.rs

Loading...
View Options

chronik/chronik-db/src/mem/mod.rs

Loading...
View Options

chronik/chronik-indexer/src/indexer.rs

Loading...
View Options

chronik/chronik-lib/src/bridge.rs

Loading...
View Options

chronik/chronik-lib/src/ffi.rs

Loading...
View Options

src/init.cpp

Loading...