HomePhabricator

contrib: make linearize-data.py cope with out-of-order blocks
aedc74dfa688Unpublished

Unpublished Commit ยท Learn More

Repository Importing: This repository is still importing.

Description

contrib: make linearize-data.py cope with out-of-order blocks

Make it possible to read blocks in any order. This will be required
after headers-first (#4468), so should be merged before that.

  • Read block header. For expected blocks, continue, else skip.
  • For in-order blocks: copy block contents directly. Write prior out-of-order blocks if this connects a consecutive span.
  • For out-of-order blocks, store extents of block data for later retrieval. Cache out-of-order blocks in memory up to 100MB (configurable).

Details

Provenance
Wladimir J. van der Laan <laanwj@gmail.com>Authored on Oct 6 2014, 15:55
deadalnixPushed on May 14 2017, 22:04
Parents
rABC5505a1b13f75: Merge pull request #5036
Branches
Unknown
Tags
Unknown

Event Timeline

Wladimir J. van der Laan <laanwj@gmail.com> committed rABCaedc74dfa688: contrib: make linearize-data.py cope with out-of-order blocks (authored by Wladimir J. van der Laan <laanwj@gmail.com>).Oct 6 2014, 16:30