Date: 2019-08-30
Categories: btrees; filesystems; ocaml; programming; research; software

B-tree random write performance: 1M random writes on a full store in about 10s

I just added a write-back cache to the B-tree code. As expected, performance has greatly improved. Currently we get about 100k random writes /s on a reasonably full store. The animation below shows 12s, but this is probably because of slowdown caused by the screen recorder.

Animated gif:

2020-05-22 A simple MCQ test program, in OCaml, compiled to JavaScript
2020-05-01 John Whitington PhD viva
2020-02-05 On the need for PhD viva chairs
2020-01-20 SQLite assumptions, or how to corrupt an SQLite database
2019-12-18 VeTSS annual summary
2019-08-30 B-tree random write performance
2019-08-21 ML'19 Workshop at ICFP: A key-value store for OCaml
2018-07-09 Backup tools
2018-07-02 Funded PhD places
2018-06-14 A typed DSL for parsing
2018-05-30 Potential improvements in filesystem performance
2018-05-22 First Python program: an Earley parser!
2018-02-01 New OCaml library: path resolution
2017-11-14 New OCaml parsing algorithm: tjr_simple_earley
2017-09-17 Two new OCaml libraries: P0 and tjr-csv
2017-09-06 OCaml workshop talk: A B-tree library for OCaml
2017-09-06 ICFP most influential paper from 10 years ago
2017-05-30 OCaml workshop submission: A B-tree library for OCaml
2017-06-13 Interesting article on ext4 free space allocation
2017-03-16 tjr-btree: a CoW B-tree library in OCaml
2016-11-17 OCaml string functions
2016-05-27 Visit to Cambridge, for REMS workshop
2016-02-19 Tree-structured text
2016-02-09 Simple implementation of an Earley-like parsing algorithm
2016-01-27 Talk at York University
2015-10-05 SibylFS presentation at SOSP'15
2015-09-28 SibylFS SOSP poster
2015-09-21 SibylFS presentation to Industrial Advisory Board
2015-06-28 SOSP 2015 paper acceptance for SibylFS
2015-06-26 P5 scala parsing library
2015-04-27 Why operational models?
2015-04-21 REMS Cambridge talk on SibylFS
2014-11-26 Isabelle on 64bit ubuntu with 32bit libraries
2014-11-21 Talk on parsing at the University of Sussex
2014-09-26 P1 combinator parsing library for OCaml
2014-09-26 E3 earley parser library for OCaml
2014-04-15 New release of P3 code on github
2014-03-02 New release of P3 code on github
2013-12-16 New release of P3 code on github
2013-11-24 Experience of using Lem
2013-11-13 Engineer position
2013-04-01 PhD position funded by Microsoft Research
2013-02-01 EPSRC grant funded
2011-12-01 Verified parsing