mirror of
https://github.com/xcat2/confluent.git
synced 2025-04-14 17:19:32 +00:00
The pickling would get horrendously slow as total node count increased. This meant very long time to sync to disk for just one change out of 65,000. This strategy changes things to more selective and only do things for the dirty keys rather than everything. Large changes to small amounts of nodes will take more time (because more calls to dump pickle), but small changes to a small subset of nodes will take much less time.
Description
Languages
Python
79.9%
Shell
15.8%
C
3.5%
Go
0.4%
Perl
0.3%