Cloudflare Meerkat - Globally distributed consensus(blog.cloudflare.com)
247 points by bobnamob 22 hours ago | 48 comments
tl;dr: Cloudflare is building Meerkat, an experimental globally-distributed consensus service based on EPFL's 2023 QuePaxa algorithm, to manage control-plane state across its 330+ data centers. Unlike Raft, QuePaxa is leaderless and avoids timeout-based leader elections, so writes remain available as long as a client can reach any replica connected to a majority—addressing outages Cloudflare has hit with Raft in high-variance wide-area networks. Meerkat provides linearizable reads/writes via a replicated log, is not yet in production, and will initially handle low-write-rate control data like database leadership.
HN Discussion:
  • Article's Raft comparison is unclear since leaderless Paxos would be more relevant baseline
  • ~First production async consensus algorithm is exciting but normal-case performance is uncertain
  • ~Consensus on every read means high latency, limiting to niche use cases
  • This will genuinely help those struggling with Raft on unreliable networks
  • ~Skeptical of Cloudflare building their own consensus but appreciates pushing state of the art