Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

NoSQL & Distributed Systems Reference Library

This page is a verified index of primary sources for distributed systems: official documentation, developer and API portals, source repositories, SDKs, downloadable or offline documentation, a two-track learning path, and free-access research literature.

It is a navigation layer, not a tutorial. Where the rest of this book explains a concept, this page tells you which document to open to get the authoritative answer, and in what order to read things. Every link was HTTP-verified on the date shown below; sources that block automated checkers but work in a browser are flagged rather than silently dropped.

Document, wide-column, key-value, graph, time-series and search stores; consensus libraries; messaging and stream processing; verification tooling; and a two-track path from Gossip Glomers to implementing Raft and model-checking your own protocols.

74 entries across 8 categories, plus 54 education & reference-implementation resources (23 basic / 31 advanced), plus 14 video resources and 8 conference sources.

Every link HTTP-verified on 2026-10-07.

Contents

1. Document, wide-column & key-value stores

MongoDB

  • Docs: mongodb.com/docs
  • Developer / API: mongodb.com/docs/drivers
  • Source: github.com/mongodb/mongo
  • SDKs & repos: Official drivers for 12+ languages; Atlas Data API; Compass
  • Downloadable / offline: Docs downloadable per version; MongoDB University courses free
  • Note: Document store with a mature query language. Read the replica-set election and write-concern docs — that is where the distributed-systems content lives.

Apache Cassandra

ScyllaDB

Redis

Valkey

Amazon DynamoDB

Couchbase

Apache HBase

FoundationDB

2. Graph, time-series & search

Neo4j

ArangoDB

InfluxDB

TimescaleDB

Elasticsearch

OpenSearch

3. Coordination, consensus & configuration

etcd

etcd Raft library

Apache ZooKeeper

HashiCorp Consul

hashicorp/raft

braft

raft.github.io

4. Messaging, streaming & distributed compute

Apache Kafka

Apache Pulsar

NATS

RabbitMQ

Apache Spark

Apache Beam

Ray

Temporal

5. Correctness, verification & chaos

Jepsen

  • Docs: jepsen.io
  • Developer / API: jepsen.io/analyses
  • Source: github.com/jepsen-io/jepsen
  • SDKs & repos: Clojure testing framework; the analyses are the real artefact
  • Downloadable / offline: All analyses free online
  • Note: Kyle Kingsbury’s reports on real databases under partition. Read three of them and your trust calibration changes permanently.

Maelstrom

  • Docs: github.com/jepsen-io/maelstrom
  • Source: github.com/jepsen-io/maelstrom
  • SDKs & repos: A workbench for writing toy distributed systems and having them tested properly
  • Downloadable / offline: In-repo docs and a full tutorial
  • Note: The best hands-on way to learn distributed systems. Start here, not with a book.

Gossip Glomers (fly.io)

  • Docs: fly.io/dist-sys
  • SDKs & repos: A guided challenge series built on Maelstrom: broadcast, CRDTs, Kafka-style logs, transactions
  • Downloadable / offline: Free, self-paced
  • Note: Probably the single best free practical distributed-systems course. Six challenge sets, real verification.

TLA+

Learn TLA+

  • Docs: learntla.com
  • SDKs & repos: A much gentler entry point than Lamport’s own materials
  • Downloadable / offline: Free online book
  • Note: Start here if TLA+ has bounced off you before.

6. Reference, reading lists & theory

Raft paper

  • Docs: raft.github.io/raft.pdf
  • Developer / API: raft.github.io
  • SDKs & repos: The extended Raft paper
  • Downloadable / offline: PDF
  • Note: Read this before any consensus implementation. It was written to be understandable, and it is.

Paxos Made Simple

Lamport’s publications

  • Docs: lamport.azurewebsites.net/pubs/pubs.html
  • SDKs & repos: Time/Clocks, Byzantine Generals, Paxos — with retrospective commentary on each
  • Downloadable / offline: All free
  • Note: The commentary explaining why each paper was written is as useful as the papers.

crdt.tech

  • Docs: crdt.tech
  • SDKs & repos: The CRDT reference: papers, implementations, talks
  • Downloadable / offline: Web index
  • Note: Start here for conflict-free replicated data types rather than with a single library.

Distributed Systems (van Steen & Tanenbaum)

awesome-distributed-systems

dancres/Pages

7. Replication, CRDTs, chaos & deterministic testing

TigerBeetle

  • Docs: docs.tigerbeetle.com
  • Source: github.com/tigerbeetle/tigerbeetle
  • SDKs & repos: Financial accounting database in Zig; Viewstamped Replication consensus; deterministic simulation testing
  • Downloadable / offline: Docs site
  • Note: The most rigorous open testing methodology currently shipping. The simulator and the design docs are the reason to read it.

Automerge

  • Docs: automerge.org
  • Developer / API: automerge.org/docs
  • Source: github.com/automerge/automerge
  • SDKs & repos: CRDT library for local-first applications; Rust core with JS and Swift bindings
  • Downloadable / offline: Docs site
  • Note: The most approachable production CRDT implementation. Read with crdt.tech.

Yjs

  • Docs: docs.yjs.dev
  • Developer / API: docs.yjs.dev/api
  • Source: github.com/yjs/yjs
  • SDKs & repos: High-performance CRDT for collaborative editing
  • Downloadable / offline: Docs site
  • Note: Powers a lot of real collaborative software. Benchmarks and internals are documented openly.

Apache BookKeeper

Dapr

  • Docs: docs.dapr.io
  • Developer / API: docs.dapr.io/reference/api
  • Source: github.com/dapr/dapr
  • SDKs & repos: Portable building blocks for distributed applications: state, pub/sub, bindings, actors
  • Downloadable / offline: Docs site
  • Note: An opinionated abstraction over the patterns. Read the component model before adopting it.

Hazelcast

Chaos Mesh

  • Docs: chaos-mesh.org/docs
  • Source: github.com/chaos-mesh/chaos-mesh
  • SDKs & repos: Kubernetes-native fault injection: network partitions, latency, pod kills
  • Downloadable / offline: Docs site
  • Note: The practical way to apply Jepsen-style thinking to your own cluster.

LitmusChaos

8. Research papers & open-access literature

arXiv

  • Docs: arxiv.org
  • Developer / API: info.arxiv.org/help/api/index.html
  • SDKs & repos: Preprints across all of CS; most systems, ML and PL work appears here before publication
  • Downloadable / offline: Every paper is a free PDF. Bulk access documented at info.arxiv.org/help/bulk_data/index.html; a full-text API at export.arxiv.org
  • Note: Not peer-reviewed. Treat an arXiv-only paper as a claim, not a result — but it is where you will read almost everything first.

ar5iv

  • Docs: ar5iv.labs.arxiv.org
  • SDKs & repos: Renders any arXiv paper as responsive HTML instead of PDF
  • Downloadable / offline: Free; swap arxiv.org/abs/ID for ar5iv.labs.arxiv.org/html/ID
  • Note: Makes papers readable on a phone and searchable in-page. Underused.

alphaXiv

  • Docs: alphaxiv.org
  • SDKs & repos: arXiv papers with a public comment and discussion layer
  • Downloadable / offline: Free
  • Note: Useful when a paper is contested — the discussion often contains the critique you were looking for.

Semantic Scholar

  • Docs: semanticscholar.org
  • Developer / API: api.semanticscholar.org/graph/v1
  • SDKs & repos: 200M+ papers with citation graph, influential-citation scoring and TLDR summaries
  • Downloadable / offline: Free Graph API (semanticscholar.org/product/api), bulk datasets available on request
  • Note: The best free citation graph. ‘Highly influential citations’ is a genuinely useful filter for finding what actually mattered.

OpenAlex

  • Docs: openalex.org
  • Developer / API: api.openalex.org/works
  • SDKs & repos: Fully open catalogue of works, authors, venues and institutions; successor to Microsoft Academic Graph
  • Downloadable / offline: Entirely free API with no key required; complete database snapshots downloadable
  • Note: The only large-scale bibliographic database that is open all the way down, including bulk snapshots.

DBLP

  • Docs: dblp.org
  • Developer / API: dblp.org/faq/13501473.html
  • SDKs & repos: Authoritative CS bibliography — complete author and venue listings
  • Downloadable / offline: Free; full XML dump downloadable
  • Note: The fastest way to find everything a given researcher has published, and to see a conference’s full programme by year.

OpenReview

  • Docs: openreview.net
  • Developer / API: docs.openreview.net
  • Source: github.com/openreview
  • SDKs & repos: ICLR, NeurIPS, COLM and dozens of other venues — papers plus the full review threads
  • Downloadable / offline: Free; REST API
  • Note: Reading the reviews and author rebuttals teaches you how the field evaluates work. Nothing else exposes this.

CORE

  • Docs: core.ac.uk
  • Developer / API: core.ac.uk/services/api
  • SDKs & repos: Aggregates 300M+ open-access papers from repositories worldwide
  • Downloadable / offline: Free API and bulk datasets
  • Note: Good for finding the green open-access copy when a publisher’s version is paywalled.

Unpaywall

  • Docs: unpaywall.org
  • Developer / API: api.unpaywall.org
  • SDKs & repos: Finds legal free copies of paywalled papers via DOI
  • Downloadable / offline: Free API; browser extension
  • Note: Legal, author-deposited copies only. Install the extension and most paywalls simply stop appearing.

Papers We Love

  • Docs: paperswelove.org
  • Source: github.com/papers-we-love/papers-we-love
  • SDKs & repos: A curated, categorised repository of classic CS papers with local meetup talks
  • Downloadable / offline: Repo cloneable; many PDFs mirrored in-repo
  • Note: The best starting point if you do not yet know which papers matter in a subfield.

The Morning Paper (archive)

  • Docs: blog.acolyer.org
  • SDKs & repos: Adrian Colyer’s daily paper summaries, 2014-2021
  • Downloadable / offline: Free archive, still online
  • Note: No longer updated, but the back catalogue of ~1000 summarised papers is one of the great free CS resources.

USENIX Proceedings

  • Docs: usenix.org/publications/proceedings
  • SDKs & repos: OSDI, SOSP (co-published), NSDI, ATC, FAST, Security — the core systems venues
  • Downloadable / offline: Every paper free, immediately, with no membership. Often with recorded talks
  • Note: USENIX made everything open access years before the rest of the field. If a systems paper exists, check here first.

ACM Digital Library

  • Docs: dl.acm.org
  • SDKs & repos: SIGMOD, ASPLOS, PLDI, POPL, SoCC and the ACM journals
  • Downloadable / offline: Partly open: ACM Open and author-paid OA papers are free; others are paywalled
  • Note: 403s to automated clients; loads in a browser. For paywalled items, check arXiv, the author’s homepage or Unpaywall first — the free copy usually exists.

IEEE Xplore

  • Docs: ieeexplore.ieee.org
  • SDKs & repos: ISCA, MICRO, HPCA and the IEEE journals
  • Downloadable / offline: Mostly paywalled; abstracts free
  • Note: Almost always worth searching the author’s page or arXiv instead. Architecture authors in particular post preprints widely.

DROPS / LIPIcs (Dagstuhl)

  • Docs: drops.dagstuhl.de
  • SDKs & repos: ECOOP, ITP, CONCUR, SAT and many theory venues
  • Downloadable / offline: 100% open access, free PDFs, Creative Commons licensed
  • Note: A fully open publisher. Every paper, always free, no exceptions.

arXiv cs.DC (Distributed Computing)

USENIX NSDI

  • Docs: usenix.org/conference/nsdi25
  • SDKs & repos: Networked Systems Design and Implementation
  • Downloadable / offline: Every paper free
  • Note: Where most large-scale distributed infrastructure work is published.

USENIX OSDI

  • Docs: usenix.org/conference/osdi26
  • SDKs & repos: Systems and distributed systems, free and open
  • Downloadable / offline: All papers free
  • Note: Raft, Spanner-adjacent work and most consensus systems research lands here or at SOSP.

PODC

  • Docs: podc.org
  • SDKs & repos: Principles of Distributed Computing — the theory side
  • Downloadable / offline: Via ACM DL; most authors post preprints
  • Note: This is where impossibility results and lower bounds live. Harder reading, but foundational.

DISC

  • Docs: disc-conference.org
  • SDKs & repos: International Symposium on Distributed Computing
  • Downloadable / offline: Proceedings open via LIPIcs/DROPS
  • Note: Fully open access through Dagstuhl. Theory-focused.

The Paper Trail

  • Docs: the-paper-trail.org
  • SDKs & repos: Henry Robinson’s distributed systems writing, including the classic consensus explainers
  • Downloadable / offline: Free
  • Note: The ‘Paxos made abstract’ material is clearer than most formal treatments.

Metadata (Murat Demirbas)

  • Docs: muratbuffalo.blogspot.com
  • SDKs & repos: Long-running paper review blog from a distributed systems researcher
  • Downloadable / offline: Free
  • Note: Reviews of both classic and current papers, with honest criticism.

Jepsen analyses

  • Docs: jepsen.io/analyses
  • SDKs & repos: Empirical consistency testing reports on real databases
  • Downloadable / offline: All free
  • Note: Not peer-reviewed and more consequential than most papers that are.

Education & reference implementations

Two tracks: Basic builds the foundations, Advanced is about reading and extending real implementations. Everything listed is free and publicly accessible.

Basic

23 resources across 6 topics.

Start by building, not reading

  • Gossip Glomers — Six challenge sets — unique IDs, broadcast, CRDT counters, a Kafka-style log, distributed transactions — each verified by a real checker. Free. Do this before any textbook.
  • Maelstrom — The workbench underneath Gossip Glomers. Write a node in any language; it injects partitions and checks linearizability.
  • MIT 6.824 / 6.5840 Distributed Systems — Labs where you implement MapReduce, Raft, a fault-tolerant KV store and sharding — in Go, with public tests. The best university course in the field, entirely free.

The core reading

Understand what breaks

First systems to run and read

  • etcd — A small, real, Raft-backed store you can run locally and inspect.
  • Redis — Readable C, clear docs, and the clustering model is a good first look at sharding.
  • NATS — Simplest serious messaging system to get running.
  • RabbitMQ tutorials — The six tutorials cover messaging patterns better than most books.
  • Apache Kafka documentation — Read the ‘Design’ section specifically — it is effectively a paper.

Academic grounding, early

Finding and reading papers

  • Papers We Love — Start here when you do not yet know which papers matter. Curated by subfield, with recorded talks.
  • The Morning Paper archive — Around a thousand papers summarised in plain language. No longer updated; still one of the best free CS resources.
  • Semantic Scholar — Free citation graph. The ‘highly influential citations’ filter is the fastest way to find what a paper actually changed.
  • Unpaywall — Install the extension. Most paywalls stop appearing, legally, because the author deposited a copy.
  • ar5iv — Read any arXiv paper as HTML instead of a two-column PDF. Swap arxiv.org/abs for ar5iv.labs.arxiv.org/html.

Advanced

31 resources across 6 topics.

Implement consensus yourself

  • MIT 6.824 Raft labs — Lab 2 is Raft from scratch against an adversarial test suite. Difficult and worth it.
  • etcd Raft library — Read this after your own implementation works. The gap is educational.
  • hashicorp/raft — A second production implementation with different design choices.
  • braft — Industrial C++ Raft, for a third perspective.
  • Raft extended paper — Return to sections 5-8 once you have implementation scars.
  • Paxos Made Simple — Understand the lineage Raft reacted against.

Formal methods & verification

  • TLA+ — Specify your protocol and let the model checker find the interleaving you missed.
  • Learn TLA+ — The practical on-ramp. Start here, then go to Lamport’s materials.
  • TLA+ tools — TLC, the Toolbox, and the standard modules.
  • Jepsen — Empirical verification as the complement to formal specification.
  • FoundationDB — Deterministic simulation testing — arguably the most rigorous testing approach in any open database.

Production system internals

  • Cassandra source — Dynamo-style replication, gossip and hinted handoff in a mature codebase.
  • ScyllaDB — The same model rebuilt shard-per-core on Seastar. Read the Seastar design notes.
  • Kafka — KRaft replaced ZooKeeper; read the KIPs for the migration reasoning.
  • Pulsar — Storage and serving separated via BookKeeper. A deliberate contrast to Kafka.
  • FoundationDB docs — Strictly serializable transactions over a distributed store, documented honestly about limits.
  • MongoDB source — Replica set elections and the write-concern machinery.

Stream processing & state

  • Apache Flink — The checkpointing and exactly-once semantics chapters are the real material.
  • Apache Beam — Event time, watermarks and triggers, formalized.
  • Temporal — Durable execution — read the architecture docs, not just the SDK tutorials.
  • Ray — Distributed compute with a task and actor model; readable architecture docs.
  • Apache Spark — Shuffle, lineage and recovery.

Consistency models & theory

Research venues

  • USENIX OSDI — Free papers, and the main venue for systems work.
  • ACM SOSP — Alternates with OSDI.
  • Jepsen analyses — Not peer-reviewed, but more consequential in practice than most papers.

Video courses, channels & talks

14 resources across 2 groups. Every channel and playlist below was fetched and title-verified on 2026-10-09. Handles drift and several plausible-looking handles resolve to the wrong channel, so a 200 response is not proof of identity — the links here were each checked against the channel title.

Channels & conference recordings

  • Confluent — Kafka Summit talks and stream-processing design sessions — the canonical Kafka video record.
  • CNCF — KubeCon keynotes and project-maintainer talks across the cloud-native landscape.
  • Kubernetes — Official Kubernetes community channel.
  • Strange Loop Conference — The Strange Loop channel: distributed systems, databases and language talks from the conference.
  • USENIX — Conference recordings for most USENIX papers — free video, the fastest route into a systems paper.
  • Papers We Love — Recorded paper walkthroughs — watch one before you read the PDF.
  • InfoQ — Conference keynotes and architecture talks — good for orientation, verify specifics elsewhere.
  • The Linux Foundation — The Linux Foundation channel: kernel and LF event recordings.
  • Meta Open Source — Talks on the infrastructure behind the big deployments — caches, schedulers, storage.
  • ScyllaDB — Latency and performance conference talks; the P99 crowd, strong on tail-latency measurement.
  • Google TechTalks — Spanner, Chubby, Borg and Dapper history, often given by the authors.

Lectures & playlists

Note: The conference channels are the real value here — most canonical distributed-systems design talks were recorded at Strange Loop, USENIX or a KubeCon.

Conference videos, notes & archives

8 resources across 2 groups. Conference recordings are the primary-source tier of video: the speaker is usually an author of the paper, and where a talk exists the proceedings entry is often open at the same link. Every URL here returned 200 on 2026-10-09 unless the note says otherwise.

The canonical distributed-systems talks were all recorded, mostly at Strange Loop, USENIX or a KubeCon; this is where to find them.

Conference channels & video archives

  • Strange Loop — Every talk online, free. Start here for distributed-systems talks given by practitioners.
  • USENIX ATC ’26 — The applied venue; open.
  • USENIX NSDI ’26 — Where the networking half of distributed systems lands.
  • EuroSys — Proceedings plus selected recordings.
  • VLDB — For the data-side papers (Spanner, Calvin, etc.), fully open.
  • FOSDEM video archive — Distributed systems, messaging and observability devrooms.
  • media.ccc.de — Distributed-infrastructure and federation tracks.

Notes, proceedings & paper-adjacent archives

  • USENIX ;login: — Postmortems and design write-ups in magazine form.

If you only do three things

  1. Do Gossip Glomers (fly.io/dist-sys). Six verified challenges on Maelstrom. Free, and more effective than any book.
  2. Do MIT 6.824’s Raft lab. Implement consensus against an adversarial test suite until it passes.
  3. Read three Jepsen analyses. Your intuitions about what databases guarantee will not survive, and that is the point.

Honest notes

  • Build before you read. Distributed systems theory sticks only after you have debugged a partition yourself.
  • Kafka’s ‘Design’ documentation section is effectively a research paper. Most people skip it and read tutorials instead.
  • Read the Raft paper, not a summary. It was explicitly written for understandability and summaries lose the parts that matter.
  • Valkey, not Redis, is now the default in several Linux distributions following the 2024 licence change. Check which you are documenting.
  • FoundationDB’s deterministic simulation testing is the most underappreciated engineering idea in this list.
  • TLA+ is less intimidating than it looks if you start at learntla.com rather than with Lamport’s own materials.