PierreZ

FoundationDB Internal RPC Analysis: Idempotency, Retries, and Design Patterns

Context

Deep analysis of FoundationDB's internal RPC architecture — not the external client API, but the inter-role communication primitives that make FDB's distributed transaction engine work. The goal is to extract design principles around idempotency and retry safety that can inform RPC design in other distributed systems.

---

PierreZ

MIT License

Copyright (c) 2023 Datadog, Inc.

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

PierreZ

{
  inputs = {
    nixpkgs.url = "nixpkgs/nixos-unstable";
    flake-utils.url = "github:numtide/flake-utils";
  };

  outputs = { self, nixpkgs, flake-utils, ... }: flake-utils.lib.eachDefaultSystem (system:
    let
      pkgs = nixpkgs.legacyPackages.${system};
      overriddenJDK = pkgs.jdk8; # Change this to the desired JDK version

PierreZ

apiVersion: v1
kind: ConfigMap
metadata:
  name: beamium-cm
data:
  scrapers.yaml: |
    scrapers:
      # scraping itself for metrics
      self:
        url: http://127.0.0.1:9110/metrics

PierreZ

Jun 25 08:54:33.153 DEBG [main] received a watcher event NoticeRemove(
    "/etc/beamium/..2020_06_25_08_52_59.743331400/config.yaml",
)
Jun 25 08:54:33.154 INFO reload configuration
Jun 25 08:54:33.165 DEBG set signal to false from main
Jun 25 08:54:33.166 DEBG [main] waiting for handler to join
Jun 25 08:54:33.217 DEBG shutting down cmd::main
Jun 25 08:54:33.217 DEBG shutdown scraper's runtime, scraper: scraper1
Jun 25 08:54:33.218 DEBG shutdown router's runtime
Jun 25 08:54:33.219 DEBG shutdown metrics server's runtime

PierreZ

// Licensed to the Apache Software Foundation (ASF) under one
// or more contributor license agreements.  See the NOTICE file
// distributed with this work for additional information
// regarding copyright ownership.  The ASF licenses this file
// to you under the Apache License, Version 2.0 (the
// "License"); you may not use this file except in compliance
// with the License.  You may obtain a copy of the License at
//
//   http://www.apache.org/licenses/LICENSE-2.0
//

PierreZ

CPPFLAGS                 -g -O2 -fPIC -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align


make[2]: Entering directory '/usr/src/app/node_modules/node-rdkafka/deps/librdkafka/src-cpp'
g++ -MD -MP -g -O2 -fPIC -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -Wno-non-virtual-dtor -c RdKafka.cpp -o RdKafka.o
g++ -MD -MP -g -O2 -fPIC -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -Wno-non-virtual-dtor -c ConfImpl.cpp -o ConfImpl.o
g++ -MD -MP -g -O2 -fPIC -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -Wno-non-virtual-dtor -c HandleImpl.cpp -o HandleImpl.o
g++ -MD -MP -g -O2 -fPIC -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -Wno-non-virtual-dtor -c ConsumerImpl.cpp -o ConsumerImpl.o
g++ -MD -MP -g -O2 -fPIC -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -Wno-non-virtual-dtor -c ProducerImpl.cpp -o ProducerImpl.o
g++ -MD -MP -g -O2 -fPIC -Wall -Wsign-compare -Wfloat-equal -Wpointer-arith -Wcast-align -Wno-non-virtua

PierreZ

1.1 => u want want to use Q

https://helloexoworld.github.io/hew-hands-on/step-2-Keplers-Data/2.1-Did-you-said-Time-Series/ => once you have defined

2.2 you survived

PierreZ

bin/bookkeeper shell bookieformat -nonInteractive -force -deleteCookie

bin/bookkeeper shell listunderreplicated -printmissingreplica

bin/bookkeeper shell listbookies -readwrite 

PierreZ

	linux-vdso.so.1 (0x00007ffdc45aa000)
	libSDL2-2.0.so.0 => /lib64/libSDL2-2.0.so.0 (0x00007f4533950000)
	libX11.so.6 => /lib64/libX11.so.6 (0x00007f453380b000)
	libXrandr.so.2 => /lib64/libXrandr.so.2 (0x00007f45337fe000)
	libcef.so => not found
	libopus.so.0 => /lib64/libopus.so.0 (0x00007f453379c000)
	libuv.so.1 => /lib64/libuv.so.1 (0x00007f453376b000)
	libpthread.so.0 => /lib64/libpthread.so.0 (0x00007f4533748000)
	libssl.so.1.1 => /lib64/libssl.so.1.1 (0x00007f45336b2000)
	libcrypto.so.1.1 => /lib64/libcrypto.so.1.1 (0x00007f45333d1000)