Restructures /docs/ by reader purpose (tutorials, how-to, reference, design), adds the new-user-progression and operator-recipe content the prior layout lacked, runs an accuracy pass against current source across the pre-existing design docs, and rewrites the gateway feature-set documentation end-to-end around its actual operational profile (a niche feature designed for systems already serving DHCP/DNS to a LAN, with two independent halves — outbound LAN→mesh, inbound mesh→LAN — sharing one nftables table, one binary, and one control socket). Top-level README and getting-started rewritten around two equally-weighted deployment modes (overlay on existing IP networks; ground-up over non-IP transports). ## Additions - 11 new tutorials in docs/tutorials/: an 8-step new-user progression from single-daemon test-mesh peering through to a ground-up two-device mesh, an IPv6-adapter side-trip walkthrough, an Advanced Tutorials index, and a hand-held OpenWrt walk-through for fips-gateway deployment that exercises both halves of the feature. - 12 new how-tos in docs/how-to/: firewall activation, Nostr discovery (resolve / advertise / open across five scenarios), Tor onion (directory + control_port modes), UDP buffer tuning, unprivileged-user setup, persistent identity, host aliases, Bluetooth LE peering, MTU diagnostics, manual Linux-host gateway deployment (covers both halves), gateway troubleshooting (organised by half), and a section index. - 9 new reference docs in docs/reference/: configuration, wire formats, control-socket protocol, four CLI references (fips, fipsctl, fipstop, fips-gateway), security posture matrix, and Nostr events catalog. Configuration and wire-formats are renamed-and-extended from prior design/ versions; the other seven are net-new. - 6 new design docs: fips-concepts, fips-architecture, and fips-prior-work split out of the deleted fips-intro.md; consolidated fips-mmp and fips-mtu aggregations; and a new generic port-advertisement-and-nat-traversal doc (Nostr-signaled port advertisement plus UDP NAT-traversal protocol, FIPS as an example implementation, suitable for eventual NIP submission). - Top-level docs/getting-started.md walking through the binary-installer-only Install story. - packaging/common/hosts pre-populated with the eight public test-mesh nodes so shortnames resolve out of the box on every fresh install. ## Changes - 23 wire-format diagrams relocated to reference/diagrams/ alongside the wire-formats move. - 4 design diagrams corrected against source code (fips-protocol-stack, fips-identity-derivation, fips-coordinate-discovery, fips-routing-decision). - 10 pre-existing design docs reconciled with current source. Numeric corrections: stale link-MMP report bounds (now [1s, 5s] with 200 ms cold-start floor); UDP default MTU (now 1280, IPv6 minimum); node_addr formula (SHA-256(pubkey)[..16]); Noise patterns (IK at link, XK at session); peer-ACL semantics (strict allowlist requires ALL in peers.deny); daemon DNS upstream ([::1]:5354); on-the-wire bloom-filter size (1,071 bytes); obsolete Cargo-feature references (PR #79 dropped them) removed. - Transport framing tightened across the docs: TCP is for UDP-filtered networks (not NAT traversal); Tor is a deployment mode (not failover); WebSocket dropped (not a shipped FIPS transport); WiFi promoted to Implemented via Ethernet in infrastructure mode; classic-Bluetooth row removed (BLE is the only Bluetooth-mode transport). - docs/design/fips-gateway.md rewritten end-to-end to lead with the niche-feature framing and the two-halves structure. Title moved from "FIPS Outbound LAN Gateway" to "FIPS Gateway"; architecture section describes the common machinery (the fips-gateway service, the nftables table, the control socket) before splitting into separate "Outbound Half" and "Inbound Half" sections of equal weight; security considerations split per-half; no Future Work section (speculative directions live in the project tracker, not in protocol design docs). Inbound port forwarding is a first-class half rather than a buried "Implemented Extensions" subsection. - Gateway terminology unified across all gateway docs as a separate Linux service running alongside the fips daemon (its own systemd unit / OpenWrt init script). Container- pattern terms (sidecar) are reserved for the Docker/Kubernetes sidecar deployment examples — the testing/sidecar/ tree, examples/k8s-sidecar/, examples/sidecar-nostr-relay/, examples/wireguard-sidecar-macos/, and the related CHANGELOG / top-level README entries — where the term carries its standard container meaning. - Net-new design body content: rekey section in fips-mesh-layer (Noise IK msg1/msg2 over the established link, K-bit cutover, drain window, smaller-NodeAddr-wins tie-breaker on dual-init); Mesh Size Estimation and Antipoison FPR Cap sections in fips-bloom-filters; Mesh-Interface Query Filter subsection in fips-ipv6-adapter; failure-suppression knobs and clock- skew tolerance in fips-nostr-discovery; loop-rejection and mid-chain ancestor swap added to spanning-tree propagation / stability rules; Priority Chain in fips-mesh-operation renumbered to match the routing-decision diagram. - Top-level README: dropped the stale nostr-discovery cargo-feature parenthetical. docs/README.md and the four section READMEs (tutorials, how-to, reference, design) refreshed for the new structure; index rows reflect both halves of the gateway feature and the new fips-gateway CLI reference. - Cargo.toml [package.metadata.deb] assets path updated for the fips-security.md move; .gitignore /reference/ rule anchored to repo root so docs/reference/ is trackable. - packaging/openwrt-ipk/files/etc/fips/fips.yaml configuration-doc URL updated to the new docs/reference/configuration.md location. ## Deletions - docs/design/fips-intro.md (split into the three new intro design docs). - docs/design/document-relationships.svg (orphan, no longer referenced). - docs/proposals/ tree removed; the only proposal it contained (the Nostr UDP hole-punch protocol) was rewritten as the new generic design/port-advertisement-and-nat-traversal.md.
14 KiB
Advertise Your Node on Nostr
After
resolve-peers-via-nostr your
daemon can look up a peer's current endpoint by npub. This
tutorial flips it around: you publish a signed advert listing
your own endpoint(s), so any other operator who knows your
npub can dial you the same way you dialed test-us01.
The whole exercise should take about ten minutes if you have a public IP or full-cone home NAT. A short final section covers the alternative path for symmetric-NAT networks.
What you'll build
┌───────────────────────┐
│ your fips daemon │
│ persistent npub │
└──────────┬────────────┘
│ signed advert (Kind 37195)
│ { udp:<your-public-ip>:2121, ... }
│ refreshes every 30 min
▼
┌──────────────────────────────────────────┐
│ Nostr relays │
│ relay.damus.io / nos.lol / offchain.pub│
└──────────────────────┬───────────────────┘
│
│ "what's <your-npub>'s endpoint?"
│
┌───────────┴───────────┐
│ another fips daemon │
│ knows your npub, │
│ via_nostr: true │
└───────────────────────┘
You will change two things in /etc/fips/fips.yaml:
- Flip
discovery.nostr.advertisefromfalsetotrue. - Add
advertise_on_nostr: trueandpublic: trueundertransports.udp.
After restart, your daemon publishes a Kind 37195 event tied to your npub, listing the UDP endpoint other peers should dial.
How advertising works
Adverts are signed Nostr events. Every advert is a Kind 37195 event signed by your daemon's secret key. Anyone reading it can verify the advert really came from the npub claiming the endpoint. The advert is the
(npub → current endpoints)mapping, signed and published.
The advert lists transports the daemon is willing to expose, and only those:
Endpoints are opt-in per transport. Only transports with
advertise_on_nostr: trueare listed in your advert. Transports without that flag stay private — they still work for peers who reach you via static config, but they won't appear in your published advert.
For UDP specifically, the daemon needs to know what IP and port to put in the advert:
Determining the advertised endpoint (wildcard-bound UDP). With UDP bound to a wildcard like
0.0.0.0:2121, the daemon doesn't know its own public IP at startup. You have two ways to tell it what to put in the advert:
public: true— daemon does a one-shot STUN observation against the configured STUN servers and uses the reflexive IPv4 it learns. Right when your public IP is dynamic or you'd rather not pin it in config. Works for nodes with a directly-bound public IP and for nodes behind full-cone NAT (most home routers).external_addr: "<ip>[:<port>]"— explicit override. Right when you already know your public IP — a static residential IP, an Elastic IP behind 1:1 NAT, a cloud instance whose advertised port differs from the bind port — and you don't want to depend on STUN reachability. Required for TCP on cloud setups where binding directly to the public IP returnsEADDRNOTAVAIL.If you bind UDP to a specific public IP rather than
0.0.0.0, neither flag is needed — the daemon advertises whatever it's bound to.
Adverts don't sit on the relays forever:
TTL and refresh. Adverts have a 1-hour expiration (NIP-40
expirationtag) and the daemon re-publishes every 30 minutes. If your daemon goes offline, your advert decays from caches in roughly an hour and consumers stop trying.
Step 1: Confirm your starting state
You should be coming out of resolve-peers-via-nostr with:
- A persistent npub (
fipsctl show status | grep '"npub"'). - Nostr discovery in consume-only mode
(
discovery.nostr.enabled: true,discovery.nostr.advertise: false). - A peer entry for
test-us01withvia_nostr: trueand no static address.fipsctl show peersshows the link established.
If any of those isn't true, finish the previous tutorials first.
Capture your npub now — you'll need it for the verification step:
sudo fipsctl show status | grep '"npub"'
Copy the value.
Step 2: Enable advertising in the config
Open /etc/fips/fips.yaml and change two things.
Change 1: flip advertise to true. Find the
discovery.nostr block under node: and set:
node:
identity:
persistent: true
discovery:
nostr:
enabled: true
advertise: true
(The previous tutorial set advertise: false; you're flipping
that bit now.)
Change 2: add the UDP advert flags. Find the udp: block
under transports:. The wildcard-bind default
(0.0.0.0:2121) means the daemon needs help knowing what to
advertise — pick one of the two approaches from the callout
above.
If you want STUN auto-discovery (works for full-cone NATs and nodes with a directly-bound public IP):
transports:
udp:
bind_addr: "0.0.0.0:2121"
advertise_on_nostr: true
public: true
If you already know your public IP (e.g., a static residential IP or a cloud Elastic IP behind 1:1 NAT) and want to skip the STUN dependency:
transports:
udp:
bind_addr: "0.0.0.0:2121"
advertise_on_nostr: true
external_addr: "203.0.113.45:2121"
Replace 203.0.113.45:2121 with your actual public IP and
port. The bare-IP form external_addr: "203.0.113.45" is also
accepted; the daemon combines it with the bind port. You may
set both public: true and external_addr together — the
explicit override wins, with STUN as a logging cross-check.
advertise_on_nostr: true is the bit that says "include this
transport in my published advert" — common to both paths.
Save the file.
Step 3: Restart the daemon
sudo systemctl restart fips
sudo systemctl status fips
Status should show active (running). Within a few seconds the
daemon will:
- Run a one-shot STUN observation against the default STUN servers to learn its public IP.
- Build a Kind 37195 advert listing
udp:<public-ip>:2121(and any other transports you haveadvertise_on_nostr: trueon). - Sign the advert with the daemon's nsec.
- Publish it to the three default advert relays.
- Schedule a refresh every 30 minutes.
If STUN fails (for example, if the network blocks outbound
UDP/3478), the daemon emits a WARN line in the journal and
suppresses the UDP entry from the advert rather than publishing
a wrong address. The link to test-us01 from the previous
tutorial keeps working regardless — only the publish side is
gated on STUN.
Quick sanity check on the journal:
sudo journalctl -u fips -n 200 | grep -iE 'STUN|advert|warn' | head -20
If you see WARN lines mentioning STUN or wildcard-bind
fallthrough, jump to Troubleshooting; the
rest of the tutorial assumes the publish succeeded.
Step 4: Verify your advert is on the network
The advert is a public Nostr event — anyone, including you,
can fetch it. With the nak Nostr CLI installed, query the
relays for adverts published by your npub:
nak req -k 37195 -d "fips-overlay-v1" \
-a $(nak decode <your-npub> | jq -r .pubkey) \
--limit 1 wss://relay.damus.io
Replace <your-npub> with the npub you copied in Step 1. The
inner nak decode converts your bech32 npub to the hex pubkey
the relay filter expects.
Expect one event back. The interesting fields:
-
pubkey— your npub in hex form. -
tags— includes["d","fips-overlay-v1"](the namespace),["protocol","fips-overlay-v1"], and an["expiration", …]tag set ~1 hour in the future. -
content— JSON listing theendpointsarray. You should see one entry like:{"transport":"udp","addr":"<your-public-ip>:2121"}
That <your-public-ip> is what STUN learned. Confirm it
matches what you'd expect for your network — for a home node,
it should be your residential IP, not a 192.168.x.x LAN
address.
Step 5: Watch for inbound connections
Your advert is now consumable by any FIPS daemon running open
discovery on the same fips-overlay-v1 namespace. The public
test mesh nodes do exactly this — they subscribe to all
adverts in the namespace and try to dial new publishers.
Within a minute or two of restart, run:
sudo fipsctl show peers
In addition to your configured test-us01 peer, you may see
an entry for test-us03 (the open-discovery test mesh node).
It will have connectivity active and its own
transport_addr. This peering appeared without you
configuring anything — the test-mesh open-discovery node saw
your advert, dialed the endpoint, and Noise IK established
the link.
If no inbound peers appear, that's not necessarily a failure of advertising — it just means no one has consumed your advert and dialed back yet. The advert is on the relays regardless, verifiable in Step 4.
What you've learned
- Adverts are publish + sign. Every running FIPS daemon
with
advertise: truepublishes a signed advert; reading it is one Nostr event lookup. - Endpoint inclusion is per-transport. Only the transports
you set
advertise_on_nostr: trueon appear in the advert. public: trueinvokes STUN. Wildcard-bound UDP withpublic: trueruns a one-shot STUN observation to learn its public IP.- Refresh is automatic. Adverts re-publish every 30 minutes; consumers cache them with a 1-hour staleness bound.
- The publish side stands alone. Once your advert is on the relays, peers can dial you whether you're advertising to them specifically or not. The test mesh's open-discovery nodes will pick you up automatically.
If you're behind symmetric NAT
public: true + STUN works on most home and office NATs (the
full-cone variety) and on nodes with a directly-bound public
IP. It does not work on symmetric NAT, where the NAT mapping
is keyed on (source-port, destination-host) so the IP/port
your STUN server saw isn't the IP/port a different peer would
see.
For symmetric-NAT networks the alternative is udp:nat mode,
which advertises a placeholder udp:nat endpoint along with
the daemon's signaling-relay and STUN-server lists, and
performs UDP hole-punching at dial time. Both sides need to be
running matching configs and at least one side needs a
non-symmetric NAT for the punch to succeed; symmetric on both
sides is not reliably traversable and will time out.
The minimal config switch:
transports:
udp:
bind_addr: "0.0.0.0:2121"
advertise_on_nostr: true
public: false # ← was true; change to false
And add the signaling/STUN block under discovery.nostr:
discovery:
nostr:
enabled: true
advertise: true
dm_relays:
- "wss://relay.damus.io"
- "wss://nos.lol"
stun_servers:
- "stun:stun.l.google.com:19302"
- "stun:stun.cloudflare.com:3478"
For the full setup including peer-side config and the punch- duration knob, see ../how-to/enable-nostr-discovery.md § Capability 2c.
Separately from NAT considerations, FIPS supports running a node behind a Tor onion service as a deployment shape in its own right — chosen for the privacy, anonymity, and censorship-resistance properties it brings, not as a fallback when UDP or TCP fail. If those properties are an independent goal for your node, see ../how-to/enable-nostr-discovery.md § Sub-scenario 2b and ../how-to/deploy-tor-onion.md.
Troubleshooting
If your advert doesn't appear on the relays:
-
STUN failed. Check the journal for WARN lines mentioning STUN or wildcard-bind. The most common causes are outbound UDP/3478 blocked or DNS for
stun.l.google.comfailing. Try:dig stun.l.google.comandnc -uvz stun.l.google.com 19302to verify reachability. -
Wrong public IP advertised. If
nakshows your advert with a non-public address (e.g.,10.x.x.xor192.168.x.x), STUN didn't see your real public IP — likely you're behind a CGNAT that NATs your STUN traffic too, or a corporate firewall that proxies it. Switch to theexternal_addrform from Step 2 with your actual public IP, or replacepublic: truewith the bound interface IP directly underbind_addr. -
Relay reachability.
nak reqagainst a relay you can reach but no events return — possibly the publish failed silently because the daemon couldn't connect to that specific relay. Try the other two:nak req ... wss://nos.lol nak req ... wss://offchain.pub -
advertise_on_nostrtypo. YAML is case-sensitive and silently ignores unknown keys. Ifnakreturns no advert at all, double-check the spelling on the UDP block and thatdiscovery.nostr.advertise: trueis also set.
What's next
-
Open discovery. open-discovery flips the consume side symmetric — switch your daemon to
policy: openand watch your peer list populate from the ambientfips-overlay-v1namespace, the same mechanismtest-us03is using right now to find you. -
Host a service of your own. host-a-service walks through bringing up an HTTP server addressable as
<your-npub>.fips, the same way the connecting node now reachestest-us01. The natural follow-on now that other operators can dial you by npub.
For the operator-style scenario reference covering all five shapes of Nostr discovery side-by-side (consume-only, publish-direct, publish-Tor, NAT traversal, open):
For the wire-format and discovery design:
- ../reference/nostr-events.md — Kind 37195 advert format, Kind 21059 traversal signaling.
- ../design/fips-nostr-discovery.md — discovery runtime design, security and threat model.