mirror of
https://github.com/jmcorgan/fips.git
synced 2026-10-05 19:18:25 +00:00
pfSense is FreeBSD underneath, but the FreeBSD package does not work there, failing in three silent ways. pfSense runs only /usr/local/etc/rc.d/*.sh at boot and re-runs them when WAN gets a new address, so a suffixless rc script never starts; unbound.conf is generated from config.xml with no conf.d, so a drop-in is never read; and on a firewall where the default-on "Allow IPv6" has been turned off, unbound is then generated with do-ip6: no and a responder on ::1 is unreachable. So this ships fips.sh, wires the fips. zone into the DNS Resolver through config.xml, and binds the responder on 127.0.0.1 for robustness against that last case. The rc script is plain sh: what pfSense imposes is the .sh name and that a re-run leave a running daemon alone and exit 0. It identifies the daemon by process name and recovers an orphaned daemon(8) supervisor found via fstat, since a locked empty pidfile makes daemon(8) report pid -1. The DNS setup is a manual step, never run from post-install, and validates the merged options with unbound-checkconf (pfSense's test_unbound_config) before touching config.xml, so a bad merge cannot take DNS from every client behind the firewall. The daemon runs under daemon(8) -H so newsyslog can rotate its log by signalling a reopen. Packages link statically by default: pfSense runs a FreeBSD base that cannot be obtained to link against. A firmware upgrade keeps the package (pfSense-upgrade removes only pfSense-pkg-*; confirmed on a live Plus 26.03.1 -> 26.07 upgrade, aarch64 — the package survived and the daemon restarted at boot. That is a minor, FreeBSD 16 -> 16 change; the cross-major compat case is still only source-reasoned). aarch64 is refused, where a static binary faults at posix_spawn. The mechanics the two builders share — version derivation, the stage layout, the manifest fields, the @sample scripts and pkg create — live in packaging/common/pkg-lib.sh, which both source; the FreeBSD package is byte-identical before and after that extraction. One ABI can serve more than one product: CE 2.9 and Plus 26.x on Intel are both FreeBSD:16:amd64 with a byte-identical artifact, named ...-ce2.9-plus26-amd64.pkg. The pfSense package is built and checked in its own CI job — separate from the FreeBSD package, and not a dependency of the release job, so a pfSense-only failure reds that job alone and is never a release asset. It is kept as a workflow artifact until it has been installed on a real pfSense box. CI produces the CE 2.8.1 (FreeBSD:15:amd64) package; CE 2.9, Plus 26.x Intel and ARM need a FreeBSD 16 build host the CI does not have, and ARM stays build-it-yourself because rustup ships no toolchain for it. testing/check-pfsense-pkg.sh validates a built package on any FreeBSD host and runs in that CI job: contents, modes, a positive boot-script lifecycle against a stub daemon, php -l and a fips_strip_block unit test of the config.xml helper. Installing on a real pfSense box, and the firmware-upgrade behaviour, are covered only by an aarch64 hardware run and pfSense-upgrade's source; the README records what is and is not tested. Co-authored-by: Johnathan Corgan <johnathan@corganlabs.com>
376 lines
13 KiB
Markdown
376 lines
13 KiB
Markdown
# FIPS Packaging
|
|
|
|
This directory contains packaging for all supported target platforms.
|
|
Most build outputs go to `deploy/` at the project root; `make ipk`
|
|
and `make apk` write to `dist/` instead.
|
|
|
|
## Quick Start
|
|
|
|
```sh
|
|
make deb # Debian/Ubuntu .deb (built in the pinned container)
|
|
make tarball # systemd install tarball
|
|
make ipk # OpenWrt .ipk (opkg, OpenWrt 24.x and earlier)
|
|
make apk # OpenWrt .apk (apk-tools, mandatory on OpenWrt 25+)
|
|
make aur # Arch Linux AUR package (fips-git, local build + namcap)
|
|
make pkg # macOS .pkg installer
|
|
make freebsd # FreeBSD .pkg package (on FreeBSD; use gmake)
|
|
make pfsense # pfSense .pkg package (on FreeBSD; use gmake)
|
|
make zip # Windows .zip package
|
|
make all # deb + tarball (default)
|
|
```
|
|
|
|
## The two Debian build paths
|
|
|
|
`make deb` builds in a container pinned to the oldest supported
|
|
distribution, named with the glibc floor in
|
|
[build-floor.env](build-floor.env), and checks the package it produced
|
|
against that floor before handing it back. Its only host prerequisite is
|
|
docker: the toolchain and the build dependencies live in the image. This
|
|
is the path the release workflow, the integration suite and the internal
|
|
builder all take, so a package that passes locally is built the way the
|
|
shipped one is.
|
|
|
|
`make deb-host` is the old path. It builds on the host, at whatever glibc
|
|
the host has, and it is checked against nothing. Use it for local
|
|
iteration only. A package built on a current distribution records a
|
|
version dependency that the loader refuses on Debian 12 and Ubuntu 22.04,
|
|
which is what shipped in every Linux artifact from v0.3.0 through v0.5.0,
|
|
so it must not produce anything anyone else installs.
|
|
|
|
## Build Prerequisites
|
|
|
|
The prerequisites below apply to the host-build targets. `make deb` needs
|
|
docker and nothing else.
|
|
|
|
These targets build FIPS from source, so the host needs a build
|
|
environment in addition to a Rust toolchain (the version pinned in
|
|
`rust-toolchain.toml` is auto-installed by rustup).
|
|
|
|
On Linux, `libclang` is **required**: the LAN gateway's nftables
|
|
bindings are generated by `bindgen` at build time, which needs
|
|
`libclang.so` on the build host. Without it the build fails inside the
|
|
`rustables` crate with an "Unable to find libclang" error.
|
|
|
|
```sh
|
|
sudo apt install libclang-dev # Debian / Ubuntu
|
|
```
|
|
|
|
This is a build-time prerequisite only — it is not a runtime
|
|
dependency, so hosts installing a pre-built `.deb` do not need it.
|
|
|
|
BLE is not optional, and it is not universal either. `build.rs` sets
|
|
`ble_available` for glibc Linux or Android, which is the set of
|
|
platforms with a concrete backend: the transport is absent from musl
|
|
Linux, macOS, FreeBSD and Windows builds entirely. On glibc Linux
|
|
`libdbus-1-dev` and `pkg-config` are hard build prerequisites: there is
|
|
no probe that skips BLE when they are missing. The BlueZ daemon is a
|
|
runtime dependency and is not needed to build.
|
|
|
|
## Directory Structure
|
|
|
|
```text
|
|
packaging/
|
|
aur/ Arch Linux AUR packaging (PKGBUILD, supporting files)
|
|
common/ Shared assets (default config, hosts file) and pkg-lib.sh,
|
|
the helpers the FreeBSD and pfSense builders share
|
|
debian/ Debian/Ubuntu .deb packaging via cargo-deb
|
|
freebsd/ FreeBSD .pkg packaging via pkg-create(8)
|
|
pfsense/ pfSense .pkg packaging (FreeBSD-based, but not the same)
|
|
macos/ macOS .pkg installer via pkgbuild
|
|
nixos/ NixOS flake module (services.fips.*)
|
|
systemd/ Generic Linux systemd tarball packaging
|
|
openwrt-ipk/ OpenWrt .ipk packaging via cargo-zigbuild (opkg)
|
|
openwrt-apk/ OpenWrt .apk packaging via cargo-zigbuild + apk mkpkg
|
|
windows/ Windows .zip package with service scripts
|
|
```
|
|
|
|
## Formats
|
|
|
|
### Debian/Ubuntu (`.deb`)
|
|
|
|
Built with [cargo-deb](https://github.com/kornelski/cargo-deb). Installs
|
|
`fips`, `fipsctl`, `fipstop`, and `fips-gateway` to `/usr/bin/`, ships
|
|
the `fips`, `fips-dns`, `fips-firewall`, and `fips-gateway` systemd
|
|
units, and enables the `fips` and `fips-dns` services.
|
|
|
|
The default configuration ships as an example at
|
|
`/usr/share/fips/fips.yaml.example` and is **not** a dpkg conf-file.
|
|
(It is deliberately **not** under `/usr/share/doc`, which minimal and
|
|
container installs path-exclude, since the postinst reads it at install
|
|
time.)
|
|
On install, `postinst` seeds `/etc/fips/fips.yaml` (mode 600) from the
|
|
example **only if it does not already exist**, so a configuration that
|
|
was rendered by configuration management or edited by an operator is
|
|
never prompted for or clobbered on upgrade. To reset to defaults, remove
|
|
`/etc/fips/fips.yaml` and reinstall, or copy the example back manually.
|
|
|
|
```sh
|
|
# Build
|
|
make deb
|
|
|
|
# Install
|
|
sudo dpkg -i deploy/fips_<version>_<arch>.deb
|
|
|
|
# Remove (preserves config and keys)
|
|
sudo dpkg -r fips
|
|
|
|
# Purge (removes config and identity keys)
|
|
sudo dpkg -P fips
|
|
```
|
|
|
|
### systemd Tarball
|
|
|
|
A self-contained tarball with binaries and an `install.sh` script for
|
|
any systemd-based Linux distribution.
|
|
|
|
```sh
|
|
# Build
|
|
make tarball
|
|
|
|
# Install (on target host)
|
|
tar -xzf deploy/fips-<version>-linux-<arch>.tar.gz
|
|
sudo ./fips-<version>-linux-<arch>/install.sh
|
|
```
|
|
|
|
See [systemd/README.install.md](systemd/README.install.md) for full
|
|
installation and configuration instructions.
|
|
|
|
### OpenWrt (`.ipk`, opkg — OpenWrt 24.x and earlier)
|
|
|
|
Cross-compiled with cargo-zigbuild and assembled as a standard `.ipk`
|
|
archive. Supports aarch64, mipsel, mips, arm, and x86\_64 targets.
|
|
|
|
```sh
|
|
# Build (default: aarch64)
|
|
make ipk
|
|
|
|
# Build for a specific architecture
|
|
bash packaging/openwrt-ipk/build-ipk.sh --arch mipsel
|
|
```
|
|
|
|
See [openwrt-ipk/README.md](openwrt-ipk/README.md) for router-specific
|
|
installation instructions.
|
|
|
|
### OpenWrt (`.apk`, apk-tools — mandatory on OpenWrt 25+)
|
|
|
|
OpenWrt 25 makes apk-tools the mandatory package manager (it is opt-in on
|
|
24.10). Same SDK-free approach
|
|
(cargo-zigbuild), but the `.apk` container is assembled by `apk mkpkg`
|
|
rather than hand-rolled, so the build additionally needs an apk-tools v3
|
|
`apk` binary built from source. The installed-filesystem payload is shared
|
|
with the `.ipk` package.
|
|
|
|
```sh
|
|
# Build (default: aarch64; also x86_64)
|
|
make apk
|
|
|
|
# Build for a specific architecture
|
|
bash packaging/openwrt-apk/build-apk.sh --arch x86_64
|
|
```
|
|
|
|
Packages are unsigned; install with `apk add --allow-untrusted`. See
|
|
[openwrt-apk/README.md](openwrt-apk/README.md) for building apk-tools and
|
|
router-specific installation.
|
|
|
|
### macOS (`.pkg`)
|
|
|
|
Built with `pkgbuild` (included with Xcode command-line tools). Installs
|
|
binaries to `/usr/local/bin/`, config to `/usr/local/etc/fips/`, sets up
|
|
the `/etc/resolver/fips` DNS resolver for `.fips` domains, and loads a
|
|
launchd daemon. The TUN device is named `utun<N>` (kernel-assigned)
|
|
rather than `fips0`.
|
|
|
|
```sh
|
|
# Build
|
|
make pkg
|
|
|
|
# Install
|
|
sudo installer -pkg deploy/fips-<version>-macos-<arch>.pkg -target /
|
|
|
|
# Remove
|
|
sudo packaging/macos/uninstall.sh
|
|
```
|
|
|
|
### FreeBSD (`.pkg`)
|
|
|
|
Built natively on a FreeBSD host with `pkg create`. Ships `fips`,
|
|
`fipsctl`, and `fipstop` (`fips-gateway` is excluded — its NAT backend
|
|
is nftables, Linux-only), rc.d services, and `.fips` DNS integration
|
|
for `local_unbound`, `unbound`, or `dnsmasq`. Config installs
|
|
sample-style under `/usr/local/etc/fips/` (edits survive upgrades).
|
|
|
|
```sh
|
|
# Build (on FreeBSD; this Makefile needs GNU make — pkg install gmake)
|
|
gmake freebsd
|
|
# or directly, no gmake needed:
|
|
./packaging/freebsd/build-pkg.sh
|
|
|
|
# Install
|
|
pkg add ./deploy/fips-<version>-freebsd-<arch>.pkg
|
|
sysrc fips_enable=YES fips_dns_enable=YES
|
|
service fips start
|
|
service fips_dns start
|
|
```
|
|
|
|
See [freebsd/README.md](freebsd/README.md) for host resolver setup and
|
|
field-tested caveats.
|
|
|
|
### pfSense (`.pkg`)
|
|
|
|
pfSense is FreeBSD underneath, but the FreeBSD package does not work
|
|
there, and fails silently in three ways: pfSense boots packages by
|
|
globbing `/usr/local/etc/rc.d/*.sh` (a suffixless rc script is never
|
|
run), it generates `unbound.conf` from `config.xml` and reads no
|
|
`conf.d` directory (the DNS drop-in is never read), and it writes
|
|
`do-ip6: no` unless "Allow IPv6" is enabled (so a responder on `[::1]`
|
|
is unreachable). This package ships `fips.sh`, integrates DNS through
|
|
the DNS Resolver custom options in `config.xml`, and binds the
|
|
responder on `127.0.0.1`.
|
|
|
|
Unlike the other packages, this one **links statically by default**
|
|
(`--dynamic` opts out). pfSense runs a FreeBSD base you cannot
|
|
obtain — Netgate builds Plus from its own 16.0-CURRENT snapshot — so
|
|
a dynamically linked binary can reference a libc symbol the appliance
|
|
does not export, install cleanly, and then refuse to start. A static
|
|
package declares no shared libraries at all.
|
|
|
|
**On aarch64 this is refused, not applied.** A statically linked
|
|
aarch64 FreeBSD binary faults where `posix_spawn` should be, so the
|
|
daemon dies the first time it shells out. ARM builds must pass
|
|
`--dynamic`, and then `ldd` on the appliance is the check that the
|
|
base drift is not real.
|
|
|
|
The build host's architecture and FreeBSD major must still match the
|
|
target's: pfSense CE 2.8.1 is FreeBSD 15 amd64; CE 2.9.0 and Plus 26.x are
|
|
FreeBSD 16 (amd64, plus aarch64 for Plus on ARM appliances), and `pkg` refuses a
|
|
mismatched ABI. No aarch64 package is published: rustup ships no
|
|
toolchain for aarch64 FreeBSD, so such a build cannot honour the
|
|
`rust-toolchain.toml` pin. It is build-it-yourself.
|
|
|
|
```sh
|
|
# Build (on FreeBSD; this Makefile needs GNU make — pkg install gmake)
|
|
gmake pfsense
|
|
# or directly, no gmake needed:
|
|
./packaging/pfsense/build-pkg.sh
|
|
|
|
# Validate the package before shipping it
|
|
./testing/check-pfsense-pkg.sh deploy/fips-<version>-pfsense-ce2.8-amd64.pkg
|
|
|
|
# Install (on the firewall, as root)
|
|
pkg add ./fips-<version>-pfsense-ce2.8-amd64.pkg
|
|
/usr/local/etc/rc.d/fips.sh start
|
|
/usr/local/libexec/fips/fips-dns-setup # edits config.xml; run deliberately
|
|
```
|
|
|
|
Not a Netgate-supported package, and a pfSense firmware upgrade removes
|
|
it. See [pfsense/README.md](pfsense/README.md) for the "Allow IPv6"
|
|
prerequisite the mesh depends on, firewall-rule notes, and removal
|
|
behaviour.
|
|
|
|
### Windows (`.zip`)
|
|
|
|
A ZIP archive containing binaries, default config, and PowerShell
|
|
service helper scripts. Requires the [wintun](https://www.wintun.net/)
|
|
driver for TUN support.
|
|
|
|
```powershell
|
|
# Build
|
|
make zip
|
|
|
|
# Or directly
|
|
powershell -File packaging/windows/build-zip.ps1
|
|
|
|
# Extract and install as service (requires Administrator)
|
|
Expand-Archive deploy\fips-<version>-windows-x86_64.zip -DestinationPath fips
|
|
cd fips
|
|
powershell -File install-service.ps1
|
|
|
|
# Uninstall (preserves config)
|
|
powershell -File uninstall-service.ps1
|
|
|
|
# Uninstall and remove config
|
|
powershell -File uninstall-service.ps1 -RemoveAll
|
|
```
|
|
|
|
### Arch Linux (AUR)
|
|
|
|
Two AUR packages are maintained: `fips` (release, builds from tagged
|
|
tarball) and `fips-git` (development, builds from latest git master).
|
|
|
|
```sh
|
|
# Build and validate locally (git variant)
|
|
make aur
|
|
|
|
# Install from AUR
|
|
yay -S fips-git # development build from master
|
|
yay -S fips # release build from latest tag
|
|
```
|
|
|
|
See [aur/README.md](aur/README.md) for AUR publication instructions
|
|
and maintainer guide.
|
|
|
|
### Nix / NixOS (flake)
|
|
|
|
A [flake](../flake.nix) at the project root builds all four binaries
|
|
(`fips`, `fipsctl`, `fips-gateway`, `fipstop`) from source. It pins the
|
|
exact toolchain from `rust-toolchain.toml` via
|
|
[fenix](https://github.com/nix-community/fenix) and wires up the
|
|
build-time native dependencies (`libclang` for `bindgen`, plus `dbus`
|
|
and `pkg-config` for BLE), so it needs no system setup beyond Nix with
|
|
flakes enabled.
|
|
|
|
```sh
|
|
nix build .#fips # build the package (all four binaries)
|
|
nix run .#fips -- --help # run a binary directly
|
|
nix run .#fipsctl -- show status
|
|
nix develop # dev shell with the pinned toolchain + cargo-edit
|
|
nix flake check # build + validate the flake
|
|
```
|
|
|
|
The flake also exposes:
|
|
|
|
- `overlays.default` — adds `pkgs.fips` to nixpkgs
|
|
- `nixosModules.default` — a NixOS module (`packaging/nixos/`) that provides
|
|
`services.fips.enable` and runs the daemon as a systemd service
|
|
|
|
**As a package only** (no service management):
|
|
|
|
```nix
|
|
environment.systemPackages = [ fips.packages.${system}.default ];
|
|
```
|
|
|
|
**As a managed NixOS service** (recommended — starts on boot, journalctl logs):
|
|
|
|
```nix
|
|
# flake.nix
|
|
{
|
|
inputs.fips = {
|
|
url = "github:jmcorgan/fips";
|
|
inputs.nixpkgs.follows = "nixpkgs";
|
|
};
|
|
|
|
outputs = { self, nixpkgs, fips, ... }@inputs: {
|
|
nixosConfigurations.myhost = nixpkgs.lib.nixosSystem {
|
|
system = "x86_64-linux";
|
|
specialArgs = { inherit inputs; };
|
|
modules = [
|
|
./configuration.nix
|
|
fips.nixosModules.default
|
|
{ services.fips.enable = true; }
|
|
];
|
|
};
|
|
};
|
|
}
|
|
```
|
|
|
|
See [`packaging/nixos/README.md`](nixos/README.md) for the full option
|
|
reference (`services.fips.enable`, `.package`, `.configFile`,
|
|
`.openFirewall`).
|
|
|
|
## Shared Assets
|
|
|
|
`common/` contains assets used across packaging formats:
|
|
|
|
- `fips.yaml` — default configuration (ephemeral identity, UDP/TCP/TUN/DNS)
|
|
- `hosts` — static hostname-to-npub mappings for `.fips` DNS resolution
|