Make a passing CI/release result mean the checks actually ran. - .forgejo/workflows/ci.yml is fail-closed: it provisions the pinned toolchain or fails, then runs one 'make ci' (fmt-check, clippy, workspace tests, VM-harness safety tests, release build, static installer build). - Pin stable Rust 1.93.1 in installer-rs/rust-toolchain.toml; run cargo gates with --locked for reproducible dependencies. - phoebus-release gates now records passed/failed/blocked/skipped/not_run (only passed is a pass), executes real host gate commands, and imports the existing VM-harness results.json instead of a competing harness. Gates with no automation are always blocked. - Bind gate reports and harness evidence to a candidate name+SHA-256 (--candidate; PHOEBUS_VM_ARTIFACT[_SHA256]); stale or unbound evidence is failed, never passed. - publish refuses unless the report is candidate-bound and all-passed, the manifest verifies the artifact and a detached signature verifies; atomic publish preserves and restores the previous release on failure. - vmsafety.Results records the verified artifact digest; 3 new Python tests. - 20 new Rust regression tests; ADR 0012 and docs updated. Verified locally: make ci (364 Rust tests, 19 harness tests, release and static builds) exit 0; static binary is static-pie linked. CI runner, VM and model gates remain unexecuted here.
192 lines
12 KiB
Markdown
192 lines
12 KiB
Markdown
# Status
|
|
|
|
Truthful implementation/verification matrix. Vocabulary:
|
|
|
|
- **Implemented** — code exists.
|
|
- **Unit tested** — covered by automated tests that run on any host.
|
|
- **VM verified** — exercised in the disposable QEMU/OVMF VM.
|
|
- **Hardware verified** — exercised on real hardware.
|
|
- **Not verified** — do not claim it works.
|
|
|
|
## Proven baseline (do not regress)
|
|
|
|
A complete installation in a disposable UEFI VM, booted with the ISO detached:
|
|
|
|
```
|
|
QEMU + OVMF (UEFI)
|
|
30 GiB qcow2, virtio-blk (/dev/vda); live ISO at /dev/sr0
|
|
GPT: 1 GiB FAT32 ESP + LUKS2 remainder
|
|
Btrfs: @ @home @var @snapshots @swap
|
|
Gentoo systemd stage3 (default/linux/amd64/23.0/systemd)
|
|
systemd-boot + BLS entry + dracut initramfs
|
|
LUKS2 passphrase unlock at boot
|
|
systemd PID 1, login, networking
|
|
systemctl is-system-running = running; 0 failed units
|
|
```
|
|
|
|
Boot timing (Rust installer): 1.378 s kernel + 5.238 s initrd + 4.114 s
|
|
userspace = 10.730 s.
|
|
|
|
The committed VM harness (`installer/tests/vm/serial-driver.py` +
|
|
`install.sh`) drives the **static Rust binary**; the Bash installer is no longer
|
|
on the install path (Bash migration Phase 2, see
|
|
`docs/VM-BOOT-VERIFICATION.md`).
|
|
|
|
A second harness (`installer/tests/vm/appliance-driver.py` +
|
|
`appliance-guest.sh`) drives the Debian-Live appliance ISO. On 2026-09-21 it
|
|
produced `INSTALL-RC=0`, `NO_SECRET_LEAK`, and a detached boot
|
|
(`systemd`, running, 0 failed units) whose Btrfs history contains the installer's
|
|
coordinated `@` + `@var` **initial known-good** snapshot and a snapshot-based
|
|
recovery boot entry (see `docs/VM-BOOT-VERIFICATION.md`). `sys undo` itself is
|
|
still not VM-verified.
|
|
|
|
## Matrix
|
|
|
|
| Area | Implemented | Unit tested | VM verified | Hardware verified |
|
|
|------|-------------|-------------|-------------|-------------------|
|
|
| Config (TOML + legacy), validation | yes | yes | yes | n/a |
|
|
| Hardware/disk discovery, protection | yes | yes | yes | no |
|
|
| Install plan + destructive preview | yes | yes | yes | n/a |
|
|
| Destructive authorization (ERASE) | yes | yes | yes | n/a |
|
|
| GPT partitioning + ESP | yes | yes | yes | no |
|
|
| LUKS2 format/open/close | yes | yes | yes | no |
|
|
| Btrfs subvolumes + swapfile | yes | yes | yes | no |
|
|
| fstab / crypttab generation | yes | yes | yes | no |
|
|
| stage3 fetch + SHA-256 verify + extract | yes | yes | yes | n/a |
|
|
| Portage config + sync + getuto | yes | yes | yes | n/a |
|
|
| Signed Gentoo binary install | yes | yes | yes | n/a |
|
|
| Source package compilation | yes | yes | yes | n/a |
|
|
| Kernel install + dracut initramfs | yes | yes | yes | no |
|
|
| systemd-boot + BLS | yes | yes | yes | no |
|
|
| Boot default pins the real kernel (not recovery) | yes | yes | yes | no |
|
|
| Recovery BLS entry (rescue.target) | yes | yes | boots (not default) | no |
|
|
| Users, passwords, sudo | yes | yes | yes | n/a |
|
|
| Locale/timezone/keymap/services | yes | yes | yes | n/a |
|
|
| Rust VM boot parity | yes | yes | yes | no |
|
|
| Rust TUI | yes | yes | smoke test | no |
|
|
| Typed GUI bridge (`--gui-bridge`) | yes | yes (dry-run) | live VM | n/a |
|
|
| Graphical welcome + install wizard (Quickshell) | yes | guards tested | live graphical VM | no |
|
|
| Phoebus brand system (SVG + tokens) | yes | yes | live VM | n/a |
|
|
| Desktop profile (dwl/waybar/mako/swaybg) | yes | partial | headless only | no |
|
|
| Desktop session script (socket wait, polkit, cleanup) | yes | yes | functional test (stubs) | no |
|
|
| PipeWire/WirePlumber | yes | no | headless (`wpctl`) | no |
|
|
| Flatpak + flathub | yes | no | installed + remote | no |
|
|
| XWayland / polkit agent / kitty / wofi | yes | no | installed, not launched | no |
|
|
| Package policy + measured history | yes | yes | yes (326 entries) | no |
|
|
| Background update preparation | yes | yes | yes (fetch; buildpkgonly skipped) | no |
|
|
| Btrfs snapshots + history | yes | yes | yes | no |
|
|
| Coordinated snapshot sets (`@` + `@var`) | yes | yes | no | no |
|
|
| Btrfs rollback (`sys undo`) | yes | yes | no | no |
|
|
| Recovery/known-good BLS entry | yes | yes | no | no |
|
|
| Snapshot retention + free-space gate | yes | yes | no | no |
|
|
| AI typed proposals + evidence review | yes | yes | fixture end-to-end | n/a |
|
|
| AI guided install (DeepSeek/OpenAI) | yes | yes | fixture path only (no live call) | n/a |
|
|
| AI privacy boundary (facts only) | yes | yes | no | n/a |
|
|
| AI OS sandbox (systemd hardened unit) | yes | yes | no | no |
|
|
| Installed assistant (`sys ask`) | yes | yes | fixture path only (no live call) | n/a |
|
|
| Resolved package effects + approval binding | yes | yes | no | n/a |
|
|
| Transaction log | yes | yes | no | no |
|
|
| Flatpak/Nix bounded typed actions | yes | yes | no | no |
|
|
| Desktop session helpers (menu/lock/idle) | yes | yes | functional test (stubs) | no |
|
|
| Mango + DankMaterialShell profile | yes | yes | live graphical VM yes; installed no | no |
|
|
| Mango is the default desktop | yes | yes | live graphical VM yes; installed install pending | no |
|
|
| greetd login (Mango default, dwl fallback) | yes | yes | no | no |
|
|
| Live desktop ISO (Mango + DMS) | yes | guards tested | graphical VM + GUI journey + detached boot | no |
|
|
| Live welcome autostart + duplicate prevention | yes | guards tested | live graphical VM | no |
|
|
| Welcome primary action keyboard-focus | yes | guards tested | live graphical VM | no |
|
|
| VM harness disk safety + structured results + artifact binding | yes | yes (19 tests) | n/a | n/a |
|
|
| Target disk revalidation before partition | yes | yes | no | n/a |
|
|
| Bridge replay/concurrency + input bounds | yes | yes | no | n/a |
|
|
| Provider transport endpoint/size hardening | yes | yes | no | n/a |
|
|
| `TargetRoot` symlink-escape guard | yes | yes | n/a | n/a |
|
|
| OpenCode server capability probe | yes | yes | real host probe + auth + policy | n/a |
|
|
| OpenCode proposal adapter (real inference) | yes | yes | real model (`deepseek-v4-flash`) | n/a |
|
|
| OpenCode in GUI / CLI / `sys ask` | yes | yes | GUI AI step + `sys ask` live | n/a |
|
|
| OpenCode full graphical install | yes | yes | AI gate passed; install not run | n/a |
|
|
| Mandatory AI requires a validated interaction | yes | yes | bridge + CLI | n/a |
|
|
| GURU packaging (scoped keywords) | yes | yes | no (build/install unverified) | no |
|
|
| Fail-closed CI (`make ci`, pinned toolchain) | yes | yes (`make ci` green locally) | no runner registered | n/a |
|
|
| Executable release gates + evidence-bound publish | yes | yes | no (no VM/model here) | n/a |
|
|
| Harness evidence import + stale-evidence refusal | yes | yes | no | n/a |
|
|
| Atomic publish + previous-release preservation | yes | yes | no | n/a |
|
|
| `sys` verbs | yes | yes | yes | no |
|
|
| OpenCode pinned bootstrap | yes | yes | no | n/a |
|
|
| Release manifest/verify | yes | yes | no | n/a |
|
|
| NVIDIA proprietary | architecture only | no | no | no |
|
|
| UKI | no (deferred) | no | no | no |
|
|
|
|
## Known limitations
|
|
|
|
- **Desktop graphical session** was verified with the *headless* wlroots
|
|
backend because the serial-only VM has no logind seat. The DRM path and a
|
|
real VT login are not yet exercised. `phoebus-session` is written by the
|
|
installer for that purpose.
|
|
- **Flatpak apps** were not installed from the remote; only the runtime and
|
|
the flathub remote were verified.
|
|
- **NVIDIA** is architecturally allowed but not verified on hardware.
|
|
- **UKI** is deferred; the dracut UKI generator did not embed the kernel
|
|
command line, so BLS is used (and verified).
|
|
- **Rollback** is implemented and unit-tested end to end at the command/text
|
|
layer (snapshot sets, root/var generation, fstab and BLS rewriting, kernel
|
|
selection, interruption resume, retention, free-space gate), but the
|
|
destructive VM acceptance test (deliberately broken update -> `sys undo` ->
|
|
detached reboot -> package-state check -> recovery with no network/model) has
|
|
not been run. `sys undo` is present; treat VM verification as the gate before
|
|
relying on it.
|
|
- **Mango + DankMaterialShell** is the default desktop
|
|
(`desktop.profile = "mango"`, Flatpak on). It is implemented with Mango
|
|
0.17.2, DMS (pinned release), Quickshell 0.3.1 and scenefx 0.5 from the GURU
|
|
overlay, a dwl fallback session and scoped `~amd64` keywords. The default is
|
|
set by explicit owner decision; it has not been installed or booted in a
|
|
graphical VM, so **no desktop stability is claimed**. `docs/STATUS.md`
|
|
distinguishes "default in configuration", "successfully built" and
|
|
"graphically verified".
|
|
- **The live desktop ISO** (`installer/live/build.sh`) builds a Debian testing
|
|
rootfs with Mango + DMS, live-only autologin, a branded welcome window and a
|
|
graphical installer frontend over the typed bridge. Its desktop-payload
|
|
guards are unit-tested. The rebuilt ISO
|
|
(`sha256 428dbd75…`, 1.6 GiB, build id in `/etc/phoebus/build`) was booted in
|
|
a graphical, seat-providing VM and the automated `gui` journey passed
|
|
**23/23** checks: the welcome window opened automatically, "Install Phoebus
|
|
OS" launched the installer from the keyboard, a second launch created no
|
|
duplicate, the live medium was reported protected, keyboard navigation
|
|
reached the network and AI steps, and advancing without a connected model was
|
|
refused. An earlier appliance build of the same code path was installed
|
|
non-interactively (`INSTALL-RC=0`, `NO_SECRET_LEAK`) and booted **with the
|
|
ISO detached** (systemd running, 0 failed units, LUKS2, all Btrfs subvolumes,
|
|
network). A live AI provider call was **not** possible (no key and no local
|
|
model in this environment), so the **full graphical install past the AI step**
|
|
is not claimed; the AI step is verified as a blocked prerequisite and with a
|
|
fixture transport in unit tests. The **installed** Mango system (GURU +
|
|
compiled Quickshell/DMS) and the dwl fallback in a VM are not yet verified.
|
|
- **AI sandbox** is implemented (`systemd-run` hardening properties, tested at
|
|
the argv level) and fails closed without `systemd-run`; it has not been
|
|
exercised in a VM. Only typed actions and the privacy boundary were previously
|
|
enforced.
|
|
- **Release gates are executable and evidence-bound (ADR 0012).** `make ci`
|
|
runs fmt/clippy/tests/harness-tests/builds and is fail-closed. `phoebus-release
|
|
gates --execute` runs host gates and imports VM/seat/model evidence from the
|
|
existing harness `results.json`; unexecuted, blocked or skipped gates are
|
|
never passes. `publish` refuses unless the report is bound to the exact
|
|
candidate digest, every gate passed, the manifest verifies the artifact and a
|
|
detached signature verifies. **No CI runner is registered**, so the workflow
|
|
itself is unexecuted; the VM, graphical-seat and live-model gates are
|
|
**blocked** here (no disposable VM or model in this environment).
|
|
`no-model-recovery`, `updates-and-rollback` and `desktop-session` have no
|
|
automated harness yet and are always `blocked`, so a full release cannot be
|
|
authorized until they are automated (or given reviewed manual evidence). That
|
|
is intentional: no false pass.
|
|
- The desktop transaction compiles heavily because desktop USE does not match
|
|
the signed binhost (~26 min for the desktop set on 8 vCPUs in the test VM).
|
|
The official Gentoo binhost is OpenRC/hardened, so a systemd system can only
|
|
reuse binaries for packages whose USE matches; the policy still requests
|
|
signed binaries where it can. Publishing a matching binhost is future work.
|
|
- **Live AI provider calls are not verified.** DeepSeek/OpenAI requests are
|
|
built and reviewed by fixtures (`phoebus-ai::provider::TestTransport`) and the
|
|
curl transport is covered by a recording runner; no call was made with a real
|
|
key.
|
|
- The installer rebuilds `sys-apps/systemd` from source because
|
|
boot/policykit/cryptsetup USE differ from the binhost.
|
|
- `sys undo` is implemented with the default-subvolume, fstab, kernel-cmdline
|
|
and BLS handling described in ADR 0007; its destructive VM acceptance test is
|
|
the remaining safety gate.
|