#Testing

When Code Bends to Pass Its Tests, the Tests Are the Finding

SWCraft's tests tied the architecture model's contract to source code by line number: 5,843 file.py:line citations, all checked. The code froze around them. What the citations really proved, the switch to symbol citations, and a test rule rewritten to judge what a test asserts rather than what it reads.

The Agent Did Not Need a Better Prompt. It Needed the Manual.

Asked about SWCraft itself, an agent on the weakest available LLM got about one question in eight right, and some of its answers were invented. Given the same user guide a person reads, it got 39 or 40 of 40, on three hosts. How the answers were checked without an LLM judge, and what went wrong on the way.

A Bug Report That Contains No Architecture

The defects that matter in an architecture tool depend on the shape of a model, and the models with the right shape cannot leave the company that owns them. A model passport and a generator called Carchetype move the shape without moving the architecture.