Compass answers questions about financial, crypto and artificial intelligence regulation by quoting the legislation. It does not paraphrase the law and it does not present the text as its own. Every passage in an answer is checked character by character against the primary legislative text before a reader sees it, and every citation identifies the act and article it came from.
Two results since the August report are set out here. On a sealed set of 190 questions, Compass cited 76.5% of the articles a correct answer required, and produced no quotation that differed from the text on file. A new check compares every act in the corpus against the editions the European Union currently publishes. That check found that at least nine of those acts have no English consolidated version at all.
Certification against 190 unseen questions
On 2 September 2026 Compass answered a sealed set of 190 questions. Forty of them asked for legal content and named 162 articles that a correct answer had to cite. The other 150 asked about subjects the corpus does not cover, where the correct behaviour is to decline. The questions were written independently. None was used to build or tune the system, and the set has not been reused since.
Compass cited 124 of the 162 required articles, a rate of 76.5%. Across all 190 questions, no answer contained a quotation that differed from the stored text. It correctly declined 139 of the 150 questions the corpus could not support, a rate of 92.7%. Each answered question drew on 9.6 distinct provisions, against the 4.05 that a correct answer required.
The second of those figures carries the most weight for a legal reader. A quoted passage can be checked against the published text by anyone, and on this test every quoted passage matched.
The last figure is a limitation rather than a strength. The system cited more than twice the provisions a correct answer required, so a reader receives relevant material alongside the material that decides the question.
Why the reported score comes from a sealed set
Compass scored 82.4% on the question sets used during development, averaged over two runs at the same settings. The same system scored 76.5% on the sealed set. Scores taken from questions a system was tuned against run higher than scores taken from questions it has not seen. Compass therefore reports the sealed figure, and treats any development-set number as an upper bound rather than a result.
Checking the served text against the publisher
EU consolidated law is not edited in place. When an act is amended, the Publications Office issues a new document under a new identifier at a new address, and the old document keeps serving its original text indefinitely. A conventional page-change detector pointed at a held address reports no change, correctly and uselessly, for as long as it runs. The question that decides whether a corpus is current is a catalogue question: which edition of this act does the publisher issue today, and is it the one being served.
Compass now asks that question for every act it serves, in a single query against the EU's official metadata catalogue, in about a quarter of a second for the whole corpus. On 18 September 2026 the catalogue returned 238 consolidated editions across the 45 acts, 213 of them in English.
The check separates four results that a simpler test would report as one:
- the publisher has never issued a consolidated edition of the act, so the original act is the law;
- consolidated editions exist, but none in English, so the original act remains the only English text;
- a newer English edition applies than the one being served;
- the edition being served is not among those the publisher lists.
The last of these is treated as the most serious result. An edition that the publisher no longer lists cannot be verified against the source, whatever its content.
What the check showed about EU publishing practice
Nine of the 45 acts in the corpus have no English consolidated edition at all:
- the Digital Operational Resilience Act
- the Digital Services Act
- the Data Act
- the Data Governance Act
- the Anti-Money Laundering Regulation
- the sixth Anti-Money Laundering Directive
- the Transfer of Funds Regulation
- the Crowdfunding Regulation
- the DLT Pilot Regime
Regulation (EU) 2022/2554 on digital operational resilience illustrates the pattern. The Publications Office has issued one consolidated edition of it, available in twelve language versions. English is not among them. An English reader therefore has the original act and nothing else, and any system claiming to serve a consolidated English text of that regulation is not serving one the publisher has produced.
One further act, Regulation (EU) 2024/886 on instant credit transfers in euro, has never been consolidated in any language.
A consolidated edition can also cease to exist after publication. In June 2026 the Publications Office created a consolidated edition of Directive 2013/36/EU dated 11 July 2026. That identifier no longer resolves in the catalogue, and the file it pointed to returns a not-found response. The newest edition of that directive now listed is dated 17 January 2025. Anyone who recorded the July identifier and did not recheck it would still be citing it.
Provenance of every stored passage
Compass records, for each downloaded source file, the address it came from, the time of retrieval, its exact size and a cryptographic fingerprint of its contents. There are 370 such records across 57 instrument editions and eight languages.
On 14 September 2026 Compass re-downloaded the English package for Directive 2009/65/EC from the address recorded ten weeks earlier. It returned 93,488 bytes with a fingerprint identical to the stored one. Any passage Compass quotes can be traced to a named file, and that file can be fetched again and verified byte for byte by anyone.
The corpus as it stands
Compass serves 45 EU acts with citable English text, holding 43,916 English citable provisions. Those divide into 4,509 articles, 38,117 paragraphs and points, and 1,290 recitals and annex items. Provisions across all eight languages number 345,858. The 370 source packages behind those provisions are held with full provenance, and 20,215 cross references link provisions to one another.
