DEMO. An unaffiliated design study built by Verzi for Posognos. Not the official Posognos site and not endorsed by Posognos. Model figures come from their published CC-BY preprint; every other number is cited inline.
Grading · PsiBench edition 2026.1

What an A means, and what it does not.

A Posognos rating reports how a model performed on 492 expert-authored medication-order scenarios [1]: how much danger it caught, how many safe orders it interrupted, and whether it flagged the right clinical reason. It is a measurement of performance on a published benchmark. It is not a safety certification, and nothing on this page should be read as one.

Ratings are dated, version-pinned, independently verifiable, and withdrawn when the model changes.

EVALUATED BY POSOGNOS A PSIBENCH 2026.1 SUBSTRATE · 2026-08

One rule of red, and nothing else. The red bar is the only brand element. It survives a 34-pixel favicon, a black-and-white print and a screenshot, and it never fights the palette of whoever hosts the mark. The edition, class and issue date sit inside the frame, not in a caption beside it. A rating without them is not a rating.

EVALUATED BYPOSOGNOSAPSIBENCH 2026.12026-08 112 px, full
POSOGNOSA2026.1 64 px, reduced
A 34 px, minimum

A rectangular plaque, not a circular seal. Circles read as seals of state; plaques read as findings, and this is a finding. The mark sheds elements in a fixed order as it shrinks, but the frame, the red rule and the grade never go. At 34 pixels those three are the whole mark, and they are still recognisably yours.

01 · The bands

Five bands, and the arithmetic behind each one.

Grades are assigned on Youden’s J, sensitivity plus specificity minus one, with floors on both components. J is used because it is the only headline statistic a model cannot inflate by alerting on everything: a system that fires on every order scores exactly zero. Counts are the 40 models in the current edition.

Why floors, and not just a score. Three models in this edition reach 100% sensitivity: they catch every dangerous order in the benchmark. Two of them alert on more than 92% of all orders, and one on 97.8%. Without a specificity floor, perfect detection and reflexive alarm are indistinguishable, and the grade would reward exactly the behaviour that produced a 90% override rate in rule-based systems.

02 · What is tested

Three tiers, because one number answers the wrong question.

Each scenario presents a structured patient vignette (demographics, active diagnoses, current medications, laboratory values and allergies) plus one medication order. The model decides whether the order proceeds or an alert fires, and names the safety categories involved.

Tier 1 · Discrimination

98 scenarios

50 fatal orders against 48 deception scenarios, safe orders deliberately built to look dangerous at a glance. An always-alert classifier scores a Youden’s J of exactly zero here. This is the tier caution cannot game.

Tier 2 · Operational

394 scenarios

261 serious unsafe orders against 133 safe ones, including 41 contexts where rule-based systems are known to over-alert, counted here as orders a good model should let through. This approximates the alert-fatigue dynamics of a live ward.

Tier 3 · Attribution

311 scenarios

For every correctly raised alert: was it raised for the right clinical reason? A model can flag the right order and attribute it to the wrong category, which, under the January 2026 FDA guidance conditioning enforcement discretion on a clinician’s ability to review the basis of a recommendation, is a regulatory question and not only a quality one [4].

What is not published yet. Per-model results exist for the full 492-scenario benchmark. The tier-level breakdown (the rankings that shift between discrimination, operational and attribution) is held for a second paper that has not been posted. Those columns are absent here because they are absent from the record, and this note stays until the clinical paper is public.

03 · The limits

The most important column on this page is the right-hand one.

Every certification that has collapsed did so by letting its mark mean more than its method. These boundaries live in the licence, not only in the copy.

What a Posognos rating is

  • A measurement of one named model version, in one named configuration class, on a stated date
  • Independent. No fee is contingent on a result, and the field is published whether or not a vendor participates
  • Reproducible in method: the protocol, the categories and the scoring are public
  • Comparable: every model faces identical scenarios and identical ground truth
  • Perishable by design. A rating expires when the model version changes

What it is not, and may never be called

  • Not a finding that a model is safe. That word is prohibited in every licence Posognos issues
  • Not an approval, clearance or authorisation. Only a regulator approves. Posognos measures
  • Not a statement about a deployed product, unless the rating carries the CONFIG class [2]
  • Not evidence of clinical outcomes. No patient has been treated on the basis of this benchmark
  • Not transferable across model versions, vendors, product names or indications
04 · Using the mark

Twelve terms, and they are not negotiable.

Modelled on how the marks that survived are actually governed [3]: UL, ENERGY STAR, the Joint Commission’s Gold Seal, URAC and Euro NCAP. Every one of these exists because a seal without governance becomes a logo, and a logo is worth nothing to the company that earned it.

The mark is issued, never downloaded

Files are released to the rated party through the ratings portal at fixed sizes. There is no public asset kit and no editable master.

Two inks, and only two

Ink for the frame and type, Posognos red for the single rule. Nothing else. No gradients, no outline versions, no third colour, and no version that matches its background. A one-ink black variant is supplied for fax, engraving and single-colour print, and it is equally valid.

Proportions are locked

Scale it; never redraw, restretch, recompose or partially use it. Clear space equals the cap height of the wordmark on all sides.

Minimum 34 px on screen, 0.4 in in print

Below that, use the grade letter alone with the edition number, and link to the report.

Every published instance links to its report

The mark is not the claim. The dated report is the claim; the mark is a pointer to it.

Class, version and issue date travel with the mark

They sit inside the plaque. Removing them voids the licence.

The rated party’s own name appears alongside

The mark may never stand alone as though it were the vendor’s own credential.

No absorption

It may not be incorporated into a company name, product name, logo, domain or app icon.

The claim is bounded to what was tested

One model version, one configuration, one indication set, one date. A substrate rating does not extend to a product built on it.

Prohibited language

“Safe”, “approved”, “cleared”, “validated”, “certified safe”, “meets the highest standards”, “exceeds”. Permitted: “Rated [grade] by Posognos on PsiBench [edition], [date].”

Removal within five business days

On expiry, on withdrawal, or when the rated version is superseded in the vendor’s own product.

Ratings are revocable

For misuse of the mark, misrepresentation of scope, or evidence that the evaluated version was not the version shipped.

A seal that cannot be revoked is not a seal. It is a sticker.
05 · Verification

Every mark resolves to a record.

The plaque on a vendor’s slide is a pointer. This is what it points at, and it is the only thing that constitutes the claim.

ratingA, Youden’s J 0.754
classSUBSTRATE: no retrieval, no drug knowledge base, no few-shot
modelo4-mini (OpenAI)
benchmarkPsiBench 2026.1 · 492 scenarios · 11 safety categories
evaluated21–23 April 2026 · 3 runs per scenario · majority vote
issued / expires2026-08-21 / on next model version
detailsensitivity 95.8% · specificity 79.6% · alert rate 68.1% · missed 13 of 311
methodsdoi:10.64898/2026.06.05.26354271
fee paid by vendorNone. Evaluated from public endpoints.
06 · Sources and disclosures

Numbers without sources are marketing.

Show the 5 sources and disclosures
  1. All model figures: Proulx J, Daines B, Barton M, et al. A Three-Tier Operational Benchmark for Evaluating Large Language Models on Hospital Medication Safety. medRxiv, posted 10 June 2026. doi:10.64898/2026.06.05.26354271, Tables 1–2, CC-BY 4.0. Not certified by peer review; no confidence intervals are reported, so adjacent ranks are not statistically separable.
  2. Same source, Methods: “All models receive identical scenario text and instructions; no few-shot examples, retrieval-augmented context, or external drug database access is provided.”
  3. Mark governance modelled on published rules from UL Solutions, the ENERGY STAR Brand Book, The Joint Commission’s Gold Seal guidelines, URAC’s client marketing guidelines and Euro NCAP’s visual identity guidelines.
  4. US Food and Drug Administration, revised Clinical Decision Support Software guidance, January 2026.
  5. Disclosure. Grade thresholds on this page are an illustrative scheme constructed by Verzi for this demo and applied to the published results [5]. They are not Posognos policy. Any real banding must be pre-registered and version-controlled before results are known. The failure that cost the Leapfrog Group a federal court ruling in March 2026 was a scoring change its own expert panel never formally voted to adopt.

The next step is a scoping call, not a contract.

Name the model, the configuration or the hospital build. You get the price, the calendar and the scenario battery in writing before anything runs. Fees are published in advance and never contingent on a result.