# The BenchMark Standard v1.0.1 Errata

Corrects The BenchMark Standard v1.0, published May 2026. Register authority: CDH-003 Phase 2R.

| Row | Page | Prior text | Corrected text | Reason |
|---|---:|---|---|---|
| R0119 | 13 | “BenchBook, Sayada, and WarrantWorks are products I helped create and use in my own court.” | The company also develops court-facing software, including BenchBook.AI. Those tools are in development; none is finalized and none is deployed in any court, including mine. | SETTLED. The named tools are in development; not finalized and not deployed in any court. Product names are flagged only because this passage concerns conflict and independence. |
| R0123 | 13 | “This is not a conflict of interest.” | I have set the facts out rather than characterizing them. A judge who builds these tools sees the failure modes a framework has to catch. That is why this framework exists. | SETTLED. The approved page 13 replacement states the facts without characterizing the conflict. |
| R0125 | 13 | “Most people writing about judicial AI have never sat on the bench.” | [Deleted.] | SETTLED. The approved page 13 replacement removes this statement. |
| R0126 | 13 | “Most judges using AI tools have never built one.” | [Deleted.] | SETTLED. The approved page 13 replacement removes this statement. |
| R0127 | 13 | “Most vendors selling to courts have never presided over a case where liberty was at stake.” | [Deleted.] | SETTLED. The approved page 13 replacement removes this statement. |
| R0128 | 14 | “I have done all three.” | [Deleted.] | SETTLED. The approved page 13 replacement removes this statement. |
| R0129 | 14 | “That perspective (builder, user, and judicial officer) is what makes this framework different from every other AI governance document published to date.” | [Deleted.] | SETTLED. The approved page 13 replacement removes this statement. |
| R0137 | 14 | “The BenchMark Standard is operated by the Judicial AI Standards Institute, an independent certification body administered as a program of Velocity Venture Holdings LLC.” | The BenchMark Standard is published by the Judicial AI Standards Institute, a division of Velocity Venture Holdings LLC. The evaluation methodology is published at judicialaistandards.org. As of this version the Institute has issued no certifications and has appointed no evaluators. When certification operations begin, the registry and the evaluator roster will be published at the same address. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0138 | 14 | “The Institute publishes its registry, evaluation methodology, and current evaluator roster at judicialaistandards.org.” | The BenchMark Standard is published by the Judicial AI Standards Institute, a division of Velocity Venture Holdings LLC. The evaluation methodology is published at judicialaistandards.org. As of this version the Institute has issued no certifications and has appointed no evaluators. When certification operations begin, the registry and the evaluator roster will be published at the same address. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0139 | 14 | “Maintains the published evaluation methodology, test case repository, and scoring rubrics.” | Maintain the published evaluation methodology, test case repository, and scoring rubrics. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0140 | 14 | “Trains and qualifies independent evaluators who meet the requirements set out in Section 2.5.” | Train and qualify independent evaluators who meet the requirements set out in Section 2.5. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0141 | 14 | “Receives vendor submissions, conducts formal evaluations, and issues certification grades (Verified, Certified, or Certified-Sensitive).” | Receive vendor submissions, conduct formal evaluations, and issue certification grades (Verified, Certified, or Certified-Sensitive). | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0142 | 14 | “Publishes evaluation reports and maintains the public registry of certified tools.” | Publish evaluation reports and maintain the public registry of certified tools. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0143 | 14 | “Conducts recertification at the intervals required by each tier.” | Conduct recertification at the intervals required by each tier. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0147 | 15 | “Vendors of judicial AI tools submit their products to the Institute for evaluation.” | When certification operations begin, vendors of judicial AI tools seeking certification will submit their products to the Institute for evaluation. | Certification operations have not started. Recast the statement as future or conditional. |
| R0155 | 15 | “In Tennessee, the adopting authority is the Administrative Office of the Courts.” | Under this model, the adopting authority in Tennessee would be the Administrative Office of the Courts. | Reclassified as Descriptive because the claim describes content or context without asserting current Institute, registry, evaluator, or certification operations. |
| R0156 | 15 | “The AOC's role is policy adoption, not technical execution. Specifically, the AOC:” | If adopted, the AOC's role would be policy adoption, not technical execution. Specifically, the AOC would: | Reclassified as Descriptive because the claim describes content or context without asserting current Institute, registry, evaluator, or certification operations. |
| R0157 | 15 | “Adopts the BenchMark Standard as the recognized evaluation methodology for AI tools used in Tennessee courts.” | Adopt The BenchMark Standard as the recognized evaluation methodology for AI tools used in Tennessee courts. | Reclassified as Descriptive because the claim describes content or context without asserting current Institute, registry, evaluator, or certification operations. |
| R0158 | 15 | “Sets minimum certification requirements for court use (for example, AI tools used in Tennessee courts must hold at least BenchMark Verified status; AI tools used in juvenile, sealed, or sensitive proceedings must hold BenchMark Certified-Sensitive status).” | Set minimum certification requirements for court use (for example, AI tools used in Tennessee courts would be required to hold at least BenchMark Verified status; AI tools used in juvenile, sealed, or sensitive proceedings would be required to hold BenchMark Certified-Sensitive status). | Reclassified as Normative because the claim states a rule, criterion, requirement, or evaluation instruction rather than a current operation. |
| R0159 | 15 | “Publishes a public list of certified vendors and their grades, drawn from the Institute's registry, accessible to every court in the state.” | Publish a public list of certified vendors and their grades, drawn from the Institute's registry, accessible to every court in the state. | Certification operations have not started. Recast the statement as future or conditional. |
| R0160 | 15 | “Updates the published list as new certifications are issued, recertifications occur, and suspensions or revocations take effect.” | Update the published list as new certifications are issued, recertifications occur, and suspensions or revocations take effect. | Certification operations have not started. Recast the statement as future or conditional. |
| R0164 | 15 | “It adopts a standard developed and operated by an independent body, and it publishes the results.” | It would adopt a standard published by the certifying body and would publish the results. | Certification operations have not started. Recast the statement as future or conditional. |
| R0166 | 16 | “They consult the AOC's published list of certified vendors, see what grade each vendor holds, and make adoption decisions appropriate to their court's caseload, budget, and operational needs.” | If the AOC adopts this model and publishes a list of certified vendors, courts would consult that list, see what grade each vendor holds, and make adoption decisions appropriate to their court's caseload, budget, and operational needs. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0168 | 16 | “Reviews the AOC's published list to confirm a vendor holds the certification tier required for the intended use.” | Review the AOC's published list to confirm a vendor holds the certification tier required for the intended use. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0169 | 16 | “Reviews the published evaluation report for any conditions, remediations, or disclosures attached to the certification.” | Review the published evaluation report for any conditions, remediations, or disclosures attached to the certification. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0172 | 16 | “The technical evaluation has already been done.” | A court would not need technical capacity to evaluate AI because it would rely on a completed technical evaluation. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0177 | 16 | “What protects evaluator independence? The certifying body is structurally separate from the vendors it evaluates and from the courts that rely on certified tools.” | What protects evaluator independence? For unrelated vendors, the certifying body holds no ownership interest in the tools it evaluates and no contractual relationship with the vendor or the court beyond the evaluation itself. | SETTLED. The approved page 16 replacement distinguishes unrelated vendors from commonly owned tools and does not claim structural separation for related-party evaluations. |
| R0178 | 16 | “It has no contractual relationship with either party that creates a conflict of interest.” | Where a tool shares ownership with the Institute, structural separation is not available and is not claimed. Those submissions are handled as related-party evaluations: assignment to an independent evaluator with no interest in Velocity Venture Holdings LLC and no reporting relationship to its owner or to the author of this Standard; disclosure of the relationship on the certificate and in the registry entry; and no participation by the author in the determination. | SETTLED. The approved page 16 replacement distinguishes unrelated vendors from commonly owned tools and does not claim structural separation for related-party evaluations. |
| R0183 | 16-17 | “The technical evaluation has already been performed by qualified evaluators, the results have been published by the AOC, and the court's task reduces to a procurement decision against a known grade.” | If the model is adopted and certification operations begin, qualified evaluators would perform the technical evaluation, the AOC would publish the results, and the court's task would reduce to a procurement decision against a known grade. | SETTLED. Certification operations have not started. Recast the statement as future or conditional. |
| R0213 | 20 | “Automated testing is performed by the certifying body's evaluation team.” | When certification operations begin, automated testing will be performed by the certifying body's evaluation team. | Certification operations have not started. Recast the statement as future or conditional. |
| R0285 | 25 | “As laws change, new case law develops, and new AI failure modes are discovered, the test case repository is updated.” | When certification operations begin, the test case repository must be updated as laws change, new case law develops, and new AI failure modes are discovered. | Certification operations have not started. Recast the statement as future or conditional. |
| R0286 | 25 | “Certification is always against the current version of the repository.” | Each certification must use the repository version current when the evaluation begins. | Certification operations have not started. Recast the statement as future or conditional. |
| R0295 | 26 | “Courts and court administrators do not conduct evaluations of vendor submissions; they rely on the published certification status maintained by the certifying body.” | Courts and court administrators do not conduct evaluations of vendor submissions. When certification operations begin, they will rely on the certification status published by the certifying body. | Certification operations have not started. Recast the statement as future or conditional. |
| R0609 | 60 | “Tools that are already CJIS-certified will have a head start on Domain 4, but CJIS certification alone is insufficient.” | Tools designed to comply with the FBI CJIS Security Policy may have a head start on Domain 4, but policy compliance is not certification of a commercial AI tool and does not satisfy The BenchMark Standard by itself. | Correct inaccurate terminology by distinguishing FBI CJIS Security Policy compliance from certification of a commercial AI tool; update the source table to v6.1 dated June 25, 2026. |
| R0774 | 75 | “Certifications under the BenchMark Standard are issued by the Judicial AI Standards Institute, the certifying body described in Section 1.7.” | When certification operations begin, certifications under The BenchMark Standard will be issued by the Judicial AI Standards Institute, the certifying body described in Section 1.7. | Certification operations have not started. Recast the statement as future or conditional. |
| R0777 | 75 | “Once issued, the certification appears on the public registry maintained by the Institute at judicialaistandards.org and on the list published by the adopting authority.” | Once issued, the certification will appear on the public registry maintained by the Institute at judicialaistandards.org and, if an adopting authority publishes such a list, on that list. | Certification operations have not started. Recast the statement as future or conditional. |
| R0805 | 77 | “Issued by the Judicial AI Standards Institute.” | “Issued by the Judicial AI Standards Institute.” Retained as certificate text within a section labeled “Specimen Form of Certificate.” | Reframe as a specimen form of certificate without putting future tense inside the certificate text; identify when the registry address becomes active. |
| R0806 | 77 | “Verify at judicialaistandards.org/registry.” | “Verify at judicialaistandards.org/registry.” Retained as certificate text; the registry address is footnoted as active upon commencement of certification operations. | Reframe as a specimen form of certificate without putting future tense inside the certificate text; identify when the registry address becomes active. |
| R0824 | 79 | “Issued by the Judicial AI Standards Institute.” | “Issued by the Judicial AI Standards Institute.” Retained as certificate text within a section labeled “Specimen Form of Certificate.” | Reframe as a specimen form of certificate without putting future tense inside the certificate text; identify when the registry address becomes active. |
| R0825 | 79 | “Verify at judicialaistandards.org/registry.” | “Verify at judicialaistandards.org/registry.” Retained as certificate text; the registry address is footnoted as active upon commencement of certification operations. | Reframe as a specimen form of certificate without putting future tense inside the certificate text; identify when the registry address becomes active. |
| R0869 | 81 | “Issued by the Judicial AI Standards Institute.” | “Issued by the Judicial AI Standards Institute.” Retained as certificate text within a section labeled “Specimen Form of Certificate.” | Reframe as a specimen form of certificate without putting future tense inside the certificate text; identify when the registry address becomes active. |
| R0870 | 81 | “Verify at judicialaistandards.org/registry.” | “Verify at judicialaistandards.org/registry.” Retained as certificate text; the registry address is footnoted as active upon commencement of certification operations. | Reframe as a specimen form of certificate without putting future tense inside the certificate text; identify when the registry address becomes active. |
| R1112 | 105 | “All test cases use hypothetical scenarios; no real case data, party names, or sealed information.” | Test cases must use hypothetical scenarios; no real case data, party names, or sealed information may be used. | State the protective test-data rule in present normative form. |
| R1113 | 105 | “Contact: For questions about The BenchMark Standard, evaluation inquiries, or vendor submission, contact the Judicial AI Standards Institute at judicialaistandards.org.” | Contact: For questions about The BenchMark Standard, contact the Judicial AI Standards Institute at judicialaistandards.org. | Retain contact for questions about The BenchMark Standard and remove vendor-intake solicitation until intake opens. |
| R1115 | 105 | “Judicial AI Readiness Assessment” | Judicial AI Readiness Assessment (in development) | Certification operations have not started. Recast the statement as future or conditional. |
| R1116 | 105 | “Vendor Self-Evaluation Guide” | Vendor Self-Evaluation Guide (in development) | Certification operations have not started. Recast the statement as future or conditional. |
| R1117 | 105 | “Evaluator Scoring Guide” | Evaluator Scoring Guide (in development) | Certification operations have not started. Recast the statement as future or conditional. |