Bringing AI agents into the legal fold through integrated AI & legal research
We are building agentic law to align them with societal values and enable high-stakes safe deployments.
We develop various Turing Tests related to high-stakes real legal workflows. Norm will continue to build out that suite of benchmarks that only a technology company powering a full-service law firm can.
As AI drives the cost of intelligence toward zero, the bottleneck in the economy shifts to assurance of agentic legal systems. How do we ensure that AI systems act in ways that are legal, trustworthy, and enforceable?
Legal systems were built for human actors. As AI agents become economic and societal actors, law is their real-time alignment infrastructure. We investigate the systems by which AI agents will transact, be governed, and held liable.
Legal reasoning spans rule extraction, statutory interpretation, analogical reasoning, judgment under ambiguity, and more. Most academic benchmarks do not measure reasoning. We build the evaluation infrastructure for getting to the right answers the right way.
Domain experts award higher intentionality scores to newer models
Legal ontologies, reasoning taxonomies, and the formal structures that underpin evaluation.
Expert-designed evaluations spanning multiple legal domains with blind review protocols.
Battle-tested agent architectures operating under real compliance and advisory constraints.
Exploratory research into reasoning capabilities that don't yet have established measurement.
Evaluating 8 frontier models across 1,456 questions spanning rule-application and interpretation tasks
Error bars: ±1 standard deviation
Error bars: ±1 standard deviation
% of questions with exactly 1 distinct answer across 10 turns
Benchmarking frontier AI agents on advanced legal reasoning tasks — with Norm Law Partners
Generating high leverage training data for distilling domain-specific reasoning into models — using complex, multi-step decision traces
Simulating AI agent deployment in high stakes corporate environments — e.g., contract negotiations and regulatory compliance
Legal Engineering: A Paradigm Shift in Law — Stanford Law
Large Language Models as tax attorneys — Royal Society
Large Language Models as fiduciaries — Stanford Law
How Regulators Can Use AI — Vanderbilt Law Review
Aligning AI Agents with Humans Through Law as Information — Stanford Law