White Paper · Enterprise AI Architecture

The Harness

Why the model isn't the product in enterprise AI, and why memory, context, capabilities, and governance decide whether an AI agent can be trusted in regulated finance.

Key Takeaways

  • An AI harness is the stateful program around a model that decides what it sees, remembers, can do, and is forbidden from doing. Agent = Model + Harness.
  • Frontier models have converged and can be swapped in a quarter. The harness, not the model, is now the differentiator, a conclusion reached independently by LangChain, Thoughtworks, OpenAI, and Stanford researchers.
  • A harness has four building blocks: memory, context, governed capabilities, and guardrails. Each one is redefined by the demands of regulated finance.
  • In regulated finance, memory is the firm's most sensitive asset, and whoever controls the harness controls the memory.
  • The paradox most firms miss: the most secure, governed, and compliant architecture is also the fastest, because the controls are the system rather than a review bolted on afterward.
Part One

Why the Model Isn't the Product

The intelligence lives in the model. Everything that makes AI useful, and trustworthy, lives in the harness around it.

The core idea

You Already Use a Harness

Open any modern AI assistant and ask it to help you plan a dinner party for this weekend. Watch what happens.

The model does not just think and reply. It searches the web for trending recipes. It checks the weather forecast to decide whether you should plan for the patio or the dining room. If you told it last month that your sister is vegetarian, it remembers and adjusts the menu. It finds a playlist on a music service. It drafts a shopping list and offers to email it to you.

That feels like one seamless interaction, but underneath it several distinct things are happening. The model is the language intelligence: it understands your request and generates a response. But everything else (the web search, the weather check, the email draft) are tools the model was permitted to call. The fact that it remembered your sister's dietary restriction from a previous conversation is a memory. The way all of this information was gathered and assembled into a single coherent answer is context. And the code that decides when to search, what to remember, which tools to invoke, and how to present the result is the harness.

Definition

An AI harness is the stateful program built around a language model that determines what the model sees, what it remembers, what it can do, and what it is not allowed to do. The model provides the intelligence; the harness provides everything else. Strip away the harness and the model is just a text generator. Add the right harness and it becomes a capable assistant.

In personal AI, this works remarkably well. The data is simple, the stakes are low, and the only person who needs to trust the output is you. But what happens when the AI needs to work not with public knowledge and personal preferences, but with a firm's live, sensitive, fast-changing enterprise data?

Why it breaks

Why This Breaks in Enterprise Finance

In a companion piece, The Stage Is Set: Why Enterprise AI in Finance Is No Longer a Future State, I examined why the gap between personal AI and enterprise AI is not a technological problem but an architectural one. The harness is where that architecture lives, and it is where personal AI and enterprise AI diverge most sharply. Three fundamental challenges explain why.

1

The model was never trained on your data

A wealth advisor's client portfolio, a private credit team's deal pipeline, a fund's investor capital accounts: this data lives across internal systems, changes daily, and no public model has ever seen it. It must be retrieved in real time from the systems where it lives. That is the harness's job.

2

Raw data is not enough

An LLM cannot reliably compute performance attribution across thousands of positions, normalize financials from dozens of private companies, or apply a proprietary risk framework. These require structured computation and institutional knowledge prepared before the model sees a question.

3

Governance is not optional

In personal AI, a wrong answer means you shrug and try again. In regulated finance, a wrong number is a regulatory issue, a reputational risk, and a client-trust problem. Every data point must pass through entitlements, every response must be traceable, every action logged.

These three challenges (retrieval of live data, preparation of meaningful context, and enforcement of governance) are not features you add to a general-purpose AI platform. They are the core responsibilities of the harness itself.

The industry consensus

Agent = Model + Harness

The idea that the code wrapped around an AI model matters as much as the model itself has rapidly become a point of convergence across the AI engineering community. What was recently an intuition among practitioners is now a documented, measured discipline that even has a name: harness engineering.

Harrison Chase, co-founder of LangChain, has argued that better models alone will not get an AI agent to production, and has traced the evolution from simple chains to complex orchestration flows to full agent harnesses as the field's true frontier. Birgitta Böckeler, a Distinguished Engineer at Thoughtworks, formalized the concept in February 2026 with her “guides and sensors” framework: guides that direct agent behavior and sensors that feed back what the agent is doing. In the same month, OpenAI described how a small team of three engineers drove its Codex agent to produce on the order of a million lines of code by changing nothing but the harness, distilling the philosophy into three words: “Humans steer. Agents execute.” And in March 2026, Stanford and MIT researchers published the Meta-Harness paper, demonstrating that automatically optimizing the harness around a fixed model can outperform hand-engineered alternatives and, critically, that a good harness transfers across different models.

~1M
Lines of code produced by three engineers driving an AI coding agent, by re-architecting the harness rather than the model. OpenAI put the effort at roughly one-tenth the time hand-coding would have taken.
Source: OpenAI, “Harness engineering: leveraging Codex in an agent-first world,” Feb 2026.

A harness is not just a configuration or a set of prompts. It is a stateful program that determines what information to store, retrieve, and present to the model at each step. The model reads text and produces text. The harness decides everything else. The diagram below shows the full anatomy: the model sits at the center, and the harness is the governed system that surrounds it and connects it to the firm.

Advisor · Team THE HARNESS the governed program around the model Model (LLM) the language intelligence Memory firm's live governed data Context team-scoped, role-governed Capabilities governed workflows + tools Guardrails security, quality, audit THE FIRM'S GOVERNED SYSTEMS Portfolio accounting CRM Vector store Market data More retrieved in real time, with entitlements + audit
Figure 1: Anatomy of an enterprise harness. The model is one component; the harness surrounds it, connects it to the firm's governed systems, and enforces control at every step.
Model quality has become table stakes. The harness is the differentiator. For general-purpose AI this insight matters. For regulated finance, it is everything.
Part Two

The Four Building Blocks of an Enterprise Harness

Memory, context, capabilities, and guardrails. Every harness has them. In regulated finance, each one is transformed.

A concrete scenario

The Advisor's Reality

To make the building blocks concrete, consider a scenario that plays out at wealth management firms every day. A financial advisor is preparing for a quarterly client review. Today, she logs into four or five separate platforms: the portfolio accounting system for current positions, the CRM for client notes and life events, a market research portal for macro views, a financial planning tool for projections, and a document management system for prior meeting notes and investment policy statements. She spends an hour assembling a picture that should take minutes.

TODAY Portfolio accounting system CRM Market research portal Financial planning tool Document management 5 logins · ~1 hour · manual assembly harness WITH A HARNESS One governed AI agent every source, one place, scoped to her entitlements 1 place · minutes · traceable end to end
Figure 2: The advisor's reality. The harness collapses five disconnected systems into one governed agent, without loosening a single control.

An AI agent with the right harness changes this entirely. But the harness must be built specifically for this world. Its four building blocks, memory, context, capabilities, and guardrails, each take on a fundamentally different character in enterprise finance.

BLOCK 01

Memory

From your past chats to the firm's live, governed data: positions, client records, deal documents.

BLOCK 02

Context

From your question plus web results to a team-scoped, role-governed slice of enterprise data.

BLOCK 03

Governed Capabilities

From open-ended tools to governed workflows, approvals, and productivity integration.

BLOCK 04

Guardrails

From basic safety filters to security, governance, and compliance woven through every layer.

Table 1: The same four building blocks, redefined for regulated finance
Building blockPersonal AIEnterprise Finance Harness
MemoryYour past conversations and preferencesThe firm's live portfolio positions, client records, and deal documents
ContextYour personal question plus web search resultsTeam-scoped, role-governed slice of enterprise data
CapabilitiesWeb search, code execution, file creationGoverned workflows, approvals, and productivity integration
GuardrailsBasic safety filtersSecurity, governance, and compliance woven through every layer
01OF 04
Building block

AI Agent Memory: The Firm's Governed Data

In personal AI, memory means the model's recall of your past conversations: that you prefer window seats, that you asked about hiking trails last week. In the AI engineering community, this has a well-established meaning: short-term memory (the current conversation) and long-term memory (preferences and patterns that persist across sessions). Both matter.

But in enterprise finance, a third and dominant category exists: institutional memory. When our advisor sits down to prepare for her client review, the memory she needs is not a summary of her last AI conversation. She needs current portfolio positions, recent transactions, risk exposures, life events that affect the financial plan, regulatory flags, and market movements relevant to the client's holdings. None of these are in the conversation, and if they are, they are already stale.

That is the real memory. It is live. It is institutional. And it does not belong to the model; it belongs to the firm. Portfolio positions updated in real time via SQL queries against live systems. Client records retrieved from CRM platforms. Deal documents surfaced from vector stores. Connected, not copied, not cached, not stored inside a model provider's infrastructure.

MEMORY INSIDE THE MODEL PROVIDER Data copied and cached off-site Stored on the vendor's infrastructure Access and deletion on their terms The firm loses data sovereignty Whoever holds the memory holds control MEMORY IN THE HARNESS Connected to the firm's own systems Retrieved in real time, never copied Access follows existing entitlements The firm keeps full data sovereignty Every governance question has an answer
Figure 3: Where memory lives decides who is in control. In the harness, the firm's most sensitive asset never leaves its governed systems.
Why this matters · Data sovereignty

If memory lives inside the model or a proprietary AI platform, the firm loses control. Where is that data stored? Who has access? Can it be deleted when a client requests? If memory lives in the harness, connected to the firm's own governed systems, every one of those questions has a clear, defensible answer.

There is another dimension that general-purpose platforms miss. Consumer AI memory is personal: one user, one history. Financial services memory is team- and role-level. Our advisor shares a client book with her team. A deal team shares pipeline intelligence. A risk team shares exposure data across the portfolio. When a team member leaves, the memory does not go with her.

02OF 04
Building block

Context: Team-Shaped, Not User-Shaped

In personal AI, context is simple: your question, plus whatever the model found on the web, plus what it remembers about you. The harness assembles the prompt, and the model responds.

For our advisor, the context challenge is entirely different. The harness needs to assemble her client's current positions from the portfolio accounting system, recent life events from the CRM, the investment policy statement from the document repository, relevant market commentary, and prior meeting notes, all scoped to what this advisor, on this team, for this specific client, is authorized to access. Show the model too little, and it hallucinates. Show it too much, and the signal drowns in noise. Show it the wrong thing, and you get a perfectly articulate, completely misleading output.

The context window is not “what does this individual user need?” but “what does this team's mandate require for this question?”

Context in finance is team-shaped, not user-shaped. An advisory team, a credit team, and a compliance team need different slices of the same enterprise data. Teams also develop their own language, shorthand, and calculation conventions that carry deep meaning but that no LLM has been trained on. Encoding this institutional context into the harness is what makes the difference between AI that sounds knowledgeable and AI that actually is.

03OF 04
Building block

Governed Capabilities

In personal AI, tools are open-ended: the model searches the web, executes code, creates files, and sends emails with minimal constraints. In enterprise finance, every capability is governed, scoped to what this team is allowed to do, logged for auditability, and integrated into workflows that include human judgment.

The capability layer of an enterprise finance harness works across four layers, grouped into two categories. The first two form the context infrastructure that prepares what the model sees. The other two are tools in the technical sense: actions the model invokes during a conversation. They build on each other, from the foundational data work at the bottom to the point-of-use tools at the top.

CONTEXT INFRASTRUCTURE : prepares what the model sees A Data Augmentation Computes derived intelligence, like performance attribution, that raw data lacks B AI Data Readiness Data dictionaries and team-level linguistic context: a team's institutional DNA TOOLS : actions the model invokes during a conversation C Workflow Orchestration Governed workflows with human checkpoints, every step logged and traceable D Productivity Integration Reaches into email, Teams, calendars, and documents under one governance model Context infrastructure creates what the model sees. Tools let it act within governed boundaries.
Figure 4: The capability stack. Two context-infrastructure layers prepare the model; two tool layers let it act, all under governance.

Data Augmentation · Context infrastructure

This is the most valuable and hardest-to-replicate layer. It creates information that does not exist in the raw data. When our advisor asks why her client's portfolio underperformed its benchmark, the answer requires performance attribution, decomposing returns into allocation, selection, and interaction effects. No LLM can compute this reliably in real time. The harness provides this derived intelligence as a pre-computed, governed context. This is the layer that answers the question every firm eventually asks: “Why can't we just plug an LLM into our data warehouse?” Because the warehouse does not have what the advisor actually needs. Someone has to compute it. That is part of the harness.

AI Data Readiness · Context infrastructure

Data engineering moves data. AI data readiness makes data comprehensible to an AI operating within a specific team's domain. It includes data dictionaries that tell the AI what each field means in this team's context, profiling so the AI understands data quality before it answers, and team-level linguistic context: the terms, acronyms, and calculation logic that an advisor uses daily, but no LLM has been trained on. These are institutional definitions, the linguistic DNA of how a team thinks about its work.

Workflow Orchestration · Tool

The AI helps our advisor prepare a client review. Then what? In enterprise finance, the answer is rarely “just show it on screen.” It is “route the draft for compliance review,” “flag the allocation change for the investment committee,” “generate the meeting summary and send it to the client.” The harness needs tools that trigger structured workflows with human checkpoints at the points where judgment matters. Each step logged. Each decision traceable.

Productivity Integration · Tool

Our advisor does not live inside an AI interface. She lives in email, Teams, calendars, and documents. The harness needs tools that reach into these environments: pull context from a recent email thread with the client, surface the last meeting's action items, draft a follow-up, and send it, all within the same governance framework.

04OF 04
Building block

AI Guardrails: Security, Governance & Compliance

In personal AI, guardrails are basic safety filters. In regulated finance, they are the foundation for everything else, and they are not one thing. They are three distinct disciplines.

Table 2: Three guardrail disciplines, and where each must live in the harness
DisciplineControlsWhere it must be enforced
SecurityWho can see and do whatAt the point of retrieval, not the point of display. Identity flows through every layer, never a broad service account
GovernanceData quality and provenanceAt the retrieval layer, adding assurance where information is actually consumed
ComplianceAuditability and traceabilityEnd to end, with the path's complexity matched to the stakes of the decision

Security controls who can see and do what. When our advisor's AI agent queries the portfolio accounting system, the identity context must flow through every layer. The system needs to know that this specific advisor, on this specific team, initiated this specific request. Most enterprise AI implementations quietly break here: they connect the AI to source systems using a service account with broad access, bypassing the entitlement controls the firm spent years building. The security boundary must be at the point of retrieval, not the point of display.

Governance controls quality. Where did this data originate? When was it last validated? Is it complete? In financial services, a wrong number is not an inconvenience; it is a regulatory issue. The harness must embed quality controls at the retrieval layer, adding assurance at the point where information is actually consumed.

Compliance controls auditability. Every interaction must be reconstructable for audit, regulatory inquiry, or internal review. Every data retrieval is logged with full provenance. Every output is traceable end to end. The complexity of the compliance path should match the stakes of the decision: a simple portfolio lookup follows one path; a client recommendation follows a different one, with draft, cross-reference, human review, and then delivery.

IDENTITY FLOWS THROUGH EVERY LAYER Advisoridentity Securityentitlement check Governancequality + provenance Compliancelogged, traceable Datasource system The controls are inline, so the review is the system, not a separate cycle
Figure 5: The authentication chain runs from the user through every layer to the source. Because control is enforced inline, assurance is produced as the work happens.
These three disciplines are not a tax on the harness. They are its most valuable output, and the most secure, well-governed, compliant architecture is also the fastest. When controls are embedded in the harness rather than applied as separate review cycles, the review is the system.
Part Three

The Strategic View

Models change every quarter. The harness is what a firm actually builds, owns, and competes on.

The strategic stakes

Who Controls Your Harness?

The central argument of harness engineering deserves repeating in the context of financial services: because memory lives inside the harness, whoever controls the harness controls the memory. In regulated finance, the memory is the firm's most sensitive asset: client data, portfolio intelligence, deal pipelines, and risk exposures.

If your harness is embedded in a vendor's proprietary platform, the vendor controls it. Your memory, your context, your guardrails, your audit trail, all on their infrastructure, under their terms.

The model, by contrast, can be swapped. Models improve every quarter. The Stanford Meta-Harness research confirms this: harness optimization transfers across models, and a well-designed harness can make a smaller, cheaper model outperform a larger one running on a generic scaffold. The harness cannot be swapped easily. It encodes how your firm thinks, how your teams operate, what your compliance framework requires, and how your data flows.

THE MODEL : A COMMODITY Model A Model B Model C Converged in quality Swapped in a quarter Interchangeable, rented THE HARNESS : THE MOAT Encodes how your firm thinks Your data, teams, and conventions Your compliance framework Cannot be swapped or copied Specific, owned, defensible
Figure 6: The model is interchangeable; the harness is not. No two firms should have the same harness, because no two firms have the same context.
$1.8B→$6.5B
The market for AI agents in financial services is projected to grow from roughly USD 1.79 billion in 2025 to USD 6.54 billion by 2035, a 13.8% CAGR. The firms capturing that value will be the ones that own their harness rather than rent it.
Source: Precedence Research, May 2026.
$1.79B 2025 $2.04B 2026 $6.54B 2035 AI agents in financial services, market size 13.8% CAGR
Figure 7: The market is compounding. Owning the harness is how firms capture that growth on their own terms. Source: Precedence Research, May 2026.
No two firms should have the same harness, because no two firms have the same context.

The Clarista view

Built, Not Imagined

At Clarista, this is not a position paper; it is the architecture we have built and continue to evolve. Our architecture treats the firm's live, governed data as the agent's institutional memory, retrieved in real time, never copied into a model provider's infrastructure. Context is assembled at the team level. Our capability layer computes derived financial intelligence, makes data AI-ready through dictionaries and team-level linguistic context, orchestrates governed workflows, and integrates with the productivity tools where teams actually operate.

Security, governance, and compliance are not features we added; they are the foundation we built on. The authentication chain flows from the user through to every data source. Entitlements are enforced at the retrieval layer. Every output is traceable from source to response.

The model provides the intelligence. The harness provides trust, compliance, and a competitive advantage.

The firms that will define the next era of financial services are making harness decisions right now, whether they use that language or not. The ones who recognize this will own their advantage. The ones who do not will rent it, on someone else's terms.

The stage was set. The harness is how you step onto it.

Reference

Frequently Asked Questions

What is an AI harness?

An AI harness is the stateful program built around a language model that decides what the model sees, what it remembers, which tools it can call, and what it is not allowed to do. The model supplies the language intelligence; the harness supplies memory, context, capabilities, and guardrails. Strip away the harness and the model is just a text generator. An agent is the combination of a model plus its harness.

Why isn't the model the product in enterprise AI?

Frontier models have converged in quality and can be swapped in a quarter, so the model has become table stakes rather than a differentiator. The harness is what encodes a firm's live data, team context, workflows, and compliance controls. Because that logic is specific to each organization and cannot be swapped easily, the harness, not the model, is where durable competitive advantage and trust are created.

Why do consumer AI harnesses break in enterprise finance?

Three challenges break them. First, the model was never trained on the firm's live, private data, which lives across internal systems and changes daily. Second, raw data is not enough; performance attribution, financial-statement normalization, and proprietary risk frameworks require structured computation before the model ever sees a question. Third, governance is not optional: every piece of data must be filtered through user entitlements, every response must be traceable to its source, and every action must be logged and auditable.

What are the four building blocks of an enterprise AI harness?

The four building blocks are Memory, Context, Governed Capabilities, and Guardrails. In enterprise finance, Memory becomes the firm's live governed data, Context becomes a team-scoped and role-governed slice of enterprise data, Capabilities become governed workflows and productivity integration, and Guardrails become security, governance, and compliance woven through every layer.

What is institutional memory in an enterprise AI harness?

Institutional memory is the firm's live, governed data: current portfolio positions, recent transactions, risk exposures, client life events, and relevant market movements. Unlike consumer AI memory, which is personal and belongs to the model provider, institutional memory belongs to the firm, is retrieved in real time from the systems where it lives, and is team- and role-scoped rather than tied to a single user.

Who controls the harness, and why does it matter?

Whoever controls the harness controls the memory, which in regulated finance is the firm's most sensitive asset: client data, portfolio intelligence, deal pipelines, and risk exposures. If the harness is embedded in a vendor's proprietary platform, the vendor controls your memory, context, guardrails, and audit trail on their infrastructure and terms. A harness connected to the firm's own governed systems keeps that control inside the firm.

Is the most secure and compliant AI architecture also the slowest?

No. This is the paradox most firms have not yet discovered: when security, governance, and compliance controls are embedded directly in the harness rather than applied as separate review cycles after the fact, the review is the system. The most secure, well-governed, and compliant architecture is also the fastest, because assurance is produced at the point where information is retrieved and consumed rather than bolted on later.

What is agentic AI architecture?

Agentic AI architecture is the design of the system around the model: the agent harness that manages memory, context, governed capabilities, and guardrails. In regulated finance it must also provide entitlement-aware data access, audit trails, and compliance evidence, so every retrieval and action the agent takes is governed and explainable.

How do you build a governed AI agent for financial services?

Start with the harness, not the model. Connect the firm's governed data as memory, scope context by team and entitlement, expose capabilities through governed MCP and API endpoints, and enforce guardrails with logging and audit evidence built in. Models can be swapped in a quarter; the governed harness is the durable investment.

Evidence

Sources & References

  1. Ryan Lopopolo, OpenAI, “Harness engineering: leveraging Codex in an agent-first world” (February 2026). Source for the ~1 million lines of code from a three-engineer team and “Humans steer. Agents execute.”
  2. Birgitta Böckeler, Thoughtworks, “Harness Engineering: first thoughts” and the guides-and-sensors framework (February 2026).
  3. Harrison Chase, LangChain, “Better models alone won't get your AI agent to production” (VentureBeat) and “Building the Orchestration Layer for AI Agents” (Sequoia Capital).
  4. Yoonho Lee et al., Stanford & MIT, “Meta-Harness: End-to-End Optimization of Model Harnesses” (arXiv:2603.28052, March 2026). Source for harness transfer across models and automated harness optimization outperforming hand-engineered baselines.
  5. Precedence Research, “AI Agents in Financial Services Market Size” (May 2026). USD 1.79B in 2025 to USD 6.54B in 2035, 13.84% CAGR.
  6. Martin Fowler, “Harness engineering for coding agent users” (2026).
  7. Suvrat Bansal, Clarista, The Stage Is Set: Why Enterprise AI in Finance Is No Longer a Future State and AI Agent Governance: Agents vs AI-Built Apps in Financial Services (companion white papers).

About Clarista

Clarista enables AI operating models for wealth and private markets firms, connecting the data, governance, and AI layers that transform how investment and advisory teams work. Clarista's architecture is designed to start with team context and existing information sources, delivering real-time, trusted AI capabilities without multi-year technology programs.

This white paper is provided for educational and informational purposes only. It does not constitute legal, regulatory, compliance, or investment advice. Market figures are drawn from third-party research cited above and are subject to revision. Firms should consult their own advisors when designing AI architectures for regulated environments.