When AI has to answer for the numbers
A system developed by EXP³ for a marketing agency operating in three countries, with AI reports in which every statement can be traced back to the evidence that supports it. Confidential client.
The problem
The agency operates in Brazil, Mexico and the United States, with hundreds of dashboards and thousands of active campaigns. In each analysis cycle, the system compares hundreds of thousands of pairs of observations. Nobody reads that. The bottleneck stopped being the data and became the qualified reading, the one that separates what matters and explains why.
The agency did not want an AI that writes reports. It wanted an AI that writes reports it could defend in front of its clients.
The decision
Whoever calculates does not write, and whoever writes does not calculate.
It works like the relationship between an audit and an annual report. The audit checks every number and stamps what can be stated. The report tells the story to the board, but only with audited numbers. In the agency's system, a deterministic layer calculates everything that is fact, measures the confidence of each piece of evidence and records its validity over time. Generative AI receives only those facts and turns them into executive language. It does no arithmetic at all.
Before any code, the agency and EXP³ formalized the knowledge that existed only in the heads of senior analysts, and chose to automate only the business questions that are recurring and answerable from calculable facts. Whatever depends on judgment about context stayed with people.
Governance as policy, not as a prompt
Explicit, persisted rules define what the AI can say and to whom. Analyst, BI, director and client receive the same fact with different depth and vocabulary. Hypothesis exploration only opens on the fronts where the facts support it. And there are restrictions the AI has no authority to violate, much like compliance. An example only illustrates the group of facts it belongs to, a comparison is only narrated when there is enough volume, and the factual base of each report is frozen and signed.
When the data does not authorize a causal claim, the system refuses to make it. For those who answer for results, that prudence is a feature.
What changed in the work
Analysts stopped compiling and started validating hypotheses already anchored in citable facts, and each validation feeds back into the system. Leadership gets answers per business question, not per dashboard. The account manager can tell the client where each conclusion came from, with the concrete example behind the aggregate number. Nobody was replaced; the mechanical part of the reading got out of the way, and the part that requires judgment gained instruments.
For those outside marketing
A bank that answers to the regulator, a firm that answers to its client, a manufacturer that answers to its board. The pattern is the same. Trust in an AI report comes from the structure built around the model, and that structure is made of the knowledge the company already had.
How it was built
Architecture based on the EXP³ framework (Exploit · Explore · Explain). A deterministic symbolic AI layer, with different inference methodologies combined according to the problem, on top of a temporal database. It emits qualified facts carrying temporal validity, subject type, confidence level and an assertion-or-retraction marker, backed by a formal taxonomy. The LLM receives only those facts and performs no calculation.
Governance through personas (tone, model, response structure, technical level and authorized language per profile), analysis lenses (where exploration may open) and deterministic and statistical checks, with a frozen, hash-verified factual artifact.
Auditability through identifiers of cited facts, evidence groups with safe examples, comparative statistics with strength of evidence and caveats, a complete trail of model calls, and persisted, versioned artifacts. Narratives with two-level caching; analyst validation feeds back into the configuration.
Campaigns, channels and periods · BR · MX · US
Hundreds of thousands of observation pairs per analysis cycle
Verifies every fact and measures the strength of every piece of evidence
Deterministic: it runs before generative AI
Personas · the same fact, with depth and vocabulary per profile
Analysis lenses · where exploration may open
Checks · restrictions the AI cannot violate, factual base frozen and signed
Turns verified facts into executive language
Does no arithmetic at all
Cited facts, with the concrete example behind the aggregate number
Where each conclusion came from, at any time