IntelafyIntelafy™Making Data Intelligent
White Paper 01 · Explainability

The end of the
black box.

When the model is measured, not trained, you don't explain a score after the fact. You explain it by construction, with the exact, named evidence that produced it.

Abstract

Modern machine-learning explainability is an act of reconstruction: SHAP and LIME approximate, after the fact, why a trained model produced a score. The approximations are useful but fragile. This paper argues that explainability is better treated as a structural property of the model itself. When the engine measures association directly from the data, each score carries the exact, named, non-redundant evidence that produced it. That evidence is an audit record.

The post-hoc problem

Explainability as reconstruction.

A trained neural network is, by design, a function whose internals resist direct reading. Practitioners who want to answer the simple question "why did this person score 0.81?" reach for attribution methods. SHAP games out feature contributions; LIME fits a local surrogate. Both are approximations layered over a model whose true decision surface is not fully exposed.

This works, up to a point. It fails precisely where explainability matters most: in regulated decisioning, where a compliance officer needs the actual reasons, not a smoothed estimate of them. Approximations drift under retraining, contradict each other across methods, and cannot promise that the explanation reflects the model's real behavior.

The problem is architectural. If the model's internals are opaque, explanation is always a separate, lossy step. Tooling can narrow that gap, but it cannot close it.

By construction

When the explanation is the model.

The Intelafy Brain measures association directly from the data, with fixed statistical math. It does not learn weights through training; it computes relationships from the population. Because the inference step selects named signals for each individual by a fixed rule, the explanation is produced as the score is produced.

Trained model + SHAP score 0.81 SHAP / LIMEapproximation explanation ≈ model Measured engine score 0.81 named evidenceexact, non-redundant explanation = model FIG 1 · Reconstruction vs. construction
FIG 1Post-hoc approximation vs. explainability by construction. One produces an estimate of the reasons; the other produces the reasons themselves.
Anatomy of a score

The evidence is named, weighted, and non-redundant.

For every individual, the engine selects a compact set of named signals and records their measured contribution. Correlated signals that "travel in packs" (demographics that reinforce one another) are de-duplicated, so confidence reflects independent evidence rather than the same fact counted twice.

SCORE EXPLANATION · INDIVIDUAL #4471-882
target: credit-card-switcher
score: 0.81
named, non-redundant evidence:
· revolving-balance-band 0.34
· recent-inquiry-recency 0.28
· tenure-at-address 0.19
· premium-media-index 0.12

There is no second model interpreting the first. The record above is how the score was computed.

Proof for regulators

Why this changes the regulated conversation.

In fair-lending and health-privacy contexts, the regulator's question is exact: did protected data influence this decision? A post-hoc explanation can only say it probably didn't. A construction-time record can say it structurally couldn't, because protected attributes leave the evidence pool before the selection runs, and the record lists only the signals that were present.

The shift

Explainability stops being a liability defense and becomes a product property. You can print the reasons and prove the exclusions, so the audit closes on evidence.

Bottom line

The black box was never inevitable.

The opacity of a trained network is a consequence of training, not of intelligence. Measure the population directly and the explanation arrives with the score. It is exact, named, and defensible, because the same step produces both.

Explainability by construction Named, non-redundant evidence Audit-grade by default

Continue to 02 · Scores You Can Actually Compare →