Truth Ledger: follows up on whether the AI's advice actually held up
Every insight is saved as a prediction with a measurable outcome. After 14 to 30 days Paidin goes back and checks whether it turned out the way the analysis said. The accuracy is reported openly, including when it is poor, so you know which advice is worth following.
The problem with "AI insights" in other tools
Tools promise AI analysis. But few measure whether the analysis actually holds. You get 30 recommendations a month without knowing which have historically been valuable and which were false alarms.
The effect: you stop trusting the system, or worse, you act on bad advice and lose money.
How the Truth Ledger works
Every insight is a prediction
When the AI says "add keyword X as a negative and CPA will drop 15%", the system saves it as a prediction with a precisely measurable outcome.
You tick it off when you have taken the action
One click: "Done". You can also write a short note on exactly what you did and what effect you expect.
The system follows up automatically
Once the measurement date has passed, by default 14 days after the prediction was created, the nightly job measures whether it held. CPA down 15% as promised? The measured change is logged.
Accuracy over time is shown in the dashboard
After a few months you see: "78% of our insights hold up", "campaign-related predictions are 84% accurate", and so on. Trust based on data, not on promises.
Why it matters
An analytics tool that gives recommendations without following up on them asks you to trust it without showing why. The recommendations are presented, you act or you do not, and nobody goes back to check how it went.
The Truth Ledger is a quality check on the AI itself. A rule that shows low accuracy gets adjusted or switched off, and a rule that holds we know we can weigh more heavily. So it is not only a report to you but the basis for what we build on next.
For you that means you can see in black and white whether the tool delivers value for your business specifically, instead of having to take our word for it.
Your own predictions
You can also add your own predictions. Running a campaign and think conversions will rise 20%? Log it. The Truth Ledger measures and reports.
Four states a prediction can have
Follow-up happens by default 14 days after the prediction was created. The window can be set to something else, for example 7 or 30 days, when the outcome needs less or more time to show.
| State | What it means | Counts towards accuracy |
|---|---|---|
| Pending | The measurement date has not passed yet. | No |
| Hit | The measured value moved in the predicted direction. | Yes |
| Missed | The outcome failed to appear or moved the wrong way. | Yes |
| Skipped | The prediction has no measurable metric and requires manual judgement. | No |
Two things make the number worth something:
- A prediction cannot be rewritten after the fact. Only the outcome is filled in. Whoever created it cannot go back and adjust what was promised once the answer is in.
- What cannot be measured does not count as a hit. A prediction without a measurable metric is marked as skipped rather than guessed at, because a guess there would have made the whole accuracy figure dishonest.
Analysis you can trust
The Truth Ledger is included in Pro and Business. Start with 2 months free and watch the accuracy build from day 1.
Get started for free