← HomeУкраїнська версія

Methodology: how we measure impact and which numbers we publish

Author: Bohdan Honcharuk, CEO · 7 years in international employment, 4 years in AI

In short

Every number on the BOOOST Labs site has a source and an evidence level, from an independently verified result (V1) to an unverified draft (V5), which we never publish. For each metric we state the formula, the baseline and the period. We cite market research with its base, label forecasts as forecasts, and present payback as an estimate with open assumptions.

The principle

The AI services market is full of bold percentages with no definitions: no baseline, no period, no one who checked. We take a different route, and it applies both to our own results and to the market research we cite. Next to every number you should be able to see where it comes from, what exactly it measures and how far to trust it.

This page sets out the rules we use to calculate and publish numbers: on this site, in proposals and in client reports.

How far you can trust a number: levels V1–V5

Not every number is equally reliable. One was checked by an independent party, another comes from the client, a third is only a calculation. So we sort numbers into five levels, from the most reliable, V1, to V5, which we never publish. When we quote a number of our own, we state its level.

LevelWhat stands behind itExample wordingHow we present it
V1 · independently verifieda client result checked by a third party; we know the before, the after, the period and how it was measured“First response time fell from 18 to 4 minutes over three months” + a link to the checkas a fact
V2 · confirmed by the clientthe client approved the figure or quote in writing, but nobody checked it independently“According to the client, managers spend half as much time on requests”marked “according to the client”
V3 · our own measurementwe measured it ourselves in tests or from system logs“On 200 test questions the agent answered 180 correctly”together with how it was measured
V4 · calculationan estimate from a formula or a forecast, not a measured result“Payback of about 4 months if the agent takes over 80 hours of work a month”always as an “estimate”, with assumptions
V5 · unverifieda draft, or a number without a source or method—never published

The examples show the wording only; they are not results of our clients.

Metric definitions

Every metric has a numerator, a denominator and a period. These are the metrics we use for agents and automations.

MetricFormulaWatch out for
Resolved without a personconversations completed by the agent with no hand-off ÷ all conversations the agent took part inwe split “confirmed” (the customer said it was solved) from “assumed” (no request for a person and no repeat contact on the same issue within 24 hours)
Hand-off rateconversations handed to a person ÷ all conversations with the agenta high rate is not always bad; sometimes that is the design
Corrected answer rateanswers a person corrected or marked wrong ÷ all reviewed answersmeasured on a sample reviewed by hand
Time to first responsemedian time from the customer’s first message to the first replymedian, not mean, so a few long cases do not distort it
Manual hours per monthnumber of process runs × average time per runmeasured the same way before and after launch
Flow failure ratefailed runs ÷ all runs in the periodfailures that lost data are counted separately

Baseline and measurement window

  • Before launch we record the “before” state with the same formulas, over at least 2–4 weeks.
  • We measure “after” no earlier than 4 weeks of running at full volume.
  • We compare like with like, allowing for season, promotions and changes in volume.
  • If something else changed at the same time — new staff, prices, product — we say so next to the number.

What we never count as a result

  • Demos and tests on hand-picked examples.
  • A pilot on part of the traffic presented as a production result.
  • Modelled savings presented as actual savings.
  • A percentage with no absolute values and no baseline.
  • An effect that season or other changes could explain, with no caveat.

Rules for numbers

  • Always state the period and the baseline.
  • Never mix pilot and production results.
  • Never call modelled savings actual savings.
  • Show absolute values next to percentages.
  • No client name or logo without permission.
  • State limitations instead of hiding them.

How we cite market research

  • We name the base of every percentage: “survey respondents”, “surveyed companies” and “EU enterprises” are different things.
  • A forecast is labelled as a forecast, with its author and date.
  • We cite the final peer-reviewed version of a study rather than an early working paper, and the latest edition of annual reports.

Why the base matters. 88% of McKinsey respondents report that their organisations regularly use AI in at least one business function (The state of AI 2025, 1,993 respondents; the 2026 edition says “nearly nine in ten”). Among EU enterprises with 10 or more employees, 20.0% used AI in 2025 (Eurostat). The two do not contradict each other: the first is a survey weighted towards large companies, the second is official statistics across all enterprises.

Why the version matters. The 2023 working paper on AI assistants in customer support reported +14% overall and +34% for novices across 5,179 agents. The peer-reviewed version (Quarterly Journal of Economics, 2025) reports +15% on average and about +30% for less-experienced workers, across 5,172 agents. We cite the latter.

How we estimate payback

Monthly saving = manual hours per month × hourly cost − support − model usage − platform. Payback period = one-off cost ÷ monthly saving.

Before launch this is a level V4 estimate with assumptions you can see and change. After launch we replace it with measured data, using the formulas above. A worked example is in our AI agent cost guide.

Limitations and conflict of interest

  • We measure our own work, so we have an interest in good numbers. That is why the formulas are public and the raw data stays with the client.
  • “Assumed” resolution can overstate success: a customer may simply have given up. We report it separately from confirmed resolution.
  • Low volumes produce unstable percentages. For small samples we show absolute numbers.

Updates and corrections

Every page with numbers shows the date of its last review. We re-check market data when a new edition of the source comes out.

Spotted a wrong number or a broken source? Write to boost.info.ai@gmail.com and we reply within five business days. Corrected figures carry the date of the change.

Questions

Why are there no case studies with numbers yet?

We publish a client result only with written permission, a baseline and a period (level V1 or V2). Case studies will appear here once they meet that rule.

Do you guarantee savings?

No. We give an estimate with open assumptions and measure the actual effect after launch with the same formulas.

How do we know the “resolved without a person” rate is not inflated?

We report confirmed and assumed resolution separately, show absolute numbers and give you access to the data behind the calculation.

Why do studies disagree so much on AI adoption?

Because they measure different bases: some survey respondents, mostly from large companies; others count every enterprise in a country. We always state the base next to the percentage.

Read next

  • How much do AI agents and business automation cost in 2026?
  • AI agents for customer support and sales
  • AI business process automation for European companies

Want to talk about your process?

Start with a short brief — we reply with an estimate.

Your next big thing

Let’s start
with your idea.

Describe what you want to build. We’ll get back to you shortly.

We reply to the contact you leave. Nothing else.