Forecasting
How to improve forecast accuracy in FP&A
Most attempts to improve forecast accuracy start in the wrong place: the model. A team swaps its linear trend for something more sophisticated, the fit on historical data looks better, and next quarter the miss is the same size as last quarter's. That's because accuracy isn't a model property — it's a process property. The model is step four of six. Here's the playbook, in the order that actually works.
Step 1 — Measure error properly before changing anything. You cannot improve what you measure wrong, and most teams measure wrong in a specific way: they judge a forecast by how well it fits the history it was trained on. Training fit is flattery — a model with enough parameters can trace last year's revenue line perfectly and still know nothing about next quarter. The honest test is a holdout: hide the last few months of actuals from the model, forecast them, and score the miss. Score it with MAPE — mean absolute percentage error — because it's comparable across lines of different sizes. The rule of thumb for reading it: under 5% is excellent, 5–15% is good, 15–30% is workable, above 30% means the forecast isn't useful. Whatever your holdout MAPE is today, write it down. That number is the baseline every following step gets measured against.
Step 2 — Fix the data before touching the model. No algorithm recovers from a series that encodes bookkeeping artifacts instead of business reality, and three cleanups pay for themselves almost immediately. Calendarization: if your months alternate between four and five weeks, or billing days drift, the model sees phantom seasonality and will faithfully forecast it — normalize to comparable periods first. One-offs: a single large deal, a legal settlement, an acquisition true-up — leave them in the series unlabeled and the model projects them forward as trend. Tag them, then decide deliberately whether each belongs in the history the model learns from. Channel mix: a total revenue line that blends two segments growing at different rates looks like noise from the top; split the series where the mix is shifting and each piece becomes forecastable. Time spent on data routinely beats time spent on models.
Step 3 — Decompose to drivers instead of forecasting the total. Net income is not a forecastable series. It's arithmetic sitting downstream of things that are. Statistical forecasting belongs on the lines with genuine external signal — demand, retention, pricing — while everything mechanical should be computed, not predicted: salaries follow headcount, commissions follow bookings, hosting follows usage. This is what driver-based planning is for. In NashOS, you mark an account as a driver and write a member formula — SALARIES_ENG = HEADCOUNT_ENG × −10000 — so changing the headcount assumption recomputes salaries, which rolls through OPEX, EBITDA, and Net Income. Every line you compute instead of forecast is a line that can't miss on its own; its error reduces to the error of its inputs. Decomposition shrinks the surface area where forecasting can go wrong, which is most of the battle.
Step 4 — Pick the algorithm empirically, then lock the winner. The argument about whether ARIMA beats Holt-Winters on your revenue line is not worth having in a conference room, because it has an empirical answer that differs by series. Run the candidates side-by-side on the same holdout window and read the scores. NashOS runs 15 forecast algorithms and compares them on R², RMSE, MAE, and MAPE against the holdout — but the method matters more than the tool: whatever you use, the winner is the lowest holdout MAPE, not the prettiest training fit and not the most sophisticated name. Then lock it, so the next cycle runs the winner by default instead of re-litigating the choice. Revisit when the business changes shape — a new product line, a pricing change, an acquisition — not every month.
Step 5 — Reforecast on cadence, not annually. A forecast is a perishable good. The annual budget set in November is asked to be right about a December thirteen months away, and every month that passes adds information the plan never absorbs. The teams with accurate forecasts aren't better at predicting December from the previous November; they re-predict it in March, June, and September, and each pass is shorter-range and better-informed. Shortening the horizon is the single highest-leverage way to improve forecast accuracy, and it costs nothing statistically — only operationally. That's the usual objection: if a reforecast costs two weeks of model rebuilding, quarterly is your ceiling. Which is exactly why steps 3 and 4 come first. In a driver-based cube with a locked algorithm, a reforecast is an update, not a rebuild — in NashOS the model-rework loop goes from 14 days -> 1 minute: change the assumption, the cube recomputes, and you rerun the locked algorithm. Cadence is only affordable when the mechanical cost is near zero.
Step 6 — Run an error post-mortem every cycle. When actuals land, score the last forecast against them line by line, then classify every material miss into one of four buckets. Data problem: a one-off leaked into the series or calendarization slipped — fix it at the source so it can't recur. Assumption problem: a driver was set optimistically — the sales-capacity number, the churn rate — so adjust the input, not the model. Model drift: the locked algorithm's holdout MAPE is creeping up as the business changes — re-run the side-by-side comparison and consider re-pinning. Genuine surprise: a top customer churned without warning — no process fixes this; note it and move on. The classification matters more than the score, because each bucket has a different fix. Teams that skip the post-mortem repeat their misses with growing confidence; teams that run it convert every miss into a process change.
The sequence is the point. Measurement comes first because everything after it needs a baseline. Data before models, because models amplify whatever the data encodes. Decomposition before algorithm selection, because the best algorithm on a composite series loses to a mediocre one on clean drivers. Cadence and post-mortems last, because they're the loop that compounds the other four. None of it requires a data science team — it requires holdout discipline and an honest MAPE number. Work the six steps in order and you give forecast accuracy a way to improve every cycle: not because the model got smarter, but because the process did.