How to Run a BI Implementation
By Newtown Analytics · · 8 min read
For cfos & finance leaders
A BI implementation turns scattered spreadsheets and system exports into reporting that people trust and use, and the way it is run matters more than which tool is chosen. Most failures are not technical. Reports are built before anyone agrees what "revenue" or "on-hand inventory" means, the numbers do not match the finance ledger, nobody tests with real users, and the launch is followed by silence because the old spreadsheets are still easier. This guide lays out a practical, phased plan for a mid-sized company, with a 16-week timeline, the roles you need, how to design the data model and definitions, how to test by reconciling to source totals with a worked example, how to measure adoption, and how to keep the system healthy after launch. It is part of business analytics for finance and operations, follows fractional analytics leader and build vs. buy for analytics, and leads to analytics project plans and how to select a BI vendor. Good reporting is the foundation of budgeting and forecasting.
Start with the decisions, not the dashboards
Before any build begins, list the decisions that the reporting should improve. A buyer deciding how much to order, a controller checking margin by customer, a sales director reviewing pipeline against quota, a CEO looking at cash and service levels. Each decision implies a short list of measures, a level of detail and a refresh frequency. Write them down, and rank them. The first release should serve the top three or four, not everything on the wish list. A tight first scope is the best protection against a project that runs long and delivers late.
Name an executive sponsor who can resolve disputes about definitions, and a business owner who will use the result and approve it. Without them, every disagreement stalls the team. Name a project lead with time to spare, and a technical lead who knows the source systems. In a smaller company one person may hold two of these roles, but the roles still need to exist.
A 16-week plan
The plan below is illustrative. Scale it to your scope.
| Phase | Weeks | Main outputs |
|---|---|---|
| Discover | 3 | Decision list, measure definitions draft, source system inventory, data quality scan |
| Design | 3 | Data model, report designs, security approach, success measures |
| Build | 5 | Data connections, cleaned and modeled data, first dashboards |
| Test | 2 | Reconciliation, user acceptance, performance checks |
| Train and launch | 2 | Training, documentation, cutover, retirement of old reports |
| Stabilize | 1 | Fixes, support, adoption review |
| Total | 16 |
Check: 3 + 3 + 5 + 2 + 2 + 1 = 16 weeks. Adding a buffer of two to three weeks is sensible when data quality is uncertain. If the data scan in the first phase turns up large problems, such as duplicate customers or inconsistent product codes, extend the plan rather than building on sand.
Discover: understand the data and the questions
Interview the people who use the current reports and the people who build them. Ask what they check first each morning, which numbers they do not trust, and which reports they rebuild by hand. List every source system and every manual spreadsheet that feeds a number. Profile the data: how many records, how many are missing key fields, how many duplicates. Document where the same measure is calculated in different ways. These disagreements are the most valuable output of the phase, because they are the issues the definitions must settle. See single source of truth.
Design: definitions, grain and model
Write a definition for every measure in plain language, with the formula, the source, the owner and the date it was agreed. "Net revenue is gross invoiced revenue less returns, discounts and rebates, recorded in the month of invoice." Agree the grain of each data set, the level of detail of a single row: one row per order line per day, for example. Mistakes about grain are a classic source of double counting.
Most business reporting models follow a simple pattern: a small number of fact tables (sales lines, inventory snapshots, purchase orders, budget lines) connected to shared dimension tables (date, product, customer, location). Shared dimensions are what let you slice sales and inventory by the same product hierarchy. Keep the model simple, name things in business terms and document it. Decide who may see which data, such as margin or salary, and set up access by role from the start, not as an afterthought.
Build: in thin slices
Build one subject area end to end, for example sales, before moving to the next. Put the transformations in a repeatable process, not in manual steps, and keep the logic where others can read it. Show early versions to users every week or two. A user who sees a working dashboard in week eight will give feedback that a requirements document in week two never captured. Resist the urge to polish before the numbers are right.
Test: reconcile before you celebrate
The most important test is that the new numbers match the source of truth. For each key measure, compare the dashboard total with the ledger or system report for the same period and filters. Suppose the dashboard shows March net revenue of $4,812,300 and the ledger shows $4,815,900 (hypothetical). The difference is 4,815,900 - 4,812,300 = $3,600, or 3,600 / 4,815,900 = 0.07 percent. That might look small, but you do not accept an unexplained difference. Investigate: if it traces to returns posted after the extract cutoff, document the rule and fix the timing. A reconciliation that matches to the dollar after explained timing items builds trust, and one that is waved through with "close enough" breeds doubt the first time someone finds a gap.
Also test with real users on real tasks. Ask a planner to find last month's top five customers by margin. Watch where they hesitate. Test performance with realistic data volumes and several users at once. Test security by logging in as people with different roles. Keep a log of issues, assign each an owner and close them before launch.
Train, launch and retire the old way
Training should be short, role-based and built around real tasks. Provide a one-page guide for each dashboard: what it shows, how the measures are defined, where the data comes from and whom to ask. Set a cutover date, announce it, and say when the old reports will be switched off. If both versions stay available indefinitely, people will use the familiar one and the new system will die. Retiring the old reports is as important as launching the new ones.
Measure adoption
Track who uses the system. Suppose 55 people are licensed and, eight weeks after launch, 38 are active in a typical week. Adoption is 38 / 55 = 69.1 percent. If the target is 80 percent, you need 0.80 × 55 = 44 weekly users, a gap of 6 people. Find out who they are and why they are not using it. Often the reason is a missing view, a lack of training or a manager who still asks for a spreadsheet. Fixing these costs little compared with the cost of the project. Also track the number of old reports still in circulation, the time to produce the monthly pack and the number of data questions raised, which should fall as trust grows.
Governance after launch
Assign an owner for the system, an owner for each data set and a process for change requests. Review the backlog monthly. Monitor refresh failures and data quality checks. Document changes. Plan for the cost of keeping the system current: reports break when source systems change, and new questions arrive every month. See data governance basics.
Common risks
- Scope creep. Hold the first release to the agreed decisions.
- Disputed definitions. Settle them early with the sponsor.
- Poor data quality found late. Scan in week one.
- No user involvement until testing.
- Single point of failure, one person who understands everything.
- No plan to retire legacy reports.
- Treating launch as the end.
Who does what during the project
Even a small project needs clear roles. The sponsor clears obstacles and decides disputes about definitions and priorities, and should be seen at the kickoff and at each phase review. The business owner supplies the questions, tests the results and approves the numbers. The project lead runs the plan, tracks the issues and keeps the sponsor informed. The technical lead or developer builds the connections, the model and the reports. A small group of power users, drawn from finance, sales and operations, test early versions and become the first line of help after launch. Their involvement is the cheapest adoption investment you can make, because colleagues trust a peer more than a memo.
Keep the working group small and meet weekly for thirty minutes. Review what was built, what is blocked and what decisions are needed. Write decisions down, because a definition that was agreed in a corridor will be reopened in a month.
Managing change
New reporting changes how people work, and some will resist it. A planner who built a personal spreadsheet over years may see a shared dashboard as a threat to their expertise. Address this directly. Involve them in the design, use their logic where it is sound, and show them how the new system removes the tedious parts of their job. Ask managers to run their regular meetings from the new reports, since people use what their boss uses. Collect complaints and fix the genuine ones quickly, because early credibility is hard to win back.
A go-live checklist
Before cutover, confirm that each key measure reconciles to its source and the differences are documented, that refresh runs succeed on schedule and failures raise alerts, that access is set by role and tested, that every dashboard has a named owner and a one-page guide, that training is complete for each group, that the date for retiring the old reports is announced, and that a support route exists for the first four weeks. If any item is missing, delay the launch by a week or two rather than launching a system people will quickly learn to distrust.
FAQs
How long does a BI implementation take?
A focused first release for a mid-sized company often takes three to five months, depending on data quality, the number of sources and the scope.
What causes BI projects to fail?
Unclear definitions, poor data, no business ownership, scope creep and a lack of adoption planning, more often than technology problems.
Who should lead a BI implementation?
A project lead with time and authority, a business owner who will use the results and a technical lead who knows the data, supported by an executive sponsor.
How do I know if the numbers are right?
Reconcile key measures to source totals for the same periods and filters, explain every difference and have users test real tasks.
Should we build all dashboards at once?
No. Start with the few that serve the highest-priority decisions, learn, then expand.
Keep reading
This article is for general information. It is not accounting, tax, legal or investment advice, and examples use illustrative numbers rather than client data. Confirm decisions that carry financial or legal consequences with a qualified professional.