Executive Paper No. 43 · Discovery

Map the Systems Before You Fund the Project

Large technology projects overrun because the starting picture is wrong. Executives approving a migration, ERP, AI or modernization budget should first buy a short discovery that shows what actually exists.

The Decision in Front of You

Somewhere on your desk is a proposal to move to the cloud, replace an ERP, modernize a legacy platform or put AI into a core process. It arrives with a business case, a vendor estimate and a go-live date. The decision is whether to approve it as written or first spend a few weeks finding out what it will touch.

The stakes are well measured. McKinsey and Oxford University studied more than 5,400 IT projects and found that those with budgets above $15 million ran 45% over budget and 7% over schedule on average, while delivering 56% less value than predicted 1. The same 2012 research found 17% of IT projects went badly enough to threaten the company's existence 1. Flyvbjerg and Budzier's analysis of 1,471 projects found an average cost overrun of 27%, which hides the real risk: one project in six was a "black swan" with an average cost overrun of 200% and a schedule overrun of almost 70% 2.

These studies are more than a decade old, and the cases below show the pattern continuing. The recommendation in this paper is narrow: approve no major technology project until a short discovery has mapped the infrastructure, the dependencies between services and the business workflows that run across them.

What's Happening

Nobody has an accurate list

Most organizations cannot say with confidence what they run. In an October 2026 benchmark of 203 organizations with more than 1,000 employees, Enterprise Management Associates found only 18.5% rated their IT service and configuration management database (CMDB) asset data at 95% accuracy or better 5. About two-thirds (65.5%) still build the CMDB at least partly by hand 5. In the author's experience, the missing records are usually integrations, which is where cutovers fail.

Government is no better. The UK government's 2025 State of Digital Government review estimated that 28% of central government systems were legacy in 2024 and said there is no comprehensive record of the scale of legacy IT across central government 3. Around 15% of respondents could not estimate the size of their own legacy estate 3. In the United States, GAO's 2025 review of the 11 federal legacy systems most in need of modernization found ages from 23 to 60 years, and only 3 of the 11 had modernization plans covering all of GAO's key practices 4. For one Commerce Department system, hardware information was unknown to the Census Bureau because several bureaus manage hardware separately 4.

Spending has moved outside the IT department

Software no longer arrives only through IT purchasing. Zylo's 2025 SaaS Management Index, based on more than 40 million licenses and $40 billion of spend, found that business units account for 70% of SaaS spend and IT for 26.1% 6. The prior year's index found more than a third of a company's applications were shadow IT, bought and run without IT's involvement 7. Any of them may call an internal system through an API key that no architecture diagram shows.

The standards already require the maps

The security frameworks your auditors cite expect these inventories to exist. NIST's Cybersecurity Framework 2.0 (2024) asks organizations to maintain inventories of hardware (ID.AM-01), of software, services and systems (ID.AM-02), of services provided by suppliers (ID.AM-04), and representations of authorized network communication and internal and external data flows (ID.AM-03) 8. CIS Critical Security Controls v8.1 makes inventory and control of enterprise assets its first control, covering end-user devices, network devices, IoT devices and servers whether they connect physically, virtually, remotely or through the cloud 9. CISA's August 2025 asset inventory guidance, written with the NSA, the FBI and five allied agencies, sets out the method: define scope, identify assets and their network dependencies through both physical inspection and network surveys, classify them by criticality, map process dependencies and keep the inventory current on every change 10.

These controls were written for security. They are also the starting picture every migration and ERP project needs.

AI raises the stakes

AI projects add a new failure path. Gartner predicted in 2024 that at least 30% of generative AI projects would be abandoned after proof of concept by the end of 2025, citing poor data quality, weak risk controls, rising costs and unclear value 14. In 2025 it reported that 63% of organizations either lacked or were unsure they had the right data management practices for AI 16. In June 2026 Gartner predicted that more than 70% of mainframe exit projects will fail because buyers overestimate what generative AI can do 15. A tool that converts code still needs to know which jobs call it and who reads what it writes.

Two Recent Cases

Asda, 2021 to 2025. After Walmart sold Asda in February 2021, the retailer started Project Future to separate its technology from Walmart's, with an initial budget of £189 million 11. The work meant untangling more than 2,500 legacy systems 11. By the end of 2023 the cost had reached £430 million 11. The annual report released in June 2026 put the total at £1.224 billion, more than £1 billion of it operating expense, about 6.5 times the original budget 12. The cutover in 2025 disrupted stock flow between depots and stores, and Asda said the problems materially affected its third-quarter trading, when revenue fell 2.8% to £5.1 billion 11. Chairman Allan Leighton called the issues "totally self-inflicted" and blamed poor integration, insufficient testing and a lack of capacity planning, adding that the delays set the turnaround back six months 11. The lesson: in a carve-out, the dependency map is the project, and every connection found after approval arrives as a change order.

College of Policing, 2023 to 2026. In October 2023 the College moved its accounting to the Home Office's Oracle-based Metis system and outsourced most payroll 13. The National Audit Office found it went live with known problems unresolved and without a line-by-line reconciliation of its data 13. The College overspent its budget by £1.3 million that year, and by the end of audit fieldwork could not support 56% of the audit sample 13. In July 2025 the Comptroller and Auditor General disclaimed an opinion on its 2023-24 accounts, and the 2024-25 accounts were disclaimed again in early 2026 because of the earlier problems 1317. The lesson: a workflow map of what the old system did, down to reconciliations and month-end steps, is the acceptance test for the new one.

Birmingham City Council's move from SAP to Oracle, budgeted at £19 million and now forecast at £144.4 million, is covered elsewhere in this series 18.

Why the Usual Approach Fails

The usual sequence runs business case, vendor selection, contract, then discovery inside the project. By the time the team finds the undocumented interfaces, the budget, date and price are set, and each surprise becomes a change request negotiated under deadline pressure.

Estimates come from the vendor. The party writing the estimate knows its product well and your environment barely at all. Its numbers describe a clean installation.

The CMDB is treated as the truth. Most are built at least partly by hand 5, and teams plan from them because they are the only list available. Discovery checks the records against the network, the schedulers and the logs.

Calendar effects are missed. Two weeks of observation shows daily traffic. It misses the quarter-end close, the annual tax file and the batch job that runs on the first Sunday of the month.

Workflow lives in people. The official process says invoices flow from the ERP to the bank. The real process includes an analyst who exports a file, fixes three columns in a spreadsheet and uploads it. That step is a dependency. It will break when the export format changes, and no system inventory will find it.

The Framework: Three Maps Before Money

A discovery is a small, fixed-price piece of work with a defined output. It takes two weeks for a single site or business unit and up to six weeks for a multi-site organization or a carve-out. It produces three maps and a decision memo. Each map is checked against live evidence, so that every item is either confirmed by the systems themselves or marked as an assumption.

Exhibit 1The discovery gate: three maps feed one funding decision
flowchart LR
    A[Fund discovery<br/>2 to 6 weeks<br/>fixed price] --> B[Infrastructure map<br/>what runs where]
    B --> C[Dependency map<br/>what calls what]
    C --> D[Workflow map<br/>how work moves]
    D --> E[Decision memo<br/>scope, cost, sequence]
    E --> F[Board decision<br/>fund, rescope<br/>or stop]

Source: author's framework, aligned with NIST CSF 2.0 ID.AM 8 and CISA asset inventory guidance 10.

Exhibit 2What each map contains and what it lets you decide
Map Contents Evidence used Standard it satisfies Decisions it settles
Infrastructure Every server, database, network device, cloud account and SaaS subscription in scope, with owner, age, support status and cost Network scans, cloud and SaaS billing, expense reports, licence records, CMDB checked against scans NIST CSF ID.AM-01, ID.AM-02, ID.AM-08 8; CIS Control 1 9 What is in scope; what can be retired before the project starts; what is past end of support
Service and dependency Every integration, API, file transfer, scheduled job and shared database between systems, including suppliers Traffic and flow logs, firewall rules, DNS logs, scheduler and ETL configurations, API keys, supplier contracts ID.AM-03, ID.AM-04 8; CISA process dependencies 10 Migration order and waves; which interfaces to rebuild, replace or drop; rollback scope; contingency size
Workflow How orders, invoices, payroll, claims or cases actually move, including manual steps, spreadsheets and month-end routines Interviews, shadowing staff at period end, report and spreadsheet inventories, audit reconciliations ID.AM-05 asset prioritization 8 Acceptance tests for go-live; candidates for automation or AI; which processes change and who must be trained

Source: author's framework mapped to NIST CSF 2.0 8, CIS Controls v8.1 9 and CISA guidance 10.

The decision memo then states, in two or three pages, what the project will touch, how many integrations are confirmed versus assumed, what can be switched off first, the order of work, and a budget range with contingency sized to the remaining unknowns. The board approves the memo. A project with 40 confirmed interfaces and 3 unknowns is a different investment from one with 40 confirmed and 60 suspected, even if the vendor quote is the same.

Two practices keep discovery honest. Observe for long enough to catch a month-end close, or read the scheduler configurations to find what runs less often. Have business staff walk the workflow map and mark every place they leave the system to finish a task.

Costs, Risks, and Tradeoffs

Discovery costs money and time. Consider a hypothetical $20 million ERP or migration program. A team of four working six weeks at a blended $250 an hour costs about $240,000, or 1.2% of the budget. If the program carries the one-in-six chance of a 200% overrun that Flyvbjerg and Budzier measured 2, the expected tail cost is about $6.7 million (one-sixth of $40 million). Even the 27% average overrun 2 is $5.4 million. This is the author's illustrative estimate. It assumes the program resembles the projects in that research, and it does not assume discovery removes all overrun risk.

Exhibit 3Tradeoffs of making discovery a funding gate
Area Cost or risk Mitigation
Schedule Adds two to six weeks before contract signature Run vendor shortlisting in parallel; make discovery the first paid phase of the selection
Direct cost Roughly 1% to 2% of a large program's budget (author's estimate above) Fix the price and the deliverables; pay against the three maps and the memo
Analysis paralysis Teams keep mapping and never decide Hard stop at six weeks; unknowns go into the contingency line instead of more research
Stale output Maps age as soon as they are drawn Hand the maps to the CMDB owner with a change-control rule, as CISA recommends 10
Uncomfortable findings Discovery may show the project should be smaller or stopped Agree in advance that rescoping or stopping is a valid outcome of the gate
When this is wrong Small, reversible changes, a SaaS purchase with no integrations, or an emergency recovery where the system is already down Approve directly; for an emergency, stabilize first and map afterwards

Source: author's analysis; overrun figures from Flyvbjerg and Budzier 2.

How to Act

Exhibit 4Thirty, ninety and 365 days
Window Actions Owner Milestone
First 30 days Adopt a policy: any technology project above a set threshold (for example $1 million or 5% of the IT budget) requires a discovery memo before funding. Pick the next project in the pipeline and commission its discovery with a fixed price and the three maps as deliverables. CFO with CIO Policy approved by the executive committee; first discovery under contract
First 90 days Complete the first discovery. Count confirmed and assumed interfaces, systems that can be retired, and manual workflow steps. Rebaseline the project's scope, sequence and contingency from the memo. CIO with the business owner of the affected process Decision memo delivered; board decision recorded as fund, rescope or stop
First 90 days Compare the CMDB against the infrastructure map and record the accuracy gap. Pull SaaS spend from expense and card data into the inventory. IT asset or service management lead with finance Measured CMDB accuracy figure; SaaS inventory reconciled to spend
First 365 days Keep the maps current through change control. Report the count of unknown integrations found after funding on every major project. Map coverage to NIST CSF ID.AM and CIS Control 1 evidence for audit. CIO with internal audit Every major project funded through the gate; post-approval surprises tracked and falling; audit evidence on file

Source: author's recommendation.

Questions to Ask Your Team

  1. For the project we are about to approve, how many integrations does it touch, and how many of those have we confirmed from the systems themselves?
  2. What runs only at month end, quarter end or year end, and how did we find out?
  3. How accurate is our CMDB, measured against a scan, and when did we last check?
  4. How much of our software is bought outside IT, and is it in the inventory?
  5. Where do staff leave the system to finish a task in a spreadsheet or email?
  6. Which systems could we switch off before the project starts?
  7. Who wrote the estimate, and how much of our environment had they seen?
  8. If discovery found the project should be half the size, would we be willing to rescope it?

Closing

Every large technology project is an estimate about systems someone has not fully counted. The research shows the cost of guessing: average overruns in the tens of percent, and one project in six running at three times its budget. A discovery of two to six weeks, priced at a percent or two of the program, replaces the guess with three maps checked against the systems themselves. Make it the gate. Approve migrations, ERP replacements, modernization and AI projects from the maps, and send back any proposal that arrives without them.


Sources

  1. Bloch, M., Blumberg, S., and Laartz, J. "Delivering large-scale IT projects on time, on budget, and on value." McKinsey & Company, with the University of Oxford. 2012. https://www.mckinsey.com/capabilities/tech-and-ai/our-insights/delivering-large-scale-it-projects-on-time-on-budget-and-on-value.
  2. Flyvbjerg, B., and Budzier, A. "Why Your IT Project May Be Riskier Than You Think." Harvard Business Review 89, no. 9. 2011. Preprint arXiv:1304.0265. https://arxiv.org/abs/1304.0265.
  3. UK Department for Science, Innovation and Technology. "State of digital government review." 2025. https://www.gov.uk/government/publications/state-of-digital-government-review/state-of-digital-government-review.
  4. U.S. Government Accountability Office. "Information Technology: Agencies Need to Plan for Modernizing Critical Decades-Old Legacy Systems." GAO-25-107795. 2025. https://www.gao.gov/products/gao-25-107795.
  5. Enterprise Management Associates. "ITAM in the Age of AI: EMA's 2026 Maturity Benchmark." Survey of 203 organizations with 1,000+ employees. Hosted by Xurrent. 2026. https://www.xurrent.com/whitepapers/ema-itam-ai-maturity-benchmark-2026.
  6. Zylo. "2025 SaaS Management Index." Press release. 2025. https://zylo.com/news/2025-saas-management-index.
  7. Zylo. "2024 SaaS Management Index." Press release. 2024. https://zylo.com/news/2024-saas-management-index.
  8. National Institute of Standards and Technology. "The NIST Cybersecurity Framework (CSF) 2.0." NIST CSWP 29. 2024. https://nvlpubs.nist.gov/nistpubs/CSWP/NIST.CSWP.29.pdf.
  9. Center for Internet Security. "CIS Control 1: Inventory and Control of Enterprise Assets." CIS Critical Security Controls v8.1. 2024. https://www.cisecurity.org/controls/inventory-and-control-of-enterprise-assets.
  10. Cybersecurity and Infrastructure Security Agency, with NSA, FBI, EPA and international partners. "Foundations for OT Cybersecurity: Asset Inventory Guidance for Owners and Operators." 2025. https://www.cisa.gov/resources-tools/resources/foundations-ot-cybersecurity-asset-inventory-guidance-owners-and-operators.
  11. The Register. "Asda's 'self-inflicted' SAP mess after Walmart divorce stalls financial revival." Citing Asda annual reports and an interview with Allan Leighton in The Times. December 1, 2025. https://www.theregister.com/2025/12/01/asda_walmart_tech_divorce/.
  12. Retail Systems. "Cost of Asda tech separation from Walmart reached £1.22bn." Citing the Bellis Finco annual report. 2026. https://www.retail-systems.com/rs/Cost_of_Asda_tech_separation_from_Walmart_reached_£1_22bn.php.
  13. National Audit Office. "Spending watchdog disclaims the College of Policing 2023-24 accounts." Press release. July 8, 2025. https://www.nao.org.uk/press-releases/spending-watchdog-disclaims-the-college-of-policing-2023-24-accounts/.
  14. Gartner. "Gartner Predicts 30% of Generative AI Projects Will Be Abandoned After Proof of Concept By End of 2025." Press release. July 29, 2024. https://www.gartner.com/en/newsroom/press-releases/2024-07-29-gartner-predicts-30-percent-of-generative-ai-projects-will-be-abandoned-after-proof-of-concept-by-end-of-2025.
  15. Gartner. "Gartner Predicts More Than 70% of Mainframe Exit Projects Will Fail Due to Overestimation of Generative AI's Capabilities." Press release. June 18, 2026. https://www.gartner.com/en/newsroom/press-releases/2026-06-18-gartner-predicts-more-than-70-percent-of-mainframe-exit-projects-will-fail-due-to-overestimation-of-generative-ais-capabilities.
  16. Gartner. "Lack of AI-Ready Data Puts AI Projects at Risk." February 26, 2025. https://www.gartner.com/en/newsroom/press-releases/2025-02-26-lack-of-ai-ready-data-puts-ai-projects-at-risk.
  17. Computer Weekly. "College of Policing accounts disclaimed by auditor for second year in wake of IT failure." 2026. https://www.computerweekly.com/news/366638947/College-of-Policing-accounts-disclaimed-by-auditor-for-second-year-in-wake-of-IT-failure.
  18. The Register. "Birmingham City Council's Oracle ERP fiasco now £144M and still not working." January 29, 2026. https://www.theregister.com/2026/01/29/birmingham_oracle_latest/.

The views in this paper are the author's own and do not represent any employer. Scenarios are hypothetical. This paper is not legal, financial, or compliance advice.

From the author

Want this decision made with your numbers?

Watkins Labs does the work this paper describes. Talk to Chris directly: no sales team, no pitch deck.

Systems down? Emergency recovery