Define the evidence needed before making a legacy decision

Quantifying legacy system risk means converting vague unease about an ageing application into a structured assessment that a business can use to make decisions. Most organisations know a system is fragile, slow, or difficult to maintain, but "knowing" does not translate into a budget, a timeline, or a board-level conversation. The purpose of quantification is to bridge that gap.

Risk in this context is not purely technical. A server running an unsupported operating system is a technical fact. The risk arises from what happens if that server fails during peak processing, or if a security vulnerability in that operating system is exploited. Quantification connects the technical condition to a business consequence, then expresses that consequence in terms leadership can weigh against other priorities.

The basic structure is straightforward: probability of an event occurring, multiplied by the impact if it does. The difficulty lies in making both sides of that equation honest rather than speculative. Probability requires evidence from incident history, monitoring data, and the judgements of people who operate the system day to day. Impact requires translating downtime, data loss, or compliance failure into costs the business recognises — lost revenue, regulatory penalties, remediation expense, or reputational damage.

Assessment areaWhat to establishEvidence to retain
Categories of legacy riskLegacy risk typically falls into several overlapping categories, and a useful quantification exercise separates them rather than producing a single vague score.A named owner, current-state evidence, unresolved questions and a dated decision record.
Why gut feeling is insufficientOperations teams often have an accurate sense of which systems are dangerous.A named owner, current-state evidence, unresolved questions and a dated decision record.
Choosing a scoring approachThere is no single correct scoring method.A named owner, current-state evidence, unresolved questions and a dated decision record.
Gathering the right inputQuantification fails when it is done in isolation by a single person.A named owner, current-state evidence, unresolved questions and a dated decision record.

Categories of legacy risk

Legacy risk typically falls into several overlapping categories, and a useful quantification exercise separates them rather than producing a single vague score.

  • Operational risk: the chance that the system stops performing its function when the business needs it. This includes unplanned outages, degraded performance under load, and manual workarounds that staff rely on to keep things running.
  • Security risk: the exposure created by unpatched software, outdated encryption, weak authentication, or a codebase that no longer receives security updates. The impact here is not theoretical — it connects directly to data protection obligations and breach-notification requirements.
  • Compliance risk: the possibility that the system no longer meets regulatory or contractual standards. This might relate to data retention, audit trails, accessibility, or industry-specific rules.
  • Supplier risk: dependence on a vendor, framework, or library that is approaching end of life, has changed its licensing, or has become difficult to engage. This is distinct from the system's internal condition but contributes to the overall risk profile.
  • Knowledge risk: the concentration of understanding about how the system works in a small number of people, or in documentation that no longer reflects reality. If those individuals leave, the business loses the ability to operate, fix, or safely replace the system.

Each category deserves its own assessment. Collapsing them into one number obscures the specific problem the business needs to solve.

Why gut feeling is insufficient

Operations teams often have an accurate sense of which systems are dangerous. That instinct is valuable, but it cannot be used to justify investment because it cannot be scrutinised, challenged, or compared with other risks the business faces. Quantification does not replace judgement — it provides a transparent framework around it so that different people in the organisation can agree on what the risk actually is and whether it warrants action now, later, or not at all.

Choosing a scoring approach

There is no single correct scoring method. What matters is that the approach is consistent, documented, and understood by everyone who will use the results. A common starting point is a simple matrix: rate probability and impact on a scale — for example, one to five — and multiply the two to produce a score. The scales need clear definitions tied to the business, not generic labels.

For probability, a rating of one might mean "no incidents in the last three years and no known vulnerabilities," while a five might mean "multiple unplanned outages in the last six months and known unpatched issues." For impact, a one might represent "minor inconvenience, workarounds available within the team," while a five might represent "regulatory breach, significant financial loss, or complete inability to operate a core process."

The definitions must reflect the specific organisation. A two-hour outage in a back-office admin tool has a different impact than a two-hour outage in a customer-facing portal that processes payments.

Gathering the right input

Quantification fails when it is done in isolation by a single person. Useful assessments draw on multiple perspectives:

  • Operations staff can describe how often the system fails, what workarounds exist, and how much time is spent keeping it running.
  • Technical staff can identify unsupported components, known vulnerabilities, and the feasibility of recovery after failure.
  • Business owners can define what the system supports in revenue, contractual obligations, and regulatory requirements.
  • Compliance or legal teams can confirm whether the system's current state meets the organisation's obligations.

The process of bringing these views together often reveals that different parts of the organisation have incompatible assumptions about how the system behaves or what would happen if it stopped. Resolving those disagreements is itself a valuable outcome.

Applying the assessment to real scenarios

Consider an internal CRM that runs on a framework the original developer no longer supports. The operations team reports occasional slowdowns but no complete outages in the past year. The technical team notes that the database version is two major releases behind current, with known security advisories. The business owner confirms the CRM holds personal data subject to UK data protection law and supports a process that generates a significant portion of monthly revenue.

Quantifying this means assigning scores to each risk category. Operational risk might score moderately — the system works, but performance is degrading. Security risk scores highly because of the unpatched database and unsupported framework. Compliance risk is elevated because of the personal data and the question of whether the system can demonstrate adequate security measures if audited. Knowledge risk depends on whether anyone other than the original developer fully understands the codebase.

The output is not a single verdict but a structured picture: the system is not in immediate danger of collapse, but it carries a concentrated security and compliance exposure that is likely to worsen as the underlying components age further. That picture can be compared against other legacy systems in the portfolio to set priorities.

Expressing risk in financial terms where possible

Not every risk translates neatly into a pound figure, but many do. If an outage of four hours would cost the business a specific amount in lost orders, that figure can be multiplied by the estimated annual probability of such an outage to produce an expected annual cost. If a regulatory breach carries a known penalty range, the upper end of that range can be used as the impact value for compliance risk. These figures are illustrative and should be labelled as such, but they make the risk comparable to other business costs in a way that abstract scores do not.

Where the work usually goes wrong

  • Treating the score as a precision tool. A risk score of 12 versus 11 does not mean one system is definitively worse. The value is in the rough grouping — high, medium, low — and in the reasoning behind the rating, not in the arithmetic.
  • Assessing only the technology. A perfectly maintained system that only one person understands carries significant knowledge risk. A system with outdated code that handles no sensitive data and has a straightforward replacement path may carry less total risk than it appears.
  • Confusing risk with priority. A system may carry high risk but be low priority if the business is about to retire the process it supports, or if a replacement is already underway. Risk quantification informs prioritisation but does not replace it.
  • Doing the assessment once and treating it as permanent. Legacy systems degrade. A risk profile that was accurate six months ago may be outdated if a component reached end of life, a key person left, or a new vulnerability was disclosed.
  • Excluding the cost of inaction. Some assessments focus on what it would cost to fix or replace the system without quantifying what it costs to continue running it — staff time spent on workarounds, incremental infrastructure costs, opportunity costs from features that cannot be added.

What this work cannot prove on its own

No quantification exercise captures unknown unknowns. If the system contains undocumented customisations, hidden data flows, or logic that only triggers under rare conditions, the assessment will underestimate risk. This is not a reason to avoid quantification, but it is a reason to treat the results as a starting point for further investigation rather than a final answer.

Quantification also struggles with cascading failures. A legacy system may appear low-risk in isolation but sit in a chain of integrations where its failure would propagate to other systems. Understanding those connections requires separate work — dependency mapping — which sits alongside risk quantification rather than within it.

Finally, risk scores do not account for the organisation's appetite for risk. Two businesses with identical legacy systems might reach different conclusions about what to do, depending on their regulatory environment, financial position, and strategic direction. The quantification provides the input; the decision remains a business judgement.

Key checks before relying on the results

  • Can each score be traced back to a specific piece of evidence — an incident log, a vulnerability advisory, a personnel record — rather than a general impression?
  • Have the probability and impact scales been defined in terms that mean something to this business, not copied from a generic framework?
  • Has someone who disagrees with the initial assessment been invited to challenge it, and have those challenges been resolved or documented?
  • Does the assessment distinguish between risks that are getting worse, stable, or likely to diminish (for example, because a replacement project is already funded)?
  • Has the assessment been reviewed by someone with the authority to confirm that the impact definitions align with the organisation's actual financial and regulatory exposure?

Record the current state and unresolved risks

When these checks are satisfied, the organisation has a defensible basis for deciding which legacy systems to address first, what level of investment is proportionate, and what can safely be left alone for now. The quantification does not make the decision — it ensures the decision is made on the basis of something more durable than instinct.