Home �   ITIL�  Index

There is No Evidence for ITIL

ITSM Watch columnist, The IT Skeptic, shakes the tree looking for quantifiable evidence of ITIL's effectiveness and comes up empty handed.
Feb 20, 2007

The IT Skeptic

Where is the evidence for the benefits of ITIL? There isn’t any. Not the kind of hard empirical evidence that would stand up in, say, clinical trials. There is more evidence for quack alternative medicines than there is for ITIL.

Granted there is some research around the benefits of aligning IT with the business but not around quantification of ROI and nothing that I can find specific to ITIL.

Other Articles by The IT Skeptic

What Goes into an ITIL Business Case

ITIL Must Embrace the Collective

Stop Calling ITIL Best Practice

What You Need to Know About "ITIL Compliant"

FREE IT Management Newsletters

The itSMF themselves make a few outrageously unsubstantiated claims in their pocketbook An Introductory Overview of ITIL:

  • Over 70% reduction in service downtime;
  • ROI up by over 1000%;
  • Savings of £100 million per annum; and
  • New product cycles reduced by 50%.

    Send no money now!!

    Before it mysteriously disappeared, the Best Practice Research Unit (BPRU) was a website claiming to be associated with the ITIL v3 Refresh (After twenty years of ITIL, it is high time there was such a unit.)

    It is a shame there is no such initiative from either OGC or itSMF (at least itSMF USA is doing something, in fact several things focused on research). The BPRU website explicitly recognised the evidence problem:

    "Much of the material published on IT management, including IT service management, has been normative or prescriptive in flavour. Few rigorous, academic studies have been undertaken to evaluate how tools, techniques, methods and management approaches have been selected, adapted, implemented and measurable benefits achieved. There is a danger that new approaches arise out of the practitioner community with little empirical validation."

    “Few rigorous, academic studies … ?” Don’t be kind. The solitary piece of academic research I can find carries a bold and, I think, unproven title Evidence that use of the ITIL framework is effective . It opens by saying “Very little academic material exists on ICT Service Management Best Practice …” and concludes its own research with:

    "We found that both customer satisfaction and operational performance improve as the activities in the ITIL framework increases. Increased use of the ITIL framework is therefore likely to result in improvements to customer satisfaction and operational performance. Although the study was limited to a single research site, claims made by executive management of the research site and OCG as to the contribution the ITIL framework seems to be justified. More definitive research delineating the nature of these “relationships” is however needed, especially regarding each process in the ITIL framework."

    The database is poor: “… research site was a large service unit of ICT in a provincial government in South Africa during 2002/3” — one site.

    More importantly, the two things measured to support this brave conclusion were (1) customer satisfaction (the three surveys they conducted only included management in the final survey so all we can say is that non-managerial staff were happier) and (2) “objective service improvement” by measuring “the number of calls logged at the Help Desk” because “we can rather safely conclude that the number of problems logged would be a good reflection of objective service levels."

  •     1 2 3 >> Last Page