Gathering meaningful data for Return on Investment (ROI) analysis
One of the challenges in measuring return on investment in training/learning contexts is that much of the value can be intangible. Take for example training in new manufacturing processes. It’s relatively easy to measure ‘hard’ data such as reduced waste and rework. But what about intangibles that also come from the training.... ideas that improve the product, boosting sales.... staff who stay longer because the job is more rewarding.... It’s even harder when you move to measuring the impact of, say, a coaching programme on the performance of managers.
Our view? Be very clear about who will use the data, and what it will be used for.
Think about who the stakeholders are that will be looking at the results. What matters to them, and what evidence would they see as ‘valid’? Often stakeholders with a Human Resources/Learning and Development focus will be much more receptive to anecdotal data with more tenuous links to the bottom line....
• Three of ten managers all noted practical examples of improvement where they believe the cost saving to the company was greater than $2,000 so we can extrapolate that....
• The performance management cycle identifies that most trainees have improved faster this year in the area they got training in, so the programme is effective...
Those with a focus more on financial PKIs may discount this sort of ‘evidence’ as just speculation that cannot be meaningfully quantified.
• The manager’s perceptions are not reliable, and we can’t extrapolate over the whole company
• Improved performance is probably due more to the pay rises.... we can’t tell what the impact of the training was....
The problem is there is often a long chain of events between a training intervention and the company bottom line. If you require absolutely certainty before you recognise return, you’ll almost certainly underestimate the true ROI. Just because it’s hard to measure, doesn’t mean it’s not real.
So before you start, ask yourself:
1. Who will be relying on the ROI data?
2. What type of data will they need to see to have confidence in it?
3. What decisions are going to be made based on it?
Get this right before you decide on how you’ll measure ROI, and you’ll reduce the chances of your work being quietly binned.
Posted by PhilGaring at November 27, 2009 11:44 AM
