Keep up-to-date with drugs and crime

The latest research, policy, practice and opinion on our criminal justice and drug & alcohol treatment systems

The unexpected consequences of payment by results

The issue of providers "gaming" PbR contracts is a hot issue in the literature. Commentators take different views with some stating that it is only rational and efficient for providers to focus on the outcomes incentivised by PbR payments to the best of their ability while others describe similar behaviour as "gaming."

Share This Post

Unexpected and perverse consequences

This is the 13th post in a blog series looking at the lessons I’ve learned from a recent review of the payment by results literature.

The issue of providers “gaming” PbR contracts is a hot topic in the literature. Commentators take different views with some stating that it is only rational and efficient for providers to focus on the outcomes incentivised by PbR payments to the best of their ability while others describe similar behaviour as “gaming.”

Whatever your perspective, there is a consensus that unexpected, often perverse, consequences are commonplace in PbR contracts.

This post examines what the literature says about the typical ways in which unexpected and unintended consequences emerge from PbR schemes as well as some of the best ways to mitigate these.

Gaming/rational use of resources

Many commentators have discussed at length how gaming/rational us of resources is intrinsic to payment by results contracts. The definition of gaming and the different forms it takes vary considerably.

The most blatant and obvious forms of gaming, perhaps more properly termed fraud, are best illustrated by the infamous example of a number of hospitals which, in order to improve their performance on Accident and Emergency (A&E) waiting times, bought more expensive trolleys so that they could be designated as beds and patients could be redefined as having been admitted as soon as they were placed on them.

Other hospitals kept patients in ambulances outside the hospital so that the four-hour target period did not start until patients were brought onto the hospital premises; others still had special units where A&E patients could be taken to remove them from the target, sometimes for days at a time.

A common “gaming” technique in PbR contracts is known as “creaming” (AKA “cherry picking”, “low-hanging fruit” or “cream-skimming”) where providers focus their resources on the end-users who are easiest to help. You can see why many providers would reasonably argue that this is an effective use of resources. The flip side of “creaming” is “parking” where the hardest to help end-users receive no, or a very low level of service.

There is a consensus amongst official evaluations and third party research on the Work Programme that creaming and parking are wide-spread within its contracts. Indeed, a number of providers with long experience of welfare to work provision argued that gaming was embedded in the Work Programme and could be seen as a rational response to PbR since a proportion of customers would always be very unlikely to get a job.

The DWP did try to avoid this problem by segmenting the long term unemployed population and setting a higher incentive payment for providers who succeeded, for example, in helping people with disabilities into work. However, these incentives were not seen as sufficient and did not reflect the need to invest a much greater level of resources to achieve the outcome measures for this group.

pay1_copy

Responses to gaming

There are suggestions in the literature about how the risks of gaming in worklessness programmes can be reduced through contract design and oversight. The inclusion of outcome measures related to job retention, wages and benefits, and earnings gains, for example, all help diminish any incentive to place participants into poor quality jobs.

Another mechanism recommended to counteract “creaming and parking” is the target accelerator model devised by Jane Mansour & Richard Johnson (check out their Buying Quality Performance site for much more detail). The basic principle of this model is that it starts with a finite, or capped, number of people being required to achieve outcomes. They recommend that this should be a high, and therefore significant, percentage of a given target group. The premise is that the further a provider reaches into that group, the harder they become to help and the more it will cost to achieve the outcomes.

Their example suggests that commissioners might not pay any incentive for the first 10% of employment outcomes, on the assumption that these jobseekers would have found work without intervention, but would pay £600 per outcome for the next 15% of jobseekers, £1,000 for the following 15% and so on, increasing the incentive as providers “penetrated” further into the cohort to people with harder-to-meet needs.

Conclusions

As we have seen, there is a consensus that unexpected, often perverse, consequences are commonplace as providers focus wholeheartedly on these measures in a manner which is either described as “rational and efficient” or “gaming the system”. Irrespective of their perspective on this issue, many commentators recommend:

  • The piloting of new initiatives and avoidance of hasty implementation of new PbR schemes.
  • The need to be flexible and modify contracts in the light of provider behaviour.
  • The value of mixed models with not all income linked to the achievement of outcome measures.
  • The importance of transparency.

 

Next week’s post is the last in this series and summarises the overarching lessons that we can learn from the payment by results research literature.

I reviewed the literature as part of a project funded by the Oak Foundation to develop an interactive tool to assist commissioners and providers to decide whether a payment by results approach might be an effective approach to commissioning a particular service.

The tool is now live – please check it out at: www.PbR.russellwebster.com

Share This Post

Related posts

Infographics
PbR jargon demystified (2) G-L

Second in a series of infographics which demystify the jargon and technical terms associated with the payment by results commissioning model.

Payment by Results
What we know about payment by results

This final post summarises the most important lessons to bear in mind if you are involved in commissioning, investing in or providing a payment by results-funded scheme.

Payment by Results
Getting payment by results contracts right

Designing PbR contracts can be a tricky business with plenty of examples in the literature of commissioners and providers wishing they had never signed on the dotted line. In addition to getting the outcomes and payment incentives right, two issues are particularly critical: the overall length of the contract and the he delay until, and interval between, incentive payments.

Payment by Results
Quality assurance in payment by results contracts

The main message from the literature is that commissioners need to be proactive in ensuring that PbR providers deliver a good quality service — particularly when service users include vulnerable groups

Payment by Results
Attributing outcomes in payment by results contracts

When outcomes are the basis for payment, it is important that the provider receiving the payments is responsible for achieving the outcomes. Targets should not be unduly influenced by external factors (such as the state of the economy for Work Programme type schemes) or by the work of other agencies who are not receiving payment from the contract.

Payment by Results
Verifying outcomes for payment by results

Latest post in a series examining the lessons from the payment by results research literature focuses on the importance of verifying outcomes.

Leave a Reply

Your email address will not be published. Required fields are marked *

Subscribe

Get every blog post by email for free