Monday, 07 May 2012 09:35

A place for program evaluation

Written by    Volume: 17  Issue: 9
Rate this item
(0 votes)

As the global economy struggles to regain some forward momentum, Canadian governments are looking for ways to limit government spending in light of reduced revenues, increasing demands for services and soaring deficits.

In the mid-1990s, Canada found itself in a similar financial situation and was forced to make radical changes by scaling back its spending priorities. One of the lessons from Program Review, the formal process at the federal level used to examine all government spending at the time, was setting different savings targets for key programs based on the considered view of the programs' effectiveness. In addition to setting targets, the Masse Committee in 1994 also created a strong challenge function at the centre of the decision-making process to ensure that the departmental plans were realistic and evidence-based.

To deal with current fiscal challenges, the Harper government has kick started a similar exercise to scale back the size of the federal government in order to achieve a balanced budget by 2014. This new effort, now labelled the Deficit Reduction Action Plan (DRAP), is being led by a special Cabinet Committee and chaired by the President of the Treasury Board Tony Clement.

There are two features of the committee's work that differentiate it from Program Review. First, all departments and agencies have been asked to generate two across-the-board cut scenarios based on five percent and 10 percent savings. Second, the Treasury Board Secretariat is relying on the outside advice of a management firm with an expertise in cost containment to look for efficiency savings by improving productivity.

Experience has shown that using a scythe to chop spending is a crude method of achieving savings. It is arbitrary and unfair since the cuts apply equally to well performing programs and to poorly performing ones, and to efficient organizations as well as poorly managed ones. Using this method of reducing costs, the DRAP ministers must find their own way to balance savings and to serve the needs of Canadians in high priority policy areas.

One possible key to achieving this balance is using the evaluations that have been conducted by the federal government during the past few years. Canada has a proud reputation for the quality of the program evaluation work done in many departments. In fact, it could be argued that at one time Canada had the most robust evaluation system among OECD countries.

While one of the unintended consequences of Program Review was the weakening of the policy capacity in the federal government, in 2009, the government reaffirmed the value of program evaluation by announcing a strengthened evaluation policy.

The new policy is far ranging and exceeds the reach of previous program evaluation policies since it covers "all direct program spending and the administrative aspect of major statutory spending, programs that are set to terminate, every five years."

While the potential for using the 2009 evaluation policy is obvious, there are two reasons why this initiative may only result in limited value to the current Cabinet Committee. First, there is growing concern among evaluation experts that the quality of their work is not meeting their own high standards. In a recent report, Lay of the Land: Evaluation Practice in Canada, the practitioner authors argue that too many evaluations have little impact because they don't ask the right questions, there is too much resistance from program administrators, and politicians are reluctant to listen to negative assessments of their programs.

Second, there is an increasing fear that the government is not interested in using evidence in decision making. The most recent example comes from the Supreme Court of Canada's ruling on the Insite case concerning the closure of the supervised drug injection facility in Vancouver's eastside. In its unanimous decision the Court admonished the federal government for its unwillingness to use information, data or analysis in making policy decisions. The court reminded the government that it could not disregard the facts and that it had an obligation to rely on "evidence" in making policy decisions.

As in the mid-1990s, the federal government has the opportunity to use the information gathered in formal evaluations to inform decisions. While there are reasons to be sceptical that the millions of dollars spent on program evaluation will find their way into the departmental submissions, there is no reason why program evaluation should not find a place in the planning cycle much as audit has become a feature in government operations.

 

David Zussman holds the Jarislowsky Chair in Public Sector Management in the Graduate School of Public and International at the University of Ottawa ( This email address is being protected from spambots. You need JavaScript enabled to view it. ).

Read 316 times Last modified on Sunday, 20 January 2013 23:31
David Zussman

David Zussman holds the Jarislowsky Chair in Public Sector Management and is director of the Graduate School of Public and International Affairs at the University of Ottawa (dzussman@uottawa.ca).

David has a PhD in psychology from McGill University and has been teaching public management at the University of Ottawa for several years and served as the Dean of the School of Management from 1988 to 1992.

Throughout his career, he held several positions related to public affairs. In recent years, he has been President of the Public Policy Forum and he served as Executive Vice President and COO of EKOS Research Associates Inc, a leading public opinion and public policy research firm. In the public sector, he was Assistant Secretary to the Cabinet for Program Review and Machinery of Government in the Privy Council.

Leave a comment

Make sure you enter the (*) required information where indicated. HTML code is not allowed.

 
Share this article

copy link

 bookmark article

 


Polls

Do you think that open data initiatives should be a priority for the Canadian government?

Yes, and they should be more of a priority than they are now. - 68.8%
Yes, they are important but should be less of a priority than they are now. - 21.9%
No - 9.4%


Related Articles

The full monty: UK deputies face full exposure
In the U.K. system, Permanent Secretaries are what we call Deputy Ministers. As part of that governmentu2019s Civil Service Reform Plan, Permanent Secretaries will have their objectives published online.  read more...

Results-based management: An endangered species?
Results matter in the public sector, particularly in these challenging times of fiscal restraint, expenditure reductions, and rethinking of program and service delivery.  read more...

Incremental reform: The impressive impact of interrelated initiatives
Too often those implementing change in the public sector can get caught up in details of one specific initiative. Taking a thematic view to a series of initiatives is important to identify the relationships between and impact of each.  read more...

Comptrollership: Adapting to the challenge of change
We are living in a period of rapid change and limited resources that has compelled governments around the world to pursue ambitious strategies to enhance the efficiency and effectiveness of their operations as part of wider efforts to contain costs and restore public finances.  read more...

Wrong public services employees favoured, American study says
US public sector employees don't trust their management to do the right thing.  read more...










Copyright © 1995 - 2013 1618261 Ontario Inc. O/A Navatar Press