Wednesday, October 28, 2009

Denise Rousseau's take on Evidence Based Management


A few weeks ago, I got in touch with Denise Rousseau, professor of Organizational Behaviour the Carnegie Mellon University and one of the figureheads of the emerging 'Evidence Based Management' school of thought. She was visiting colleagues in Ireland, but took the time to answer a few of my questions. Jeffrey Pfeffer also replied, but was swamped in his work and preparing to leave the country for an extensive trip abroad. He'll probably give his point of view later. Bob Sutton hasn't been in touch yet. Today I got in touch with another leading thinker in this field. His name is Rob Briner, professor of Organizational Psychology from Birkbeck College, University of London, who already collaborates with Denise on the Evidence Based Management Collaborative. But, back to Denise.

1. What do you view as the core idea and purpose of EBM?
EBMgt in my opinion is family of approaches to improving the quality of managerial decisions and organizational practices by combining in a more systematic fashion
1) relevant findings from mgt/social science research,
2) business facts and metrics with
3) more skillful individual judgments.

2. What do you think would be the benefit(s) for organizations and society as a whole if management would be based more on evidence?
In both public policy and organizational decisions, we possess so much more relevant knowledge and information than is actually ever used. Improving the uptake of scientific evidence with better understanding of how people organize and make decisions  translates into better quality decisions and easier implementation.

3. What progress has the EBM movement currently been making?
I would say that there are three legs in the EBMgt tripod and on 2 of the 3 we see some progress, though much work remains to be done. The two legs were we see developments are;
  • education where there is greater attention in teaching managers and other practitioners who can benefit from managerial knowledge (e.g., nurses, social workers, doctors, public policy professionals, etc.) and
  • scholarship/research, where somewhat more attention is being paid to identifying what we can confidently know from mgt research, as opposed to always focusing on brand new ideas or new theories at the expense of assessing progress to date.  

You can probably gather that I believe the weakest link (but really all need work!) is managerial USE of quality business facts in making decisions let alone any use of or reliance on social science findings in the decisions being made.

Is there evidence of evidence based management getting a foothold in organizations? I am doubtful. Hit or miss, and it may be that as in medicine, it takes a generation before a new evidence-informed practice takes hold.

4. What future do you envision for EBM in (research and practice)?
This is the project of a community, perhaps several communities, and a generation, I think we are seeing ENERGY in several communities to move EBMgt forward. I am hopeful and patient!

Thank you very much.

Monday, October 26, 2009

Toward evidence based change management


Change management is very much alive today! Despite the lack of success and reports about high percentages of failure (the infamous 70%), popularity is on the rise. This is the opening statement from the article "Op weg naar evidence based change management" by Eric Barends and Steven ten Have which was published in the Holland Management Review. These Dutch researchers disagree with the reported percentages of failure and have refuted this in another article. They are however optimistic about systematic research (in the spirit of Peter Drucker) in order to establish What, Why and When works and what doesn't regarding change management. Their article provides an overview of the developments in change management and investigates the practical barriers for evidence based change management. They make an analogy with psychology, where there was consensus amongst clinical psychologist that 'debriefing' after shocking events prevents psycho trauma. Only, until recently it was discovered that 'debriefings' enhances the chance of a psycho trauma. Without any doubt there are similar misperceptions in change management and we should work extra hard to reach the next level toward evidence based change management and root these misperceptions out.

The term '' change management' generates 252.000.000 hit in 0.32 seconds on Google (26 october, 2009). No doubt very popular, but heavily polluted and debased by IT management. When you try it in Google Scholar it yields 3.600.000 hit in 0,16 seconds. Still an impressive number.

The authors concur with Tichy who was very critical about the efforts toward change management when he observed 20 years ago: Billions of dollars have been spent in the last two decades on management and organizational development activities purposely designed to change organisations. These include programs to introduce management by objectives, organizational development programs, the managerial grid. leadership training, strategic planning models, and, more recently quality circles. Virtually none of these efforts has any systematic monitoring or evaluation associated with it. This leads to an unfortunate state of affairs where waxing and waning of organizational improvement remedies are associated with limited understanding about what works and what does not and why"

But does that imply that change management is bankrupt? Well, if we limit ourselves for the next rise and fall of the latests management hype, the answer is yes.

Developement in change management
The analogy with clinical psychology is made. This discipline matured in the last decades (as opposed to change management). In the 1960, there was a struggle between two therapy schools. This is known in literature as "Theory E" and "Theory O". This struggle lead to an enormous improvement in research methods. Therapy effects could be compared and supported by empirical evidence. The fase of "free theorizing" was closed and succeeded by scientific (effect) research. In the beginning there where many methodological problems, but over the years they where sorted out and this made the profession a lot less arbitrary.

The next step: scientific (effect) research
Authors Jeffrey Pfeffer and Bob Sutton claim in their book Hard facts, Half truths and Total Nonsense the call for scientific evidence of postulated theory and models. This call is inspired by  the "evidence based" school of thought in medicine. Managers and educators disregard the enormous amount of behavioural science research which is evidence based. The lack of a shared body of knowledge (in the spirit of Peter Drucker) prevents the development of "peer pressure" focussed on the use of "evidence". Evidence based medicine should guide the way and inspire.

Practical barriers for evidence based change management
1. Management is no academic discipline: Bennis and O'Toole state: "The scientific model, as we call it, is predicated on the faulty assumption that business is an academic discipline like chemistry and geology. In fact, business is a profession, akin to medicine and the law, and business school are professional schools - or should be." 
2. Research of the management practise: For methodological and practical reasons researchers can not afford to allow solely homogeneous patients. Research would be invalidated for the heterogeneous clinical practise.
3. Management is not strictly defined: Christensen and Sundahl argue: "Many researchers and writers about management have been eager to offer theories - in the form "if you do this, this will result"- that they haven't taken the care to build their predictions of cause-and-effect on a robust classification scheme".In other words, management is to broad to do serious research.

How to proceed from here?
Experience from medicine and clinical psychology learn us that great harm can come from personal experiences alone. Just recall that until 30 years ago, stress was thought to induce stomach ulcers. To the great amazement of the medical community a bacteria (Helicobacter pylori) turned out to be the root cause and it is easily treatable with antibiotics. The same goes for "benefits" of the aforementioned 'debriefings' by clinical psychologists. Without any doubt there are similar misperceptions in change management and we should work extra hard to reach the next level toward evidence based change management and root these misperceptions out.

Note: Non Dutch speakers are advised to use Google translate to upload the file and translate Dutch to English to read the full article.

References:
  • Managing strategic change: Technical, political and cultural dynamics, N. Tichy, New York, Wiley&Sons, 1983, p. 363
  • Hard facts, Half truths and Total Nonsense, J. Pfeffer, B. Sutton, Harvard Business Press, 2006
  • How Business Schools Lost Their Way', W. Bennis, J. O'Toole, Harvard Business Review, vol. 83, No. 5 (May), 2005, p. 96-104
  • Op weg naar evidence based change management, E. Barends, S. ten Have, Amstelveen, Holland Management Review, nr. 120. 2008, p. 15-21.

Monday, September 14, 2009

Evidence based consultancy, the next step?

The discussing about evidence based management is very much alive today. In the Dutch management journal M&O magazine, three scholars take things one step further. They wonder in their article if evidence based consultancy is within the realm of possibilities. They describe evidence based consultancy as a service innovation in consultancy, where interventions are supported by scientific evidence and/or repeatedly proven positive practices. They are aware of the huge gap between theory and practice. In their article they refer to the evidence based medicine practice as a way of working in the medical profession and see potential for evidence based consultancy. In order to achieve this, a few basics need to be warranted:
  • compliance with professional codes of conduct for consultants
  • interventions backed up by scientific evidence and/or information on best practices
  • systematic integration of the context (the client's organization)
The last point prevents rationalization and standardization of the evidence based consultancy practice. It should actually strengthen the link between theory and practice.

Non Dutch speakers are advised to use Google translate to upload the file and translate Dutch to English to read the full article.

Source: M&O Magazine, january 2009, dr. J.M.J. Baaijens, prof. dr. P.N. Kenis, prof. dr. M.T.H. Meeus

There are a few problems with evidence based consulting. The first basic is the professional code of conduct. Consultancy is a free (and commercial) enterprise. A small percentage of consultants are members of a professional organization (check the ICMCI for your local branch). Of this small percentage even a smaller number are 'certified consultants'. An additional problem is legislation. A certified management consultant (CMC) is not a recognized 'title' like for instance a registered accountant (CPA) or a member of the bar association (lawyers and judges). The second problem is contributing to a body of knowledge. Contrary to scientific research, this is not (always) the case for consultants. They prefer to 'share' knowledge in order to reach customers (look how smart I am, hire me). Also clients never give consultants 'carte blanche'. Most of the times, the 'best intervention' is not necessarily the solution the client is looking for (f.i. personal agendas, politics or affirmation of radical plans). But, maybe I'm wrong.

Suggestions or examples are welcome.

Thursday, September 10, 2009

Three questions about evidence based management


The last few days, I have had pleasant email exchanges with Dennis Tourish (University of Kent) and Mark Learmonth (University of Nottingham). Dennis will join in the EBM debate later and Mark still defends his arguments against the emerging evidence based management movement. He also sent me a few articles. Since he published his short paper in ORGANIZATION, he has become a little milder. I've invited him to respond on the blog and share his current views with the rest of the readers.

After reading several publications, there are actually three questions which fascinate me about the evidence based management movement. Please share your thoughts in the comments or write your own posting.
  1. What is the core idea and purpose of EBM? What would be the benefit for organizations and society as a whole if management would be based more on evidence?
  2. What progress has the EBM movement currently been making? Is there evidence of evidence based management getting a foothold in organizations?
  3. What is future for EBM in (research and practice)?
Readers who have written articles on evidence based management (published in academic journals or still in the process or otherwise), please share them with me. I'd like to make a repository with interesting articles on evidence based management.

Friday, September 4, 2009

Asking the right question: a tribute to Howard Moskowitz

This is a classic on the internet, but still worth paying attention to. Malcolm Gladwell, the best selling author of the tipping point, Blink! and Outliers was invited to give a TED talk in 2004. He started out by saying he thought of talking about his latest book, but instead choose to talk about his personal hero. An that is dr.Howard Moskowitz. Moskowitz claim to fame came when he reinvented spaghetti sauce. ...Actually, he discovered a major flaw in thinking about product development and the first product in which he successfully fixed the flaw was spaghetti sauce. What happened? In the late 70 Pepsi came to his office asking him to determine the sweetspot ( the right amount of aspartame, an artificial sweetener) for their new product Pepsi Cola.

After extensive testing, by asking thousands of people to test samples, the results were a mess. No nice bell curve, but the dots were scattered across the board. For years and years, he tried to figure out what went wrong. Where was the flaw? Finally, he figured out that Pepsi had asked him the wrong question. The question was : develop the right Pepsi (single) and it should have been : develop the right Pepsi's (plural). Just watch and learn from this beautiful lecture. Everything starts with asking the right question(s).

Thursday, September 3, 2009

Is business management a profession?

In an earlier post I pointed out that the science (or art) of management is still in the middle ages, where the alchemist still tell us they can change lead into gold. The underlying problem is that management is not yet perceived as a profession. But what is the definition of a profession? This morning I was searching for papers on this subject and found an interesting publication dealing with the same question (Khurana, Nohria, and Penrice; 2005). In order to establish if management is a profession and compare it to professions like law and medicine, these authors choose four criteria;
  1. a common body of knowledge resting on a well-developed, widely accepted theoretical base;
  2. a system for certifying that individuals possess such knowledge before being licensed or otherwise allowed to practice;
  3. a commitment to use specialized knowledge for the public good, and a renunciation of the goal of profit maximization, in return for professional autonomy and monopoly power;
  4. a code of ethics, with provisions for monitoring individual compliance with the code and a system of sanctions for enforcing it.
I'm not going to run down the list, it is merely a nice framework. The authors note that the study of management is very young compared to law, medicine and theology. During the time that the first business schools were being constituted, at the beginning of the twentieth century, "scientific management" was in the air, as Frederick Taylor's application of scientific methods to the study of physical labor had begun to be extended to the organization of industry as well as to spheres such as higher education and government.

Management differs from medicine, law, and other recognized professions in having neither a formal educational requirement nor a system of examination and licensing for aspiring members. Although the MBA has been the fastest-growing graduate degree for the past twenty years, it is not a requirement for becoming a manager.

You can argue, that management is struggling for recognition. Big cataclysmic events, like to global melt down of the financial system fuel the discussion on professionalism (the blessing in disguise). Still, judgement, context and personal experience are always part of the equation. No matter how many codes of ethics, bodies of knowledge and permanent education become mandatory for a management position. Decision making is not the same as solving a puzzle.

On thing where I see the first improvement in the road toward professionalism is permanent eduction. This could bridge the gap between science and practice. On the other hand, management science should explore the field more and test their hypotheses. This partially validates Mark Learmonth's argument for pluralistic research methods. Most articles in A rated journals have no connection to the real world. It is just a political game for tenure. An observation which was made earlier by Howard Johnson. We still have a long road ahead of us.

Wednesday, September 2, 2009

Food for thought: Mark Learmonth's view on evidence based management


In my exploratory search for the state of the art of the evidence based management movement, I stumbled on this short paper by dr. Mark Learmonth, Associate Professor in Organization Theory at the University of Nottingham. This is a must read for all the evidence based management enthusiasts. Maybe not always what you want to hear or read, but definitely food for thought on the freedom of conducting research and the politics which are involved in securing research grants and the pursuit of a academic career. Although, criticizing the EBM proponents by challenging their intellectual credibility does not make his case stronger. In the abstract of his contribution which is called Evidence-Based Management: A Backlash Against Pluralism in Organizational Studies?, he states:

The rise of ‘evidence-based management’ (EBM) is read as the latest form of resistance to pluralism—one that might prove particularly hard to refuse given the popularity of many other forms of evidence-based practices. So I explore the prospects for EBM within organization studies and some of its implications for those who value the continuation of pluralistic forms of analysis in organizational research. 

In 1993 Jeffrey Pfeffer bemoaned the proliferation of theoretical perspectives in the field of organizational studies. He advocates the paradigmatic unity which was enforced by a group of scholars who imposed their views in the field of economics. This was a good thing, because it enabled coherent research and more advancements in the field of economics. Organization studies could benefit in the same way. His appeal fell on deaf ears and it seemed that the pluralists of methodology in social sciene had won the battle. Learmonth is still not convinced. He worries that the evidence based management movement is a political project and that the emergence of the evidence based practice will lead to methodological fundamentalism. In social science, he says, evidence is never just there for the researcher to find it, it is always necessary to construct the evidence in some way, a process that is inherently ideological and always contestable.

Update: I reread the short paper and distilled the main arguments made by Mark.
  • Evidence based management limits (what counts as) legitimate research methodologies (leads to fundamentalism).
  • What works tends to assume elite definitions of effectiveness.
  • Evidence based management has a top management bias.
  • Evidence is not objective or neutral.This leads to philosophical discussions on science.
  • Evidence based management is a political project.
  • Evidence based management threatens funding for independent research.
I wonder if he still feels so strongly about the points he's made. Maybe he'll respond.