Showing posts with label jeffrey pfeffer. Show all posts
Showing posts with label jeffrey pfeffer. Show all posts

Wednesday, November 25, 2009

Jeffrey Pfeffer on the state of affairs of evidence based management

Last week I received mail from Stanford. Jeffrey Pfeffer had returned after some extensive traveling and found the time to answer my four key questions. Here you can read his take on the current state of affairs of evidence based management. I'm always grateful if people take time out of in their busy schedules to help me out.








1. What do you view as the core idea and purpose of EBM? What do you think would be the benefit for organizations and society as a whole if management would be based more on evidence?

The core idea is simple and seemingly common sense to make decisions, to the extent possible, on the basis of the best facts and evidence available at the time, and to update ideas and decisions as new evidence becomes available. The purpose is to make sounder decisions by basing choices on the best theory and facts instead of on belief or ideology, unreliable retrospective consideration of experience, and fads and fashion. The benefits could be profound, as at least in the United States, in domains ranging from criminology to education to business management, many unsound decisions are made wasting resources and affording poor outcomes.

2. What progress has the EBM movement currently been making and is there evidence of evidence based management getting a foothold in organizations?

I think progress has been halting and even in medicine, there is evidence of much backsliding. For instance, when data showed that radiological screening for breast cancer should be postponed until age 50, there was an outcry and there seems to be no will to implement these findings, even though they are based on a lot of science. In management, senior managers seem to trust consultants, their own judgement, and casual benchmarking much more than they do the facts.

3. What future do you envision for EBM in (research and practice)?

In research, we need in management the same sorts of efforts that have occurred in other fields--summarizing the state of knowledge (and updating such summaries) so they can be used by practitioners. We also need more research on the barriers to implementing EBM practices and how to overcome such barriers. In practice, we need collectives and associations that push EBM forward, much as there have been in other fields.

Thank you very much for your time and efforts.

Saturday, November 21, 2009

Miguel Olivas Lujan take on evidence based management

Just last week I received a nice email from Miguel Olivas Lujan. He just became aware of this little blog and was kind enough to attach his article on evidence based management, which was not yet in my collection. Miguel is professor of administrative sciences at Clarion University in Pennsylvania. The article is titled Evidence Based Management: A Business Necessity for Hispanices which he published in The Business Journal for Hispanic research. Subscribers to this journal can read the whole article here. Non subscribers can send an email to Miguel for a personal copy. (this prevents any copyrights infringement on my part...). Since he wrote an article on evidence based management, I thought it would only be fair to ask him some fundamental questions on evidence based management.

1. What do you view as the core idea and purpose of EBMgt?
The core idea in my opinion is –first of all—the systematic use of research methods in managerial decision making. But the decision maker’s judgment and the integration of stakeholders’ values are also essential components that have often been overlooked. Managerial problems are often so complex that decision makers have to extrapolate (also known as making “best guesses”) from previous experiences because a solution has not been tried in a particular context. Also, there are many areas (take for example, international management) whereby stakeholders’ values (particularly customers’ and employees’ values) are such that “what has been found” in one context might not work in another (a classic example would be managing by objectives or MBO). The core purpose is making managers and organizations more effective and rational, less wasteful, yet respectful of differences and mindful of personal competencies and weaknesses (yes, I’ll admit this sounds much as a “pie in the sky” but I’m an idealist at heart).

2. What do you think would be the benefit(s) for organizations and society as a whole if management would be based more on evidence?
Greater efficiency, less politics (well, of the “spinning wheels in vain” kind; I agree that the use of evidence per se will have political repercussions), accelerated progress, more competitiveness…

3. What progress has the EBMgt movement currently been making?
At this point, I believe we have been able to start a much needed conversation. I wish I could report a greater impact but (well, speaking from the academic experience) it’s not easy to dedicate the time this movement deserves when teaching our students is what brings bread to the table. Now, the conversation is not “without teeth” either! Denise Rousseau, along with David Denyer and Josh Manning have raised the standard for literary reviews; Sara Rynes has been documenting specific problems and making actionable recommendations within the Human Resource Management profession; Joan Pearce just wrote a new, and already award-winning textbook focusing on research findings; Jean Bartunek, Gary Latham, Sara Rynes, and others have individually been writing on how academicians can better communicate their findings to practitioners, etc. Plus, the fact that you, Tracy Altman, Bob Sutton and Jeff Pfeffer have been bringing this topic to the “blogosphere” (I probably should include my blog here too) also attests to the fact that there is an important need to be satisfied. But, as Denise stated in her response to this question, it may take “a generation before a new evidence-informed practice takes hold.”

4. What future do you envision for EBMgt in (research and practice)?
More focused work! The need is too important to be left unattended! As my article in the Business Journal of Hispanic Research suggests, if other fields such as Medicine and Education have been able to make such significant inroads through the Cochrane and the Campbell collaborations, why not Management? It is evident that the ride will not be smooth as the inertia to do things the old way is quite strong… but, as we say in Spanish, “Roma no se hizo en un día” (Rome was not built in a day) ;-D

Thank you very much Miguel for sharing your insights.

Wednesday, October 28, 2009

Denise Rousseau's take on Evidence Based Management


A few weeks ago, I got in touch with Denise Rousseau, professor of Organizational Behaviour the Carnegie Mellon University and one of the figureheads of the emerging 'Evidence Based Management' school of thought. She was visiting colleagues in Ireland, but took the time to answer a few of my questions. Jeffrey Pfeffer also replied, but was swamped in his work and preparing to leave the country for an extensive trip abroad. He'll probably give his point of view later. Bob Sutton hasn't been in touch yet. Today I got in touch with another leading thinker in this field. His name is Rob Briner, professor of Organizational Psychology from Birkbeck College, University of London, who already collaborates with Denise on the Evidence Based Management Collaborative. But, back to Denise.

1. What do you view as the core idea and purpose of EBM?
EBMgt in my opinion is family of approaches to improving the quality of managerial decisions and organizational practices by combining in a more systematic fashion
1) relevant findings from mgt/social science research,
2) business facts and metrics with
3) more skillful individual judgments.

2. What do you think would be the benefit(s) for organizations and society as a whole if management would be based more on evidence?
In both public policy and organizational decisions, we possess so much more relevant knowledge and information than is actually ever used. Improving the uptake of scientific evidence with better understanding of how people organize and make decisions  translates into better quality decisions and easier implementation.

3. What progress has the EBM movement currently been making?
I would say that there are three legs in the EBMgt tripod and on 2 of the 3 we see some progress, though much work remains to be done. The two legs were we see developments are;
  • education where there is greater attention in teaching managers and other practitioners who can benefit from managerial knowledge (e.g., nurses, social workers, doctors, public policy professionals, etc.) and
  • scholarship/research, where somewhat more attention is being paid to identifying what we can confidently know from mgt research, as opposed to always focusing on brand new ideas or new theories at the expense of assessing progress to date.  

You can probably gather that I believe the weakest link (but really all need work!) is managerial USE of quality business facts in making decisions let alone any use of or reliance on social science findings in the decisions being made.

Is there evidence of evidence based management getting a foothold in organizations? I am doubtful. Hit or miss, and it may be that as in medicine, it takes a generation before a new evidence-informed practice takes hold.

4. What future do you envision for EBM in (research and practice)?
This is the project of a community, perhaps several communities, and a generation, I think we are seeing ENERGY in several communities to move EBMgt forward. I am hopeful and patient!

Thank you very much.

Wednesday, September 2, 2009

Food for thought: Mark Learmonth's view on evidence based management


In my exploratory search for the state of the art of the evidence based management movement, I stumbled on this short paper by dr. Mark Learmonth, Associate Professor in Organization Theory at the University of Nottingham. This is a must read for all the evidence based management enthusiasts. Maybe not always what you want to hear or read, but definitely food for thought on the freedom of conducting research and the politics which are involved in securing research grants and the pursuit of a academic career. Although, criticizing the EBM proponents by challenging their intellectual credibility does not make his case stronger. In the abstract of his contribution which is called Evidence-Based Management: A Backlash Against Pluralism in Organizational Studies?, he states:

The rise of ‘evidence-based management’ (EBM) is read as the latest form of resistance to pluralism—one that might prove particularly hard to refuse given the popularity of many other forms of evidence-based practices. So I explore the prospects for EBM within organization studies and some of its implications for those who value the continuation of pluralistic forms of analysis in organizational research. 

In 1993 Jeffrey Pfeffer bemoaned the proliferation of theoretical perspectives in the field of organizational studies. He advocates the paradigmatic unity which was enforced by a group of scholars who imposed their views in the field of economics. This was a good thing, because it enabled coherent research and more advancements in the field of economics. Organization studies could benefit in the same way. His appeal fell on deaf ears and it seemed that the pluralists of methodology in social sciene had won the battle. Learmonth is still not convinced. He worries that the evidence based management movement is a political project and that the emergence of the evidence based practice will lead to methodological fundamentalism. In social science, he says, evidence is never just there for the researcher to find it, it is always necessary to construct the evidence in some way, a process that is inherently ideological and always contestable.

Update: I reread the short paper and distilled the main arguments made by Mark.
  • Evidence based management limits (what counts as) legitimate research methodologies (leads to fundamentalism).
  • What works tends to assume elite definitions of effectiveness.
  • Evidence based management has a top management bias.
  • Evidence is not objective or neutral.This leads to philosophical discussions on science.
  • Evidence based management is a political project.
  • Evidence based management threatens funding for independent research.
I wonder if he still feels so strongly about the points he's made. Maybe he'll respond.

Friday, August 28, 2009

Is the evidence based management movement dead?

When you go to see a doctor, you would like him or her to make medical decisions based on scientific evidence and research. Not stick the first needle or pill in you, because he or she heard rumours that it just might work. However, in management we are still in the middle ages of science, where the alchemists still try to make gold from lead. And by alchemists I mean all types of managers (managers, consultants, coaches, interim-managers, project managers, etc.). One of the reasons why managers still make decisions based on anecdotal evidence, gut feeling or a whim is the fact that management is not a profession. Well, perhaps it is, but we lack a body of knowledge and skills. Everybody with decent qualifications can become a manager in contrast with nurses, judges or engineers. Management is still treated as a 'skill' and if you have a better story than the next guy, you just found yourself a new career.

Around the year 2000, the evidence based management movement emerged. It is a movement to explicitly use the current, best evidence in management decision making. Its roots are in evidence based medicine, a quality movement to apply the scientific method to medical practice.

Evidence-based management (EBMgt) entails managerial decisions and organizational practices informed by the best available scientific evidence. Like its counterparts in medicine (e.g., Sackett, et al., 2000) and education (e.g., Thomas & Pring, 2004), the judgments EBMgt entails also consider the circumstances and ethical concerns managerial decisions involve. In contrast to medicine and education, however, EBMgt today is only hypothetical. Contemporary managers and management educators make limited use of the vast behavioral science evidence base relevant to effective management practice (Walshe & Rundall, 1999; Rousseau, 2005, 2006; Pfeffer & Sutton, 2001). (Source: en.wikipedia.org)

Last month the annual Academy of Management meeting was hosted in Chicago and a couple of my colleagues who work for Universities went to meet people and take in the latest developments on Organisational and Management Science. The Evidence Based Management movement is still there, but progress is really slow. Most developments are exchanged in closed communities and you really have to make an effort to dig up new information and stay in the loop of recent developments. I'm now in the process of preparing an interview (together with my friend Coert Visser) with the four figureheads of the Evidence Based Management movement. These are Denise M. Rousseau, Tracy Altman, Jeffrey Pfeffer and Bob Sutton. Interviews take time, but I'm confident we'll get some answers. Wait and see what they have to say about the future of Evidence Based Management.

Monday, August 10, 2009

Interview with Michael Shermer

On skepticism and evidence based management

© 2009 Richard Puyt

Dr. Michael Shermer is an adjunct professor in economics at Claremont Graduate University, founder of the Skeptics Society, chief editor of Skeptic Magazine and (co)author of many books and articles that take on everything from the existence of Bigfoot to Intelligent Design and why people believe in such phenomena. Recent publications include The Mind of The Market. He is also contributing editor and monthly columnist for Scientific American, and is the host of the Skeptics Distinguished Lecture Series at Caltech. Last summer I've interviewed him for Managementsite.com about skepticism in general and the emergence of evidence based management in particular.

The Skeptics Society is inspired by the philosophies of great thinkers, like the 16th Century Dutch philosopher and lens grinder Baruch de Spinoza, who tried to understand human nature throughout his life and the 20th Century theoretical physicist Albert Einstein, who said all our science is child play and primitive compared to reality, but it is the most precious thing we have. Skepticism is a method, not a position. Skeptics are not cynical.

Richard: On the English Wikipedia entry about you, there is the following statement: I became a skeptic on Saturday, August 6th, 1983, on the long climbing road to Loveland Pass, Colorado….I got the impression you had an epiphany. Like you denounced everything you believed in previously and chose the scientific method. Like a conversion to science. What happened on the mountain?

Michael: I was involved in extreme biking and used legal performance enhancement techniques. No drugs, I might add. Still feeling no improvements after taking herbs, vitamins, minerals, and potions of all kinds, I actually wondered if all the claims which were made on the bottles really could stand scientific scrutiny. That’s the moment I decided to go back to my scientific roots. At the time, I held a Masters in Experimental Psychology and went back to Claremont Graduate University to do my Ph.D. That’s what I actually wanted to do all my life. Become a college professor and improve the world a little by teaching.

Richard: On the internet, we can read, see and hear many of your articles, debates and lectures. The ones which stand out for us are: Why people believe weird things and the baloney detection kit. Becoming a skeptic is one thing, founding an organization and a magazine is something else. What do you hope to achieve by promoting skeptical thinking? How will things become better if more people assume a skeptical attitude?

Michael: If things sound too good to be true, they probably are (and never abandon lying as a probable explanation). Never assume. Challenge everything. Skeptical thinking is not a religion or a way of life. It’s a way of thinking, a method. It helps you to test assertions and claims. You can detect lies and half truths. When we say we are “skeptical,” we mean that we must see compelling evidence before we believe. It prevents us from believing in illusions and spares us a lot of sorrow. The Skeptics Society organization started bottom up. We are the debunk squad of pseudo, voodoo, junk and bad science. Right from the start, it received quite a lot of attention and before you know it we were on the radio and asked to appear in tv-shows like Larry King Live and Oprah.

All over the world there are skeptics organizations, like for CSICOP/CSI, Skeptical Investigations, The James Randi Educational Foundation and I even believe there’s a chapter in the Netherlands. Here in the United States we have our hands full with school boards wanting to teach intelligent design or creationism instead of Darwinian evolution. People outside the States, like you, always ask us why we spend so much time on these guys. It is a necessity. We are caught in the middle of a cultural war.

Just as Richard Dawkins is raising our consciousness about the power of evolution to explain not only life, but religion and morality as well and that it is okay to be an atheist… I’m going to do something like that in the next book project (Mind of the Market), which is to raise the consciousness about the power of evolution to explain economics, evolutionary ethics and how markets can be moral, complexity theory to explain how markets rise, and that it is okay to be a libertarian (fiscally conservative, socially liberal). Libertarianism is based on the principle that people are free to think, believe, and act as they choose as long as they do not infringe the equal freedom of others. The part of infringement is where the rubber meets the road…
(YouTube: The Amazing Meeting 5: Michael Shermer, Evolutionary economics, part 1

Richard: On the 12th of February 2009 it was exactly 200 years ago that Charles Darwin was born. This year we celebrate his live and work. The school of evolutionary economics draws from the work of Charles Darwin on evolutionary biology. In your book Mind the Market you advocate this school. What fascinates you about evolutionary economics and how does it translate to our everyday life?

Michael: Since I was a teenager, I’ve been a libertarian. I noticed that there are not so many of us and that most people find us a bit strange. Most people have a hard time with the idea of so much freedom in the market place. Now, why is that? When I started applying evolutionary thinking to the process, thinking about folk intuitive notions of things and why people get so many areas of science wrong intuitively, it began to make sense to me. With folk astronomy we have an intuitive notion that the world is flat, celestial bodies revolve around the earth. That’s the way it feels. The planets are wondering gods that determine our future.

In folk economics, we have an intuitive notion that excessive wealth is wrong. Economic systems must be designed from the top down. We misunderstand and mistrust ‘the invisible hand” of the market place (note: Charles Darwin also read the work of Adam Smith). The reason why folk science so often gets it wrong is that we evolved in an environment radically different from the one in which we live. We still have a sweet tooth and biological inclination to eat fat, because food was always scarce. That’s why we have an obesity epidemic right now. Our senses are geared for perceiving objects of middling size, between say ants and mountains. Not bacteria, molecules and atoms on one side of the scale and stars and galaxies on the other end. We live to short to witness evolution, continental drift or long-term environmental changes. That’s why we still have an inclination to want products now, versus products later at a considerable discount. It is human nature.

According to the Austrian school of economics, if you “create” too much money, the indicators in the market go haywire. That’s why we probably should go back to the gold standard. The value of money needs to be backed up. This should prevent us from creating money from thin air. It also makes you wonder if the spectacular economical growth over the last 25 years was maybe based on nothing. Normal growth rates are between 2 to 3% per year, instead of 20%. Makes you wonder.

Richard: Nassim Nicolas Taleb is a literary essayist, epistemologist, researcher, and former practitioner of mathematical finance and calls himself skeptical empiricist. He wrote Fooled by randomness and The Black Swan. Since the crisis in 2008 he is an activist for a Black Swan robust society. On the 7th of April 2009 he wrote an article in the Financial Times, where he states; We’ll see an economic life closer to our biological environment: smaller companies, richer ecology, no leverage. A world in which entrepreneurs, not bankers, take the risks and companies are born and die every day without making the news. Sounds like he also advocates evolutionary economics. Taleb's contents that statisticians can be pseudo scientists when it comes to financial risks and risks of blowups, masking their incompetence with complicated equations. How does skeptical thinking prevent us from becoming epistemological arrogant?

Michael: Well, I actually know Nassim quite well. He’s even a bigger skeptic than me. A lot of people think he is arrogant, but I disagree. In his book The Black Swan, he made some valid points. For instance, you have to take all data into account. Not only count the successes, but also the failures. The same problems arise in science magazines. Reports about failures are equally important, but are much harder to get accepted by the editorial boards of scientific magazines. If the chance is 50/50, then the payoff has to be twice as high as the risk. Loss hurts us much harder. This comes all down to biology. As for statistics, how can you predict the 100 year flood, if your data set only covers the last 10 years? Be humble and very aware of the limitations of your knowledge. Risk calculations and probabilities is not the same as fact finding. There is always bounded rationality in decision making. Nassim predicted the meltdown of the economy and the black swan emerged. That’s why he has so much fun in challenging people who make claims they can’t backup. He’s very popular right now.

The only remedy I see to avert epistemological arrogance is humility. Be humble before the market. But when the market goes up again, we’ll probably forget all the previous warnings and start over again. The cycle will repeat itself. The market now hit rock bottom. If you buy right now, you’ll make a huge profit. And that will probably happen on occasion. Then we’re back on anecdotal evidence and confirmation bias. We tend to have a short term memory. It’s human nature.

Richard: In Managers Not MBAs, 2004, Professor Henry Mintzberg at McGill University challenges the validity of the perennially popular MBA program: a program that top-tier companies continue to rely on as essential to the creation of successful corporate leaders. As one of the great iconoclasts of management theory, Mintzberg emphasizes the need to reexamine and drastically change our traditional form of management education. As Mintzberg boldly asserts: MBAs do not managers make. What do you think about this assertion?

Michael: I think he’s right. Maybe I can tell you an analogy. By contract, my book publisher in New York can choose the images and the titles of my books. I can only “approve”. If I don’t agree they can still go ahead. I asked them who chooses the pictures for the books. Well, just the three of us, they replied. I proposed to ask my followers on the internet (over 50.000 skeptic readers) to give their opinion on the best book cover, by putting up 3 pictures of covers on my blog, but they opposed fiercely. I would be in breach of contract and this is not the way covers are picked out in publishing. They think that their way is the best way and are not inclined to change. I could test things for them within an hour. Heck, they can test it for themselves a local Barnes and Nobles, but they simply refuse. They have never tested their theory and don’t see any benefit in changing. I think they should. They’ll probably end up selling more books.

Richard: The emerging evidence based management movement is introduced by Jeffrey Pfeffer and Robert Sutton in 2006. It is based on the same sort of thinking and discipline that has improved the practice of medicine to work on the management of medical organizations so that the management can be held to the same standards as the doctors in terms of the rigor of thought and analysis. What are your views on the emergence of this movement?

Michael: Management is a broad spectrum. But, I like the principle. Where I think it might trip up is anecdotal evidence to support claims and confirmation bias. That’s why I like the wiki’s. You have constant interaction and improvements. This probably doesn’t work in all fields off course. For instance, in astrophysics, I doubt if anybody outside of the professional field could make a useful contribution, let alone understand the matter. But, it is not outside of the realm of possibilities. Open and peer reviewed theories are the best, because they get constantly challenged. On my site, I also invite people to help improve Wikipedia. Be skeptical! It can only improve (scientific) theory.

Richard: In science there is much debate about the level of evidence. The dominant way of conducting science is the way physicists and mathematicians gather scientific proof. Big samples (n>1000), complex formulas, impressive charts, etc. Social scientists argue that this is not the preferred way to conduct research. Especially when researching management. What is in your view the preferred way to conduct research in science from a skeptical point of view?

Michael: There are two types of scientific research: experimental and comparative. In the social sciences, especially in economics and business, we cannot run controlled experiments and manipulate variables like we can in laboratory experiments. Instead, we have to wait and see what happens in natural experiments that are run by people trying different techniques. For example, communism was a 75 year experiment on collectivization of the means of production, and we see how well that worked compared to capitalistic systems during the same period of time. We can compare, say, South Korea to North Korea, the former employs capitalism while the latter uses communism. The average annual income per person in South Korea is several tens of thousands of dollars. The average annual income per person in North Korea is less than a thousand dollars. That is a natural experiment that we can collect data from and draw our conclusions.

Richard: Thank you very much for your time and this interview.

References

Contact:
Michael Shermer can be reached by email

Acknowledgement:
Thanks to Coert Visser (www.solutionfocusedchange.com) for helping with the preparation of this interview.

About the author:
Richard Puyt is a management consultant (CMC), editor and part time lecturer. More information: Facebook / Dutch LinkedIn Innovatief Organiseren Community / Dutch blog Innovatief Organiseren / Puyt Consultancy.