Showing posts with label Rob Briner. Show all posts
Showing posts with label Rob Briner. Show all posts

Thursday, November 12, 2009

The Halo effect

This morning I received the book The Halo Effect by Phil Rosenzweig. It is recommended by Nassim Nicolas Taleb. On the cover it reads "One of the most important management books of all time". Well, you can't blame book publishers for lack of trying to get a book sold. The under title of the book is intriguing. It is called ...and the eight Other Business Delusions That Deceive Managers. Of course, we don't like to admit how little we know. The social psychologist Eliot Aronson observed that people are not rational beings so much as rationalizing beings. We want explanations. We want the world around us to make sense. (p. 12).

Managers don't usually care to wade through discussions about data validity and methodology and statistical model and probabilities. We prefer explanations that are definitive and offer clear implications for action. We like stories.( p. 15). Maybe that's why management is (still) not an academic discipline like geology or medicine. There is nothing wrong with stories, but some stories (like the constant flood of business books) are dresses up as science. They take the form of science and claim the authority of science, but lack the rigor and logic of science. They're better described as pseudo science.(p. 16). The famous Cargo Cult Science of Richard Feynman is used as illustration. Evidence based decision making is for the manager who does not go for the quick fix. Many manager complain they have so little time to take informed decisions. But there is of course a trade off. Good decisions taken at a slower pace or bad decisions at a rapid pace. This point is also made by professor Rob Briner in his video using evidence based management in your day job.



The halo effect
The halo effect is a way for the mind to create and maintain a coherent and consistent picture, to reduce cognitive dissonance ( p. 50-51). Why is it so hard to understand why some companies succeed and others fail? In fact, our thinking about business is shaped by a number of delusions, the first of which is the Halo effect. So many things we-managers, journalists, professors and consultants- commonly think contribute to company performance are often attributions based on performance. And even if we try to gather data in large-scale examples, like the Fortune survey or the Great Place to work study, we often do little more than multiply the Halo effect. (p. 64). Great examples are given with cases studies on Cisco and ABB. When the S&P ratings are up, journalists, professors and consultants tumble over each other to applaud and offer praise for the vision and steady leadership of the CEO. However, when a year later the stock market collapses, the same leaders are blamed for ruthlessness, ego mania and lack of customer focus. Other delusions include the mix up of correlation and causality, the delusion of single explanation (anecdotal evidence), connecting the winning dots (selective sampling, i.e. only picking winners), lasting success (cookbook recipes), absolute performance (blueprints for success?), wrong end of the stick and finally organizational physics

The famous studies In Search of Excellence (Peters and Waterman), Good to Great (Collins and Porras) and Build to last (Collins and Porras)are critically appraised.It is off course easy to point out flaws, but what lessons can be learned from these mistakes? For one thing, there is no holy grail for high performance organizations (yet). Finding evidence to support management decision making is not at all easy. These examples just illustrates the gap between management and science. Furthermore, putting evidence in context, avoiding delusions and understanding the evidence (if available) is a team effort. Even then, it is still difficult and it is no guarantee for success.

What do I think of this book?
The book is easy to read and the examples (Lego, Cisco, ABB, Microsoft) are well chosen. I agree with the message of the author that managers should be skeptical, if not critical of management fads, business books and self proclaimed guru's who supposedly know the magic formula for lasting success or a high performing organization. On the other hand, it is pretty demanding to expect from a manager to look for "the evidence" if it is hard to find let alone being able to appraise it. As a researcher I have my work cut out for me.

Monday, November 2, 2009

Grinded nails and bikes in your cereal


Last week, the Chair of the UK Government’s Advisory Council on the Misuse of Drugs – Professor David Nutt – was forced to resign. The Council was set up some time ago as an independent body to advise the UK Government on its drugs policy by providing evidence about the harmful effects of drug use. In particular, a drug classification system has been in use which is intended to reflect the level of harm of different drugs. Some years ago the UK Government ignored the advice of this panel and moved the classification of cannabis into a higher harm category to “send a signal” to users. Of course people at the time asked if there was evidence that doing this did deter users or not. I don’t think anyone knows and in fact some argue it might make it more attractive.

David Nutt had in the past criticised that decision and this week questioned the fact that alcohol and tobacco were not included in this classification system and suggested they were worse in terms of their harm to individuals and society than ecstasy, LSD or cannabis. He also suggested a new classification system. This seemed to be too much for the Government and they saw it has his attempt to change policy rather than just offer evidence-based advice and sacked him.

Here in the Netherlands we have a consumer program called 'De Keuringsdienst van Waarde', the title is a paraphrase on what in the UK is called the Food Standards Agency. The literal translation would be 'The value agency'. Four research journalist investigate every episode a specific type of food. E.g. orange juice, peas, onions, tea, etc. Two weeks ago, they had a topic on Kellogs Special K, with added iron. Ironically, the voice over said that the stuff of grinded nails and bikes is added to the cereal. They asked a food professor from Wageningen University, a family doctor and a chemist at Corus (the iron ore processing factory). None of them believed actual iron was added to the cereal. It must like iron in spinach, like Popeye.....or so they thought.

The journalists conducted tests (with metal detectors and magnets) and it turned out that the cereal indeed has magnetic properties. Then the fun really started. They added water to the cereal and put it in a blender. Next they put a magnet in a plastic bag and surprise, surprise, they found small iron particles. To the amazement of everybody, including the food professor, the family doctor and the chemist at Corus. Strangely, Kellogs did not want to answer questions on camera. The production process of cereal is proprietary information.....

Home movie to extract iron from your cereal



Time for serious research journalism. Why is metallic iron added to cereal? Is this good for public health and more important is this legal? All our Dutch food agencies (i.e. the government) point toward each other and then point to the EFSA (European Food and Safety Authority). (Note. Nobody checks for evidence). The EFSA doesn't know anything about approving nor stating that iron should be added to food, let alone metallic iron. In the final shot they are talking to the Dutch Food Authority who say, well if this is true, the product will be banned!

That was two weeks ago. A media storm broke out. Kellogs bought advertising space the next day, claiming that the program misrepresented the whole process of adding iron to food and actually blamed the journalists for bad journalism and slander.The voice over tells us that they were completely wrong with their metaphor two weeks ago about grinded nails and bikes, the should have said grinded cars... Kellogs has an iron supplier in Denmark who also supplies iron ore and powder to the car industry (a script writer could not come up with this...). All of course according to the highest standards....The food professor was on the receiving end of critique by his peers and was buried with reports and research. Only to find out that all the reports contradict each other! The poor man was intimidated and didn't want to participate in the program anymore. But, he had a collegue who would. This man clarified that adding iron to food stems from the USA, where it is mandatory by law since the second world war. The body can only absorp 9% (max.) of this type of added iron in an acid (the stomach) environment. But Kellogs claims it is needed because 40-60% of the men, women and children receive too little iron in their daily diet. It's good for you. They do it in the interest of the public and the claim their way is approved and our Dutch Food agency takes the side of Kellogs.... (so much for consumer trust in the authorities...).

It turns out that predecessors of the ESFA scientists (20 years ago) were highly doubtful of the effects of iron as food supplement. The never approved it. So, the health claim of Kellogs is false. And, in Denmark the practice of adding iron to food is forbidden by law, because people get sick and die as a result of to much iron in their food (hemochromatosis, type 2). Kellogs has a similar product (Special K) in Denmark, without the added iron. The cereal boxes look very much alike. We learn that Danish people are the only ones who think for themselves.... (sadly). The lady from the Danish consumers union states that supplements are abnormal and points out the obesity epidemic in Europe (and the USA). This episode ends with a chat at the dining table at the Dutch consumers union. They are appalled about the findings and are planning on launching a campaign against food supplements. The food professors announced new research. What is the scientific evidence of benefits from metallic iron as food supplement? One can only wonder what our politician will do. At least they can't fire the journalists.

To make a long story short, managers are certainly not the only ones in the dark about evidence based decision making. The poster boys for circumstantial decision making turn out to be the agencies who are there to protect the general population from health hazards.

Wednesday, October 28, 2009

Denise Rousseau's take on Evidence Based Management


A few weeks ago, I got in touch with Denise Rousseau, professor of Organizational Behaviour the Carnegie Mellon University and one of the figureheads of the emerging 'Evidence Based Management' school of thought. She was visiting colleagues in Ireland, but took the time to answer a few of my questions. Jeffrey Pfeffer also replied, but was swamped in his work and preparing to leave the country for an extensive trip abroad. He'll probably give his point of view later. Bob Sutton hasn't been in touch yet. Today I got in touch with another leading thinker in this field. His name is Rob Briner, professor of Organizational Psychology from Birkbeck College, University of London, who already collaborates with Denise on the Evidence Based Management Collaborative. But, back to Denise.

1. What do you view as the core idea and purpose of EBM?
EBMgt in my opinion is family of approaches to improving the quality of managerial decisions and organizational practices by combining in a more systematic fashion
1) relevant findings from mgt/social science research,
2) business facts and metrics with
3) more skillful individual judgments.

2. What do you think would be the benefit(s) for organizations and society as a whole if management would be based more on evidence?
In both public policy and organizational decisions, we possess so much more relevant knowledge and information than is actually ever used. Improving the uptake of scientific evidence with better understanding of how people organize and make decisions  translates into better quality decisions and easier implementation.

3. What progress has the EBM movement currently been making?
I would say that there are three legs in the EBMgt tripod and on 2 of the 3 we see some progress, though much work remains to be done. The two legs were we see developments are;
  • education where there is greater attention in teaching managers and other practitioners who can benefit from managerial knowledge (e.g., nurses, social workers, doctors, public policy professionals, etc.) and
  • scholarship/research, where somewhat more attention is being paid to identifying what we can confidently know from mgt research, as opposed to always focusing on brand new ideas or new theories at the expense of assessing progress to date.  

You can probably gather that I believe the weakest link (but really all need work!) is managerial USE of quality business facts in making decisions let alone any use of or reliance on social science findings in the decisions being made.

Is there evidence of evidence based management getting a foothold in organizations? I am doubtful. Hit or miss, and it may be that as in medicine, it takes a generation before a new evidence-informed practice takes hold.

4. What future do you envision for EBM in (research and practice)?
This is the project of a community, perhaps several communities, and a generation, I think we are seeing ENERGY in several communities to move EBMgt forward. I am hopeful and patient!

Thank you very much.