Shutterstock/FotograFFF

Bestselling business books promise to teach you the winning formula and reveal the secrets of success. But the inconvenient truth is that exceptional successes in business are largely based on luck. No rule exists for achieving exceptional performance because it usually requires doing something different or novel and there can be no recipe for such innovation.

My new research provides systematic evidence that luck plays a critical role in such performance, not only in business but also in music, movies, science and professional sports. A key finding is that more can be gained by paying more attention to “second best”.

Let’s look at the music industry. If a new band or musician has a top-20 hit, should a music label immediately try to sign them? My analysis of 8,297 acts in the US Billboard 100 from 1980 to 2008 would suggest not. Music label bosses should instead be looking to sign up those reaching positions between 22 and 30, the “second best” in the charts.

A common feature of many artists charting in the top ranks is that they enjoyed a “runaway success”. A classic example is Gangnam Style by Korean artist PSY. The music video went viral beyond anyone’s foresight. Since such an outcome involved exceptional luck, PSY’s success is unsustainable. In fact, artists charting in the top 20 will likely see their next single achieve between 40 and 45 on average, regressing disproportionally more to the mean than their lower performing counterparts.

{vembed Y=9bZkp7q19f0}

Those charting between 22 and 30, meanwhile, have the highest predicted future rank for their next single. Their less exceptional performances suggests that their successes depends less on luck, making their performances a more reliable predictor of their merit as well as future performances. This is where music label bosses will find the hidden gems.

The same happens in the business world. For example, the fastest growing firms – such as those on Fortune’s 100 Fastest Growing Companies list – usually attract the most media attention, investment and imitation. My results show that the consecutive-year growth rates of firms are almost random but a systematic “less-is-more effect” can occur.

So businesses with the top current growth rate (more than 34% per annum) have a significantly lower expected growth rate next year than firms with a high but less extreme current growth rate (between 32% and 34% per annum). This suggests that top performers are not only luckier than the rest, but also become predictably worse.

However, selling the problematic idea of learning from the most successful continues to prosper. For example, many business bestsellers, such as In Search of Excellence, the most widely owned book in the US between 1986 and 2006, share a formula. First, select a few successful firms that beat the odds and achieve excellence. Then analyse the shared practices of these firms from when they moved from “good to great” and frame these practices as the principles for others that aspire to become great.

An overlooked caveat is that the exceptional performances featured in these bestsellers typically do not last. Take the 50 firms featured in the three most popular business bestsellers: In Search of Excellence, Good to Great and Build to Last. My research shows that the significant improvements of these firms (good to great) before being featured were followed by systematic disappointments. Of the 50, 16 failed within five years after the books were published and 23 became mediocre as they under-performed in the S&P 500 index (which represents the average performance expectation of the 500 largest public companies in the US).

Only five out of the remaining 11 firms maintained a similar level of excellence compared to when they were featured in the books. What happened after becoming great is clearly not enduring greatness but, instead, strong regression to the average.

Nevertheless, such a misleading “success formula” is still very popular in business media and education. There is a growing number of lists that feature top-performing firms, CEOs and entrepreneurs. One possible reason for this may be a fundamental paradox in human behaviour: the more uncertain the world becomes, the more people seek out and rely on seemingly certain solutions and strong leaders.

The business of luck

Management research and education should focus on prescriptive theories that can help business practitioners move from “incompetent to OK”, rather than focusing on those that address how to move from “good to great”. But current management theories and many business management bestsellers focus on the latter, even though being “great” in business is often primarily a matter of luck.

Such reference to luck is rare in management research. A review of the use of luck in leading management journals suggests that only 2% of articles mention the word. Business media and educators need to acknowledge that we have a lot of offer to help practitioners to make fewer mistakes in business and everyday life, but there is little we can teach about how to become exceptionally successful.

This poses a challenge to modern societies regarding how to deal with successes. We are hardwired to reward and imitate the most successful. But when the most successful in modern societies are no longer a reliable benchmark, overlooking such a mismatch sees us continuing to reward their luck and augment the inequality.

Hiring “stars” or copying the practices of the most successful not only leads to predicable disappointment but also encourage cheating because there is no other way to replicate their exceptional good luck. The business world needs to balance the accounts of exceptional performance and take a far more judgemental look at the effects of luck and the benefits of being second – or even third or fourth – best. Blindly rewarding successes strengthens the myth of meritocracy and invites fraud.

About The Author

Chengwei Liu, Associate Professor of Strategy and Behavioural Science, Warwick Business School, University of Warwick

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Related Books:

What Color Is Your Parachute? 2022: Your Guide to a Lifetime of Meaningful Work and Career Success

by Richard N. Bolles

This book offers a comprehensive guide to career planning and job searching, providing insights and strategies for identifying and pursuing fulfilling work.

Click for more info or to order

The Defining Decade: Why Your Twenties Matter--And How to Make the Most of Them Now

by Meg Jay

This book explores the challenges and opportunities of young adulthood, offering insights and strategies for making meaningful choices and building a fulfilling career.

Click for more info or to order

Designing Your Life: How to Build a Well-Lived, Joyful Life

by Bill Burnett and Dave Evans

This book applies the principles of design thinking to personal and career development, offering a practical and engaging approach to building a meaningful and fulfilling life.

Click for more info or to order

Do What You Are: Discover the Perfect Career for You Through the Secrets of Personality Type

by Paul D. Tieger and Barbara Barron-Tieger

This book applies the principles of personality typing to career planning, offering insights and strategies for identifying and pursuing work that aligns with your strengths and values.

Click for more info or to order

Crush Your Career: Ace the Interview, Land the Job, and Launch Your Future

by Dee Ann Turner

This book offers a practical and engaging guide to career development, focusing on the skills and strategies needed to succeed in job searching, interviewing, and building a successful career.

Click for more info or to order