Tag: Harvard Business Review

  • How Studying Organizational Change Lost its Way

    How Studying Organizational Change Lost its Way

    Introduction

    A grandiose title, but as the claims that I am challenging have been equally grandiose, when in Rome…

    At the end of this post, you will find a link to the published paper, Reflections: How studying organizational change lost its way. My focus in this post is broadly explaining and differentiating the three frames.  If you want to delve deeper, you will find full references in the linked posts and papers at the end.

    It is the repeated assertions that all organizational change tends to fail that I find so problematic.  In a world of limitless social science funding, it would be difficult to envisage a research design that could meaningfully research such a silly sweeping generalization.  It is unsurprising, that meaningful evidence in support of this generalization has not been forthcoming.  In advancing this debate I introduce three potential frames for studying organizational change. 

    1. Organizational change tends to fail
    2. The management of change is failing
    3. Leading change will succeed

    The first frame reflects the current orthodoxy if gauged by what elite journals and prestigious business schools are keen to promote. The second frame about the management of change failing has not been acknowledged to date. The third frame about leading change succeeding is implicit rather than explicit in theories and practices.

    It isn’t just evaluating change that has lost its way in failing to challenge the assumption that change tends to fail. Current studies of change agency fail to explain the shift from managing change to leading change. They fail to either explain or debate failure being attributed to management and success to leadership.  Instead, the unchallenged assumption is that a tendency for organizational change to fail was empirically established. Equally, the implication is that a shift from managing change to leading change was empirically driven.

    The claims that I am making are not new.  They have been informed by my scholarship around the shift from managing change to leading change and around change evaluation over the past decade. I am grateful to the Journal of Change Management for enabling me to voice my concerns about a field of study with which I have been involved for the past three decades.  

    Frame one – Organizational change tends to fail

    I am neither an organizational change apologist nor an evangelist. I am very aware of change initiatives failing to achieve desired outcomes and I have worked in and with organizations in which changes failed.  Equally, I am not persuaded by unrealistic rhetoric in which change universally succeeds.

    The current failure versus success dualism is too simplistic to satisfactorily inform either theories or the lived experience of processes of changing.   Notions of all change tending to fail haven’t grasped the contextual, processual and dynamic nature of change processes and change outcomes. We shouldn’t underestimate these academic advances. I lived through the initial sweeping generalizations about organizational change and I was fortunate to witness a field of study evolving and maturing. Three decades ago, there was a heady enthusiasm in the literature and practice for change management success.  In this sense counterclaims of change failure provided a healthy reality check.

    However, attempting to replace change tends to succeed with change tends to fail isn’t good social science.   When respected journals and respected academics want to take us back to an era of early organizational change generalizations, I am left perplexed and annoyed. 

    Studying organizational change, despite organizational change tending to fail
    Organizational Change Tends to Fail – Framing

    Career academics claiming that all change tends to fail, begs the question if they believe this why study organizational change? Why waste your life studying practices you perceive as pointless and futile? Equally, why are elite journals and prestigious business schools so keen to promote notions of organizational change failing? 

    The performative nature of academic journals and the enterprising nature of business schools make their failure rhetoric, so perplexing.  The advertisement reads something like – Is your organization going through organizational change, come to our business school and we will explain to you in detail how it is failing and will continue to fail! 

    No, these individuals and institutions are clever and enterprising, there are darker arts at work here.  There is a rationale behind depictions of all organizational change tending to fail and the repetition of these depictions over the decades. Business schools do business as well as reporting about business. This isn’t about reducing their involvement in organizational change business. This is about creatively developing new income streams, delivering on demanding institutional performance metrics through blurring distinctions between facts and fictions.

    I have been one of the few scholars explicitly challenging unchallenged change failure assumptions.  Putting it crudely, at times I felt like I was pissing in the wind! But then in 2021 that wind dramatically changed direction.  Suddenly and surprisingly, I found myself being cited in support of the assumption that change tends to fail.  On one level I was flattered to be cited in an elite journal.  On another level, I was left perplexed at this apparent miraculous conversion. 

    The main opponent to change tends to fail generalizations was now cited as the main proponent.  My paper highlighting that the 70% change failure rate was without evidence was reimagined as the change tends to fail evidence that had eluded academics for so long.  I don’t want to become side-tracked on what was a challenging, although informative example of a debate actively being framed to serve powerful interests.  In the Reflections paper (please see links at the end), if you are curious, I reflect upon my futile attempt to have this misrepresentation corrected. I get knocked down, but I get up again (Chumbawamba, 1997)!

    Despite my agitation, we do need to be clear about the current organizational change studies orthodoxy, as I am certainly not orthodox.  In prestigious business schools today, students are taught about a tendency for organizational change to fail.  In elite journals, claims are still being made that organizational change tends to fail. 

    Academics and journals still promote the spurious statistic that 70% of all organizational change initiatives fail.  This is the first way in which I believe organizational change studies lost its way. However, preoccupations with change failure, either intentionally or unintentionally, hide wider academic change agency confusions currently impeding organizational change studies.

    Frame two – The management of change is failing

    Over three decades, I observed and was academically engaged with a shift from managing change to leading change both in theory and practice.  The fact that my career mirrored this shift was by default rather than design.  That said, I was personally invested in making sense of a debate that ran parallel to my development. 

    In 2006, my first organizational change textbook had ‘change management’ in the title. In 2010, my second textbook had ‘managing change’ in the title. In 2019, my textbook had ‘managing and leading’ in the title.  We moved from management as a ‘thing’, to managing as a ‘process’ and then to managing and leading as a ‘duality’.

    The Management of Change is Failing Frame
    The Management of Change is Failing – Framing

    Over three decades, I became more and more critical of organizational change theories being espoused in journals and by business schools. Perversely, my respect for organizational change practices and practitioners grew as we worked with very different practitioners in very different contexts.

    In the early heady days, there was a real (if unrealistic) enthusiasm to successfully manage change. Today we can contrast this with talk and writing focusing almost exclusively on successfully leading change.  The either managing OR leading and failure OR success rhetoric still seems unrealistic. 

    However, I was more curious about why a shift from managing change to leading change had taken place.  Ideally, the shift was empirically driven with research and theory demonstrating that leadership rather than management was required in facilitating successful change. The elephant in the room is that when you explore academic literature in support of the shift, it isn’t very convincing.  So, if this shift wasn’t academically driven, what was driving it?

    A shift from managing change to leading change was part of a broader shift from management to leadership.  A greater emphasis on leadership rather than management has been apparent both in theory and practice. If we go back fifty years, we witness American corporations and billionaires requesting a shift from management to leadership.

    In parallel, we witness academics beginning to question the utility of management and encouraging the adoption of leadership. However, contentiously I argue that this questioning wasn’t arising out of objective research.  It was more a case of academics framing a debate that management fails and leadership succeeds to fit the cultural context requested by corporate America at that time.

    Between 1990 and 2000 the titles of three Harvard Business Review articles appeared to frame organizational change and transformation as failing.  For myself, this is part of the explanation why elite journals and prestigious business schools claim organizational change tends to fail.  However, this raises a question about why would Harvard Business School depict change and transformation as failing? Perhaps, you believe it was an act of altruism to give up the lucrative change and transformation income stream. 

    I would disagree and it is informative to read beyond the headline titles of the three articles. In each article, it is the management of change that is depicted as failing. The articles claim that with the addition of leadership change and transformation will succeed.   This very different frame to Frame One is currently neither being acknowledged nor discussed in organizational change studies. At the very least, it merits further discussion in both change evaluation and change agency debates.  

    Organizational change studies lost its way in allowing Frame One to hide the existence of Frame Two.  We should be more openly and honestly acknowledging and debating academic disparaging of management.   There are implications for practice when management is academically disparaged when it might still have a role to play in organizations.

    Frame three – Leading change will succeed

    The third frame is implicit in current leading change theories and practices.  Change tending to fail (Frame One) necessitates leading change (Frame Three).  There is an unchallenged assumption that leading change will succeed.  The contrast between managing change and leading change is important here. Frame Two enables Frame Three in terms of shifting change agency from change management to change leadership.  The authority of change managers was corroded as part of the construction of change leader authority.

    Leading Change will Succeed Frame
    Leading Change will Succeed – Framing

    We begin to understand why organizational change had to be depicted as failing and how specifically it was the management of change that was failing. In parallel, we begin to see how such framing benefits business schools and leadership research, teaching and development that they now deliver.  Business schools strive to be successful businesses. There is a wonderful symmetry when elite journals and prestigious business schools identify a tendency for change to fail and simultaneously offer a leadership solution.

    I believe organizational change studies lost its way in failing to acknowledge and discuss how change agency and change evaluation debates were academically being framed.  Idealized concepts such as we need strong leaders to lead change were never empirical realities. Performance metrics and academic institutional policies increasingly privileged gap-filling research over assumptions challenging critical scholarship.

    Academics, business schools and journals echoed the desires for leading change.  Socratic questioning which used to be so integral to academic work was lost.  Academics, business schools and journals moved into the business of legitimating societal and organizational desires, rather than critically questioning these desires.

    The debate needs to move beyond simplistic generalizations that organizational change tends to fail. We need to consider academic involvement in both the disparaging of management and the promotion of leadership.  This is achievable and I offer seven constructive hopes for organizational change in the paper (please see below). It has been too easy to date for academics to highlight the failings of organizational change practitioners and their practices. It is now time to take the inventory of those academics, institutions and journals framing these debates and highlight their vested interest in promoting particular lucrative frames.

    If you want to explore further the three frames introduced here, you may find the following links useful (please click on the bold titles).

    Do 70 per cent of all organizational change initiatives really fail? In this post, I share links to the publisher website for the 2011 paper published in the Journal of Change Management and a freely available draft version of this paper.

    Leading changes: Why transformation explanations fail. In this post, I share links to the publisher website for the 2016 paper published in Leadership and a freely available draft version of this paper.

    The leadership of organizational change.  In writing this monograph I was interested in literature informing the shift from managing change to leading change.  It was more of a narrative review than a systematic review, but my critical engagement with literature was wide-ranging. The link is to the Routledge website containing further details about the monograph published in 2016.

    Managing and leading organizational change.  This is a link to my textbook published by Routledge in 2019. I know many academics are ‘sniffy’ about textbooks, but I stand by the extensive critical scholarship I undertook in writing this text.  In particular, the Evaluating organizational change chapter offers my most recent review of literature in this area. If you do not have access to the book, but would like to read the chapter, please email me via the contact page.

    Reflections: How studying organizational change lost its way This is the link to the publisher website for the 2022 paper published in the Journal of Change Management. It appeared as part of the Reflections series in which Editorial Board members share their reflections on our field of study.

    It shouldn’t be firewalled and freely downloadable using this link. Please use the email Contact form on my home page if there are any problems.

    How studying organizational change lost it’s way
  • Challenging the 70% Organizational Change Failure Myth

    Challenging the 70% Organizational Change Failure Myth

    Challenging the 70% organizational change failure myth is pertinent to organizational practices, research and education. Unfortunately, business schools and consultants have a vested interest in promoting and amplifying the change failure myth.

    Do 70 per cent of all organizational changes really fail? The answer to this rhetorical question is – NO!

    Updated November 2024

    Organizational Change Tends to Fail, That’s Interesting! (YouTube 14.40min video, March 2023)

    Do 70 per cent of all organizational changes really fail?

    The question provides the rhetorical title for my paper published in 2011, in the Journal of Change Management 11(4): 451-464. It is gratifying that at the time of writing, this paper has been downloaded 26,880 times with an altmetric score of 61.

    I was troubled by academic claims that all organizational change tended to fail. The claims had apparently been substantiated by Harvard Business School research with a 70 per cent organizational change failure rate cited. In 2011, I highlighted the complete absence of either empirical evidence or theories in support of these rhetorical claims.

    The 70 per cent organizational change failure statistic was frequently cited by leading business schools and in leading journals before 2011. I would like to tell you that after 2011 the academic claims that organizational change practitioners tend to fail ceased, but sadly this has not been the case.

    My suspicion is that business schools depict change as failing in order to underpin their highly lucrative leadership courses, research and consultancy.

    Abstract A 70 per cent failure rate is frequently attributed to organizational change initiatives, raising questions about the origins and supporting evidence for this very specific statistic. This article critically reviews five separate published instances identifying a 70 per cent organizational change failure rate. In each instance, the review highlights the absence of valid and reliable empirical evidence in support of the espoused 70 per cent failure rate. Organizational change research and scholarship now exists which enables us to question the belief in inherent organizational change failure rates. Inherent failure rates are critically questioned in terms of the ambiguities of change, the context-dependent nature of change, competing perceptions, temporal aspects and measurability. In conclusion, whilst the existence of a popular narrative of 70 per cent organizational change failure is acknowledged, there is no valid and reliable empirical evidence to support such a narrative.

    Journal access If you have online access to academic journals the full published 2011 paper may be downloaded here:

    https://www.tandfonline.com/doi/abs/10.1080/14697017.2011.630506

    Access to the final draft of the 2011 paper Alternatively, I have linked to this post the final draft of the 2011 paper, accepted for publication, after review. Please click on the link below.

    How studying organizational change lost its way

    A decade later in a Special Issue of Human Relations on organizational change failure the 70 per cent failure statistic was still being cited.  More troublingly my 2011 paper was now cited in support of the belief of the guest editors (Schwarz et al, 2021) that organizational change tends to fail. For example:

    Page 160 – Central to this outlook is that organizational research has long been concerned with the features of and mechanisms for how organizations change, while at the same time acknowledging separately that large-scale organizational changes tend to fail (Hughes, 2011).

    Page 167 – We do so recognizing that, even though the majority of change initiatives fail in some way (Hughes, 2011), there is perpetual interest in successful firms and success stories (Bledow et al., 2017).

    Source: Schwarz, G.M., Bouckenooghe, D., and Vakola, M. (2021) Organizational change failure: Framing the process of failing. Human Relations, 74(2) 159-179.

    For the avoidance of doubt, I never generalized in 2011 that change tends to fail. I never would make such a sweeping generalization given that organizational changes are highly context dependent and outcomes very dynamic. An either ‘fail’ or ‘succeed’ dualism misses the subtleties and processes of both failure and success in any organizational change.

    I did write to the lead guest editor on the 10th June 2019, collegially restating my position, but I never received a reply. In 2021, I included the lead guest editor in a tweet, highlighting my concern that I had been misrepresented, immediately after my tweet he left Twitter. I turned to the editorial office of Human Relations, seeking an impartial review. Their conclusion was that I hadn’t been misrepresented.

    If you have the time/inclination I have included a link below to my 2022 paper, in which I respond to the perceived misrepresentation.

    As this paper is part of the journal’s Reflections series it should be freely accessible (no firewall) to download using the link below.

    https://www.tandfonline.com/doi/full/10.1080/14697017.2022.2030980

    If you have any difficulties accessing this paper, or you want to agree/disagree with my conclusions please email using the contact form on the home page.

    70 Per Cent Organizational Change Failure?
  • Leading Change: The Nonsense of Urgency

    Leading Change: The Nonsense of Urgency

    Creating urgency has become synonymous with leading change to the detriment of individuals, organizations, and societies. The more leaders create these artificial crises, the less we trust and engage with our leaders and the less effective their change leadership becomes.

    Introduction – What’s the burning platform?

    The sense of urgency on a major organizational change was famously likened to a burning platform (Conner, 1998).  Subsequently, the question has frequently been asked – what’s the burning platform? 

    Conner (1998) recounts learning about the burning platform through television coverage of an explosion and fire on an oil-drilling platform.  Whilst, 166 crew members, and 2 rescuers lost their lives, there were survivors.  Andy jumped 150 feet in the middle of the night into a sea of burning oil and debris, subsequently commenting ‘it was either jump or fry.’ We will all be confronted with situations requiring urgency, though hopefully less dramatic.  Thankfully the urgency required when confronted with an explosion and a fire was atypical for oil exploration companies.  It is likely that many of their successes were by-products of patient desk research undertaken over many years, rather than taking ‘jump or fry’ gambles on different oil exploration sites.  In this post, I argue that creating a sense of urgency has been overemphasized in accounts of leading change and that the urgency instinct may even be problematic with implications for leading change practices.

    Book Cover "Factfulness" by Hans Rosling
    Book Cover “Factfulness” by Hans Rosling

    How did Kotter encourage a sense of urgency?

    Kotter (2008) devoted a book to change leaders creating this sense of urgency, which was the third of Kotter’s (1996/2012) eight leading change steps.

    Visible crises can be enormously helpful in catching people’s attention and pushing up urgency levels.  Conducting business, as usual, is very difficult if the building seems to be on fire.  But in an increasingly fast-moving world, waiting for a fire to break out is a dubious strategy.  And in addition to catching people’s attention, a sudden fire can cause a lot of damage. (Kotter, 1996: 45)

    Whereas, Andy jumped from the burning platform because it was a case of ‘jump or fry’, Kotter (1996) appears to pre-empt the fire with the change leader encouraged to engineer a sense of urgency so that the ‘building seems to be on fire.’  Kotter (1996:44) offered many tips on raising urgency levels, such as ‘create a crisis by allowing a financial loss, exposing managers to major weaknesses vis-à-vis competitors, or allowing errors to blow up instead of being corrected at the last minute.’ Leading change in such an unethical way is likely to result in trust between leaders and subordinates being lost.  There is a primitive appeal in the urgency instinct as it appears to invest power in the change leader over subordinates, but at what cost to individuals, organizations and societies?

    Why is change urgency problematic?

    Rosling et al (2018) in Factfulness, was concerned with global risks such as global pandemics, financial collapse, world war, climate change and extreme poverty.  The reason Factfulness is invoked here is that one of the eleven problematic instincts highlighted when dealing with these risks was the urgency instinct.  Hans Rosling shared very human examples to demonstrate how the urgency instinct can have tragic human consequences.  He would have agreed with Andy’s ‘jump or fry’ instinct, he would not have favoured Andy applying this instinct to all scenarios or change leaders modeling their leadership around such an instinct.

    When we are afraid and under time pressure and thinking of worst-case scenarios, we tend to make really stupid decisions.  Our ability to think analytically can be overwhelmed by an urge to make quick decisions and take immediate action. (Rosling et al, 2018: 226)

    Rosling et al (2018) question the either/or dualism of act or don’t act as too simplistic. The warning is that framing everything in terms of creating a sense of urgency drains credibility and trust with such constant alarms numbing us to when real urgency is required. The provocative warning is that  ‘when people tell me we must act now, it makes me hesitate.  In most cases, they are just trying to stop me thinking clearly.’ (Rosling et al, 2018:228)

    We appear to have been seduced by a form of change leadership which emphasizes being strong with the Just Do It (JDI) mantra invoked.  Everything is cloaked in a sense of urgency – who is going to debate the merits of an organizational change approach or question a change leader when a ‘building seems to be on fire.’

    What can we do practically to control the urgency instinct?

    Burning platforms and creating urgency have become interwoven with how to lead change with no appreciation of the diversity of change approaches and contexts.  Urgency strengthens the hand of individual leaders to force through change, but it is potentially detrimental to individuals, organizations, and societies. A constant sense of crisis distorts our worldview, which inevitably is to the detriment of everyone.

    Even change leaders encouraged to create this constant sense of urgency eventually suffer ‘we cannot get into a situation where no one listens anymore.  Without trust, we are lost’ (Rosling, 2018: 233).  Rosling (2018) offers four small steps in controlling the urgency instinct which may be applied to leading change.

    • Ask for more time and more information. It is rarely now or never, it is rarely either/or.
    • If something is urgent and important, it should be measured with only relevant and accurate data used.
    • Any prediction about the future is uncertain.
    • Step-by-step practical improvements and evaluation of impact are usually less dramatic but more effective.

    In organizational change terms, this is more about an evolution, rather than a revolution. This does not negate the need for decisive and prompt action when a real crisis occurs, but creating artificial crises urgently needs to be challenged. All of this is contingent on understanding the nature of the organizational change problems which determine if management, leadership or command is most appropriate.  These considerations are addressed in the next post.

    Leading Change book on a recycling bin
    Leading Change now ready for recycling

    Further Reading

    Conner, D.R. (1998). Managing at the speed of change. Chichester: John Wiley and Sons.

    Kotter, J. (1996/2012). Leading change. Boston: Harvard Business School Press.

    Kotter, J. (2008). A sense of urgency. Boston: Harvard Business School Press.

    Rosling, B.H. with Rosling, O. and Rönnlund, A.R. (2018). Factfulness. London: Hodder and Stoughton Ltd.

    Leading Change: The Nonsense of Urgency