Planning is About Creating Clarity, Not Certainty
Summary
The episode challenges the traditional view of planning as a tool for creating certainty about the future. It begins by acknowledging the emotional rollercoaster of planning—from initial excitement and resolution of anxiety to eventual jadedness when plans inevitably go awry. The host argues that this disappointment stems from a fundamental misunderstanding: people expect plans to provide control and certainty over an unpredictable future.
The core of the argument uses a model of exponential complexity. Using the example of planning a software development quarter with binary decisions per sprint, the host illustrates how the number of possible future states grows exponentially. This leads to the law of diminishing returns on planning effort; each additional hour invested yields smaller and smaller gains in confidence, as you can never account for all possible pathways or new, unforeseen choices.
Therefore, the true purpose of planning is redefined. It is not about achieving 100% certainty, which is asymptotically impossible, but about ‘creating enough clarity to be able to act on your priorities.’ Effective planning identifies and bounds areas of uncertainty, managing risk rather than eliminating it. A good planning process should honestly surface many ‘I don’t knows’ and acknowledge potential failures.
The episode concludes with practical advice: planning clarity should follow a gradient, with the highest confidence reserved for the most immediate work. It also encourages empathy for others when plans fail, recognizing the inherent difficulty of predicting the future. The host invites listeners to join a community discussion on these topics to continue learning and improving their approach.
Topic Timeline
- 00:00:00 — Introduction to the emotional experience of planning — The episode opens by describing the common feelings associated with planning, such as energy, excitement, urgency, and resolution of anxiety. It also acknowledges the jadedness that can come from repeatedly seeing plans fail or become obsolete. This sets the stage for questioning the fundamental goal of the planning process.
- 00:02:18 — The misconception: planning is expected to create certainty — The host identifies the core mistake: people enter planning expecting it to create certainty and a sense of control over the future. While planning helps give direction, there is a limit to the certainty it can provide. The relationship between planning investment and added certainty is described as asymptotic, with greatly diminishing returns.
- 00:04:58 — Modeling planning complexity with a decision tree — To illustrate the impossibility of certain planning, the host presents a model. Using the example of a software development quarter with binary decisions per two-week sprint, the number of possible outcome states grows exponentially (e.g., 64 states for 6 sprints). In reality, with multifactorial decisions, the tree is vastly larger. This exponential growth directly causes the diminishing returns on planning effort.
- 00:08:47 — Redefining the goal: planning creates clarity, not certainty — The host states the central thesis: planning is not about creating total certainty. Instead, it is about ‘finding some level of clarity to a sufficient degree so that you can act efficiently.’ Good planning optimizes a clear pathway for the near future to enable current decision-making. It honestly identifies areas of uncertainty, creating a ‘boundary of clarity’ around what is unknown.
- 00:12:39 — Practical advice: gradient of clarity and cultivating empathy — The host offers key takeaways. First, planning clarity should follow a gradient, with the highest confidence for the most immediate work. You cannot have equal clarity for distant future tasks. Second, recognizing the inherent difficulty of predicting the future should foster empathy for others when their plans fail. The episode ends by inviting listeners to join a community discussion on the Developer Tea Discord.
Episode Info
- Podcast: Developer Tea
- Author: Jonathan Cutrell
- Category: Technology Business Careers Society & Culture
- Published: 2023-04-28T07:00:00Z
- Duration: 00:14:26
References
- URL PocketCasts: https://pocketcasts.com/podcast/developer-tea/cbe9b6c0-7da4-0132-e6ef-5f4c86fd3263/planning-is-about-creating-clarity-not-certainty/71bbc791-ce9b-4ad0-90a3-a075c76b0493
- Episode UUID: 71bbc791-ce9b-4ad0-90a3-a075c76b0493
Podcast Info
- Name: Developer Tea
- Type: episodic
- Site: http://www.developertea.com
- UUID: cbe9b6c0-7da4-0132-e6ef-5f4c86fd3263
Transcript
[00:00:00] If you’ve ever been a part of a planning process before, you know that the stories we tell
[00:00:18] ourselves about what we’re going to do in the future are often as close to fairy tales
[00:00:25] as it can get.
[00:00:28] And indeed, the goal of planning is often mistaken in today’s episode.
[00:00:34] We’re going to talk about what planning can give you and why it goes poorly for most people.
[00:00:45] If you’ve been planning recently, maybe you’ve been sprint planning, or maybe you’re doing
[00:00:52] planning or life planning your next five years, you probably know that the feeling you get
[00:01:03] when you plan something is a feeling of energy, excitement.
[00:01:11] Some people feel a sense of urgency.
[00:01:15] Some people get the emotion of resolution.
[00:01:19] Sometimes you had some anxiety about not having a plan, and then when you made a plan, you
[00:01:24] resolved that anxiety.
[00:01:28] Other people who may have made many plans in the past may feel a sense of waste or a
[00:01:37] feeling of jadedness, the feeling of being jaded to the process of planning.
[00:01:47] And this is because so many times you’ve seen planning go awry, whether it’s because
[00:01:54] the plan is thrown out altogether or because something changes in the plan, or maybe because
[00:02:01] you see people religiously trying to hold to a plan that has gone stale.
[00:02:08] For one reason or another, plans often fail us.
[00:02:13] And specifically, they fail us in what we thought they were meant to do.
[00:02:18] You see, people walk into planning expecting plans to create certainty.
[00:02:27] Think about this for a second.
[00:02:28] What do you do when you plan?
[00:02:31] You make an assertion about what you will do in the future.
[00:02:36] And sometimes you make multiple assertions that are all chained together.
[00:02:42] What you’ll do in the future both now and also five steps or ten steps or five years
[00:02:49] into the future.
[00:02:52] And all of these assertions about the future give you the sense that somehow you’ve added
[00:02:58] some sense of control, some moderation to the future.
[00:03:04] And this isn’t unfounded.
[00:03:07] Of course, planning helps us get an idea of where we should go.
[00:03:13] And good planning takes into consideration potential differences in the pathway.
[00:03:22] But there’s only so much that planning can do in providing any level of certainty.
[00:03:28] And in fact, I would argue no planning can actually provide certainty.
[00:03:34] And there’s a relationship between the amount that you invest and the relative added value
[00:03:42] in the form of certainty that you get.
[00:03:47] We can interchange the word certainty in this episode with confidence because there is no
[00:03:53] level of planning that can reach 100% certainty.
[00:03:58] This is kind of an asymptotic relationship.
[00:04:01] As you approach 100% certainty, the investment goes very exponentially up, and you never
[00:04:10] actually reach full certainty.
[00:04:12] In other words, there are limited or diminishing, greatly diminishing returns with each invested
[00:04:20] hour or each invested day, each invested energy unit into further planning.
[00:04:27] So you may plan for an hour and get 50% more confidence in that plan.
[00:04:36] But by hour two, you may only get 75% confidence, and hour three, you may just approach 80%.
[00:04:44] And eventually, you’re going to be spending multiple hours just to get a tenth of a percent
[00:04:49] more confident.
[00:04:50] And this is simply because there are so many different futures.
[00:04:58] When we don’t know what’s going to happen next, planning requires us, okay, think about
[00:05:05] this for a second, it requires that we consider all possible futures, all right?
[00:05:14] So if we were, let’s say for example, trying to plan for the course of a quarter worth
[00:05:20] of work, and this is very common, and imagine that you’re running something like two-week
[00:05:27] sprints.
[00:05:28] Okay, most teams who are running two-week sprints can produce a meaningfully different
[00:05:35] version of software within those two weeks.
[00:05:39] Hopefully you agree with this.
[00:05:41] Now let’s imagine that your plan assumes that you’re making one choice, one significant
[00:05:48] state change per sprint, and those state changes are only represented as a binary choice.
[00:05:58] So you can either go one direction or the other.
[00:06:00] I’m creating this model artificially.
[00:06:03] Of course, in most cases, you have many choices, perhaps a near infinite number of choices
[00:06:10] to change your software in that many different ways.
[00:06:13] So let’s imagine that each sprint you can choose a binary path, either left or right.
[00:06:21] Now this can be represented as a tree, a binary tree for choice, and in a given quarter you’re
[00:06:29] going to have about six sprints.
[00:06:31] So if you do the math, you know that there are 64 possible outcome states.
[00:06:39] In other words, for you to efficiently and effectively plan this sprint, assuming only
[00:06:48] one significant decision per sprint, sorry, this quarter, assuming only one significant
[00:06:54] decision per sprint, you’re looking at 64 possible outcome states.
[00:06:59] Now we know that many more decisions are made per sprint and most of them are multifactorial.
[00:07:05] They have many options.
[00:07:07] And so the number of possible outcome states is much more than 64.
[00:07:12] Now arguably when we are planning, we are choosing in advance some of those pathways.
[00:07:19] We may believe that we have a handful of those choices already made, so we’re reducing the
[00:07:25] number of potential outcomes in those sprints, but ultimately there may be new choices that
[00:07:32] are presented to us and we never made a plan for that pathway.
[00:07:36] Or maybe we stop making choices altogether.
[00:07:39] We scrap this pathway entirely and we start a totally new tree.
[00:07:44] Here’s the important takeaway.
[00:07:46] The further out you try to plan, the more of these potential pathways that show up,
[00:07:54] the bigger the decision tree becomes.
[00:07:57] In fact, it grows at an exponential rate.
[00:08:01] The growth of this decision tree is directly related to the diminishing returns that you
[00:08:09] see from planning.
[00:08:11] For each layer that you try to plan, if you spent the same amount of time at that layer
[00:08:17] on the tree, you’re covering a smaller and smaller percentage of each layer.
[00:08:23] Hopefully this makes sense.
[00:08:24] If you can visualize the decision tree, you can imagine only covering or only planning
[00:08:29] for two or five or ten decisions at each layer.
[00:08:33] Each time you go down to the next layer, ten covers a lesser percentage of potential states
[00:08:40] at that layer.
[00:08:41] All right, so this is all nice theory, but how does it actually apply?
[00:08:45] What do we do about this?
[00:08:47] The truth is planning is not about creating certainty.
[00:08:52] This may feel wrong when you hear it, but planning is not about creating total certainty.
[00:08:58] It’s about finding some level of clarity to a sufficient degree so that you can act
[00:09:05] efficiently.
[00:09:06] Let me say this again in a different way.
[00:09:10] Planning is not about finding a hundred percent certainty.
[00:09:13] It’s about optimizing a clear pathway in the near future so that you can make decisions
[00:09:20] now about what to do.
[00:09:24] You’re never going to be able to predict the future completely.
[00:09:28] You can try to figure out what the highest priority items are on your backlog.
[00:09:33] You can try to figure out whether or not you think that those are going to be representing
[00:09:38] some kind of dependency on another team, on another library, maybe some kind of knowledge
[00:09:43] dependency.
[00:09:45] You can try to figure out if you think that this work represents some kind of resourcing
[00:09:50] issue.
[00:09:51] Maybe you don’t have enough bandwidth on your team to meet the demand and the timeline that
[00:09:56] the business is trying to demand it.
[00:09:58] Or maybe you don’t have the knowledge and you need to invest in some training.
[00:10:03] Some of this work that you do in planning is simply about managing risk.
[00:10:09] You’re trying to get the biggest benefit of the smallest amount of clarity.
[00:10:15] Good planning, accurate planning, truthful planning, honest planning results in a lot
[00:10:23] of I don’t knows.
[00:10:25] It results in a lot of, well, that might fail.
[00:10:30] Or we may have to look a little bit deeper into that.
[00:10:35] It results in a lot of I don’t know if we can get that done.
[00:10:39] Or I’m not sure that this is the right way to do this, but maybe we can try it.
[00:10:46] A good planning process should identify areas of uncertainty without necessarily trying
[00:10:53] to create certainty.
[00:10:57] This is a very critical difference.
[00:10:59] Identifying an area of uncertainty creates some kind of boundary of clarity.
[00:11:04] This is like a bubble.
[00:11:06] We don’t know necessarily what’s inside of that bubble, but we might be able to roughly
[00:11:13] define the size of that bubble.
[00:11:16] It may become bigger.
[00:11:18] It may inflate a little bit, or it may inflate a lot.
[00:11:21] We don’t really know.
[00:11:22] But at least we know that there is uncertainty.
[00:11:26] Planning is about creating enough clarity to be able to act on your priorities.
[00:11:33] That’s all it is.
[00:11:34] If you find yourself trying to chase certainty, if you find yourself trying to figure out
[00:11:39] exactly what day something is going to deliver two or three or four months in advance, then
[00:11:44] you’re probably going to be disappointed.
[00:11:46] And your boss is probably going to be disappointed too.
[00:11:50] You may find yourself in this rat race of planning and then never really revisiting
[00:11:55] your plans after the fact.
[00:11:58] I would encourage you to go back and review what you thought you were going to do three
[00:12:03] months ago.
[00:12:04] How accurate was it?
[00:12:06] Did you meet those goals?
[00:12:09] Sometimes our plans actually do line up with what we output.
[00:12:14] When that happens, it makes sense to learn from it, but it also makes sense to recognize
[00:12:19] that that’s not always going to be the case.
[00:12:22] Just because you had a fewer number of chaotic events occurring in the last three months
[00:12:28] doesn’t mean that that calmness is going to continue indefinitely.
[00:12:33] Optimize your planning for creating clarity.
[00:12:36] And a little bonus note here.
[00:12:39] Your planning clarity should follow a gradient.
[00:12:43] The highest level of clarity, the highest level of confidence should be for the closest
[00:12:50] term work.
[00:12:53] You cannot have equal level of clarity and confidence for work that is two months away
[00:12:57] from now or three months away from now as you have for work that’s coming up in the
[00:13:01] next sprint.
[00:13:02] Thanks so much for listening to today’s episode.
[00:13:05] I hope this will help you in your planning efforts to calibrate your expectations, not
[00:13:10] only of yourself, but for others as well.
[00:13:14] By recognizing the fact that planning is about wrangling all of this complexity and trying
[00:13:19] to create some level of clarity, you may be able to grow some empathy for the other people
[00:13:25] around you whose plans didn’t go as well as they had hoped.
[00:13:30] Maybe they made a promise to you or to your team to deliver some dependency, and then
[00:13:35] they slipped.
[00:13:36] If you know how complex and difficult it is to predict the future, and namely that means
[00:13:42] impossible, then hopefully you can develop empathy for people around you who struggle
[00:13:48] to predict the future as well.
[00:13:51] Thanks so much for listening to today’s episode.
[00:13:53] I’d encourage you, if you enjoyed this episode, to go to developert.com slash Discord and
[00:13:57] join that Discord community today.
[00:13:59] We’re talking about this kind of topic on a regular basis in there, and there’s other
[00:14:05] engineers who are looking to give you advice that might differ entirely from the kind of
[00:14:09] advice I give on this show, but we’re all there to learn and improve together.
[00:14:14] That’s developert.com slash Discord.
[00:14:17] Thanks so much for listening, and until next time, enjoy your tea.