Vox

Leitura de 21 min

Using Substitute Questions to Gain a Better Perspective

Summary

In this episode of Developer Tea, host Jonathan Cuttrell explores the cognitive phenomenon of question substitution—how our brains automatically replace difficult questions with easier ones to arrive at quick answers. He begins with the simple example of “What color is the sky?” to illustrate how we bypass complex scientific explanations and jump to the culturally ingrained answer of “blue.” This automatic process helps us navigate daily life efficiently but can also lead to oversimplifications and errors in judgment when applied to more complex scenarios.

Cuttrell examines how this substitution works in various contexts, from solving math problems with a calculator to making judgments about people’s reliability based on single traits like punctuality. He explains that while these mental shortcuts are often helpful, they can be detrimental when the substitute question fails to accurately represent the original, more nuanced inquiry. The key characteristic of a good substitute question is whether it can confidently and accurately answer the question it is replacing.

The host encourages listeners to become more aware of this automatic process and to use question substitution intentionally as a tool. He introduces the concept of “degrees of confidence” to evaluate how well a substitute question represents the original. By consciously choosing substitute questions with high confidence scores, we can make better decisions and avoid common pitfalls like mistaking correlation for causation, as illustrated by the humorous example linking ice cream consumption to sunburns.

Ultimately, the episode serves as a coaching session to help developers and professionals sharpen their thinking. Cuttrell emphasizes that awareness of our cognitive shortcuts allows us to work smarter, focus on what matters, and open our minds to new perspectives and possibilities in both career and personal decision-making.

Recommendations

Tools

  • Pusher — A hosted API that makes it simple to add real-time features like chat, adaptive UI, and A/B testing to web and mobile applications. The host mentions it’s used by companies like GitHub and The New York Times.

Topic Timeline

  • 00:00:00 — Introduction to question substitution with the sky color example — Jonathan Cuttrell introduces the episode’s theme by asking “What color is the sky?” He explains that our quick answer of “blue” demonstrates how our brains substitute a complex question with a simpler one. This automatic process helps us navigate the world efficiently but can also lead to oversimplifications.
  • 00:02:32 — How our brains automatically substitute questions — Cuttrell delves deeper into the mechanism, explaining that substitution makes hard questions easier to answer with relative accuracy. He uses the example of long multiplication, where we substitute the actual problem with the question of what a calculator tells us. This automatic process is helpful but can be detrimental in other scenarios.
  • 00:07:09 — The key characteristic of a good substitute question — The host identifies the most important characteristic: whether the substitute question can accurately and confidently answer the question it is replacing. He contrasts good substitutions (like the sky color) with poor ones, using examples like “Is milk good for you?” and judging a person’s reliability based solely on punctuality.
  • 00:12:01 — Using degrees of confidence to evaluate substitute questions — Cuttrell advises listeners to start thinking in “degrees of confidence” when intentionally substituting questions. He explains that substituting an easier question usually decreases confidence in the answer’s accuracy. Listeners are encouraged to score their confidence (1-10) to find substitutions that are both efficient and reliable.
  • 00:14:13 — The danger of correlation vs. causation in substitutions — Using a fictional example about ice cream and sunburns, the host illustrates how mistaking correlation for causation leads to poor question substitutions. He emphasizes the need for vigilant awareness that our automatic and intentional substitutions can often be wrong, and we can easily trust things we shouldn’t.

Episode Info

  • Podcast: Developer Tea
  • Author: Jonathan Cutrell
  • Category: Technology Business Careers Society & Culture
  • Published: 2017-03-24T14:30:00Z
  • Duration: 00:17:18

References

Podcast Info

Transcript

[00:00:00] what color is the sky if you answered blue then you’re right sort of that’s kind of what we’re

[00:00:12] going to be talking about today my name is jonathan cuttrell and this is developer t

[00:00:17] and no we’re not going to be talking about the science of the color of the sky but rather

[00:00:21] the question itself and how quickly you came to an answer how is that is there an underlying

[00:00:30] mechanism that we can understand better about our brains and then use to our advantage that

[00:00:36] this question kind of outlines and this isn’t the only question that we do this with this isn’t the

[00:00:41] only question that we have a very quick answer for so we’re going to talk about some of that today

[00:00:46] my goal here on this show on developer t is not just to be the host of a podcast

[00:00:51] instead my goal is to coach you to coach you through your career to help you become

[00:00:57] a better developer and really i’m learning as i go just like you are so my hope is not

[00:01:05] only to coach you but to stand beside you and help you fight through the things that you’re

[00:01:10] fighting through as a developer so if you’re listening to this show then hopefully you are

[00:01:15] willing to be coached hopefully you are willing to work and to

[00:01:21] to

[00:01:21] to

[00:01:21] to put energy into becoming better.

[00:01:24] If you’re here for a quick fix,

[00:01:26] if you’re here for hacking your life in some way

[00:01:30] to jump ahead without putting in the hard work,

[00:01:33] well, this probably isn’t the place for you.

[00:01:35] If you’re here to hack your life and jump ahead

[00:01:38] and also put in the hard work,

[00:01:41] this is exactly the place for you.

[00:01:43] That’s exactly what we do here.

[00:01:45] I don’t try to help you be lazy or cut out work

[00:01:49] where work is necessary.

[00:01:50] Instead, I try to help you work on the things

[00:01:53] that matter the most

[00:01:54] and eliminate the things that matter the least.

[00:01:57] So I hope you can adopt that perspective of this show

[00:02:01] that really it’s just a coaching session

[00:02:03] between you and me over a cup of tea.

[00:02:06] That’s what I hope for this show.

[00:02:08] And I also hope that you will take the opportunity

[00:02:10] to really view this as a give and take.

[00:02:13] I really would love to hear your feedback.

[00:02:15] I’d love to hear your questions,

[00:02:17] any comments you have on these coaching sessions.

[00:02:20] These podcast episodes

[00:02:22] and how they apply to your career and to your life.

[00:02:25] You can reach out to me at developertea at gmail.com.

[00:02:29] Let’s jump into this discussion on question substitution.

[00:02:32] Your brain does a really good job of this.

[00:02:36] Substituting one question for another

[00:02:38] is something we automatically do

[00:02:40] to make hard questions easier to answer

[00:02:43] with relative accuracy, right?

[00:02:45] So let’s think about that question

[00:02:47] that we asked at the beginning of the show.

[00:02:50] What are the questions that we ask at the beginning of the show?

[00:02:50] What color is the sky?

[00:02:53] And the funny thing is

[00:02:54] our brains don’t automatically call to memory

[00:02:56] our science class

[00:02:57] where we learned that the sky’s color changes

[00:03:00] because the sky itself

[00:03:02] isn’t really what has the color.

[00:03:04] It’s actually the refraction of light

[00:03:07] by particles in the atmosphere.

[00:03:10] And this is the basic way of understanding it

[00:03:13] from a scientific perspective.

[00:03:15] And yet we don’t answer the question

[00:03:17] what color is the sky

[00:03:19] by outlining

[00:03:19] even the most basic of scientific answers.

[00:03:23] Instead, we jump directly to blue.

[00:03:26] Or if you’re standing outside,

[00:03:28] you may look up at the sky

[00:03:29] and answer from that perspective.

[00:03:32] So really what’s happening is

[00:03:34] you’re substituting a different question

[00:03:36] for the original question.

[00:03:38] Instead of answering what color is the sky,

[00:03:41] holistically,

[00:03:43] you’re answering the question

[00:03:44] what color do we normally perceive

[00:03:46] the sky’s refraction to be?

[00:03:49] Or perhaps,

[00:03:49] what color am I currently perceiving

[00:03:52] the sky’s refraction to be?

[00:03:55] An interesting additional note here

[00:03:57] is that this particular question

[00:03:58] is easier to answer

[00:04:00] and it’s harder to ask.

[00:04:02] It’s a little bit more wordy.

[00:04:04] It’s a little bit more thought out.

[00:04:07] And the sky isn’t the only thing

[00:04:09] that we substitute questions for.

[00:04:12] The sky’s color is not the only thing

[00:04:14] we substitute questions for.

[00:04:16] We have also given ourselves

[00:04:17] these shortcuts in harder conversations.

[00:04:19] Concrete problems,

[00:04:21] like for example,

[00:04:22] longer multiplication problems.

[00:04:24] Even with its relative simplicity

[00:04:26] and the scale of math,

[00:04:28] if I were to ask you the question,

[00:04:30] what is 254 times 763,

[00:04:34] you won’t immediately know

[00:04:36] that the answer is 193,802.

[00:04:39] You’ll probably do what I did.

[00:04:42] The way we answer this question is,

[00:04:43] in and of itself,

[00:04:44] a substitution.

[00:04:45] Instead of actually finding 254 objects,

[00:04:49] let’s say,

[00:04:49] marbles,

[00:04:50] and replicating them 763 times

[00:04:53] and creating some grid

[00:04:55] and counting up the results,

[00:04:57] instead of doing that,

[00:04:59] we type in symbols

[00:05:00] on our computer’s calculator

[00:05:02] and ask the question,

[00:05:05] what does the calculator tell me

[00:05:07] when I type in a representation

[00:05:08] of this question and hit enter?

[00:05:12] That’s the real question

[00:05:13] that we’re substituting,

[00:05:15] even though that question

[00:05:17] is representative

[00:05:18] of the original question.

[00:05:20] While this automatic substitution

[00:05:22] is extremely helpful

[00:05:24] in many scenarios,

[00:05:25] it can also be detrimental in others.

[00:05:28] And furthermore,

[00:05:28] we can use this concept

[00:05:30] more intentionally

[00:05:31] to help us create more space for focus

[00:05:33] and open up our minds

[00:05:34] to new perspectives and possibilities.

[00:05:37] We’ll talk about these characteristics

[00:05:39] right after we talk about

[00:05:40] today’s sponsor, Pusher.

[00:05:42] Today’s sponsor, Pusher,

[00:05:44] allows you to stop thinking about

[00:05:46] whether or not you can build features,

[00:05:49] that are real-time,

[00:05:50] into your application

[00:05:51] and instead start thinking about

[00:05:53] which features you want

[00:05:54] that are real-time.

[00:05:56] Features like adaptive UI

[00:05:58] and A-B testing

[00:06:00] that can adapt on the fly

[00:06:02] for your application

[00:06:03] based on data

[00:06:05] that’s coming from other users

[00:06:06] who are currently using that application.

[00:06:09] Features like chat.

[00:06:11] All of these features

[00:06:11] are made much simpler by Pusher.

[00:06:15] Pusher has a hosted API

[00:06:17] that makes it simple

[00:06:17] to add these real-time features

[00:06:19] to your application.

[00:06:19] Your web and your mobile apps

[00:06:21] in minutes

[00:06:22] and you can scale up massively

[00:06:23] with Pusher’s API.

[00:06:25] Pusher allows you

[00:06:26] to use the power of WebSockets

[00:06:28] to connect from your server

[00:06:30] to the clients

[00:06:31] that are using your application.

[00:06:33] It doesn’t matter

[00:06:34] what language or framework

[00:06:35] you are used to,

[00:06:36] they will have a library

[00:06:37] that works for you.

[00:06:38] They have over 150,000 developers

[00:06:41] who are using their service

[00:06:42] and big companies like

[00:06:44] GitHub, Intercom, MailChimp

[00:06:46] and the New York Times

[00:06:48] rely on Pusher

[00:06:49] to build your application.

[00:06:49] To build their real-time features.

[00:06:51] So go and check it out.

[00:06:52] Spec.fm slash Pusher.

[00:06:54] You can get started today

[00:06:55] with a free plan.

[00:06:57] That’s spec.fm slash Pusher.

[00:06:59] Thank you again to Pusher

[00:07:00] for sponsoring today’s episode

[00:07:02] of Developer Tea.

[00:07:03] So let’s talk about

[00:07:04] the most important characteristics

[00:07:06] of a substitute question.

[00:07:09] The most important characteristics

[00:07:11] of a substitute question.

[00:07:13] Really there’s one characteristic here

[00:07:15] and a lot of kind of sub-characteristics

[00:07:17] or things to consider

[00:07:19] about this characteristic

[00:07:20] that is important

[00:07:21] and that is

[00:07:22] whether or not

[00:07:23] that substitute question

[00:07:25] can accurately

[00:07:26] and confidently answer

[00:07:29] the question it is substituting for.

[00:07:32] Let me say that again.

[00:07:34] Can your substitute question

[00:07:35] accurately represent an answer

[00:07:38] for the question

[00:07:39] it is substituting for?

[00:07:41] In our previous example

[00:07:42] we talked about

[00:07:44] the color of the sky

[00:07:45] and the color of the sky

[00:07:47] is entirely dependent

[00:07:48] on your perspective.

[00:07:50] Right now I’m looking at the sky

[00:07:52] out my window

[00:07:52] and it’s largely gray

[00:07:55] and kind of a hazy blue.

[00:07:57] It’s not really what we imagine

[00:07:59] when we think about that simple

[00:08:02] what color is the sky.

[00:08:03] Sky blue is a color

[00:08:06] that we have kind of ingrained

[00:08:07] in our minds.

[00:08:07] It comes from some cultural aspects

[00:08:10] of carrying that idea forward

[00:08:12] of what color is the sky.

[00:08:13] Perhaps it comes from

[00:08:14] the most common representation

[00:08:17] of the sky.

[00:08:18] Usually,

[00:08:18] the sky is not cloudy

[00:08:20] in most parts of the world.

[00:08:22] In the main portions

[00:08:24] where the world is populated

[00:08:26] when we look up

[00:08:27] we see the color blue.

[00:08:29] So the substitution

[00:08:30] of the question

[00:08:32] what color is the sky

[00:08:33] for what color do I perceive

[00:08:36] the sky to be

[00:08:36] or perhaps

[00:08:38] the better question would be

[00:08:39] what color do most people

[00:08:41] perceive the sky to be

[00:08:43] on a regular basis.

[00:08:44] That kind of question

[00:08:45] we have a pretty good way

[00:08:47] of determining.

[00:08:48] the answer for.

[00:08:49] So the substitute question

[00:08:51] in that scenario

[00:08:52] is relatively good.

[00:08:54] However,

[00:08:55] take a question

[00:08:55] that has

[00:08:57] a lot more information

[00:08:58] to consider.

[00:08:59] For example,

[00:09:01] is milk good for you?

[00:09:03] Or is bread good for you?

[00:09:06] There’s a lot of research

[00:09:07] that you may call to mind.

[00:09:08] There’s a lot of news articles

[00:09:10] that you may call to mind as well.

[00:09:12] More information

[00:09:13] than you can really digest

[00:09:15] and immediately spit out

[00:09:17] an answer for.

[00:09:18] And so you’re going

[00:09:18] to substitute that question

[00:09:20] automatically

[00:09:21] with something

[00:09:23] that you believe

[00:09:24] based on a construction

[00:09:26] of the information

[00:09:27] you’ve received.

[00:09:28] And though I don’t have

[00:09:29] the actual answers

[00:09:30] to these questions

[00:09:31] the most likely answer is

[00:09:34] it depends.

[00:09:36] It depends on

[00:09:37] perhaps you are

[00:09:38] particularly

[00:09:39] lactose intolerant.

[00:09:41] Well then milk

[00:09:42] probably isn’t

[00:09:43] the best choice for you.

[00:09:44] And of course

[00:09:45] this doesn’t just apply

[00:09:46] to food

[00:09:48] or nutrition

[00:09:49] it also applies

[00:09:50] to the way we perceive

[00:09:51] other people

[00:09:52] the way we judge

[00:09:53] other people

[00:09:54] and their abilities.

[00:09:55] We ask

[00:09:56] is this person

[00:09:57] going to be good

[00:09:58] for this project?

[00:10:00] And really we’re trying

[00:10:01] to interpolate

[00:10:02] the information

[00:10:02] we have from the past

[00:10:03] and project something

[00:10:05] into the future

[00:10:06] about their

[00:10:07] abilities

[00:10:08] about their behaviors

[00:10:09] about their

[00:10:09] way that they deal

[00:10:11] with stress

[00:10:12] for example.

[00:10:13] We may use

[00:10:14] information

[00:10:14] to create

[00:10:16] a simplified answer

[00:10:18] and ultimately

[00:10:19] we’re creating

[00:10:20] a non-explicit

[00:10:22] connection

[00:10:22] to a substitute

[00:10:24] question.

[00:10:25] In other words

[00:10:25] is this person

[00:10:27] going to be reliable

[00:10:28] on this project?

[00:10:30] We may

[00:10:30] take from our

[00:10:31] information about

[00:10:32] that person

[00:10:32] who let’s say

[00:10:34] in this scenario

[00:10:35] they are on time

[00:10:36] regularly.

[00:10:37] We may take

[00:10:38] from their

[00:10:39] on-timeness

[00:10:40] to extrapolate

[00:10:42] that concept

[00:10:43] into

[00:10:43] them being

[00:10:45] a reliable person

[00:10:46] in every part

[00:10:47] of their life.

[00:10:48] And so the actual

[00:10:49] question we are

[00:10:50] answering is

[00:10:51] are they on time

[00:10:52] regularly?

[00:10:54] And that substitute

[00:10:55] question stands

[00:10:56] in place

[00:10:57] for the larger

[00:10:58] question

[00:10:58] will this person

[00:10:59] be reliable

[00:11:00] on this project?

[00:11:02] Of course

[00:11:03] on the flip side

[00:11:03] of the scenario

[00:11:04] if you’re not the one

[00:11:05] asking the question

[00:11:06] but rather the one

[00:11:07] who the question

[00:11:07] is being asked

[00:11:08] about

[00:11:09] then you know

[00:11:10] that these

[00:11:10] substitutions

[00:11:11] could occur.

[00:11:12] You know that

[00:11:13] for example

[00:11:13] if somebody

[00:11:14] sees you

[00:11:15] being late

[00:11:16] well they may

[00:11:17] substitute that

[00:11:18] lateness

[00:11:18] for is this person

[00:11:20] lazy?

[00:11:21] You may not be

[00:11:21] lazy at all

[00:11:22] it may be

[00:11:23] that you face

[00:11:24] traffic on a regular

[00:11:25] basis and so

[00:11:26] you often are late

[00:11:27] because traffic

[00:11:28] is hard to predict

[00:11:29] based on where

[00:11:31] you live.

[00:11:32] Now what are you

[00:11:33] supposed to do

[00:11:34] in that scenario

[00:11:35] is entirely

[00:11:36] up to you.

[00:11:37] The point of

[00:11:38] this discussion

[00:11:39] the point of

[00:11:39] today’s episode

[00:11:40] is to help you

[00:11:42] become more aware

[00:11:43] of this reality

[00:11:44] help you become

[00:11:45] more aware

[00:11:46] of the question

[00:11:47] substitution

[00:11:48] but I also

[00:11:49] want to help you

[00:11:50] pick better

[00:11:51] substitute questions

[00:11:53] on purpose

[00:11:54] intentionally

[00:11:55] rather than the ones

[00:11:56] that you’re doing

[00:11:57] subconsciously

[00:11:57] you can use this

[00:11:59] as a tool

[00:12:00] right so

[00:12:01] what I want you

[00:12:02] to start doing

[00:12:02] is thinking

[00:12:03] in degrees

[00:12:04] of confidence

[00:12:05] in these

[00:12:06] substitute questions

[00:12:07] this will likely

[00:12:09] be covered

[00:12:09] in another

[00:12:10] separate episode

[00:12:11] we’ve discussed

[00:12:12] degrees of confidence

[00:12:14] and similar

[00:12:15] concepts before

[00:12:16] when we talked

[00:12:17] about heuristics

[00:12:18] and when we talked

[00:12:19] about estimation

[00:12:20] but here’s the idea

[00:12:21] in almost all scenarios

[00:12:23] substituting

[00:12:24] a new question

[00:12:26] for a

[00:12:27] more difficult

[00:12:28] question

[00:12:29] substituting an

[00:12:30] easier to answer

[00:12:30] question

[00:12:31] that will decrease

[00:12:32] the degree of

[00:12:33] confidence

[00:12:34] and accuracy

[00:12:35] in the answer

[00:12:36] right think about

[00:12:38] that for a second

[00:12:38] anytime you

[00:12:39] substitute an

[00:12:40] easier question

[00:12:41] for a harder

[00:12:42] question

[00:12:43] to answer

[00:12:44] then you’re

[00:12:46] sacrificing

[00:12:46] some

[00:12:47] degree of

[00:12:48] confidence

[00:12:49] that that answer

[00:12:50] is actually

[00:12:51] representative

[00:12:51] of the question

[00:12:53] it is substituting

[00:12:54] now this isn’t

[00:12:55] always true

[00:12:56] for example

[00:12:57] in the

[00:12:58] multiplication

[00:12:58] problem

[00:12:59] I actually

[00:13:00] trust a calculator

[00:13:01] much more

[00:13:02] than I trust

[00:13:03] my own

[00:13:04] long form

[00:13:05] math abilities

[00:13:06] but this is

[00:13:07] especially true

[00:13:08] with more

[00:13:08] complex questions

[00:13:10] that rely on

[00:13:10] context

[00:13:11] subjective answers

[00:13:12] research

[00:13:13] rather than

[00:13:14] a one dimensional

[00:13:15] easy to

[00:13:17] determine fact

[00:13:18] like for example

[00:13:18] lateness

[00:13:19] so what I want you

[00:13:21] to do is start

[00:13:22] thinking in degrees

[00:13:22] of confidence

[00:13:23] determine especially

[00:13:24] for intentional

[00:13:26] question substitutions

[00:13:27] your degree of

[00:13:28] confidence

[00:13:29] and you can use

[00:13:31] a scoring system

[00:13:31] if you want to

[00:13:32] one to ten

[00:13:33] how confident are you

[00:13:34] your degree of

[00:13:35] confidence

[00:13:36] that the new

[00:13:37] question

[00:13:37] provides an

[00:13:39] accurate and

[00:13:39] representative answer

[00:13:41] for the original

[00:13:42] question

[00:13:42] of course you want

[00:13:43] to find substitutions

[00:13:44] that have high

[00:13:46] degrees of

[00:13:46] confidence

[00:13:47] interestingly

[00:13:48] we can be very

[00:13:50] wrong about

[00:13:51] our degrees of

[00:13:52] confidence in a

[00:13:53] given answer

[00:13:53] right

[00:13:54] consider the

[00:13:55] often repeated

[00:13:56] phrase

[00:13:57] correlation

[00:13:57] is not

[00:13:59] causation

[00:13:59] when we rely

[00:14:01] purely on

[00:14:01] correlation

[00:14:02] as a heuristic

[00:14:03] for causation

[00:14:05] there’s no

[00:14:06] guarantee

[00:14:06] that the

[00:14:07] substitution of

[00:14:08] one side of

[00:14:09] the correlated

[00:14:10] factors

[00:14:10] for the other

[00:14:11] is a valid

[00:14:12] move

[00:14:13] I’ll give you

[00:14:14] a fake scenario

[00:14:15] Joe the scientist

[00:14:16] is trying to

[00:14:17] understand

[00:14:18] what factors

[00:14:19] cause sunburn

[00:14:21] in young

[00:14:22] children

[00:14:23] and he does

[00:14:24] some studies

[00:14:25] he collects

[00:14:25] some data

[00:14:26] and he analyzes

[00:14:28] that data

[00:14:28] only to find out

[00:14:30] that there’s a

[00:14:31] high correlation

[00:14:32] with ice cream

[00:14:33] consumption

[00:14:34] per capita

[00:14:35] and the reported

[00:14:37] rate of sunburns

[00:14:38] now we can

[00:14:40] look at that

[00:14:40] and hopefully

[00:14:41] you’re already

[00:14:41] starting to see

[00:14:42] the answer

[00:14:43] but we can

[00:14:44] look at that

[00:14:44] and tell children

[00:14:45] that they no

[00:14:46] longer are

[00:14:47] allowed to have

[00:14:47] ice cream

[00:14:48] because ice cream

[00:14:49] certainly causes

[00:14:51] sunburns

[00:14:51] or we can

[00:14:53] take a step

[00:14:53] back and analyze

[00:14:54] that data

[00:14:55] and recognize

[00:14:55] that the

[00:14:56] correlation

[00:14:57] between sunburns

[00:14:58] and ice cream

[00:14:59] is really

[00:15:00] nothing to do

[00:15:01] with each other

[00:15:02] but rather

[00:15:02] they both have

[00:15:03] something to do

[00:15:04] with summer

[00:15:05] and children

[00:15:07] are more often

[00:15:08] outside in the

[00:15:09] summer

[00:15:09] and they are

[00:15:10] more likely

[00:15:11] to have ice cream

[00:15:12] because it’s hot

[00:15:13] outside

[00:15:14] so of course

[00:15:15] a non-useful

[00:15:16] non-useful

[00:15:16] substitution

[00:15:17] in this scenario

[00:15:18] is is this child

[00:15:19] likely to get

[00:15:20] a sunburn

[00:15:20] if you were

[00:15:22] to substitute

[00:15:23] how often

[00:15:24] does the child

[00:15:25] eat ice cream

[00:15:25] then it would

[00:15:26] yield a poor

[00:15:28] result

[00:15:28] even though

[00:15:29] the data

[00:15:30] may say otherwise

[00:15:31] so we have to

[00:15:33] be vigilantly

[00:15:34] aware

[00:15:34] that

[00:15:35] first of all

[00:15:37] we are making

[00:15:37] these substitutions

[00:15:38] all the time

[00:15:39] automatically

[00:15:40] and secondly

[00:15:42] we have to

[00:15:43] be vigilantly

[00:15:44] aware

[00:15:45] that when we

[00:15:45] do these

[00:15:46] intentionally

[00:15:47] when we

[00:15:47] substitute

[00:15:48] questions

[00:15:49] for other

[00:15:50] questions

[00:15:51] in order to

[00:15:52] come to an

[00:15:52] answer

[00:15:53] faster

[00:15:54] that we

[00:15:54] very often

[00:15:55] can be

[00:15:56] wrong

[00:15:57] we very often

[00:15:58] trust things

[00:15:59] that we

[00:15:59] shouldn’t

[00:16:00] trust

[00:16:00] thank you so

[00:16:02] much for

[00:16:02] listening to

[00:16:03] today’s episode

[00:16:03] of developer

[00:16:04] tea

[00:16:04] I hope you’ve

[00:16:06] enjoyed this

[00:16:06] episode

[00:16:07] I hope that

[00:16:07] you feel

[00:16:08] the same

[00:16:09] momentum

[00:16:09] from this

[00:16:11] coaching

[00:16:11] that thousands

[00:16:12] of others

[00:16:13] just like you

[00:16:14] are feeling

[00:16:15] they’ve

[00:16:15] subscribed to

[00:16:16] this show

[00:16:17] I hope you

[00:16:17] will subscribe

[00:16:18] to the show

[00:16:18] as well

[00:16:19] so you don’t

[00:16:19] miss out

[00:16:20] on future

[00:16:21] episodes of

[00:16:22] developer tea

[00:16:22] we talk about

[00:16:23] stuff like this

[00:16:24] all the time

[00:16:25] on the show

[00:16:25] we talk about

[00:16:25] psychology

[00:16:26] about focus

[00:16:27] I invite you

[00:16:28] to join us

[00:16:29] and stick around

[00:16:30] this show

[00:16:31] would not be

[00:16:31] possible

[00:16:32] or even

[00:16:33] important

[00:16:33] without you

[00:16:34] listening to it

[00:16:36] so thank you

[00:16:36] so much for

[00:16:37] listening to the

[00:16:37] show and I

[00:16:38] hope that you

[00:16:39] will reach out

[00:16:39] you can email

[00:16:40] me at

[00:16:40] developer tea

[00:16:41] at gmail

[00:16:42] dot com

[00:16:42] thank you so

[00:16:43] much for

[00:16:44] listening to

[00:16:44] developer tea

[00:16:45] and I’ll see you

[00:16:45] in another huge

[00:16:46] thank you to

[00:16:47] pusher our

[00:16:48] sponsor for

[00:16:49] today’s episode

[00:16:50] with pusher you

[00:16:51] can start putting

[00:16:51] real-time features

[00:16:52] into your web

[00:16:54] and mobile apps

[00:16:55] in just a few

[00:16:55] minutes they

[00:16:56] have API

[00:16:58] hosted API

[00:16:59] and libraries

[00:17:00] for pretty much

[00:17:00] every language

[00:17:01] so go and

[00:17:02] check it out

[00:17:02] spec.fm

[00:17:03] slash pusher

[00:17:04] you can get

[00:17:04] started for

[00:17:04] free today

[00:17:06] thank you so

[00:17:06] much for

[00:17:07] listening to

[00:17:07] today’s episode

[00:17:08] of developer tea

[00:17:09] and until next

[00:17:10] time enjoy your

[00:17:11] tea

[00:17:15] bye

Visão de gráfico