쉐도잉 연습: Dot Plots: How to Actually See What Your Users Are Doing - 영상으로 영어 말하기 배우기
레슨 만드는 중...
1
One of the biggest mistakes I see founders make is relying on aggregate user metrics, instead of understanding how any individual users use their product.
2
In my last video, I talked about cohort retention curves
3
and how you can use those to separate groups of users and track what they do over time throughout using your product.
4
And I think that's the best tool that you've got to figure out if people keep using your product.
5
But what you don't know is how are they using your product?
6
How are they interacting?
7
What features are they using?
8
What's the frequency of use?
9
What's the pacing of how they use the product?
10
And most founders just like ignore this.
11
But I think it's the most important signal to figure out if you've built something that people want.
12
So you want to be able to look at what individual users are doing.
13
But that's a lot, right?
14
If you even have like 10 or 20 users, it's pretty challenging to just tail the logs and watch every event that every user is doing.
15
So with aggregate data, the graphs that we're all used to talking about, things like DAUs or MAUs,
16
these lump all of your users together and you can't really get a sense of what any individual user is doing.
17
And if you have any amount of growth, those graphs tend to be going up and to the right, even if users aren't actually enjoying using your product.
18
So today I want to tell you about a tool
19
that we came to in my startup
20
that allows you to understand what's going on with individual users
21
while also giving you a big picture view of how your entire product is performing.
22
And we call it the dot plot.
23
So let me show you what a dot plot looks like.
24
Based on the name you can figure out it probably involves dots.
25
What you basically do is just make a two-dimensional grid like a spreadsheet
26
where there are a bunch of columns and a bunch of rows.
27
Each row represents one individual user.
28
If I'm one of the users, I'll write my name here, Dave, I'm one of the users.
29
And every other user of your product gets their own row.
30
And then every column represents a time period.
31
I think days are usually the right thing to use for your product, but it probably depends a bit on the nature of your product.
32
So let's just draw in the days.
33
I'll just do Monday, Tuesday, Wednesday, Thursday, Friday.
34
And you can make this as big or as small as you want.
35
For the sake of this example, I'll just do like a week or two of days just to show you what's going on here.
36
And then the idea, it's called a dot plot, is you put some dots in each of the cells.
37
You want to pick an event
38
that your user does in the process of using your product that you think represents value in the product.
39
Maybe it's
40
It's sharing a photo if you're building a photo app
41
or listening to a song if you're building a music app
42
or processing an invoice if you're building a B2B invoice processing product.
43
And you can just put a dot for each day that each user uses the product.
44
Let's say we're Spotify and we're building a music streaming app and we want to see how our users are using it.
45
Let's pick the event that we're going to chart here being listen to a song.
46
So anytime a user listens to a song during a day, we're going to put a dot.
47
So for me, let's say I listen to Spotify song on Monday and Tuesday and not on Wednesday, but Thursday and Friday again.
48
And then maybe again on Monday and Wednesday.
49
Another thing you can do to make a record of the first day that a user used the product, the day that they onboarded, you can put another symbol.
50
Like let's say on a user's first day, we'll just draw a little ring around the dot like that just to give us a little bit more signal.
51
And what you'll eventually start seeing is a pretty high density visualization of individual users and their usage over time.
52
What's really cool about this is it lets you figure out patterns
53
that you probably would not have seen with your human brain just looking at aggregate charts or looking at individual user logs.
54
Okay, so let's look at this example I've just drawn.
55
For our Spotify app, what do we see?
56
What patterns have emerged now that we can see individual users and their own behavior?
57
Well, one thing I see is it seems like there's a set of people who use the product on weekdays, right?
58
We've got myself, we've got user number three here, user four used it on a Monday, user six used it during the week.
59
And there's a couple of users who seem to kind of only use it on the weekends.
60
That's an interesting observation that might help me redesign my product in a different way or target different users, maybe understand which users are the most valuable ones to me.
61
Do I want the weekday work time listeners or do I want the weekend users?
62
We would have no idea about this if we didn't have a dot plot visualization like this.
63
Another thing I can see is a measure of retention.
64
Like, do we see a lot of users like user 4
65
that try the app on one day and then never come back?
66
If we see that on a bunch of our rows, we have an idea of a potential problem that we've got in our onboarding or other things.
67
As you get more sophisticated with dot plots, you can make them as intricate as you want.
68
At Bump, we had different symbols that we would put into these cells.
69
So we knew whether you shared your contact information using Bump or if you shared a photo.
70
And it gives you a lot more granularity and you can kind of go as deep as you want on this.
71
This idea of dot plots might be familiar to some of you.
72
You've probably seen it at the top of GitHub pages.
73
This is basically what a GitHub graph looks like.
74
They've just wrapped the days around per week.
75
Another thing you can do is instead of just tracking user actions, you can track user state.
76
So was this user using an iPhone or an Android phone?
77
Were they on the web?
78
Was this user coming from the United States or a different country?
79
Sometimes you have demographic information about your users.
80
Is this a user that makes a lot of money?
81
Or is this a college kid that you just got on Reddit or something?
82
You can encode those states with other symbols or shading the cells, different colors.
83
You can write things over here.
84
So like I might say, you know, this is a iOS user and this is an iOS user, but these ones are Androids.
85
And another thing you can do then is sort your rows based on whatever attributes you want to sort them by.
86
So you might say, I only want to look at iOS users first, or I only want to look at users whose first time using the app was this Monday.
87
So let's resort so we only see people that have rings around their first day.
88
What you find when you look at this in aggregate, you can then kind of zoom out and see an entire page of these, is your brain will start to notice these patterns in a way
89
that you would never have figured out on your own a priori.
90
This is actually an idea that I remember hearing about 10 years ago from Max Levchin, one of the founders of PayPal.
91
They had a big fraud problem at PayPal when they first launched, but they didn't know the patterns to look for.
92
So what they did instead is build a visualization, a graph of all the transactions that were happening on PayPal.
93
And they just had humans sit and stare at screens of these drawings and graphs.
94
And while the humans didn't know what exactly was going on, they were able to look at the screen and say,
95
that thing happening there, that's different and probably fraud.
96
And then they would go and dig into that.
97
it's kind of the same idea with dot plots you can look at these these charts
98
and figure out huh there's something going on with users i see this pattern emerging
99
and then you can go dig into it a lot deeper
100
so to illustrate the point i was talking about where dot
101
plots give you a lot more granularity about what's going on
102
with the users let's draw the dau graph for these users
103
so what you would have seen had you only been looking
104
at your dau graph i'll just draw it on top of here to illustrate
105
so again like imagine each of these days is the same
106
day above the da you graph here looks like this on
107
day one it's two on day two it's three on day three it's two 2,
108
2, 2, 2, 2, 1, 0, 1.
109
So if you were just looking at DAUs, this is the graph you would see.
110
And it really doesn't tell you all that much.
111
It basically tells you, yeah, we're not growing.
112
We have some users.
113
Instead, looking at the dot plot, we have a much richer understanding of our users.
114
We know something about their behavior, maybe something about their lives we probably have inferred from this that these people that use it during the week,
115
probably they're doing it at the office
116
or in some other place where they can listen to music every single day of the work week.
117
And again, you can go a lot deeper on this.
118
And if you change the dots to be different symbols, for example, in our Spotify example, we could choose to represent different features of the product.
119
Let's say if a user uses search in Spotify, we'll put a little S next to it.
120
Or if they use maybe a playlist, they join a public playlist, let's say we could put a P there.
121
And you might start to see patterns where specific features maybe drive behaviors in the product that you actually want.
122
Let's just say for the sake of argument that we see this one user here that joined a public playlist.
123
They then have a string of many, many consecutive days of using the product.
124
We could then infer like, oh, maybe the playlist feature is really causal to having people be really active in our product.
125
This is the sort of stuff that you can learn with dot plots.
126
So what's really great for most founders, you have a very small number of users at the beginning.
127
And so you can literally look at every single user of your product on every single day they've ever used it.
128
And it all fits on one screen on your monitor.
129
That's really great.
130
but it actually does scale to when you have thousands or millions or billions of users.
131
This is a tool that we used at Google Photos when we had well more than a billion users.
132
And the idea is you can just choose to sample your users and represent them on a dot plot however you want.
133
So we would have days where we print out dozens of
134
these pieces of paper with dot plots on them for different samples of our user base.
135
I would print out a piece of paper and hand one of our team members, like, here's the iOS users in France.
136
I want you to understand what they're doing.
137
And I would hand another piece of paper to somebody else and say, these are the users on web in the United States who make more than $80,000 a year.
138
Let's see what they're up to.
139
And we would have days where we just sit in the office
140
and look at these dot plots and try to draw conclusions about what's going on with our users.
141
So you might be thinking to yourself, this is cool, Dave, but we're a B2B product
142
and we just sell seats to businesses and pay for it
143
and so i that's all that matters right turns out
144
that dot plots could be really useful to you too let
145
me give you a specific example i worked with a company in the most recent yc batch
146
that had a very name brand customer that signed up
147
and bought their product i think it was like a 80
148
000 a year contract they onboarded the company the company said they wanted 10 seats
149
and later the company chert let me show you what they
150
could have figured out had they been using dot plots So this is what it actually looked like.
151
The company bought 10 seats, but only three seats ever activated.
152
Only three of those people ever tried the product.
153
And if you look at their usage, they weren't getting a lot of value from it.
154
Nobody used it more than two days per week.
155
And it looks like pretty sporadic usage.
156
And it turns out what happened is the company was in the state.
157
The champion had gotten excited about this product and bought it.
158
And then the champion left the company.
159
And as soon as the champion left, a new person came in and they said, why are we using this software?
160
We're going to churn.
161
And so they opted out of a renewal clause at the last moment.
162
The company could have known that this contract was in jeopardy by looking at the dot plot.
163
So there's a few ways you can misuse dot plots.
164
The number one thing is to just chart the wrong event.
165
A lot of founders might want to populate their dot plot with the easiest way to populate
166
so it feels good and you see a lot of dots.
167
Maybe you'll pick like opened the app or signed into the product.
168
Those are pretty bad events to choose because they don't really measure whether the user is getting real value.
169
So I suggest you pick something that actually represents value being created for the user.
170
Listen to a song, shared a photo, something like that that's a real event.
171
The other mistake you can make is picking a time period that's too wide.
172
Sometimes founders want to make it look better and they pick weeks, like week one, week two, week three it's way harder to figure out what's actually going on unless you look at it at the day
173
or maybe even like sub-day granularity.
174
So I would go so far as to say until you have hundreds of users, the dot plot could be your only dashboard.
175
What's great about dot plots is they're just a logs visualization tool.
176
There's no fancy computations happening here.
177
You basically just need to parse your logs and put them into a 2D grid.
178
This is a thing that modern AI coding tools can whip up in like 10 minutes.
179
These are best used in conjunction with cohort retention curves.
180
Cohort retention curves teach you in aggregate whether groups of users that you acquire stick with you over time.
181
That's very important.
182
You should definitely be measuring that.
183
But the dot plot shows you how those users are actually using your product.
184
And they give you the color to go ask the right questions of your users, to go build the right features,
185
to fix things that are broken in your product that you would never learn by looking at aggregate metrics.
186
So cohort retention curves and dot plots are in my experience two of the most important tools
187
that you've got to understand your users.
188
Good luck!
📺 같은 채널
C11
Garry Tan: Own Your Intelligence
Business EnglishUniversity StudentsWorking Adults
B25
How Pitching Investors is Different Than Pitching Customers - Michael Seibel
Business EnglishInterview EnglishUniversity Students
C14
Jensen Huang: The Mindset That Built NVIDIA
Business EnglishUniversity StudentsWorking Adults
B2How to Get Your First 10 Customers
Business EnglishWorking Adults
C1How to Build an AI-Native Services Company
Business EnglishUniversity StudentsWorking Adults
✨ 추천 영상
B21
157 문장
The Weird Design Playbook of 6 App Outliers
Business EnglishUniversity StudentsWorking Adults
B21
364 문장
Claude Cowork Tutorial: Build Monthly Reports in Minutes
Business EnglishUniversity StudentsWorking Adults
B14
83 문장
What are KPIs and Metrics? | Data Fundamental for Beginners
Business EnglishUniversity StudentsWorking Adults
B2271 문장
I Challenge You: Commit to YouTube for 3 months (exact plan inside!)
Business EnglishUniversity StudentsWorking Adults
B21
49 문장
Learn UX Storyboarding in 5 Minutes: w/ Steps and Examples | UXtweak
Business EnglishUniversity StudentsWorking Adults
B21
119 문장
Basic Opt Flw regimes
Business EnglishUniversity StudentsWorking Adults
B21
583 문장
Episode 531: Shallow feedback and my coworker is a huge sloperator
Business EnglishUniversity StudentsWorking Adults
B21
220 문장
How Modern Data Teams Work (Engineer, Analyst, Scientist, Architect, ML)
Business EnglishUniversity StudentsWorking Adults
B21
282 문장
What Stanford students actually use ChatGPT for
Business EnglishUniversity StudentsWorking Adults
B22
286 문장
I Tested OpenAI's Dots vs. Meta's Muse. What You Need to Know.
Business EnglishUniversity StudentsWorking Adults
B21
264 문장
Inside a YC Startup Disrupting a $900B Industry That Runs the US
Business EnglishUniversity StudentsWorking Adults
B2171 문장
I built an app and no one's using it
Business EnglishUniversity StudentsWorking Adults
영어 학습에서 실제 대화의 중요성
이 비디오는 제품 사용자 분석에 대한 내용이지만, 영어 학습자에게도 큰启示를 줄 수 있습니다. 특히 자연스러운 발음과 말하기 능력을 키우고자 할 때는 실제 대화의 맥락을 이해하는 것이 필수적입니다. 발표자는 명확하고 논리적인 표현을 사용하며, 일상적인 비즈니스 용어와 함께 구체적인 예시를 통해 내용을 전달합니다. 이런 유형의 대화는 IELTS 스피킹 준비에도 유용하며, 발음과 리듬을 연습하기에 적합합니다.
일상 커뮤니케이션에 유용한 5가지 구문
- "One of the biggest mistakes I see..." - 일반적인 문제점을 제기할 때 자주 사용되는 구문으로, 논리적인 설명을 시작할 때 유용합니다.
- "But what you don't know is..." - 상대방의 인식과 다른 점을 강조할 때 사용되며, 대화의 흐름을 전환시키는 효과가 있습니다.
- "For the sake of this example..." - 예시를 들어 설명할 때 사용되는 표현으로, 복잡한 내용을 간단히 전달할 수 있습니다.
- "Let's say we're..." - 가정적인 상황을 설정할 때 자주 사용되며, 상대방의 이해를 돕습니다.
- "Another thing you can do..." - 추가적인 정보를 제공할 때 사용되는 구문으로, 대화를 깊게 이어갈 수 있습니다.
비디오를 활용한 쉐도잉 연습 가이드
이 비디오는 발음 교정과 shadow speech 연습에 적합합니다. 다음 단계를 따라 연습해 보세요.
- 청취 단계: 비디오를 2-3번 반복해서 듣고, 발표자의 리듬과 강세를 파악합니다. 특히 "aggregate metrics", "cohort retention curves"와 같은 전문 용어의 발음을 주의깊게 듣습니다.
- 모방 단계: 발표자의 목소리를 따라서 즉시 반복합니다. 이때 영어 쉐도잉의 핵심은 "시간차 없이" 따라가는 것입니다. 처음에는 느린 속도로 시작하고, 점차 원래 속도에 맞춰봅니다.
- 비교 단계: 자신의 녹음을 발표자의 목소리와 비교합니다. 발음, 강세, 억양의 차이를 찾고, 영어 발음 교정에 집중합니다. 특히 "frequency"와 "pacing"과 같은 단어의 발음을 확인합니다.
- 응용 단계: 비디오의 내용을 바탕으로 자유롭게 이야기해 보세요. "Dot plot"의 개념을 설명하거나, 자신이 사용하는 제품의 사용자 분석 방법을 생각해 보는 등의 연습을 하면 좋습니다.
이와 같은 연습을 지속하면, 자연스러운 영어 표현과 말하기 능력이 크게 향상될 뿐만 아니라 IELTS 스피킹 점수도 상승시킬 수 있습니다. 필요하다면 shadowing site를 활용하여 더 체계적인 연습을 할 수도 있습니다.
이 영상의 문법
화자가 가장 많이 쓰는 문형을 영상 속 실제 표현과 함께 정리했습니다.
| 문형 | 영상 속 표현 |
|---|---|
| 조건문 if + 절, will/would + 동사 — 조건과 그 결과 | If I'm one of the users, I'll write |
| 현재완료 have/has + 과거분사 — 과거의 일이 지금도 관련이 있을 때 | you've built · I've just drawn · have emerged |
| 수동태 be + 과거분사 — 누가 하는지보다 무슨 일이 일어나는지에 초점 | being created · are broken |
쉐도잉이란? 영어 실력을 빠르게 키우는 과학적 방법
쉐도잉(Shadowing)은 원래 전문 통역사 훈련을 위해 개발된 언어 학습 기법으로, 다언어 학자인 Dr. Alexander Arguelles에 의해 대중화된 방법입니다. 핵심 원리는 간단하지만 매우 강력합니다: 원어민의 영어를 들으면서 1~2초의 짧은 지연으로 즉시 소리 내어 따라 말하는 것——마치 '그림자(shadow)'처럼 화자를 따라가는 것입니다. 문법 공부나 수동적인 청취와 달리, 쉐도잉은 뇌와 입 근육이 동시에 실시간으로 영어를 처리하고 재현하도록 훈련합니다. 연구에 따르면 이 방법은 발음 정확도, 억양, 리듬, 연음, 청취력, 말하기 유창성을 크게 향상시킵니다. IELTS 스피킹 준비와 자연스러운 영어 소통을 원하는 분들에게 특히 효과적입니다.