Shadowing Practice: The Math Behind Recommender Systems - Learn English Speaking with Video

Choose a practice mode

Each mode opens a full-screen practice room.

89 sentences
If sentences are too short or too long, click Edit to adjust them.
1
In 2006, Netflix famously offered a prize to solve a simple problem which had been around for years.
2
All online commerce giants are fighting to get better at solving this same problem.
3
Given observations of a user's past behavior, predict which other things that same user will like.
4
For example, based on Alice's viewing history, will she like
5
The Matrix or Grapes of Wrath?
6
We can represent user preferences graphically as connections between people on one side and things on the other, such as movies.
7
Here, the strength of connection is visually represented by the thickness of the lines.
8
So the problem is to fill out all of these missing connections we don't yet know, shown in red.
9
But because of the messy, unpredictable nature of people's taste, we can never perfectly predict what they will like
10
because for one it involves a guess about the future based on something you've never seen
11
and two the answer is always in flux
12
because people's tastes change over time what we can do is try to estimate those values as best
13
we can using whatever data we have access to
14
so regardless of the context we can describe the problem in the following mathematical form we use a matrix
15
which is a collection of numbers organized into rows and columns, where the rows are users and the columns are items, in this case movies.
16
And each cell in this matrix contains a number that describes how much each individual likes each movie.
17
For example, we could use a scale from 0 to 4, where 0 would represent I hate it,
18
2 is neutral, and 4 is I love it.
19
At any given moment, there will be some set of preference data for users and movies.
20
But it will be incomplete because users have only seen and rated a few movies each.
21
And so the problem boils down to trying to predict these missing values.
22
How should we make these predictions?
23
There are two general approaches to this problem.
24
The first is called content filtering, which is to use information we know about people and things as connective tissue for recommendations.
25
It's like asking Alice questions about what kinds of movies she likes to figure out if she will like The Matrix.
26
It begins by labeling each person and movies with some known attributes, or what we call features, for example, action and comedy.
27
That means if Alice likes comedy and hates action, we can represent her as 3 -0.
28
Each movie is also mapped to each feature in the same way.
29
For example, the matrix has no comedy and lots of action, so we could represent it as 0, 4.
30
And to determine whether someone will like a movie, we need to multiply these factors together.
31
So we could represent the strength of connection between Alice
32
and the matrix as 3 times 0 plus 0 times 4 equals 0.
33
So our estimation is that she will hate the movie.
34
So to make our predictions, we first need to gather this feature data for every user and movie.
35
To simplify, let's return to a matrix representation.
36
We can store this information in two matrices.
37
One defines the mapping between people and features.
38
The other defines the mapping between movies and features.
39
And by multiplying these two matrices together, using matrix multiplication, we get an estimated strength of connection between every person and movie.
40
And if we'd like, we can normalize our data to make sure the scale stays between 0
41
and 4 by dividing all values by 8 and rounding to the nearest 0 .5.
42
That's one way to solve this problem, known as content filtering.
43
The problem is, it's overly simplistic and not very accurate it.
44
That's because there are obviously more relevant features of a movie than just comedy or action.
45
The obvious way to improve this is just to include more features.
46
If you recall when Netflix started, it did just this.
47
It would ask new users to fill out a laundry list of questions about their preferences before presenting them with suggested movies.
48
And this leads to the problem of having to collect all of this preference data on users.
49
Not only is it a burden for users, it's also prone to failure, as we aren't always great at describing our own preferences.
50
Sometimes we simply can't explain why we like things.
51
We just do.
52
Which brings us to the other approach, called collaborative filtering.
53
The motivation for collaborative filtering comes from the idea that you will probably like things people with similar viewing habits also like.
54
This idea was popularized in this 2009 paper by Cohen, Bell, and Walensky.
55
So to begin, we can throw away the idea of dreaming up features used to connect peoples in movies.
56
Instead, we flip things around and use the user preference data we do have to generate the features.
57
For example, we might have this incomplete set of preference data,
58
and we will instead learn or discover the relevant features based on patterns in this data.
59
And this is done by simply reversing the problem.
60
We first perform an approximate factorization into two matrices, and we can do this using a machine learning approach.
61
The job of the machine learning algorithm is to guess values for those matrices,
62
which will match the existing data in the preference matrix as closely as possible.
63
The simplest approach is to simply guess numbers over
64
and over until you arrive at a set of numbers which predict the data with the lowest error overall.
65
Once this estimation is finished, we can multiply the matrices as before to fill in all of the missing values.
66
And it's important to note that we won't know exactly what to label these discovered features, so we call them latent features,
67
because they arise out of the underlying patterns in the data.
68
You can think of them as an average or weighted sum of the patterns in the data.
69
They are not based on a human -defined feature, such as comedy.
70
And that's the key insight behind this method.
71
With content filtering, the features come from the human mind,
72
whereas with collaborative filtering, the features are extracted directly from the patterns in the data.
73
And this will predict the data in the same way but more accurately.
74
It's also important to notice that this kind of prediction is actually a form of compression
75
because we can represent a huge matrix of preference data by two smaller matrices of feature data.
76
And once our feature data is determined or learned, we can throw away the original data we started with,
77
because we can simply multiply the features together to recreate that data.
78
And the reason this is possible is because the preference data we started with is not random, but follow patterns which exist across people.
79
If instead the preference data was filled with random numbers,
80
we would not be able to compress it accurately because there would be no patterns to extract.
81
This collaborative filtering approach has also been applied to a wide range of contexts,
82
such as evaluating policy outcomes before they are implemented in the real world, known as synthetic control.
83
For example, if we wanted to understand the effect of gun control or minimum wage increases in some city,
84
we could look at the effect in similar cities first
85
which have implemented those policies to approximate the outcome using the same mechanism.
86
So it is the patterns we share that allow this method to work.
87
Recommendation systems based on these ideas are in widespread use today, whether it's movies, music, news articles, or anything else you search for online.
88
The things
89
that are recommended to you are based on patterns the machine has observed in other people who are similar to yourself.

Download App

Everything you need to speak fluently

AI PronunciationScore every sentence
IPA PracticeMaster every sound
VocabularyBuild your word bank
Vocab GameLearn while playing
FOR YOU

Recommend Video

Vocabulary and speaking notes for this lesson

This speaking lesson is built on the video “The Math Behind Recommender Systems”. The speaker keeps coming back to these words: feature, movie, preference, matrix, user. This video has 89 sentences and 1284 words to shadow. The speech runs for 8:04. The speaker talks at a natural 159 words per minute, close to everyday conversation. 84% of the words are among the 3,000 most common in English; the rest is worth studying before you start.

Key vocabulary in this video

15 words from the video worth learning, with pronunciation and meaning:

WordPronunciationMeaning
matrix noun/ˈmeɪ.tɹɪks/The cavity or mold in which anything is formed.
preference noun/ˈpɹɛf(ə)ɹ(ə)ns/The selection of one thing or person over others (with the main adposition being "for" in relation to the thing or person, but possibly also "of")
filter noun/ˈfɪltɚ/A device which separates a suspended, dissolved, or particulate matter from a fluid, solution, or other substance; any device that separates one substance from…
predict verb/pɹɪˈdɪkt/To make a prediction: to forecast, foretell, or estimate a future event on the basis of knowledge and reasoning; to prophesy a future event on the basis of…
collaborative adjective/kəˈlæb.ə.ɹə.tɪv/Of, relating to, or done by collaboration.
solve verb/sɒlv/To find an answer or solution to a problem or question; to work out.
define verb/dɪˈfaɪn/To determine with precision; to mark out with distinctness; to ascertain or exhibit clearly.
prediction noun/pɹɪˈdɪkʃən/A statement of what will happen in the future.
label noun/ˈleɪ.bəl/A small ticket or sign giving information about something to which it is attached or intended to be attached.
discover verb/dɪˈskʌvə/To find or learn something for the first time.
outcome noun/ˈaʊtkʌm/That which is produced or occurs as a result of an event or process.
estimate noun/ˈɛs.tɪ.mət/A rough calculation or assessment of the value, size, or cost of something.
implement verb/ˈɪmpləmənt/To bring about; to put into practice; to carry out.
recommendation noun/ˌɹɛkəmɛnˈdeɪʃən/An act of recommending.
extract noun/ˈɛkstɹækt/Something that is extracted or drawn out.

Phrasal verbs you will hear

WordPronunciationMeaning
fill out verb/fɪl ˈaʊt/To complete a form or questionnaire with requested information.
throw away verbTo discard (trash, garbage, or the like), to toss out, to put in the trash.
figure out verbTo come to understand; to discover or find a solution; to deduce.

Sentences worth repeating

Short, complete lines from the video that you can reuse in everyday conversation:

  • How should we make these predictions?
  • To simplify, let's return to a matrix representation.
  • Sometimes we simply can't explain why we like things.

Grammar in this video

The structures the speaker uses most, with the exact words from the video:

StructureIn the video
Passive voice be + past participle — the focus is on what happens, not who does itis visually represented · is called · is also mapped
Present perfect have/has + past participle — a past action that still matters nowyou've never seen · have only seen · has also been applied
Relative clauses who / which + clause — extra information about a person or thingfiltering, which is · people who are

Pronunciation to watch

The speaker uses 6 contractions and reduced forms, such as aren't, can't, don't. Say them the short way, as you hear them.

  • The “th” sounds: gather /ˈɡæðɚ/, mathematical /ˌmæθ(.ə)ˈmæt.ɪ.kəl/, algorithm /ˈælɡəɹɪðm̩/, synthetic /sɪnˈθɛtɪk/, thickness /ˈθɪknəs/
  • The “sh” and “zh” sounds: prediction /pɹɪˈdɪkʃən/, recommendation /ˌɹɛkəmɛnˈdeɪʃən/, representation /ˌɹɛp.ɹə.zɛnˈteɪ.ʃən/, tissue /ˈtɪʃ.(j)u/, motivation /ˈmoʊ.tə.veɪ.ʃən/
  • Long words — get the stress right: collaborative /kəˈlæb.ə.ɹə.tɪv/, recommendation /ˌɹɛkəmɛnˈdeɪʃən/, accurately /ˈæk.jə.ɹɪt.li/, approximate /əˈpɹɑk.sə.mət/, representation /ˌɹɛp.ɹə.zɛnˈteɪ.ʃən/

How to practise with this video

  1. Listen to the whole video once without speaking and note the words you do not know.
  2. Start at 0.75× speed, shadow it sentence by sentence, then go back to normal speed once it feels easy.
  3. Record yourself and compare with the original, paying attention to words like matrix, preference, filter.

What is the Shadowing Technique?

Shadowing is a science-backed language learning technique originally developed for professional interpreter training and popularized by polyglot Dr. Alexander Arguelles. The method is simple but powerful: you listen to native English audio and immediately repeat it out loud — like a shadow following the speaker with just a 1–2 second delay. Unlike passive listening or grammar drills, shadowing forces your brain and mouth muscles to simultaneously process and reproduce real speech patterns. Research shows it significantly improves pronunciation accuracy, intonation, rhythm, connected speech, listening comprehension, and speaking fluency — making it one of the most effective methods for IELTS Speaking preparation and real-world English communication.

Shadowing technique: read the full step-by-step guide →