Shadowing Practice: The Essential Main Ideas of Neural Networks - Learn English Speaking with Video
Kies een oefenmodus
Elke modus opent een volledig scherm oefenruimte.
168 zinnen
Als zinnen te kort of te lang zijn, klik op Bewerken om ze aan te passen.
1
Neural networks seem so complicated, but they're not.
2
StatQuest!
3
Hello, I'm Josh Starmer and welcome to StatQuest.
4
Today we're going to talk about Neural Networks Part 1, Inside the Black Box.
5
Neural networks, one of the most popular algorithms in machine learning, learning, cover a broad range of concepts and techniques.
6
However, people call them a black box because it can be hard to understand what they're doing.
7
The goal of this series is to take a peek into the black box by breaking down each concept
8
and technique into its components and walking through how they fit together, step by step.
9
In this first part, we will learn about what neural networks do and how they do it.
10
In part two, we'll talk about how neural networks are fit to data with backpropagation.
11
Then, we will talk about variations on the simple neural network presented in this part, including deep learning.
12
Crazy awesome news!
13
I have a new way to think about neural networks
14
that will help beginners and seasoned experts alike gain a deep insight into what neural networks do.
15
For example, most tutorials use cool-looking but hard-to-understand graphs and fancy mathematical notation to represent neural networks. In contrast,
16
I'm going to label every little thing on the neural network to make it easy to keep track of the details.
17
And the math will be as simple as possible while still being true to the algorithm.
18
These differences will help you develop a deep understanding of what neural networks actually do.
19
So, with that said, let's imagine we tested a drug that was designed to treat an illness,
20
and we gave the drug to three different groups of people with three different dosages.
21
Low, Medium, and High.
22
The low dosages were not effective, so we set them to zero on this graph.
23
In contrast, the medium dosages were effective, so we set them to 1.
24
And the high dosages were not effective, so those are set to 0.
25
Now that we have this data, we would like to use it to predict whether or not a future dosage will be effective.
26
However, we can't just fit a straight line to the data to make predictions, because no matter how we rotate the straight line,
27
it can only accurately predict two of the three dosages.
28
The good news is that a neural network can fit a squiggle to the data.
29
The green squiggle is close to zero for low dosages, close to one for medium dosages,
30
and close to zero for high dosages.
31
And even if we have a really complicated data set like this, a neural network can fit a squiggle to it.
32
In this StatQuest, we're going to use this super simple data set and show how this neural network creates this green squiggle.
33
But first, let's just talk about what a neural network is.
34
A neural network consists of nodes and connections between the nodes.
35
Note, the numbers along each connection represent parameter values that were estimated when this neural network was fit to the data.
36
For now, just know that these parameter estimates are analogous to the slope
37
and intercept values that we solve for when we fit a straight line to data.
38
Likewise, a neural network starts out with unknown parameter values
39
that are estimated when we fit the neural network to a dataset using a method called backpropagation.
40
And we will talk about how backpropagation estimates these parameters in part 2 in this series.
41
But for now, just assume that we've already fit this neural network to this specific dataset.
42
And that means we have already estimated these parameters.
43
Also, you may have noticed that some of the nodes have curved lines inside of them.
44
These bent or curved lines are the building blocks for fitting a squiggle to data.
45
The goal of this StatQuest is to show you how these identical curves can be reshaped by the parameter values
46
and then added together to get a green squiggle that fits the data.
47
Note, there are many common bent or curved lines that we can choose for a neural network.
48
This specific curved line is called Soft Plus, which sounds like a brand of toilet paper.
49
Alternatively, we could use this bent line called RelU, which is short for Rectified Linear Unit and sounds like a robot.
50
Or we could use a sigmoid shape or any other bent or curved line.
51
Oh no, it's the dreaded terminology alert!
52
The curved or bent lines are called activation functions.
53
When you build a neural network, you have to decide which activation function or functions you want to use.
54
When most people teach neural networks, they use the sigmoid activation function.
55
However, in practice, it is much more common to use the ReLU activation function, or the soft plus activation function.
56
So we'll use the soft plus activation function in this stat quest.
57
Anyway, we'll talk more about how you choose activation functions later in this series.
58
Note, this specific neural network is about as simple as they get.
59
It only has one input node where we plug in the dosage, only one output node to tell us the predicted effectiveness,
60
and only two nodes between the input and output nodes.
61
However, in practice, neural networks are usually much fancier and have more than one input node,
62
more than one output node, different layers of nodes between the input and output nodes,
63
and a spider web of connections between each layer of nodes.
64
Oh no!
65
It's another terminology alert!
66
These layers of nodes between the input and output nodes are called hidden layers.
67
When you build a neural network, one of the first things you do is decide how many hidden layers you want
68
and how many nodes go into each hidden layer.
69
Although there are rules of thumb for making decisions about the hidden layers, you essentially make a guess and see how well the neural network performs,
70
adding more layers and nodes if needed.
71
Now, even though this neural network looks fancy, it is still made from the same parts used in this simple neural network,
72
which has only one hidden layer with two nodes.
73
So let's learn how this neural network creates new shapes from the curved or bent lines in the hidden layer,
74
and then adds them together to get a green squiggle that fits the data.
75
To keep the math simple, let's assume dosages go from 0, for low, to 1, for high.
76
The first thing we are going to do is plug the lowest dosage, 0, into the neural network.
77
Now, to get from the input node to the top node in the hidden layer,
78
this connection multiplies the dosage by negative 34.4 and then adds 2.14.
79
And the result is an X-axis coordinate for the activation function.
80
For example, the lowest dosage, 0, is multiplied by negative 34.4,
81
and then we add 2.14 to get 2.14 as the x-axis coordinate for the activation function.
82
To get the corresponding y-axis value, we plug 2.14 into the activation function,
83
which, in this case, is the soft plus function.
84
Note, if we had chosen the sigmoid curve for the activation function, then we would plug 2.14 into the equation for the sigmoid curve.
85
And if we had chosen the relu bent line for the activation function, then we would plug 2.14 into the relu equation.
86
But since we are using soft plus for the activation function, we plug 2.14 into the soft plus equation.
87
And the log of 1 plus e raised to the 2.14 power is 2.25.
88
Note, in statistics, machine learning, and most programming languages, the log function implies the natural log, or the log base e.
89
Anyway, the y-axis coordinate for the activation function is 2.25.
90
So let's extend this y-axis up a little bit, and put a blue dot at 2.25 for when dosage equals 0.
91
Now, if we increase the dosage a little bit and plug 0.1 into the input,
92
the x-axis coordinate for the activation function is negative 1.3,
93
and the corresponding y-axis value is 0.24.
94
So let's put a blue dot at 0.24 for when dosage equals 0.1.
95
And if we continue to increase the dosage values all the way to 1, the maximum dosage, we get this blue curve.
96
Note, before we move on, I want to point out
97
that the full range of dosage values from 0 to 1
98
corresponds to this relatively narrow range of values from the activation function function.
99
In other words, when we plug dosage values from 0 to 1 into the neural network,
100
and then multiply them by negative 34.4 and add 2.14,
101
we only get x-axis coordinates that are within the red box.
102
And thus, only the corresponding y-axis values in the red box are used to make this new blue curve.
103
Bam!
104
Now we scale the y-axis values for the blue curve by negative 1.3.
105
For example, when dosage equals zero, the current y-axis coordinate for the blue curve is 2.25.
106
So we multiply 2.25 by negative 1.3 and get negative 2.93.
107
and negative 2.93 corresponds to this position on the y-axis.
108
Likewise, we multiply all of the other y-axis coordinates on the blue curve by negative 1.3,
109
and we end up with a new blue curve.
110
BAM!
111
Now let's focus on the connection from the input node to the bottom node in the hidden layer.
112
However, this time we multiply the dosage by negative 2.52 instead of negative 34.4,
113
and we add 1.29 instead of 2.14 to get the x-axis coordinate for the activation function.
114
Remember, these values come from fitting the neural network to the data with backpropagation, and we'll talk about that in Part 2 in this series.
115
Now, if we plug the lowest dosage, 0, into the neural network,
116
then the x-axis coordinate for the activation function is 1.29.
117
Now we plug 1.29 into the activation function to get the corresponding y-axis value, and get 1.53.
118
And that corresponds to this yellow dot.
119
Now we just plug in dosage values from 0 to 1 to get the corresponding y-axis values.
120
And we get this orange curve.
121
Note, just like before, I want to point out that the full range of dosage values from 0 to 1
122
corresponds to this narrow range of values from the activation function.
123
In other words, when we plug dosage values from 0 to 1 into the neural network,
124
we only get X-axis coordinates that are within the red box.
125
And thus, only the corresponding y-axis values in the red box are used to make this new orange curve.
126
So we see that fitting a neural network to data gives us different parameter estimates on the connections,
127
And that results in each node in the hidden layer using different portions of the activation functions
128
to create these new and exciting shapes.
129
Now, just like before, we scale the Y-axis coordinates on the orange curve.
130
Only this time, we scale by a positive number, 2.28.
131
Boop, boop, boop, boop, boop, boop.
132
And that gives us this new orange curve.
133
Now the neural network tells us to add the y-axis coordinates from the blue curve to the orange curve.
134
And that gives us this green squiggle.
135
Then, finally, we subtract 0.58 from the y-axis values on the green squiggle.
136
And we have a green squiggle that fits the data.
137
Bam!
138
Now, if someone comes along and says that they are using dosage equal to 0.5,
139
we can look at the corresponding y-axis coordinate on the green squiggle and see that the dosage will be effective.
140
Or, we can solve for the y-axis coordinate by plugging dosage equals 0.5 into the neural network, and do the math.
141
Biddup boop boop boop boop boop boop
142
And we see that the y-axis coordinate on the green squiggle is 1.03.
143
And since 1.03 is closer to 1 than 0, we will conclude that a dosage equal to 0.5 is effective.
144
Double bam!
145
Now, if you've made it this far, you may be wondering why this is called a neural network, instead of a big fancy squiggle-fitting machine.
146
The reason is that way back in the 1940s and 50s, when neural networks were invented, they thought the nodes were vaguely like neurons,
147
and the connections between the nodes were sort of like synapses.
148
However, I think they should be called big, fancy squiggle-fitting machines, because that's what they do.
149
Whether or not you call it a squiggle-fitting machine, the parameters that we multiply are called weights.
150
and the parameters that we add are called biases.
151
Note, this neural network starts with two identical activation functions, but the weights and biases on the connections slice them,
152
flip them, and stretch them into new shapes, which are then added together to get a squiggle that is entirely new,
153
and then the squiggle is shifted to fit the data.
154
Now, if we can create this green squiggle with just two nodes in a single hidden layer,
155
just imagine what types of green squiggles we could fit with more hidden layers and more nodes in each hidden layer.
156
In theory, neural networks can fit a green squiggle to just about any data set, no matter how complicated.
157
And I think that's pretty cool.
158
Triple bam!
159
Now it's time for some shameless self-promotion.
160
If you want to review statistics and machine learning offline, check out the StatQuest study guides at StatQuest.org.
161
There's something for everyone.
162
Hooray!
163
We've made it to the end of another exciting StatQuest.
164
If you like this StatQuest and want to see more, please subscribe.
165
And if you want to support StatQuest, consider contributing to my Patreon campaign,
166
becoming a channel member, buying one or two of my original songs or a t-shirt or a hoodie, or just donate.
167
The links are in the description below.
168
Alright, until next time, quest on!
App downloaden
Alles wat je nodig hebt om vloeiend te spreken
AI UitspraakScoor elke zin
IPA OefeningBeheers elk geluid
WoordenschatBouw je woordenschat op
WoordenspelLeren terwijl je speelt
Zelfde Kanaal
C17
Gaussian Naive Bayes, Clearly Explained!!!
Daily ConversationUniversity Students
C11
Naive Bayes, Clearly Explained!!!
Daily ConversationUniversity Students
C12
The GELU, SiLU and SwiGLU activation functions, clearly explained!!!
Daily ConversationUniversity Students
C11
A Gentle Introduction to Machine Learning
Business EnglishUniversity StudentsWorking Adults
FOR YOU
Aanbevolen Video
C19
38 zinnen
The Neuroscience of Learning
Business EnglishUniversity StudentsWorking Adults
C12
224 zinnen
What is Statistics? A Beginner's Guide to Statistics (Data Analytics)!
Business EnglishUniversity StudentsWorking Adults
C11
127 zinnen
The Alignment Problem Explained: Crash Course Futures of AI #4
Business EnglishDaily ConversationUniversity Students
C12
97 zinnen
Vectors | Chapter 1, Essence of linear algebra
American AccentBusiness EnglishUniversity StudentsWorking Adults
C12
12 zinnen
A Return to Code
Business EnglishUniversity StudentsWorking Adults
C148
8 zinnen
Neurosymbolic AI Explained
Business EnglishUniversity StudentsWorking Adults
C18
41 zinnen
Design Thinking 101
Business EnglishUniversity StudentsWorking Adults
C12
33 zinnen
PyTorch in 100 Seconds
American AccentBusiness EnglishUniversity StudentsWorking Adults
C28
129 zinnen
But what is a neural network? | Deep learning chapter 1
American AccentBusiness EnglishUniversity StudentsWorking Adults
C12
357 zinnen
Food & Supplements for Brain Health & Cognitive Performance | Huberman Lab Essentials
Business EnglishUniversity StudentsWorking Adults
C12
41 zinnen
Mathematical Statistics and the Theory of Probability in Casinos
Business EnglishUniversity StudentsWorking Adults
Woordenschat en spreektips bij deze les
Deze spreekles op niveau C1 is gebaseerd op de video “The Essential Main Ideas of Neural Networks”. Deze woorden komen het vaakst terug: neural, network, dosage, node, function. Deze video bevat 168 zinnen en 2283 woorden om na te spreken. Het gesproken deel duurt 18:53. De spreker praat in een gelijkmatig tempo van ongeveer 121 woorden per minuut, prettig om te shadowen. Slechts 75% van de woorden hoort bij de 3.000 meest gebruikte Engelse woorden, dus de woordenschat is pittig.
Belangrijke woorden in deze video
De 15 moeilijkste woorden uit de video, met uitspraak en betekenis:
| Woord | Uitspraak | Betekenis |
|---|---|---|
| neural bijvoeglijk naamwoord | /ˈnʊɹəl/ | neuraal |
| dosage zelfstandig naamwoord | /ˈdəʊsɪd͡ʒ/ | dosering |
| axis zelfstandig naamwoord | /ˈæksɪs/ | as |
| coordinate werkwoord | /koʊˈɔɹ.dəˌneɪt/ | coördineren |
| correspond werkwoord | /ˌkoɹəˈspɑnd/ | corresponderen |
| multiply werkwoord | /ˈmʌltɪplaɪ/ | vermenigvuldigen |
| equation zelfstandig naamwoord | /ɪˈkweɪ.ʒən/ | vergelijking |
| predict werkwoord | /pɹɪˈdɪkt/ | voorspellen |
| excite werkwoord | /ɪkˈsaɪt/ | prikkelen, opwinden |
| terminology zelfstandig naamwoord | /ˌtɝ.məˈnɑ.lə.d͡ʒi/ | terminologie |
| algorithm zelfstandig naamwoord | /ˈælɡəɹɪðm̩/ | algoritme |
| likewise bijwoord | /ˈlaɪkˌwaɪz/ | evenzo, eveneens |
| graph zelfstandig naamwoord | /ɡɹæf/ | grafiek |
| analogous bijvoeglijk naamwoord | /əˈnæl.ə.ɡəs/ | analoog, analoge |
| neuron zelfstandig naamwoord | /ˈn(j)ʊɹɑn/ | neuron, zenuwcel |
Phrasal verbs die je zult horen
| Woord | Betekenis |
|---|---|
| point out werkwoord | aanwijzen, aanduiden |
| break down werkwoord | stukgaan, kapot gaan |
| check out werkwoord | onderzoeken |
Grammatica in deze video
De structuren die de spreker het meest gebruikt, met de exacte woorden uit de video:
| Structuur | In de video |
|---|---|
| Lijdende vorm be + voltooid deelwoord — het gaat om wat er gebeurt, niet om wie het doet | was designed · are set · were estimated |
| Present perfect have/has + voltooid deelwoord — iets uit het verleden dat nu nog telt | have already estimated · have curved · you've made |
| Betrekkelijke bijzinnen who / which + zin — extra informatie over een persoon of ding | RelU, which is · shapes, which are |
Uitspraak om op te letten
De spreker gebruikt 14 samentrekkingen en verkorte vormen, zoals we'll, I'm, they're. Spreek ze kort uit, zoals je ze hoort.
- De “th”-klanken: algorithm /ˈælɡəɹɪðm̩/, thumb /ˈθʌm/, mathematical /ˌmæθ(.ə)ˈmæt.ɪ.kəl/
- De klanken “sh” en “zh”: activation /ˌæktəˈveɪʃən/, equation /ɪˈkweɪ.ʒən/, notation /noʊˈteɪʃən/, reshape /ɹiːˈʃeɪ̯p/, shameless /ˈʃeɪ̯mlɪs/
- Lange woorden — let op de klemtoon: activation /ˌæktəˈveɪʃən/, coordinate /koʊˈɔɹ.dəˌneɪt/, parameter /pəˈɹæm.ə.tɚ/, terminology /ˌtɝ.məˈnɑ.lə.d͡ʒi/, analogous /əˈnæl.ə.ɡəs/
Klanken die Nederlandstaligen lastig vinden:
- Stemhebbende eindmedeklinker — /b/, /d/, /g/, /z/, /v/ niet verscherpen: dosage /ˈdəʊsɪd͡ʒ/, node /noʊd/, correspond /ˌkoɹəˈspɑnd/, sigmoid /ˈsɪɡ.mɔɪd/, likewise /ˈlaɪkˌwaɪz/
- /æ/ — opener dan de Nederlandse “e”: axis /ˈæksɪs/, activation /ˌæktəˈveɪʃən/, parameter /pəˈɹæm.ə.tɚ/, algorithm /ˈælɡəɹɪðm̩/, graph /ɡɹæf/
- /g/ — een harde plofklank, geen Nederlandse “g”: squiggle /ˈskwɪɡl̩/, sigmoid /ˈsɪɡ.mɔɪd/, algorithm /ˈælɡəɹɪðm̩/, graph /ɡɹæf/, analogous /əˈnæl.ə.ɡəs/
Zo oefen je met deze video
- Luister de hele video één keer zonder te spreken en noteer de woorden die je niet kent.
- Spreek zin voor zin na op normale snelheid en herhaal elke zin tot je ritme gelijk is aan dat van de spreker.
- Neem jezelf op en vergelijk met het origineel; let daarbij op woorden als neural, dosage, axis.
Wat is de Shadowing-techniek?
Shadowing is een wetenschappelijk onderbouwde taalleermethode die oorspronkelijk is ontwikkeld voor professionele tolkentraining en gepopulariseerd door polyglot Dr. Alexander Arguelles. De methode is eenvoudig maar krachtig: je luistert naar native Engelse audio en herhaalt het onmiddellijk hardop — als een schaduw die de spreker volgt met slechts 1–2 seconden vertraging. In tegenstelling tot passief luisteren of grammaticadrills, dwingt shadowing je hersenen en mondspieren om echte spraakpatronen tegelijkertijd te verwerken en te reproduceren. Onderzoek toont aan dat het de uitspraaknauwkeurigheid, intonatie, ritme, verbonden spraak, luisterbegrip en spreekvaardigheid aanzienlijk verbetert — waardoor het een van de meest effectieve methoden is voor IELTS Speaking-voorbereiding en echte Engelse communicatie.