シャドーイング練習: Large Language Models explained briefly - 動画で英語スピーキングを学ぶ
練習モードを選ぶ
各モードは全画面の練習ルームで開きます。
81 文
文が短すぎたり長すぎる場合は、Editをタップして調整してください。
1
Imagine you happen across a short movie script that describes a scene between a person and their AI assistant.
2
The script has what the person asks the AI.
そのスクリプトには、その人がAIに求める内容が記載されています。
3
but the AI's response has been torn off.
しかしAIの回答は切り取られています。
4
Suppose you also have this powerful magical machine that can take any text
仮に、あなたがどんなテキストでも受け取れるこの強力な魔法の機械を持っているとしましょう。
5
and provide a sensible prediction of what word comes next.
次に来る単語について、妥当な予測を提供してください。
6
You could then finish the script by feeding in what you have to the machine, seeing what it would predict to start the AI's answer,
それから、手持ちの情報をマシンに入力して、AI の回答の出だしとして何が予測されるかを確認することで、スクリプトを完成させることができます。
7
and then repeating this over and over with a growing script completing the dialogue.
そして、対話を完成させるために、スクリプトをどんどん増やしながらこれを何度も繰り返していきます。
8
When you interact with a chatbot, this is exactly what's happening.
9
A large language model is a sophisticated mathematical function that predicts what word comes next for any piece of text.
10
Instead of predicting one word with certainty, though, what it does is assign a probability to all possible next words.
11
to build a chatbot.
12
What you do is lay out some text that describes an interaction between a user and a hypothetical AI assistant,
13
You add on whatever the user types in as the first part of that interaction,
14
And then you have the model repeatedly predict the next word that such a hypothetical AI assistant would say in response, and that's what's presented to the user.
15
In doing this, the output tends to look a lot more natural
16
if you allow it to select less likely words along the way at random.
17
So what this means is even though the model itself is deterministic, A given prompt typically gives a different answer each time it's run.
18
Models learn how to make these predictions by processing an enormous amount of text, typically pulled from the internet.
19
For a standard human to read the amount of text that was used to train GPT -3, for example, if they read "non -stop, 24 /7," it would take over 2600 years.
20
Larger models since then train on much, much more.
21
You can think of training a little bit like tuning the dials on a big machine.
22
The way that a language model behaves is entirely determined by these many different continuous values, usually called parameters or weights.
23
Changing those parameters will change the probabilities that the model gives for the next word on a given input.
24
What puts the "large" in large language model is how they can have hundreds of billions of these parameters.
25
you No human ever deliberately sets those parameters.
26
Instead, they begin at random, meaning the model just outputs gibberish, but they are repeatedly refined based on many example pieces of text.
27
One of these training examples could be just a handful of words, or it could be thousands, but in either case, the way this works is to pass in all
28
but the last word from that example into the model, and compare the prediction that it makes with the true last word from the example.
29
An algorithm called backpropagation is used to tweak all of the parameters in such a way
30
that it makes the model a little more likely to choose the true last word
31
and a little less likely to choose all the others.
32
When you do this for many, many trillions of examples, Not only does the model start to give more accurate predictions on the training data,
33
but it also starts to make more reasonable predictions on text that it's never seen before.
34
Given the huge number of parameters and the enormous amount of training data, The scale of computation involved in training a large language model is mind -boggling.
35
To illustrate, imagine that you could perform 1 billion additions and multiplications every single second.
36
How long do you think it would take for you to
37
do all of the operations involved in training the largest language models?
38
Do you think it would take a year?
39
Maybe something like 10 ,000 years?
40
The answer is actually much more than that.
41
It's well over 100 million years.
42
you This is only part of the story, though.
43
This whole process is called pre -training.
44
The goal of auto -completing a random passage of text from the internet
45
is very different from the goal of being a good AI assistant.
46
To address this, chatbots undergo another type of training, just as important, called reinforcement learning with human feedback.
47
Workers flag unhelpful or problematic predictions, and their corrections further change the model's parameters,
48
making them more likely to give predictions that users prefer.
49
Looking back at the pre -training though, this staggering amount of computation is only made possible by using special computer chips
50
that are optimized for running many many operations in parallel, known as GPUs.
51
However, not all language models can be easily parallelized.
52
Prior to 2017, most language models would process text one word at a time.
53
But then, a team of researchers at Google introduced a new model known as the Transformer.
54
Transformers don't read text from the start to the finish.
55
they soak it all in at once, in parallel.
56
The very first step inside a transformer, and most other language models for that matter, is to associate each word with a long list of numbers.
57
The reason for this is that the training process only works with continuous values, so you have to somehow encode language using numbers.
58
and each of these list of numbers may somehow encode the meaning of the corresponding word.
59
What makes Transformers unique is their reliance on a special operation known as attention.
60
This operation gives all of these lists of numbers a chance to talk to one another, and refine the meanings that they encode based on the context around, all done in parallel.
61
For example, the numbers encoding the word "bank" might be changed based on the context surrounding it, to somehow encode the more specific notion of a riverbank.
62
Transformers typically also include a second type of operation, known as a feed -forward neural network,
63
and this gives the model extra capacity to store more patterns about language learned during training.
64
All of this data repeatedly flows through many different iterations of these two fundamental operations.
65
And as it does so, the hope is
66
that each list of numbers is enriched to encode whatever information
67
might be needed to make an accurate prediction of what word follows in the passage.
68
At the end, one final function is performed on the last vector in this sequence, which now has had a chance to be influenced by all the other context from the input text,
69
as well as everything the model learned during training, to produce a prediction of the next word.
70
Again, the model's prediction looks like a probability for every possible next word.
71
Although researchers design the framework for how each of these steps work, it's important to understand
72
that the specific behavior is an emergent phenomenon based on how those hundreds of billions of parameters are tuned during training.
73
This makes it incredibly challenging to determine why the model makes the exact predictions that it does.
74
What you can see is that when you use large language model predictions to autocomplete a prompt,
75
the words that it generates are uncannily fluent, fascinating, and even useful.
76
If you're a new viewer and you're curious about more details on how transformers and attention work, boy do I have some material for you.
77
One option is to jump into a series I made about deep learning, where we visualize and motivate the details of attention and all the other steps in a transformer.
78
But also, on my second channel I just posted a talk
79
that I gave a couple months ago about this topic for the company TNG in Munich.
80
Sometimes I actually prefer the content that I make as a casual talk rather than a produced video, but I leave it up to you which one of these feels like the better follow on.
81
you you
アプリをダウンロード
流暢に話すために必要なすべて
AI発音採点文ごとに採点
IPA練習すべての音をマスター
単語学習自分の単語帳を作る
単語ゲーム遊びながら覚える
同じチャンネル
C1Differential equations, a tourist's guide | DE1
Daily ConversationUniversity Students
C12
Linear combinations, span, and basis vectors | Chapter 2, Essence of linear algebra
American AccentCambridge Exam PrepUniversity StudentsWorking Adults
C15
Fourier series
American AccentUniversity StudentsWorking Adults
C14
Euler's Formula Poem
American AccentIELTS PrepTOEFL PrepUniversity Students
C12
Vectors | Chapter 1, Essence of linear algebra
American AccentBusiness EnglishUniversity StudentsWorking Adults
C13
How might LLMs store facts | Deep Learning Chapter 7
American AccentIELTS PrepTOEFL PrepUniversity Students
C113
Essence of linear algebra preview
American AccentBusiness EnglishUniversity StudentsWorking Adults
C15
The inscribed square problem
American AccentUniversity StudentsWorking Adults
C14
The Newton art puzzle
American AccentUniversity StudentsWorking Adults
C15
Transformers, the tech behind LLMs | Deep Learning Chapter 5
American AccentBusiness EnglishUniversity StudentsWorking Adults
C12
Oh, wait, actually the best Wordle opener is not “crane”…
American AccentBusiness EnglishUniversity StudentsWorking Adults
C23
Hilbert's Curve: Is infinite math useful?
American AccentBusiness EnglishUniversity StudentsWorking Adults
C211
But what is a neural network? | Deep learning chapter 1
American AccentBusiness EnglishUniversity StudentsWorking Adults
C1But what is the Fourier Transform? A visual introduction.
Daily ConversationUniversity Students
C1Divergence and curl: The language of Maxwell's equations, fluid flow, and more
American AccentBusiness EnglishUniversity StudentsWorking Adults
C1But what is quantum computing? (Grover's Algorithm)
American AccentBusiness EnglishUniversity StudentsWorking Adults
C1Tie random ends: How many loops?
American AccentUniversity StudentsWorking Adults
FOR YOU
おすすめ動画
C12
105 文
Google’s AI Course for Beginners (in 10 minutes)!
American AccentBusiness EnglishUniversity StudentsWorking Adults
C111
102 文
World Models explained in 10min..
Business EnglishUniversity StudentsWorking Adults
B28
59 文
An ex-OpenAI researcher just deleted language from the LLM...
American AccentBusiness EnglishUniversity StudentsWorking Adults
B23
137 文
AI Agents, Clearly Explained
American AccentBusiness EnglishUniversity StudentsWorking Adults
C168
35 文
SEtalk: What a Second Language Does to Your Brain
American AccentIELTS PrepTOEFL PrepUniversity Students
C12
33 文
PyTorch in 100 Seconds
American AccentBusiness EnglishUniversity StudentsWorking Adults
C117
118 文
Computational Linguistics: Crash Course Linguistics #15
Business EnglishUniversity StudentsWorking Adults
C12
68 文
Prompt engineering - Introduction
Business EnglishUniversity StudentsWorking Adults
C11
125 文
Introduction to statistical prediction models
Daily ConversationUniversity Students
C11
143 文
MCP vs API: The protocol every developer needs to know
Business EnglishUniversity StudentsWorking Adults
コンテキストと背景
この動画では、大規模な言語モデルについての基本的な説明が行われています。特に、AIアシスタントとの対話を通じて、どのように言語モデルが次に来る言葉を予測するのかを詳しく解説しています。AIがどのように自然な応答を生成するのか、その背後にある数学的な機構についても触れています。英語を学ぶ君にとっては、この動画の内容を理解することで、英語の発音を良くする手助けとなるでしょう。
日常コミュニケーションのためのトップ5フレーズ
- “What do you think about this?” - このことについてどう思いますか？
- “Could you help me with this?” - これを手伝ってもらえますか？
- “I don't understand this part.” - この部分が理解できません。
- “Can you explain that further?” - それをもっと詳しく説明してもらえますか？
- “Let’s work on this together.” - これを一緒にやりましょう。
ステップバイステップ シャドーイングガイド
この動画の内容を効果的に学ぶためには、シャドーイング手法を活用することが重要です。以下のステップに従って、効率的にスキルを向上させましょう。
- 動画を視聴する: 最初に、全体を通して動画を視聴し、話の流れを把握します。このとき、特に気になるフレーズを書き留めておきましょう。
- フレーズを選ぶ: 上記のトップ5フレーズの中から、特に自分が使いたいフレーズに注目します。
- 音声に合わせてシャドーイング: 同じフレーズを繰り返し聞き、徐々に自分の声で復唱していきます。この際、発音やイントネーションにも意識を向けてください。
- 録音して確認: 自分の声を録音し、動画の音声と比較します。音の違いや改善点を見つける良い機会です。
- 反復練習: 繰り返し練習することで、内面的な理解が深まり、英語スピーキング練習における自信がつきます。
このように、YouTubeで英語学習を行いながら、実際の会話で使われる表現を習得し、英語の発音を良くするためにシャドーイングを活用していきましょう。各ステップを実行すれば、自然な会話力の向上が期待できます。
この動画の文法
話し手がよく使っている文型を、動画の実際の表現とともに紹介します。
| 文型 | 動画での表現 |
|---|---|
| 受動態 be + 過去分詞 — 誰がするかより、何が起きるかに焦点を当てる | has been torn · are repeatedly refined · is called |
| 現在完了形 have/has + 過去分詞 — 過去の出来事が今も関係している | has been torn · has had |
シャドーイングとは？英語上達に効果的な理由
シャドーイング（Shadowing）は、もともとプロの通訳者養成プログラムで開発された言語学習法で、多言語習得者として知られるDr. Alexander Arguelles によって広く普及されました。方法はシンプルですが非常に効果的：ネイティブスピーカーの英語を聞きながら、1〜2秒の遅延で声に出してすぐに繰り返す——まるで「影（shadow）」のように話者を追いかけます。文法ドリルや受動的なリスニングと異なり、シャドーイングは脳と口の筋肉が同時にリアルタイムで英語を処理・再現することを強制します。研究により、発音精度、抑揚、リズム、連音、リスニング力、そして会話の流暢さが大幅に向上することが確認されています。IELTSスピーキング対策や自然な英語コミュニケーションを目指す方に特におすすめです。