シャドーイング練習: ChatGPT vs. IELTS Examiner: Writing - 動画で英語スピーキングを学ぶ

練習モードを選ぶ

各モードは全画面の練習ルームで開きます。

136 文
文が短すぎたり長すぎる場合は、Editをタップして調整してください。
1
Over the past few months I've been testing Chagipity and other language models to see if they can act like IELTS examiners.
2
For this video I took 30 real essays and compared AI band scores to real examiner scores.
3
So let's look at what happened and what it means for your preparation.
4
It all started when I received this message from Maria.
5
I've been preparing for my IELTS for five months.
6
But I think I'm gonna fail my exam anyway.
7
I get bent eight or nine in listening and reading.
8
But writing almost never reaches span seven.
9
I must score a seven everywhere to start my master's in September.
10
What can I do?
11
Well, Marie had been using chat APT to check how good her essays were
12
and i decided to do the same i took one of her essays
13
and gave this prompt to chat gpt
14
you are an experienced ielts examiner who assesses ielts writing task
15
2 essays using the ielts band descriptors give me the band scores for the four assessment criteria
16
and the overall task 2 band score.
17
I posted the essay and the result stunned me.
18
Task response or how well you respond to the task band 6.
19
Coherence and cohesion or the flow and structure of your essay band 6.
20
Lexical resource or vocabulary band 6.
21
Grammar and overall band 6.
22
Are you sure this score is so low?
23
I asked.
24
And ChattyPT gave me a full explanation of why it couldn't possibly be any higher.
25
So I sent the same essay using the same prompt to several other language models.
26
Claude gave a band 7 for task response and coherence and cohesion but only band 6 for vocabulary and grammar,
27
which resulted in an overall 6 .5.
28
DeepSeek was more generous, giving a band 7.
29
Gemini also landed at a band 6.
30
And since I have a paid subscription for Chagipity, I could test its latest 4 .5 model with more advanced reasoning,
31
or at least definitely the slowest model.
32
And that one gave a band 7.
33
To be honest, none of that looked right to me.
34
So we decided to conduct a more thorough experiment and see if AI can actually give accurate scores,
35
which models perform better, and if the scores are wrong, are they usually too high or too low.
36
A St. Marie's essay to a former IELTS examiner on our team and while I was waiting.
37
I found 27 essays from Cambridge practice tests so books like that
38
and all the essays are graded by official IELTS examiners as you can see each essay comes with a score
39
and examiner's notes so I uploaded these essays into chat apt one by one
40
and what I found could save you weeks of or wasted preparation.
41
So let's take the first essay and upload it with the same prompt as before.
42
So chattypt thinks it's a band 6 but I see two problems.
43
So first the grammar score is listed as 5 .5
44
but in IELTS you can only get a band 5 or band 6 for each criterion not 5 .5.
45
So this would be a band 5.
46
And the overall score wouldn't be a 6 either.
47
To get a band 6 overall you need at least a 6 in each criterion.
48
But in any case the examiner's score for this essay is a band 7, not a 6.
49
Next essay, band 5 .5 according to HRGPT, but again the examiner gave it a 7.
50
And that's a huge difference.
51
Essay 3.
52
So Chair GPT says band 5.
53
Yet once again this is a band 7.
54
Now look at this one.
55
Chair GPT calls it a 5 .5 but the examiner's score is a band 8.
56
That's a two and a half band difference
57
and I'm going to show you the essay on the screen it's really good how could it possibly be 5 .5
58
At this point I started wondering whether it even made sense to continue.
59
Every essay I'd sent so far had been undervalued by at least one full band
60
and in some cases by two and a half bands.
61
But then I realized something.
62
Maybe the scores dropped after I told chat GPT not to use half bands when marking individual criteria.
63
So I started a brand new chat with just the initial prompt and things began to improve.
64
Suddenly there was a correct score band 6
65
when it was really a band 6
66
and overall these scores were now mostly just half a band lower than they should be which
67
Which honestly isn't bad for a language model compared to a trained human examiner.
68
But here's the thing.
69
Not a single essay got a score higher than it deserved.
70
The result was either accurate or too low.
71
That said, this wasn't a perfect experiment.
72
Most of the essays were between bands 5 and 7.
73
Only one was a band 8 and none were a band 9.
74
but we really want to know if you write a brilliant essay band 8
75
or 9 will chat gpt recognize it or any other language model
76
so i took my own essay and another written by one of our examiners
77
and tested them exactly the same way i tested maria's essay first
78
i sent both to a different former examiner for scoring not the author to avoid any conflict of interest
79
and let's start with my essay then kevin's
80
and finally see how the other examiner scored all three of us including maria
81
so let me send my essay to chdpt okay a band 8 for task response band 8 for coherence
82
Basically a band 8 for the whole essay.
83
Well that's more inspiring.
84
What if we try the smartest model 4 .5?
85
Is it gonna be any different?
86
Actually no it's still a band 8 but with a band 9 for grammar so thank you very much.
87
And now Claude.
88
I know a lot of people love it so I thought we should definitely check it.
89
Okay, so it gave me event 7 for vocabulary and grammar and 7 .5 overall.
90
Not exactly the kind of examiner I'd want in my test.
91
I got an 8 .5 in the real exam and this essay better.
92
What about Deep Seek?
93
To be honest it's my first time using it.
94
A vent 8. And Gemini?
95
Oh really?
96
A vent 7?
97
Oh wait look!
98
It gave a vent 7 in every criterion but the overall score is 7 .5.
99
Gemini why how does it even work well it gave a long reply
100
and to be honest it's total rubbish
101
it's not even worth reading to you it seems i'm feeling a bit protective of my essay
102
so let's take Kevin's essay and see how well our examiner did it should be fun so chatty bitty band eight
103
And this smarter model.. hmm, that's also a band 8.
104
It's quite strange actually.
105
I did them all and Kevin's essay got exactly the same scores as mine.
106
How is it possible when two different people wrote them?
107
I'm not sure.
108
But the key question is what did our other examiner award us?
109
So my essay scored between 8 .5 and 9 and Kevin's got 8 .5.
110
I didn't tell the other examiner whose essays they were,
111
I just sent them as 1 -2 -3 and Kevin if you're watching this 8 .5 is a fantastic score.
112
So it seems that for essays with really high scores language models do give relatively high scores.
113
But there is one more score left and the one that matters most.
114
Maria's essay.
115
The whole reason why we started this experiment.
116
And Maria's essay got an 8.
117
Imagine you are writing band 8 essays but every time you check with Chagipity it tells you you're band 6.
118
What would bad due to your motivation and Maria isn't the only one either here is another message I received
119
This candidate also got 6 .5 to 7 by CHAT -EPT, but an 8 in a real exam.
120
So, what can we take away from this?
121
First of all, AI tends to underrate essays rather than overrate them.
122
This means if you are relying on AI feedback, you might think you are doing worse than you really are.
123
2. The gap is the biggest for mid -band essays.
124
So band 5 and 6 essays were sometimes pretty close, maybe half a band off.
125
But 7 and 8 essays were often underrated by one or even two full bands.
126
3. AI can recognize quality, it knows when an essay is good.
127
But it really struggles to award those top -level scores.
128
And AI doesn't follow IELTS scoring rules correctly, like using half -bands when they don't even exist.
129
And finally, the results vary a lot between models.
130
So use AI to check your vocabulary and grammar, or get help with ideas and flow.
131
But don't rely on it for scoring.
132
Instead, learn the requirements examiners use for yourself
133
and I go through every single one of them while writing a full answer in this video here.
134
And thank you so much for watching me today.
135
Good luck with your preparation and your exam.
136
Bye!

アプリをダウンロード

流暢に話すために必要なすべて

AI発音採点文ごとに採点
IPA練習すべての音をマスター
単語学習自分の単語帳を作る
単語ゲーム遊びながら覚える

同じチャンネル

FOR YOU

おすすめ動画

このレッスンの語彙とスピーキングのポイント

このスピーキングレッスンは、動画「ChatGPT vs. IELTS Examiner: Writing」を教材にしています。 繰り返し出てくる語は次のとおりです:band, essay, score, examiner, model。 この動画には、シャドーイング用の文が136文、単語が1452語あります。 音声の長さは11:39です。 話す速さは1分あたり約125語で安定しており、シャドーイングしやすいペースです。 英語の頻出3,000語に含まれる単語は78%だけなので、語彙は難しめです。

この動画の重要語彙

動画に出てくる覚えておきたい単語15語を、発音と意味つきで紹介します。

単語発音意味
essay 名詞/ˈɛs.eɪ/エッセイ, 随筆
grammar 名詞/ˈɡɹæm.ə(ɹ)/文法
examination 名詞/ɪɡˌzæm.ɪˈneɪ.ʃən/診察, 検査
vocabulary 名詞/vəˈkæb.jə.lə.ɹi/語彙, 語彙力
experiment 名詞/ɪkˈspɛɹ.ə.mənt/実験
preparation 名詞/ˌpɹɛpəˈɹeɪʃ(ə)n/準備, 支度
ventilation 名詞/ˌvɛntɪˈleɪʃ(ə)n/通風, 換気
compare 動詞/kəmˈpɛɚ/比べる, 比較する
rely 動詞/ɹɪˈlaɪ/頼る, あてにする
upload 動詞/ˈʌpˌloʊd/アップロードする
assessment 名詞/əˈsɛsmənt/評価
explanation 名詞/ˌɛkspləˈneɪʃən/説明
resource 名詞/ɹɪˈzɔːs/資源, 資産
spin 動詞/spɪn/回転する
feedback 名詞/ˈfiːdˌbæk/フィードバック, 反応

繰り返し練習したい文

動画に出てくる短く完結した文です。日常会話でそのまま使えます。

  • What can I do?
  • Are you sure this score is so low?
  • To be honest it's my first time using it.

この動画の文法

話し手がよく使っている文型を、動画の実際の表現とともに紹介します。

文型動画での表現
現在完了進行形 have/has been + -ing — 以前に始まり今も続いている動作I've been testing · I've been preparing
受動態 be + 過去分詞 — 誰がするかより、何が起きるかに焦点を当てるare graded · is listed · had been undervalued

注意したい発音

話し手はI'm, don't, gonnaなど、短縮形や弱形を21回使っています。聞こえたとおりの短い形で発音しましょう。

  • 「sh」と「zh」の音: examination /ɪɡˌzæm.ɪˈneɪ.ʃən/, preparation /ˌpɹɛpəˈɹeɪʃ(ə)n/, ventilation /ˌvɛntɪˈleɪʃ(ə)n/, explanation /ˌɛkspləˈneɪʃən/, motivation /ˈmoʊ.tə.veɪ.ʃən/
  • 長い単語(アクセントの位置に注意): examiner /əɡˈzæmɪnɚ/, examination /ɪɡˌzæm.ɪˈneɪ.ʃən/, vocabulary /vəˈkæb.jə.lə.ɹi/, experiment /ɪkˈspɛɹ.ə.mənt/, preparation /ˌpɹɛpəˈɹeɪʃ(ə)n/

日本語話者が苦手な音:

  • /r/ と /l/ の区別 — /l/ は舌先を歯茎につけ、/r/ はどこにもつけない: vocabulary /vəˈkæb.jə.lə.ɹi/, rely /ɹɪˈlaɪ/, correctly /kəˈɹɛk(t).li/, undervalue /ˌʌndə(ɹ)ˈvælju/
  • /v/ — /b/ にならないように、上の歯を下唇に当てる: vocabulary /vəˈkæb.jə.lə.ɹi/, ventilation /ˌvɛntɪˈleɪʃ(ə)n/, vary /ˈvɛəɹi/, motivation /ˈmoʊ.tə.veɪ.ʃən/, protective /pɹəˈtɛk.tɪv/
  • 子音の連続 — 間に母音を入れない: bind /ˈbaɪ̯nd/, grammar /ˈɡɹæm.ə(ɹ)/, prompt /pɹɑmpt/, experiment /ɪkˈspɛɹ.ə.mənt/, preparation /ˌpɹɛpəˈɹeɪʃ(ə)n/

この動画での練習方法

  1. まず声を出さずに動画を最後まで聞き、知らない単語をメモします。
  2. 通常の速度で一文ずつシャドーイングし、話し手のリズムに合うまで繰り返します。
  3. 自分の声を録音して元の音声と比べます。essay, grammar, examinationなどの単語に特に注意しましょう。

シャドーイングとは?英語上達に効果的な理由

シャドーイング(Shadowing)は、もともとプロの通訳者養成プログラムで開発された言語学習法で、多言語習得者として知られるDr. Alexander Arguelles によって広く普及されました。方法はシンプルですが非常に効果的:ネイティブスピーカーの英語を聞きながら、1〜2秒の遅延で声に出してすぐに繰り返す——まるで「影(shadow)」のように話者を追いかけます。文法ドリルや受動的なリスニングと異なり、シャドーイングは脳と口の筋肉が同時にリアルタイムで英語を処理・再現することを強制します。研究により、発音精度、抑揚、リズム、連音、リスニング力、そして会話の流暢さが大幅に向上することが確認されています。IELTSスピーキング対策や自然な英語コミュニケーションを目指す方に特におすすめです。

シャドーイングのやり方: ステップ別の完全ガイドを読む →