쉐도잉 연습: ChatGPT vs. IELTS Examiner: Writing - 영상으로 영어 말하기 배우기

연습 모드 선택

각 모드는 전체 화면 연습실로 열립니다.

136 문장
문장이 너무 짧거나 길면 Edit를 눌러 조정하세요.
1
Over the past few months I've been testing Chagipity and other language models to see if they can act like IELTS examiners.
2
For this video I took 30 real essays and compared AI band scores to real examiner scores.
3
So let's look at what happened and what it means for your preparation.
4
It all started when I received this message from Maria.
5
I've been preparing for my IELTS for five months.
6
But I think I'm gonna fail my exam anyway.
7
I get bent eight or nine in listening and reading.
8
But writing almost never reaches span seven.
9
I must score a seven everywhere to start my master's in September.
10
What can I do?
11
Well, Marie had been using chat APT to check how good her essays were
12
and i decided to do the same i took one of her essays
13
and gave this prompt to chat gpt
14
you are an experienced ielts examiner who assesses ielts writing task
15
2 essays using the ielts band descriptors give me the band scores for the four assessment criteria
16
and the overall task 2 band score.
17
I posted the essay and the result stunned me.
18
Task response or how well you respond to the task band 6.
19
Coherence and cohesion or the flow and structure of your essay band 6.
20
Lexical resource or vocabulary band 6.
21
Grammar and overall band 6.
22
Are you sure this score is so low?
23
I asked.
24
And ChattyPT gave me a full explanation of why it couldn't possibly be any higher.
25
So I sent the same essay using the same prompt to several other language models.
26
Claude gave a band 7 for task response and coherence and cohesion but only band 6 for vocabulary and grammar,
27
which resulted in an overall 6 .5.
28
DeepSeek was more generous, giving a band 7.
29
Gemini also landed at a band 6.
30
And since I have a paid subscription for Chagipity, I could test its latest 4 .5 model with more advanced reasoning,
31
or at least definitely the slowest model.
32
And that one gave a band 7.
33
To be honest, none of that looked right to me.
34
So we decided to conduct a more thorough experiment and see if AI can actually give accurate scores,
35
which models perform better, and if the scores are wrong, are they usually too high or too low.
36
A St. Marie's essay to a former IELTS examiner on our team and while I was waiting.
37
I found 27 essays from Cambridge practice tests so books like that
38
and all the essays are graded by official IELTS examiners as you can see each essay comes with a score
39
and examiner's notes so I uploaded these essays into chat apt one by one
40
and what I found could save you weeks of or wasted preparation.
41
So let's take the first essay and upload it with the same prompt as before.
42
So chattypt thinks it's a band 6 but I see two problems.
43
So first the grammar score is listed as 5 .5
44
but in IELTS you can only get a band 5 or band 6 for each criterion not 5 .5.
45
So this would be a band 5.
46
And the overall score wouldn't be a 6 either.
47
To get a band 6 overall you need at least a 6 in each criterion.
48
But in any case the examiner's score for this essay is a band 7, not a 6.
49
Next essay, band 5 .5 according to HRGPT, but again the examiner gave it a 7.
50
And that's a huge difference.
51
Essay 3.
52
So Chair GPT says band 5.
53
Yet once again this is a band 7.
54
Now look at this one.
55
Chair GPT calls it a 5 .5 but the examiner's score is a band 8.
56
That's a two and a half band difference
57
and I'm going to show you the essay on the screen it's really good how could it possibly be 5 .5
58
At this point I started wondering whether it even made sense to continue.
59
Every essay I'd sent so far had been undervalued by at least one full band
60
and in some cases by two and a half bands.
61
But then I realized something.
62
Maybe the scores dropped after I told chat GPT not to use half bands when marking individual criteria.
63
So I started a brand new chat with just the initial prompt and things began to improve.
64
Suddenly there was a correct score band 6
65
when it was really a band 6
66
and overall these scores were now mostly just half a band lower than they should be which
67
Which honestly isn't bad for a language model compared to a trained human examiner.
68
But here's the thing.
69
Not a single essay got a score higher than it deserved.
70
The result was either accurate or too low.
71
That said, this wasn't a perfect experiment.
72
Most of the essays were between bands 5 and 7.
73
Only one was a band 8 and none were a band 9.
74
but we really want to know if you write a brilliant essay band 8
75
or 9 will chat gpt recognize it or any other language model
76
so i took my own essay and another written by one of our examiners
77
and tested them exactly the same way i tested maria's essay first
78
i sent both to a different former examiner for scoring not the author to avoid any conflict of interest
79
and let's start with my essay then kevin's
80
and finally see how the other examiner scored all three of us including maria
81
so let me send my essay to chdpt okay a band 8 for task response band 8 for coherence
82
Basically a band 8 for the whole essay.
83
Well that's more inspiring.
84
What if we try the smartest model 4 .5?
85
Is it gonna be any different?
86
Actually no it's still a band 8 but with a band 9 for grammar so thank you very much.
87
And now Claude.
88
I know a lot of people love it so I thought we should definitely check it.
89
Okay, so it gave me event 7 for vocabulary and grammar and 7 .5 overall.
90
Not exactly the kind of examiner I'd want in my test.
91
I got an 8 .5 in the real exam and this essay better.
92
What about Deep Seek?
93
To be honest it's my first time using it.
94
A vent 8. And Gemini?
95
Oh really?
96
A vent 7?
97
Oh wait look!
98
It gave a vent 7 in every criterion but the overall score is 7 .5.
99
Gemini why how does it even work well it gave a long reply
100
and to be honest it's total rubbish
101
it's not even worth reading to you it seems i'm feeling a bit protective of my essay
102
so let's take Kevin's essay and see how well our examiner did it should be fun so chatty bitty band eight
103
And this smarter model.. hmm, that's also a band 8.
104
It's quite strange actually.
105
I did them all and Kevin's essay got exactly the same scores as mine.
106
How is it possible when two different people wrote them?
107
I'm not sure.
108
But the key question is what did our other examiner award us?
109
So my essay scored between 8 .5 and 9 and Kevin's got 8 .5.
110
I didn't tell the other examiner whose essays they were,
111
I just sent them as 1 -2 -3 and Kevin if you're watching this 8 .5 is a fantastic score.
112
So it seems that for essays with really high scores language models do give relatively high scores.
113
But there is one more score left and the one that matters most.
114
Maria's essay.
115
The whole reason why we started this experiment.
116
And Maria's essay got an 8.
117
Imagine you are writing band 8 essays but every time you check with Chagipity it tells you you're band 6.
118
What would bad due to your motivation and Maria isn't the only one either here is another message I received
119
This candidate also got 6 .5 to 7 by CHAT -EPT, but an 8 in a real exam.
120
So, what can we take away from this?
121
First of all, AI tends to underrate essays rather than overrate them.
122
This means if you are relying on AI feedback, you might think you are doing worse than you really are.
123
2. The gap is the biggest for mid -band essays.
124
So band 5 and 6 essays were sometimes pretty close, maybe half a band off.
125
But 7 and 8 essays were often underrated by one or even two full bands.
126
3. AI can recognize quality, it knows when an essay is good.
127
But it really struggles to award those top -level scores.
128
And AI doesn't follow IELTS scoring rules correctly, like using half -bands when they don't even exist.
129
And finally, the results vary a lot between models.
130
So use AI to check your vocabulary and grammar, or get help with ideas and flow.
131
But don't rely on it for scoring.
132
Instead, learn the requirements examiners use for yourself
133
and I go through every single one of them while writing a full answer in this video here.
134
And thank you so much for watching me today.
135
Good luck with your preparation and your exam.
136
Bye!

앱 다운로드

유창하게 말하는 데 필요한 모든 것

AI 발음 평가문장마다 점수 확인
IPA 발음 연습모든 소리 마스터
단어 학습나만의 단어장 만들기
단어 게임놀면서 외우기

같은 채널

FOR YOU

추천 영상

이 레슨의 어휘와 말하기 포인트

이 말하기 레슨은 영상 “ChatGPT vs. IELTS Examiner: Writing”을(를) 바탕으로 합니다. 가장 자주 반복되는 단어는 다음과 같습니다: band, essay, score, examiner, model. 이 영상에는 섀도잉할 문장 136개와 단어 1452개가 있습니다. 말하는 구간의 길이는 11:39입니다. 화자는 분당 약 125단어의 일정한 속도로 말해서 섀도잉하기에 편한 속도입니다. 영어에서 가장 많이 쓰이는 3,000단어에 속하는 단어가 78%뿐이라 어휘가 어려운 편입니다.

이 영상의 핵심 어휘

영상에 나오는 익혀 둘 만한 단어 15개를 발음, 뜻과 함께 정리했습니다.

단어발음뜻
essay 명사/ˈɛs.eɪ/수필, 에세이
grammar 명사/ˈɡɹæm.ə(ɹ)/Korean: 문법, 문법학
examination 명사/ɪɡˌzæm.ɪˈneɪ.ʃən/진찰, 검사
prompt 동사/pɹɑmpt/부추기다
vocabulary 명사/vəˈkæb.jə.lə.ɹi/어휘, 어휘력
experiment 명사/ɪkˈspɛɹ.ə.mənt/실험
preparation 명사/ˌpɹɛpəˈɹeɪʃ(ə)n/준비
ventilation 명사/ˌvɛntɪˈleɪʃ(ə)n/통풍, 환기
compare 동사/kəmˈpɛɚ/비교하다, 비유하다
rely 동사/ɹɪˈlaɪ/의지(依支)하다
upload 동사/ˈʌpˌloʊd/업로드하다, 올리다
assessment 명사/əˈsɛsmənt/평가
explanation 명사/ˌɛkspləˈneɪʃən/설명
resource 명사/ɹɪˈzɔːs/자원
spin 동사/spɪn/회전하다

따라 말해 볼 만한 문장

영상에 나오는 짧고 완결된 문장으로, 일상 대화에서 그대로 쓸 수 있습니다:

  • What can I do?
  • Are you sure this score is so low?
  • To be honest it's my first time using it.

이 영상의 문법

화자가 가장 많이 쓰는 문형을 영상 속 실제 표현과 함께 정리했습니다.

문형영상 속 표현
현재완료진행 have/has been + -ing — 전에 시작해 지금도 계속되는 동작I've been testing · I've been preparing
수동태 be + 과거분사 — 누가 하는지보다 무슨 일이 일어나는지에 초점are graded · is listed · had been undervalued

주의할 발음

화자는 I'm, don't, gonna 같은 축약형과 약화된 형태를 21번 사용합니다. 들리는 대로 짧게 발음하세요.

  • “sh”와 “zh” 소리: examination /ɪɡˌzæm.ɪˈneɪ.ʃən/, preparation /ˌpɹɛpəˈɹeɪʃ(ə)n/, ventilation /ˌvɛntɪˈleɪʃ(ə)n/, explanation /ˌɛkspləˈneɪʃən/, motivation /ˈmoʊ.tə.veɪ.ʃən/
  • 긴 단어 — 강세 위치에 주의: examiner /əɡˈzæmɪnɚ/, examination /ɪɡˌzæm.ɪˈneɪ.ʃən/, vocabulary /vəˈkæb.jə.lə.ɹi/, experiment /ɪkˈspɛɹ.ə.mənt/, preparation /ˌpɹɛpəˈɹeɪʃ(ə)n/

한국어 화자가 어려워하는 소리:

  • /v/ — ㅂ(/b/)과 구별하기: vocabulary /vəˈkæb.jə.lə.ɹi/, ventilation /ˌvɛntɪˈleɪʃ(ə)n/, vary /ˈvɛəɹi/, motivation /ˈmoʊ.tə.veɪ.ʃən/, protective /pɹəˈtɛk.tɪv/
  • /z/ — ㅈ이 아니라 성대를 울리는 /s/: examiner /əɡˈzæmɪnɚ/, examination /ɪɡˌzæm.ɪˈneɪ.ʃən/, resource /ɹɪˈzɔːs/
  • /r/과 /l/ 구별하기: vocabulary /vəˈkæb.jə.lə.ɹi/, rely /ɹɪˈlaɪ/, correctly /kəˈɹɛk(t).li/, undervalue /ˌʌndə(ɹ)ˈvælju/

이 영상으로 연습하는 방법

  1. 먼저 말하지 않고 영상을 끝까지 듣고 모르는 단어를 적어 둡니다.
  2. 보통 속도로 한 문장씩 섀도잉하고, 화자의 리듬과 맞을 때까지 반복합니다.
  3. 자신의 목소리를 녹음해 원본과 비교하고, essay, grammar, examination 같은 단어에 특히 주의합니다.

쉐도잉이란? 영어 실력을 빠르게 키우는 과학적 방법

쉐도잉(Shadowing)은 원래 전문 통역사 훈련을 위해 개발된 언어 학습 기법으로, 다언어 학자인 Dr. Alexander Arguelles에 의해 대중화된 방법입니다. 핵심 원리는 간단하지만 매우 강력합니다: 원어민의 영어를 들으면서 1~2초의 짧은 지연으로 즉시 소리 내어 따라 말하는 것——마치 '그림자(shadow)'처럼 화자를 따라가는 것입니다. 문법 공부나 수동적인 청취와 달리, 쉐도잉은 뇌와 입 근육이 동시에 실시간으로 영어를 처리하고 재현하도록 훈련합니다. 연구에 따르면 이 방법은 발음 정확도, 억양, 리듬, 연음, 청취력, 말하기 유창성을 크게 향상시킵니다. IELTS 스피킹 준비와 자연스러운 영어 소통을 원하는 분들에게 특히 효과적입니다.

섀도잉 방법: 단계별 전체 가이드 읽기 →