Shadowing Practice: ChatGPT vs. IELTS Examiner: Writing - Learn English Speaking with Video
Bir pratik modu seçin
Her mod tam ekran bir pratik odası açar.
136 cümleler
Cümleler çok kısa veya çok uzun ise, ayarlamak için Düzenle'ye tıklayın.
1
Over the past few months I've been testing Chagipity and other language models to see if they can act like IELTS examiners.
2
For this video I took 30 real essays and compared AI band scores to real examiner scores.
3
So let's look at what happened and what it means for your preparation.
4
It all started when I received this message from Maria.
5
I've been preparing for my IELTS for five months.
6
But I think I'm gonna fail my exam anyway.
7
I get bent eight or nine in listening and reading.
8
But writing almost never reaches span seven.
9
I must score a seven everywhere to start my master's in September.
10
What can I do?
11
Well, Marie had been using chat APT to check how good her essays were
12
and i decided to do the same i took one of her essays
13
and gave this prompt to chat gpt
14
you are an experienced ielts examiner who assesses ielts writing task
15
2 essays using the ielts band descriptors give me the band scores for the four assessment criteria
16
and the overall task 2 band score.
17
I posted the essay and the result stunned me.
18
Task response or how well you respond to the task band 6.
19
Coherence and cohesion or the flow and structure of your essay band 6.
20
Lexical resource or vocabulary band 6.
21
Grammar and overall band 6.
22
Are you sure this score is so low?
23
I asked.
24
And ChattyPT gave me a full explanation of why it couldn't possibly be any higher.
25
So I sent the same essay using the same prompt to several other language models.
26
Claude gave a band 7 for task response and coherence and cohesion but only band 6 for vocabulary and grammar,
27
which resulted in an overall 6 .5.
28
DeepSeek was more generous, giving a band 7.
29
Gemini also landed at a band 6.
30
And since I have a paid subscription for Chagipity, I could test its latest 4 .5 model with more advanced reasoning,
31
or at least definitely the slowest model.
32
And that one gave a band 7.
33
To be honest, none of that looked right to me.
34
So we decided to conduct a more thorough experiment and see if AI can actually give accurate scores,
35
which models perform better, and if the scores are wrong, are they usually too high or too low.
36
A St. Marie's essay to a former IELTS examiner on our team and while I was waiting.
37
I found 27 essays from Cambridge practice tests so books like that
38
and all the essays are graded by official IELTS examiners as you can see each essay comes with a score
39
and examiner's notes so I uploaded these essays into chat apt one by one
40
and what I found could save you weeks of or wasted preparation.
41
So let's take the first essay and upload it with the same prompt as before.
42
So chattypt thinks it's a band 6 but I see two problems.
43
So first the grammar score is listed as 5 .5
44
but in IELTS you can only get a band 5 or band 6 for each criterion not 5 .5.
45
So this would be a band 5.
46
And the overall score wouldn't be a 6 either.
47
To get a band 6 overall you need at least a 6 in each criterion.
48
But in any case the examiner's score for this essay is a band 7, not a 6.
49
Next essay, band 5 .5 according to HRGPT, but again the examiner gave it a 7.
50
And that's a huge difference.
51
Essay 3.
52
So Chair GPT says band 5.
53
Yet once again this is a band 7.
54
Now look at this one.
55
Chair GPT calls it a 5 .5 but the examiner's score is a band 8.
56
That's a two and a half band difference
57
and I'm going to show you the essay on the screen it's really good how could it possibly be 5 .5
58
At this point I started wondering whether it even made sense to continue.
59
Every essay I'd sent so far had been undervalued by at least one full band
60
and in some cases by two and a half bands.
61
But then I realized something.
62
Maybe the scores dropped after I told chat GPT not to use half bands when marking individual criteria.
63
So I started a brand new chat with just the initial prompt and things began to improve.
64
Suddenly there was a correct score band 6
65
when it was really a band 6
66
and overall these scores were now mostly just half a band lower than they should be which
67
Which honestly isn't bad for a language model compared to a trained human examiner.
68
But here's the thing.
69
Not a single essay got a score higher than it deserved.
70
The result was either accurate or too low.
71
That said, this wasn't a perfect experiment.
72
Most of the essays were between bands 5 and 7.
73
Only one was a band 8 and none were a band 9.
74
but we really want to know if you write a brilliant essay band 8
75
or 9 will chat gpt recognize it or any other language model
76
so i took my own essay and another written by one of our examiners
77
and tested them exactly the same way i tested maria's essay first
78
i sent both to a different former examiner for scoring not the author to avoid any conflict of interest
79
and let's start with my essay then kevin's
80
and finally see how the other examiner scored all three of us including maria
81
so let me send my essay to chdpt okay a band 8 for task response band 8 for coherence
82
Basically a band 8 for the whole essay.
83
Well that's more inspiring.
84
What if we try the smartest model 4 .5?
85
Is it gonna be any different?
86
Actually no it's still a band 8 but with a band 9 for grammar so thank you very much.
87
And now Claude.
88
I know a lot of people love it so I thought we should definitely check it.
89
Okay, so it gave me event 7 for vocabulary and grammar and 7 .5 overall.
90
Not exactly the kind of examiner I'd want in my test.
91
I got an 8 .5 in the real exam and this essay better.
92
What about Deep Seek?
93
To be honest it's my first time using it.
94
A vent 8. And Gemini?
95
Oh really?
96
A vent 7?
97
Oh wait look!
98
It gave a vent 7 in every criterion but the overall score is 7 .5.
99
Gemini why how does it even work well it gave a long reply
100
and to be honest it's total rubbish
101
it's not even worth reading to you it seems i'm feeling a bit protective of my essay
102
so let's take Kevin's essay and see how well our examiner did it should be fun so chatty bitty band eight
103
And this smarter model.. hmm, that's also a band 8.
104
It's quite strange actually.
105
I did them all and Kevin's essay got exactly the same scores as mine.
106
How is it possible when two different people wrote them?
107
I'm not sure.
108
But the key question is what did our other examiner award us?
109
So my essay scored between 8 .5 and 9 and Kevin's got 8 .5.
110
I didn't tell the other examiner whose essays they were,
111
I just sent them as 1 -2 -3 and Kevin if you're watching this 8 .5 is a fantastic score.
112
So it seems that for essays with really high scores language models do give relatively high scores.
113
But there is one more score left and the one that matters most.
114
Maria's essay.
115
The whole reason why we started this experiment.
116
And Maria's essay got an 8.
117
Imagine you are writing band 8 essays but every time you check with Chagipity it tells you you're band 6.
118
What would bad due to your motivation and Maria isn't the only one either here is another message I received
119
This candidate also got 6 .5 to 7 by CHAT -EPT, but an 8 in a real exam.
120
So, what can we take away from this?
121
First of all, AI tends to underrate essays rather than overrate them.
122
This means if you are relying on AI feedback, you might think you are doing worse than you really are.
123
2. The gap is the biggest for mid -band essays.
124
So band 5 and 6 essays were sometimes pretty close, maybe half a band off.
125
But 7 and 8 essays were often underrated by one or even two full bands.
126
3. AI can recognize quality, it knows when an essay is good.
127
But it really struggles to award those top -level scores.
128
And AI doesn't follow IELTS scoring rules correctly, like using half -bands when they don't even exist.
129
And finally, the results vary a lot between models.
130
So use AI to check your vocabulary and grammar, or get help with ideas and flow.
131
But don't rely on it for scoring.
132
Instead, learn the requirements examiners use for yourself
133
and I go through every single one of them while writing a full answer in this video here.
134
And thank you so much for watching me today.
135
Good luck with your preparation and your exam.
136
Bye!
Uygulamayı İndir
Akıcı konuşmak için ihtiyacınız olan her şey
AI TelaffuzHer cümleyi puanla
IPA AlıştırmasıHer sesi ustalaştır
Kelime BilgisiKelime bankanızı oluşturun
Kelime OyunuOynarken öğrenin
Aynı Kanal
![How to start your IELTS preparation [for beginners]](https://img.youtube.com/vi/3gvJ_0qi_Tc/mqdefault.jpg)
B12
How to start your IELTS preparation [for beginners]
British AccentIELTS PrepUniversity StudentsWorking Adults
B212
3 IELTS Listening Techniques to Understand EVERYTHING
British AccentIELTS PrepUniversity StudentsWorking Adults
B25
IELTS Speaking Part 1 SAMPLE ANSWERS | Hometown
British AccentIELTS PrepCambridge Exam PrepUniversity Students
B23
Band 9 IELTS Speaking SAMPLE ANSWERS | HOME
British AccentIELTS PrepUniversity Students
B22
Get Better at IELTS Reading in 13 Minutes
British AccentIELTS PrepCambridge Exam PrepUniversity Students
B26
IELTS Speaking Part 3 | Questions & Answers
British AccentIELTS PrepCambridge Exam PrepUniversity Students
FOR YOU
Video Öner
B21
671 cümleler
The Writing Makeover That Took Her Essay From 6 5 to 8 5
IELTS PrepUniversity Students
B22
324 cümleler
Cambridge IELTS 11 Listening Test 1 | Full Practice Test with Answers (40 Questions)
IELTS PrepUniversity Students
B22
160 cümleler
IELTS Speaking Band 7.5 Mock Test with Feedback
IELTS PrepUniversity Students
B2179
30 cümleler
IELTS Listening Part 3: A Survey on Student Sleep
American AccentBritish AccentIELTS PrepUniversity Students
B21
420 cümleler
How to Get Band 9 in IELTS Writing Task 2
IELTS PrepUniversity Students
B213
41 cümleler
RE2 Unit 11B
IELTS PrepTOEFL PrepBusiness English
B24
556 cümleler
IELTS Test with EX EXAMINER!!!! + Language and Tips
IELTS PrepUniversity Students
B22
233 cümleler
IELTS Speaking Exam - How to Do Part Three of the IELTS Speaking Test
IELTS PrepUniversity Students
B24
195 cümleler
IELTS Tips You MUST Know Before Your Test
IELTS PrepUniversity Students
B21
282 cümleler
What Stanford students actually use ChatGPT for
Daily ConversationUniversity Students
B215
36 cümleler
Bạn hiểu được bao nhiêu % khi clip chưa được sub | luyện nghe tiếng anh cùng imleafsun
IELTS PrepCambridge Exam PrepUniversity Students
C12
240 cümleler
Why This Is the Most Exciting Time to Be Human | Ken Ono, Axiom Math
IELTS PrepTOEFL PrepUniversity Students
Bu dersin kelimeleri ve konuşma notları
Bu konuşma dersi “ChatGPT vs. IELTS Examiner: Writing” videosuna dayanıyor. En çok tekrarlanan kelimeler: band, essay, score, examiner, model. Bu videoda gölgeleme çalışması için 136 cümle ve 1452 kelime var. Konuşma bölümü 11:39 sürüyor. Konuşmacı dakikada yaklaşık 125 kelimelik dengeli bir hızla konuşuyor; gölgeleme için rahat bir tempo. Kelimelerin yalnızca %78’i İngilizcede en sık kullanılan 3.000 kelime arasında, bu yüzden kelime dağarcığı zorlayıcı.
Bu videodaki önemli kelimeler
Videodan öğrenmeye değer 15 kelime, telaffuzu ve anlamıyla:
| Kelime | Telaffuz | Anlam |
|---|---|---|
| essay isim | /ˈɛs.eɪ/ | deneme, kompozisyon |
| grammar isim | /ˈɡɹæm.ə(ɹ)/ | dil bilgisi, gramer |
| examination isim | /ɪɡˌzæm.ɪˈneɪ.ʃən/ | imtihan etmek, sınav yamak |
| vocabulary isim | /vəˈkæb.jə.lə.ɹi/ | kelime hazinesi, kelime kadrosu |
| experiment isim | /ɪkˈspɛɹ.ə.mənt/ | deney (n), tecrübe |
| preparation isim | /ˌpɹɛpəˈɹeɪʃ(ə)n/ | hazırlık |
| compare fiil | /kəmˈpɛɚ/ | karşılaştırmak, kıyaslamak |
| explanation isim | /ˌɛkspləˈneɪʃən/ | açıklama |
| resource isim | /ɹɪˈzɔːs/ | kaynak |
| spin fiil | /spɪn/ | dolanmak, dönmek |
| feedback isim | /ˈfiːdˌbæk/ | geri bildirim |
| requirement isim | /ɹɪˈkwaɪɹmənt/ | gereklilik, zaruret |
| motivation isim | /ˈmoʊ.tə.veɪ.ʃən/ | güdü, motivasyon |
| generous sıfat | /ˈd͡ʒɛn(ə)ɹəs/ | cömert, eli açık |
| bend fiil | /bɛnd/ | bükmek |
Tekrar etmeye değer cümleler
Videodan, günlük konuşmada yeniden kullanabileceğiniz kısa ve tam cümleler:
- What can I do?
- Are you sure this score is so low?
- To be honest it's my first time using it.
Bu videodaki dil bilgisi
Konuşmacının en çok kullandığı yapılar, videodaki sözcüklerin aynısıyla:
| Yapı | Videoda |
|---|---|
| Present perfect continuous have/has been + -ing — önceden başlayıp hâlâ süren bir eylem | I've been testing · I've been preparing |
| Edilgen yapı be + fiilin üçüncü hâli — kimin yaptığı değil, ne olduğu önemli | are graded · is listed · had been undervalued |
Dikkat edilecek telaffuzlar
Konuşmacı I'm, don't, gonna gibi kısaltılmış biçimleri 21 kez kullanıyor. Bunları duyduğunuz gibi kısa söyleyin.
- “sh” ve “zh” sesleri: examination /ɪɡˌzæm.ɪˈneɪ.ʃən/, preparation /ˌpɹɛpəˈɹeɪʃ(ə)n/, ventilation /ˌvɛntɪˈleɪʃ(ə)n/, explanation /ˌɛkspləˈneɪʃən/, motivation /ˈmoʊ.tə.veɪ.ʃən/
- Uzun kelimeler — vurguyu doğru yere koyun: examiner /əɡˈzæmɪnɚ/, examination /ɪɡˌzæm.ɪˈneɪ.ʃən/, vocabulary /vəˈkæb.jə.lə.ɹi/, experiment /ɪkˈspɛɹ.ə.mənt/, preparation /ˌpɹɛpəˈɹeɪʃ(ə)n/
Türkçe konuşanların zorlandığı sesler:
- Kelime başındaki ünsüz kümesi — araya ünlü eklemeyin: grammar /ˈɡɹæm.ə(ɹ)/, prompt /pɹɑmpt/, preparation /ˌpɹɛpəˈɹeɪʃ(ə)n/, spin /spɪn/, protective /pɹəˈtɛk.tɪv/
- /æ/ — “e”den daha açık: examiner /əɡˈzæmɪnɚ/, grammar /ˈɡɹæm.ə(ɹ)/, examination /ɪɡˌzæm.ɪˈneɪ.ʃən/, vocabulary /vəˈkæb.jə.lə.ɹi/, feedback /ˈfiːdˌbæk/
Bu videoyla nasıl çalışılır
- Videonun tamamını konuşmadan bir kez dinleyin ve bilmediğiniz kelimeleri not edin.
- Normal hızda cümle cümle tekrar edin; ritminiz konuşmacıyla aynı olana kadar her cümleyi yineleyin.
- Kendinizi kaydedin ve orijinaliyle karşılaştırın; essay, grammar, examination gibi kelimelere özellikle dikkat edin.
Gölgeleme Tekniği Nedir?
Gölgeleme, başlangıçta profesyonel tercüman eğitimi için geliştirilen ve çok dilli Dr. Alexander Arguelles tarafından popüler hale getirilen, bilim destekli bir dil öğrenme tekniğidir. Yöntem basit ama güçlüdür: ana dili İngilizce olan bir sesi dinler ve hemen yüksek sesle tekrar edersiniz — konuşmacıyı 1-2 saniye gecikmeyle takip eden bir gölge gibi. Pasif dinleme veya dilbilgisi alıştırmalarının aksine, gölgeleme beyninizi ve ağız kaslarınızı gerçek konuşma kalıplarını eşzamanlı olarak işlemeye ve yeniden üretmeye zorlar. Araştırmalar, telaffuz doğruluğu, tonlama, ritim, bağlı konuşma, dinleme anlama ve konuşma akıcılığını önemli ölçüde geliştirdiğini göstermektedir — bu da onu IELTS Konuşma hazırlığı ve gerçek dünya İngilizce iletişimi için en etkili yöntemlerden biri yapar.