쉐도잉 연습: Introduction to Generative AI and LLMs [Pt 1] | Generative AI for Beginners - 영상으로 영어 말하기 배우기

연습 모드 선택

각 모드는 전체 화면 연습실로 열립니다.

93 문장

문장이 너무 짧거나 길면 Edit를 눌러 조정하세요.

Hi everyone and welcome to the first lesson of the Generative AI for Beginners course.

This course is based on an open source curriculum with the same name available on GitHub

that you can find at the link on the screen.

I'm Carlotta Castelluccio, I'm a cloud advocate at Microsoft focused on artificial intelligence technologies

and in this video I'm going to introduce you to generative AI and large language models.

Large language models represent the pinnacle of AI technology, pushing the boundaries of what was once thought impossible.

They've conquered numerous challenges that older language models struggled with, achieving human-leavened performance in various tasks.

They have similar capabilities and applications, but for the sake of this course,

we'll explore how large language models are revolutionizing education through a fictional startup that we'll be referring to as Our Startup.

Our startup works in the education domain with the ambitious mission of improving accessibility in learning on a global scale,

ensuring equitable access to education, and providing personalized learning experiences to every learner, according to their needs.

In this course, we'll delve into how our startup harnesses the power of generative AI to unlock new possibilities in education.

We'll also examine how they address the inevitable challenges tied to the social impact of this technology and its technological limitations.

But let's start by defining some basic concepts we'll be using throughout the course.

Despite the relatively recent hype surrounding generative AI,

we can say that in the last couple of years we have really heard of generative AI everywhere and every time.

But this technology has been decades in the making, with its origins tracing back to the 1950s, 1960s.

The earliest AI prototypes consisted of typewritten chatbots relying on knowledge bases maintained experts.

These chatbots generated responses based on keywords found in user input,

but it soon became clear that this approach had scalability limitations.

A significant turning point arrived in the 1990s when a statistical approach was applied to text analysis.

And this gave birth to machine learning algorithms which could learn patterns from data without explicit programming.

And these algorithms allowed machines to stimulate human language understanding, having the way for the eye we know today.

In more recent times, advancements in hardware technology allowed for development of advanced machine learning algorithms, particularly neural networks.

These innovations significantly improved natural language processing, enabling machines to understand the context of words in sentences.

This breakthrough technology powered the birth of virtual assistants in the early 21st century.

This virtual assistants excelled at interpreting human language, identifying needs, and taking actions to fulfill them,

such as answering queries with predefined scripts or connecting to third-party services.

And so we arrived at Generative AI, a subset of deep learning.

After decades of AI research,

a new model architecture known as the Transformer emerged transformers could handle longer text sequences as input

and work based on the attention mechanism, enabling them to focus on the most relevant information,

regardless of its order in the input text.

Today, mass-generative AI models, often referred to as large language models,

are built upon the transformer architecture, and that's what the T in GPT actually means.

These models trained on vast amounts of data from sources like books, articles, and websites possess a unique adaptability.

They can tackle a wide range of tasks and generate chromatically correct text with a hint of creativity.

But let's dive deeper into the mechanism of large language models

and shed light on the inner workings of models like the OpenAI GPT's.

One of the key concepts to grasp is tokenization.

Large language models receive text as input and produce text as output, if you want to really simplify the mechanism.

However, these models work much more efficiently with numbers rather than with raw text sequences.

And that's where the tokenizer comes into play.

Text prompts are chunked into tokens, helping the model in predicting the next token for completion.

Models also have a maximum length of token window,

and model pricing is also tightly computed by the number of tokens used in output and inputs.

So tokenization is really an important concept in large language models and generative AI domain.

Now, a token is essentially a chunk of text which can vary in length and typically consists of a sequence of characters.

And the tokenizer's primary job is to really break down the input text into an array of those tokens,

which are then further mapped to token indices.

These token indices are essentially integer and coding of the original text chunks, making it easier for the model to process and understand.

Now let's move to predicting the output tokens.

Given an input sequence of and tokens with the maximum and varying from one model to another according to the maximum

content window length of for one model, the model is designed to predict a single token as its output.

But here's where it gets interesting.

The predicted token is then incorporated into the input of the next iteration, creating an expanding window pattern.

And this pattern allows the model to provide more coherent and contextually relevant responses,

often extending to one or multiple sentences.

Now let's delve into the selection process.

The model chooses the output token based on its probability of occurring after the current text sequence.

This probability distribution is calculated using the model's training data.

However, here's the twist.

The model doesn't always choose the token with the highest probability from the distribution.

To simulate the process of creative thinking, a degree of randomness is introduced into the selection process.

This means that the model doesn't produce the exact same output for the same input every time.

That's the element that allows generative AI to generate text that feels, you know, creative and engaging.

Now, we see that the main capability of a large language model is generating text from scratch, starting from a textual input written in natural language.

But what kind of textual input and output?

First of all, let me say that the input of a large language model is known as prompt, while the output is known as completion,

a term that refers to the model mechanism of generating the next token to complete the current input.

Let's do some examples of prompts and completion by using the OpenAI ChatGPT Playground, always in our educational scenario.

Now, a prompt may include an instruction specifying the type of output we expect from the model.

In the example we are seeing, we are asking to write an assignment for high school students,

including four open-ended questions about Louis XIV and his court.

You can see that the output is exactly what I'm asking for.

The model was able to generate an assignment with the questions.

Now, another prompt might be a question, asking in the form of a conversation with an agent.

In this example, we are asking about in a question.

So we asked who is Louis XIV and why he is an important historical character?

And we've got an answer.

Another type of prompt might be a chunk of text to complete.

So an incipit of a text to complete.

And you can see now that we used an incipit of a text to complete to complete as prompt,

and we've got a whole paragraph to complete the current input.

So this is basically an implicit ask for writing assistance.

Now, the examples I just did are quite simple, and don't want to be an exhaustive demonstration of large language models capabilities.

They just want to show you the potential of using Generative AI,

in particular, but not limited in a context such as the educational context we have used today as an example.

That's all for now.

In the following lesson, we are going to explore different types of generative AI models.

And we're going to cover also how to test, to iterate, and to improve the performance,

and compare also different models to find the most suitable one for a specific use case.

Thank you.

앱 다운로드

유창하게 말하는 데 필요한 모든 것

AI 발음 평가문장마다 점수 확인

IPA 발음 연습모든 소리 마스터

단어 학습나만의 단어장 만들기

단어 게임놀면서 외우기

QR 스캔

Download on theApp Store Get it onGoogle Play

같은 채널

Armchair Architects: Resiliency in the Cloud – Core Patterns

Daily ConversationUniversity StudentsWorking Adults

FOR YOU

이 레슨의 어휘와 말하기 포인트

이 C1 수준 말하기 레슨은 영상 “Introduction to Generative AI and LLMs”을(를) 바탕으로 합니다. 가장 자주 반복되는 단어는 다음과 같습니다: model, text, token, language, input. 이 영상에는 섀도잉할 문장 93개와 단어 1349개가 있습니다. 말하는 구간의 길이는 10:25입니다. 화자는 분당 약 129단어의 일정한 속도로 말해서 섀도잉하기에 편한 속도입니다. 영어에서 가장 많이 쓰이는 3,000단어에 속하는 단어가 75%뿐이라 어휘가 어려운 편입니다.

이 영상의 핵심 어휘

영상에서 가장 어려운 단어 15개를 발음, 뜻과 함께 정리했습니다.

단어	발음	뜻
token 명사	/ˈtoʊkən/	토큰
prompt 동사	/pɹɑmpt/	부추기다
chunk 명사	/t͡ʃʌŋk/	조각
predict 동사	/pɹɪˈdɪkt/	예언하다, 예측하다
transformer 명사	/tɹænsˈfoɹməɹ/	변압기, 트랜스
probability 명사	/ˌpɹɑ.bəˈbɪl.ə.ti/	확률
algorithm 명사	/ˈælɡəɹɪðm̩/	알고리즘, 알고리듬
chatbot 명사	/ˈtʃætbɑt/	챗봇
integer 명사	/ˈɪn.tɪ.d͡ʒə(ɹ)/	정수
keyword 명사	/ˈkiː.wɜːd/	키워드, 핵심어
learner 명사	/ˈlɜɹnəɹ/	학습자
revolutionize 동사	/ˌɹɛv.əˈl(j)u.ʃəˌnaɪz/	혁명을 일으키다
scalability 명사	/ˌskeɪ.ləˈbɪl.ɪ.ti/	신축성
typewrite 동사		타자하다, 타이프하다
subset 명사	/ˈsʌbˌsɛt/	부분집합

이 영상의 문법

화자가 가장 많이 쓰는 문형을 영상 속 실제 표현과 함께 정리했습니다.

문형	영상 속 표현
수동태 be + 과거분사 — 누가 하는지보다 무슨 일이 일어나는지에 초점	is based · was applied · are built
현재완료 have/has + 과거분사 — 과거의 일이 지금도 관련이 있을 때	They've conquered · have really heard · has been

주의할 발음

화자는 we'll, I'm, doesn't 같은 축약형과 약화된 형태를 16번 사용합니다. 들리는 대로 짧게 발음하세요.

“th” 소리: algorithm /ˈælɡəɹɪðm̩/, breakthrough /ˈbɹeɪk.θɹuː/
“sh”와 “zh” 소리: limitation /lɪmɪˈteɪʃən/, iteration /ˌɪt.əˈɹeɪ.ʃən/, revolutionize /ˌɹɛv.əˈl(j)u.ʃəˌnaɪz/, fictional /ˈfɪkʃənəl/, ambitious /æmˈbɪʃ.əs/
긴 단어 — 강세 위치에 주의: generative /ˈd͡ʒɛnəɹətɪv/, probability /ˌpɹɑ.bəˈbɪl.ə.ti/, capability /ˌkeɪ.pəˈbɪl.ɪ.ti/, limitation /lɪmɪˈteɪʃən/, adaptability /ədæptəˈbɪlɪti/

한국어 화자가 어려워하는 소리:

/f/ — ㅍ(/p/)으로 바꾸지 말고 윗니를 아랫입술에 대기: transformer /tɹænsˈfoɹməɹ/, simplify /ˈsɪmplɪfaɪ/, specify /ˈspɛs.əˌfaɪ/, fulfill /fʊlˈfɪl/, fictional /ˈfɪkʃənəl/
/v/ — ㅂ(/b/)과 구별하기: generative /ˈd͡ʒɛnəɹətɪv/, delve /dɛlv/, exhaustive /ɪɡˈzɔstɪv/, leaven /ˈlɛv.ən/, revolutionize /ˌɹɛv.əˈl(j)u.ʃəˌnaɪz/
/z/ — ㅈ이 아니라 성대를 울리는 /s/: exhaustive /ɪɡˈzɔstɪv/, personalize /ˈpɜː.sə.nə.laɪz/, revolutionize /ˌɹɛv.əˈl(j)u.ʃəˌnaɪz/, possess /pəˈzɛs/

이 영상으로 연습하는 방법

먼저 말하지 않고 영상을 끝까지 듣고 모르는 단어를 적어 둡니다.
보통 속도로 한 문장씩 섀도잉하고, 화자의 리듬과 맞을 때까지 반복합니다.
자신의 목소리를 녹음해 원본과 비교하고, token, prompt, chunk 같은 단어에 특히 주의합니다.

쉐도잉이란? 영어 실력을 빠르게 키우는 과학적 방법

쉐도잉(Shadowing)은 원래 전문 통역사 훈련을 위해 개발된 언어 학습 기법으로, 다언어 학자인 Dr. Alexander Arguelles에 의해 대중화된 방법입니다. 핵심 원리는 간단하지만 매우 강력합니다: 원어민의 영어를 들으면서 1~2초의 짧은 지연으로 즉시 소리 내어 따라 말하는 것——마치 '그림자(shadow)'처럼 화자를 따라가는 것입니다. 문법 공부나 수동적인 청취와 달리, 쉐도잉은 뇌와 입 근육이 동시에 실시간으로 영어를 처리하고 재현하도록 훈련합니다. 연구에 따르면 이 방법은 발음 정확도, 억양, 리듬, 연음, 청취력, 말하기 유창성을 크게 향상시킵니다. IELTS 스피킹 준비와 자연스러운 영어 소통을 원하는 분들에게 특히 효과적입니다.

섀도잉 방법: 단계별 전체 가이드 읽기 →

쉐도잉 연습: Introduction to Generative AI and LLMs [Pt 1] | Generative AI for Beginners - 영상으로 영어 말하기 배우기

연습 모드 선택

앱 다운로드

같은 채널

Armchair Architects: Resiliency in the Cloud – Core Patterns

추천 영상

What is AI and ML? [Pt 2] | Generative AI with .NET for Beginners

What's new in Google Cloud in less than 1 minute

World Models explained in 10min..

AI & Education: Generative AI & the Future of Critical Thinking

Prompt engineering - Introduction

Google’s AI Course for Beginners (in 10 minutes)!

Transformers, the tech behind LLMs | Deep Learning Chapter 5

The Limitless AI Lie. The Bubble Is Slowly BURSTING.

The Multi-Agent Architecture That Actually Ships — Luke Alvoeiro, Factory

Rapid Engineering With AI

Computational Linguistics: Crash Course Linguistics #15

Understand AI in 14 minutes – with Anthropic's Chloe Lubinski [ARC 2026]