쉐도잉 연습: Prompt engineering - Introduction - 영상으로 영어 말하기 배우기

레슨 만드는 중...
1
Welcome to this course on ChatGPT problem engineering for developers.
2
I'm thrilled to have with me Iza Fulford to teach this along with me.
3
She is a member of the technical staff of OpenAI and had built the popular ChatGPT retrieval plugin.
4
And a large part of work has been teaching people how to use OEM or large language model technology in products.
5
She's also contributed to the OpenAI cookbook that teaches people prompting.
6
So thrilled to have you with you.
7
And I'm thrilled to be here and share some prompting best practices with you all.
8
I'm not sure.
9
So there's been a lot of material on the internet for prompting,
10
with articles like "30 Prompts Everyone Has to Know" A lot of that has been focused on the ChatGPT web user interface,
11
which many people are using to do specific and often one -off tasks.
12
I think the power of LOM's large language models as a developer too, that is using API calls to LOMs to quickly build software applications.
13
I think that is still very underappreciated.
14
In fact, my team at AI Fund, which is a sister company to deep learning AI,
15
has been working with many startups on applying these technologies to many different applications.
16
It's been exciting to see what LOM APIs can enable developers to very quickly build.
17
So in this course, we'll share with you some of the possibilities for what you can do, as well as best practices for how you can do them.
18
There's a lot of material to cover.
19
First, you'll learn certain prompting best practices for software development.
20
Then we'll cover some common use cases, summarising, inferring, transforming, expanding.
21
And then you'll build a chatbot using an LLM.
22
Thank you.
23
We hope that this will spark your imagination about new applications that you can build.
24
So in the development of large language models or LLMs, there have been broadly two types of LLMs,
25
which I'm going to refer to as base LLMs and instruction -tuned LLMs.
26
So base LLM has been trained to predict the next word, based on text training data, often trained on large amount of data from the internet and other sources,
27
to figure out what's the next most likely word to follow.
28
So for example, if you were to prompt this, once upon a time there was a unicorn, it may complete this, that is, it may predict the next several words are,
29
that live in the magical forest of all unicorn friends.
30
But if you were to prompt us with what is the capital of France, then based on what articles on the internet might have,
31
it's quite possible that the base LM will complete this with, what is France's largest city, what is France's population and so on.
32
Because articles on the internet could quite plausibly be lists of quiz questions about the country of France.
33
Thank you.
34
In contrast, an instruction tuned LLM, which is where a lot of momentum of LLM research and practice has been going,
35
An instruction team has been trained to follow instructions.
36
So if you were to ask it, what is the capital of France is much more likely to output something like the capital of France is Paris
37
So the way that instruction -tuned OOMs are typically trained is, you start off with a base OOM that's been trained on a huge amount of text data,
38
and further train it, further fine tune it with inputs and outputs that are instructions and good attempts to follow those instructions.
39
And then often further refine using a technique called RLHF, reinforcement learning from human feedback,
40
to make the system better able to be helpful and follow instructions.
41
Because instruction TNLMs have been trained to be helpful, honest, and harmless.
42
So for example, they're less likely to output problematic texts, such as toxic outputs compared to base LLM.
43
a lot of the practical usage scenarios have been shifting toward instruction to,
44
you know, Some of the best practices you find on the internet may be more suited for a base LLM, but for most practical applications today,
45
we would recommend most people instead focus on instruction tuned LLMs, which are easier to use.
46
And also because of the work of OpenAI and other LLM companies becoming safer and more aligned.
47
So this course will focus on best practices for instruction to neural arms
48
which is what we recommend you use for most of your applications.
49
Before moving on, I just want to acknowledge the team from OpenAI
50
and DeepLearn .AI that had contributed to the materials that Ysia and I will be presenting.
51
I'm very grateful to Andrew Main, Joe Palermo, Boris Power, Ted Sanders, and Lillian Wang from OpenAI.
52
They were very involved with us brainstorming materials, vetting the materials to put together.
53
the curriculum for this short course.
54
And I'm also grateful on the deep learning side for the work of Jeff Lodwick, Eddie Hsu and Tommy Nelson.
55
So when you use an instruction tuned LLM, think of giving instructions to another person.
56
Say someone that's smart but doesn't know the specifics of your task.
57
So when an LM doesn't work, sometimes it's because the instructions weren't clear enough.
58
For example, if you were to say, "Please write me something about Alan Turing." Well, In addition to that, it can be helpful to be clear about whether you want
59
the text to focus on his scientific work or his personal life or his role in history or something else.
60
And if you specify what you want the tone of the text to be, should it take on the tone like a professional journalist would write?
61
Or is it more of a casual note
62
that you dash off to a friend that holds the OM generate what you want.
63
And of course, if you picture yourself asking, say a fresh college graduate to carry out this task for you,
64
if you can even specify what you want snippets of texts
65
they should read in advance to write this text about Alan Turing, then that even better sets up that fresh college grad for success to carry out this task for you.
66
So in the next video, you see examples of how to be clear and specific, which is an important principle of prompting LOMs.
67
And you also learn from Ezer a second principle of prompting, that is giving LDLM time to think.
68
So with that, let's go on to the next video.

이 수업에 대하여

이 수업에서는 ChatGPT 문제 공학과 대형 언어 모델(LLM)의 기본 원리를 배우게 됩니다. 이 과정은 개발자들이 어떻게 효과적으로 프롬프트를 사용할 수 있는지에 관한 팁과 모범 사례를 제공하여, 실제 애플리케이션 개발에 적용할 수 있는 방법을 제시합니다. LLM의 작동 원리를 이해하는 것은 IELTS 스피킹 능력을 향상시키는 데도 큰 도움이 됩니다. LLM은 기초 모델과 지시조정 모델로 나뉘며, 이 각각의 특징을 파악하여 여러분의 의사소통 능력을 높일 수 있는 기회를 제공합니다.

핵심 어휘 및 구문

  • 프롬프트(Prompt) - 모델에게 제공하는 입력 요청
  • 지시조정 모델(Instruction-Tuned Model) - 지시를 따르도록 훈련된 언어 모델
  • 기초 모델(Base Model) - 자연어 데이터를 기반으로 다음 단어를 예측하기 위해 훈련된 모델
  • 재강화 학습(Reinforcement Learning) - 인간의 피드백을 사용하여 모델의 성능을 개선하는 기법
  • 비판적 사고(Critical Thinking) - 정보를 분석하고 평가하는 능력
  • 어플리케이션(Application) - 실제 소프트웨어 개발에 활용되는 프로그램
  • 자연어 처리(Natural Language Processing) - 컴퓨터가 인간의 언어를 이해하고 처리하는 기술
  • 친숙한 출력(Familiar Outputs) - 일반적으로 기대되는 결과 또는 응답

연습 팁

이 비디오에서 다루는 내용을 연습할 때는 shadowspeak 기법을 활용하여 더 효과적으로 영어 speaking 능력을 키울 수 있습니다. 강의 속도가 빠르기 때문에, 먼저 내용을 들은 후 직접 따라 말해 보세요. 이때, 강사의 발음을 모방하고, 강세와 억양을 주의 깊게 살펴보는 것이 좋습니다. 자신의 목소리로 반복해서 이야기함으로써 shadow speech의 효과를 극대화할 수 있습니다. 반복 연습을 통해 자연스럽게 구사할 수 있는 표현들이 늘어날 것입니다. 이러한 방식으로 shadowspeaks을 연습하면 IELTS 스피킹 시험에서도 자신감을 갖게 될 것입니다. 비디오의 내용을 자신의 말로 요약해보는 것도 도움이 될 것입니다. 발화를 통해 직접적인 학습이 이루어지며, 자연스럽고 즉각적인 반응을 연습할 수 있습니다.

쉐도잉이란? 영어 실력을 빠르게 키우는 과학적 방법

쉐도잉(Shadowing)은 원래 전문 통역사 훈련을 위해 개발된 언어 학습 기법으로, 다언어 학자인 Dr. Alexander Arguelles에 의해 대중화된 방법입니다. 핵심 원리는 간단하지만 매우 강력합니다: 원어민의 영어를 들으면서 1~2초의 짧은 지연으로 즉시 소리 내어 따라 말하는 것——마치 '그림자(shadow)'처럼 화자를 따라가는 것입니다. 문법 공부나 수동적인 청취와 달리, 쉐도잉은 뇌와 입 근육이 동시에 실시간으로 영어를 처리하고 재현하도록 훈련합니다. 연구에 따르면 이 방법은 발음 정확도, 억양, 리듬, 연음, 청취력, 말하기 유창성을 크게 향상시킵니다. IELTS 스피킹 준비와 자연스러운 영어 소통을 원하는 분들에게 특히 효과적입니다.