Shadowing Practice: How AI is Changing Data Scientist's Workflow - Learn English Speaking with Video
Creando lección...
1
Data scientist is the top job title referencing generative AI.
2
So that means that companies don't just need data talent.
3
They need data talent that knows AI.
4
So what does know AI actually mean?
5
Well, I found that it's actually twofold.
6
Firstly, you know how to leverage AI to speed up your existing workflow, not just in a way of prompting ChatGBT to write Python code kind of way,
7
but it's more about rethinking the way you get things done from generating or collecting data, exploratory data analysis, modeling, reporting, and communication.
8
Secondly, you know how to build AI systems.
9
For example, creating and deploying tools and agents to automate part of or an entire process or workflow for your team.
10
Now, let's first talk about different ways to leverage AI to speed up a data science workflow.
11
I'll talk about a few specific tools in this video, but I want to be clear that tools isn't the point because tools can change.
12
What matters is knowing what's now possible so you can think about how to adapt and rethink the way you're working.
13
So the first major way data scientists can leverage AI is in EDA and data pre-processing.
14
If you've worked in a real data science project before, you probably already experienced this.
15
Too much time spent preparing data, not enough time analyzing it.
16
You got the job thinking you spent all day finding data patterns, coming up with hypothesis and interesting analysis.
17
In reality, you spent 60 to 70% of your time cleaning data, writing repetitive code to check data types,
18
handling missing values, or creating standard visualizations.
19
Here are two open source tools I've come across that can make your work a little bit easier and more fun.
20
The first one is Pandas AI.
21
It's a Python library that basically allows you to ask questions to your data frame in natural language.
22
For example, what's the total sales per coffee type?
23
Depending on your question, it can return different kinds of responses like a string, a data frame, a chart, or a number.
24
It's totally open source and you can hook it up with any LLM you like.
25
And I'm connecting Pandas AI with an LLM from OpenAI here.
26
Now, if you're wondering if your whole data set would be sent to an LLM or not, the answer is no. When you ask Pandas AI a question, it actually sends just enough context.
27
So your question along with the column names, a few sample rows, and some metadata.
28
The LLM reads that context
29
and writes a small Python script to answer your question pandas AI then checks
30
that the script is safe to run
31
and then it runs the script locally on your actual data using pandas
32
so if you want to get away with writing pandas
33
and matplotlib code yourself you can use this library to do quick analysis data cleaning
34
and data manipulation but for more complex tasks like joining data frames
35
or creating correlation matrix you should still use pandas the second tool
36
that I think is pretty cool is data formulator this one comes out of microsoft research
37
and the easiest way to think about it is the combination of excel formulas power query
38
and modern ai it also allows you to interact with your data in natural language
39
but the nice part is the tool shows you exactly how the data is being transformed
40
and visualized step by step nothing hidden which means the workflow stays transparent and reusable.
41
Give it a broad prompt like show me interesting trends in this data set and we'll start transforming the data,
42
generating visualizations and suggesting directions you can explore further.
43
This tool is also open source and you can install it locally.
44
So in your workflow if you happen to spend a lot of time in the Microsoft ecosystem like Excel, Power Query, Power BI, it's definitely worth experimenting with this tool.
45
Now with these kind of tools you still need to understand your data
46
but they can drastically speed up the exploration phase where you're
47
just trying to understand what you're working with before you get into building the actual pipeline
48
and the real modeling work now as a top one percent data scientist you don't just limit yourself to tools
49
that are already available you also know how to build ai tools
50
and systems to support your team
51
so i want to quickly shout out to datacamp who sponsors this part of the video I used Datacam back
52
when I was learning Python for work.
53
What I really like is that it's hands-on.
54
You actually write code, solve exercises, and build projects right in your browser.
55
They're offering some solid tracks for data scientists to level up your skills.
56
The first one I'd recommend is the Associate AI Engineer for Data Scientist track that covers scikit-learn, PyTorch, Hugging Face, building LLM apps with Lanchain,
57
and the MLObs basics to help you take models into production.
58
If you're more on application building side, their associate AI engineer for developers track covers the more practical stack so OpenAI API,
59
prompt engineering, embeddings, PyCon and LangChain.
60
They also offer an AI engineer for data scientist certification if you want a credential you can put on LinkedIn.
61
If you want to level up your skills in AI with these tracks check the links in the description.
62
Okay the second way data scientists can leverage AI is creating synthetic data sets for prototyping.
63
Getting access to real and high quality data is the problem every data scientist has faced.
64
Probably the data is locked behind privacy constraints, doesn't exist yet, or you just want to test an idea quickly.
65
So instead of waiting, many data scientists use AI to create synthetic data sets, whether they are structured or unstructured data.
66
LLMs have become so good that they can actually generate artificial data that mimics real world patterns. In fact,
67
synthetic data is widely used in privacy sensitive industries like healthcare
68
finance where real data can't always be shared freely for example
69
i used claw to generate this whole e-commerce data set of
70
5 000 rows with customers products order items you just describe what you need the structure the number of rows
71
and it gives you something you can actually work with in
72
minutes similarly you can also generate unstructured text data for testing
73
a model training pipeline now here's another interesting way you can use ai
74
that a lot of data scientists are sleeping on
75
that is using foundation models foundation models those are trained on massive
76
and varied data sets they are different from traditional machine learning models
77
that are custom built for specific tasks today foundation models are no longer just for chatbots
78
and image generation they're starting to show up in core data science work like time series forecasting tabular prediction
79
and even recommendation systems let's say you're building a time series forecasting model you usually collect your data
80
and clean it and engineer your features and then pick a model
81
and train it and fine-tune it and evaluate it now the problem is
82
if your company wants forecasts across 200 product lines you would normally have to repeat
83
that process over and over but nowadays you can use foundation models like chronos by amazon
84
and time gpt
85
so here's an example where i tried one of those models you just feed your data
86
and get a forecast no feature engineering no model selection no
87
training loop this approach is really changing the whole modeling workflow
88
netflix recently replaced a whole stack of separate recommendation models with one foundation model trained on billions of user interactions
89
and now every team just fine-tunes on top of it the
90
data scientists pulling ahead right now are the ones who know
91
when to build from scratch and when to build on top of something
92
that already works next let's talk about how a data scientist
93
can automate workflows with mcp model context protocol think about your
94
typical day you're jumping between five different apps you're querying databases
95
pushing code to github sharing updates on slack pulling some data
96
that your colleague shared on google drive that constant back
97
and forth burns your energy so the idea of using mcp is
98
that it lets you connect all of those tools to an ai assistant like cloud
99
so instead of switching between apps you're doing everything from one
100
place for example i connected cloud desktop with my postgres sql database through mcp
101
and now instead of opening a sql client writing a query
102
running it copying results i just ask cloud for example show me the top 10 customers my revenue this month
103
and i get my answer right there.
104
Now, quick heads up, not every employer allows tools like Claude Desktop or Claude Code due to security policies.
105
But even if you can't use it at work yet, it's useful, I think, to exploit personally because I think sooner or later,
106
this kind of integrated tools will become the standard because it removes a lot of friction in the day-to-day work.
107
Now, beyond just using AI tools to speed up your work
108
the data scientists who are really standing out right now are
109
the ones who can actually build things with AI systems
110
that solve real business problems for their teams
111
and companies from my conversations with all of my data scientist friends their jobs are less
112
and less about prototyping a model in a notebook it's more
113
and more about delivering something people can actually use for example
114
imagine your finance team processes hundreds of invoices every week manually you could build an AI system
115
that read those invoices extracts the key information
116
and saves it straight to your database
117
or say your company wants to understand patterns across thousands of customer interactions
118
or research documents you could build a knowledge graph
119
that maps out how everything connects that way you uncover insights
120
that are impossible to find with traditional analysis methods i also
121
have a tutorial on this i'll link here somewhere in the screen these are the kinds of projects
122
that make you invaluable at a company these days also there's a real gap
123
that most data scientists need to close right now myself included
124
a lot of data scientists can build a great prototype
125
but they can't get into production they can't deploy it monitor it
126
or make it reliable enough for other people to depend on
127
and to close
128
that gap you need to start learning things like how to containerize your application with docker
129
so it runs anywhere how to deploy and serve your models on cloud platforms
130
and how to monitor
131
and maintain ai systems once they're alive these skills are more engineering skills ai engineering specifically
132
but they're becoming essential for data scientists as well
133
if you want to help your team build ai systems now we've talked about a lot of different tools
134
and hard skills but i think eventually data professionals are increasingly about judgment
135
and influence understanding how business works how your company makes money domain knowledge stakeholder management, trust building, communication, and data storytelling,
136
these soft skills in the long term are becoming the core of what you do.
137
Right now, I think one thing that's going to pay off dividends for you is to stay open to trying out new tools, learning them, using them, questioning them, adapting them for your own needs.
138
I run a free newsletter where I share my latest insights and experiments in data science and AI.
139
So if you're interested, check it out in the description below.
140
Thank you for watching.
141
Bye-bye.
✨ Recomendar Video
C11
126 oraciones
How I use AI as a senior software engineer and 5 principles of AI explained in 10 minutes
Business EnglishUniversity StudentsWorking Adults
C11
402 oraciones
The Future of Data Science - Data Science @ Stanford
Business EnglishUniversity StudentsWorking Adults
C1260 oraciones
Data Analyst Interview 2024 | SQL | POWER BI | Data Science | Mock Interview
Business EnglishInterview EnglishUniversity Students
C11
133 oraciones
Data Ingestion Best Practices! How to Ingest Data Efficiently at Enterprise Scale!
Business EnglishUniversity StudentsWorking Adults
C115
29 oraciones
Amazon Athena explained in 120 seconds💡
Business EnglishUniversity StudentsWorking Adults
B21
220 oraciones
How Modern Data Teams Work (Engineer, Analyst, Scientist, Architect, ML)
Business EnglishUniversity StudentsWorking Adults
C18
55 oraciones
When AIs act emotional
Business EnglishUniversity StudentsWorking Adults
C12
39 oraciones
The Global Power Play
Business EnglishUniversity StudentsWorking Adults
C11
40 oraciones
Introducing GPT-6 Astra for developers
Business EnglishUniversity StudentsWorking Adults
B21
79 oraciones
How AI Is Ruining Job Interviews
Business EnglishInterview EnglishUniversity Students
B21
31 oraciones
What is AI?
Business EnglishUniversity StudentsWorking Adults
C11
254 oraciones
AI Will Create New Wealth, But Not Where You Think | Carnegie Mellon University, Po-Shen Loh
Business EnglishDaily ConversationUniversity Students
Vocabulario y notas de pronunciación para esta lección
Esta lección de conversación de nivel C1 se basa en el vídeo “How AI is Changing Data Scientist's Workflow”. Las palabras que más se repiten: tool, scientist, model, build. Este vídeo tiene 141 frases y 1957 palabras para practicar shadowing. La parte hablada dura 10:46. El hablante habla rápido, unas 182 palabras por minuto, así que espera sonidos enlazados y reducidos. Solo el 81 % de las palabras está entre las 3.000 más comunes del inglés, por lo que el vocabulario es exigente.
Vocabulario clave de este vídeo
Las 15 palabras más avanzadas del vídeo, con su pronunciación y significado:
| Palabra | Pronunciación | Significado |
|---|---|---|
| query sustantivo | /ˈkwɪɹ.i/ | consulta, pregunta |
| leverage sustantivo | /ˈlɛv.(ə.)ɹɪd͡ʒ/ | palanca, palanqueo |
| forecast sustantivo | /ˈfɔːkɑːst/ | pronóstico, vaticinio |
| deploy verbo | /dɪˈplɔɪ/ | desplegar |
| prototype sustantivo | /ˈpɹəʊtətaɪp/ | prototipo |
| prompt verbo | /pɹɑmpt/ | llevar a, concitar |
| automate verbo | /ˈɔ.təˌmeɪt/ | automatizar |
| invoice sustantivo | /ˈɪnˌvɔɪs/ | albarán, factura |
| rethink verbo | /ɹiːˈθɪŋk/ | repensar, reflexionar |
| visualization sustantivo | /ˌvɪʒ.ʊ.ə.laɪˈzeɪ.ʃən/ | visualización |
| excel verbo | /ɪkˈsɛl/ | aventajar, superar |
| desktop sustantivo | /ˈdɛsktɒp/ | escritorio, sobremesa |
| adapt verbo | /əˈdæpt/ | adaptar, ajustar |
| transform verbo | /tɹænsˈfɔɹm/ | trasformar, transformar |
| pipeline sustantivo | /ˈpaɪpˌlaɪn/ | oleoducto, tubería |
Phrasal verbs que vas a escuchar
| Palabra | Pronunciación | Significado |
|---|---|---|
| speed up verbo | /spiːdˈʌp/ | acelerar, apurarse |
| come across verbo | pasarse a | |
| come up with verbo | ingeniar, ingeniarse | |
| get away with verbo | irse de rositas, salir impune / inulto (de) | |
| pay off verbo | valer la pena, salir a cuenta | |
| try out verbo | probar, ensayar |
Gramática en este vídeo
Las estructuras que más usa el hablante, con las palabras exactas del vídeo:
| Estructura | En el vídeo |
|---|---|
| Voz pasiva be + participio pasado — importa lo que ocurre, no quién lo hace | would be sent · being transformed · is locked |
| Present perfect have/has + participio pasado — una acción pasada que sigue importando ahora | you've worked · I've come · has faced |
| Oraciones de relativo who / which + oración — información extra sobre una persona o cosa | hidden which means · ones who know · ones who can |
Pronunciación a tener en cuenta
El hablante usa 30 contracciones y formas reducidas, como you're, can't, they're. Dilas en su forma corta, tal como las oyes.
- Los sonidos de “th”: synthetic /sɪnˈθɛtɪk/, rethink /ɹiːˈθɪŋk/, hypothesis /haɪˈpɒθɪsɪs/
- Los sonidos de “sh” y “zh”: visualization /ˌvɪʒ.ʊ.ə.laɪˈzeɪ.ʃən/, recommendation /ˌɹɛkəmɛnˈdeɪʃən/, credential /kɹɪˈdɛnʃəl/, visualize /ˈvɪʒuəˌlaɪz/, friction /ˈfɹɪkʃən/
- Palabras largas — cuida el acento: visualization /ˌvɪʒ.ʊ.ə.laɪˈzeɪ.ʃən/, recommendation /ˌɹɛkəmɛnˈdeɪʃən/, exploratory /ɛkˈsplɒɹ.ə.tə.ɹi/, generative /ˈd͡ʒɛnəɹətɪv/, metadata /ˈmɛt.əˌdeɪ.tə/
Sonidos difíciles para hispanohablantes:
- s + consonante al inicio — sin añadir una “e” delante: stack /stæk/, stakeholder /ˈsteɪkˌhəʊl.də/, slack /slæk/, sponsor /ˈspɒn.səː/
- /v/ — no es /b/: los dientes tocan el labio inferior: leverage /ˈlɛv.(ə.)ɹɪd͡ʒ/, invoice /ˈɪnˌvɔɪs/, visualization /ˌvɪʒ.ʊ.ə.laɪˈzeɪ.ʃən/, generative /ˈd͡ʒɛnəɹətɪv/, uncover /ʌnˈkʌvɚ/
- /z/ — sonora, no /s/: visualization /ˌvɪʒ.ʊ.ə.laɪˈzeɪ.ʃən/, visualize /ˈvɪʒuəˌlaɪz/, newsletter /ˈn(j)uzˌlɛtɚ/, analyze /ˈæn.əˌlaɪz/, browser /ˈbɹaʊ.zəɹ/
Cómo practicar con este vídeo
- Escucha el vídeo entero una vez sin hablar y anota las palabras que no conoces.
- Empieza a velocidad 0,75×, haz shadowing frase por frase y vuelve a la velocidad normal cuando te resulte fácil.
- Grábate y compara con el original, prestando atención a palabras como query, leverage, forecast.
¿Qué es la Técnica de Shadowing?
Shadowing es una técnica de aprendizaje de idiomas respaldada por la ciencia, desarrollada originalmente para la formación de intérpretes profesionales y popularizada por el políglota Dr. Alexander Arguelles. El método es simple pero poderoso: escuchas audio en inglés nativo y lo repites en voz alta de inmediato, como una sombra que sigue al hablante con solo 1-2 segundos de retraso. A diferencia de la escucha pasiva o los ejercicios de gramática, el shadowing obliga a tu cerebro y músculos de la boca a procesar y reproducir simultáneamente patrones de habla reales. Las investigaciones muestran que mejora significativamente la precisión de la pronunciación, la entonación, el ritmo, el habla conectada, la comprensión auditiva y la fluidez al hablar, convirtiéndola en una de las metodologías más efectivas para la preparación del IELTS Speaking y la comunicación en inglés en el mundo real.