Shadowing Practice: Enhancing AV Simulation with Generative AI - DRIVE Labs Ep. 36 - Learn English Speaking with Video
Les maken...
1
Simulation is critical to ensuring the safety of autonomous driving systems before real -world deployment.
2
However, creating realistic scenarios that accurately depict rare and potentially dangerous situations can be extremely labor -intensive,
3
especially when creating 3D assets and adding natural behavior.
4
In this episode of Dryer Labs, together we'll discuss three key advancements from NVIDIA that uses generative AI to create realistic environments,
5
generate natural driving behaviors, and edit the resulting scenarios to enable rigorous AV evaluation and training.
6
First, NVIDIA has developed Map LLM,
7
a large language model that generates realistic driving environments in the form of high -definition maps based on user input. For example,
8
it can use text from a crash report to generate multiple possible high -definition maps
9
that match the original description the generation of diverse driving environments
10
provides the first key components of general realistic av simulation the
11
road layout the second key capability is placing agents within these environments
12
and generating natural driving behaviors once the virtual world is constructed
13
we can use nvidia lctgen a language condition traffic generation model to populate vehicles pedestrians
14
and other agents exhibiting natural realistic behaviors lctgen is a transformer based language model
15
that interprets text descriptions of traffic scenarios it predicts where both
16
agents are likely to be as well as their motion through the environment all according to the given text prompt.
17
Again, using the example of a crash report,
18
LCTGen can place vehicles at their specified locations and generate the trajectories described in the report, as well as possible variations.
19
This is designed to help AV developers turn previously dormant data sources, such as text -based crash reports, into SIM -ready evaluation scenarios.
20
This not only increases data diversity,
21
but also enhances the training and testing of AVStacks in simulation to maintain safety across a wider variety of scenarios.
22
If we still need to fine -tune the scenario, we can use editing tools built on NVIDIA Omniverse,
23
which incorporates large language models to easily modify elements of the virtual world using simple language props.
24
In this example, the scenario editor can immediately change a daytime scene into a nighttime scene, adjust the weather from sunny to rainy,
25
or add agents to the scene.
26
This greatly expands the range of real -world operational design domains, or ODDs, that AVs are exposed to during training.
27
The responsiveness of these systems will be accelerated by the NVIDIA BlackWild GPU architecture,
28
taking advantage of its expanded inference and next -generation transformer engines designed for generative AI workloads.
29
When we combine the capabilities of MapLM for generating realistic environments,
30
LCTGen for populating those environments with naturalistic agents, and the LM Power Scenario Editors for customizing simulation in all the verse using text,
31
we can officially tap into Generative AI to create limitless ultra -realistic scenarios in new ways,
32
as well as rigorous AV evaluation and training that accurately mirrors the real world.
33
Stay tuned for these innovative capabilities to be integrated into NVIDIA Inference Microservices, or the NIMM roadmap.
📺 Zelfde Kanaal
✨ Aanbevolen Video
C13
188 zinnen
NVIDIA GTC 2025 - Keynote Highlights by NVIDIA CEO Jensen Huang
Business EnglishUniversity StudentsWorking Adults
C11
46 zinnen
Bebop: Accelerating LLM RL Training via MTP
University StudentsWorking Adults
C11
108 zinnen
How I Learned Procedural Generation
Business EnglishUniversity StudentsWorking Adults
C18
55 zinnen
When AIs act emotional
Business EnglishUniversity StudentsWorking Adults
C14
28 zinnen
Neural Radiance Fields in 2 Minutes
University StudentsWorking Adults
C11
315 zinnen
how AI broke the SWE Career Ladder
Business EnglishUniversity StudentsWorking Adults
C11
747 zinnen
MIT Introduction to Deep Learning | 6.S191
Business EnglishUniversity StudentsWorking Adults
B21
183 zinnen
How F1 Cars Collect Data in Real Time
Business EnglishUniversity StudentsWorking Adults
C12
244 zinnen
Real-Time Digital Twins Using CFD, Sensors & AI - Haris Kokkinos | Podcast #165
Business EnglishUniversity StudentsWorking Adults
C12
339 zinnen
Easy Migration from Postgres to Databricks Lakebase
Business EnglishUniversity StudentsWorking Adults
C1115 zinnen
Novanta CIO Sarah Betadam on managing risk around AI
Business EnglishUniversity StudentsWorking Adults
C185 zinnen
We Can Now Simulate a Human Brain, Scientists Show
IELTS PrepTOEFL PrepUniversity Students
Woordenschat en spreektips bij deze les
Deze video bevat 33 zinnen en 500 woorden om na te spreken. Het gesproken deel duurt 3:37. De spreker praat in een gelijkmatig tempo van ongeveer 138 woorden per minuut, prettig om te shadowen. Slechts 67% van de woorden hoort bij de 3.000 meest gebruikte Engelse woorden, dus de woordenschat is pittig.
Belangrijke woorden in deze video
15 woorden uit de video die het leren waard zijn, met uitspraak en betekenis:
| Woord | Uitspraak | Betekenis |
|---|---|---|
| scenario zelfstandig naamwoord | /sɪˈnɛəɹioʊ/ | scenario |
| realistic bijvoeglijk naamwoord | /ˌɹɪəˈlɪs.tɪk/ | realistisch |
| evaluation zelfstandig naamwoord | /ɪˌvæljuˈeɪʃn̩/ | beoordeling, evaluatie |
| expand werkwoord | /ɪkˈspænd/ | vergroten, uitbreiden |
| virtual bijvoeglijk naamwoord | /ˈvɜɹt͡ʃuəl/ | virtueel |
| edit werkwoord | /ˈɛdɪt/ | bewerken, wijzigen |
| tune zelfstandig naamwoord | /tjuːn/ | melodie |
| accurately bijwoord | /ˈæk.jə.ɹɪt.li/ | trefzeker |
| rigorous bijvoeglijk naamwoord | /ˈɹɪɡəɹəs/ | rigoureus |
| mirror zelfstandig naamwoord | /ˈmiɹɚ/ | spiegel |
| element zelfstandig naamwoord | /ˈɛləmənt/ | element |
| architecture zelfstandig naamwoord | /ˈɑː.kɪˌtɛk.t͡ʃə/ | architectuur, bouwstijl |
| potentially bijwoord | /pəˈtɛnʃ(ə)li/ | potentieel |
| component zelfstandig naamwoord | /kəmˈpoʊ.nənt/ | onderdeel, component |
| diversity zelfstandig naamwoord | /daɪˈvɜː(ɹ)sɪti/ | verscheidenheid, diversiteit |
Uitspraak om op te letten
- De klanken “sh” en “zh”: simulation /ˌsɪm.jəˈleɪ.ʃn̩/, evaluation /ɪˌvæljuˈeɪʃn̩/, potentially /pəˈtɛnʃ(ə)li/, operational /ˌɑ.pəˈɹeɪ.ʃə.nəl/, variation /ˌvɛəɹiˈeɪʃn̩/
- Lange woorden — let op de klemtoon: evaluation /ɪˌvæljuˈeɪʃn̩/, capability /ˌkeɪ.pəˈbɪl.ɪ.ti/, accurately /ˈæk.jə.ɹɪt.li/, architecture /ˈɑː.kɪˌtɛk.t͡ʃə/, potentially /pəˈtɛnʃ(ə)li/
Zo oefen je met deze video
- Luister de hele video één keer zonder te spreken en noteer de woorden die je niet kent.
- Spreek zin voor zin na op normale snelheid en herhaal elke zin tot je ritme gelijk is aan dat van de spreker.
- Neem jezelf op en vergelijk met het origineel; let daarbij op woorden als scenario, realistic, evaluation.
Wat is de Shadowing-techniek?
Shadowing is een wetenschappelijk onderbouwde taalleermethode die oorspronkelijk is ontwikkeld voor professionele tolkentraining en gepopulariseerd door polyglot Dr. Alexander Arguelles. De methode is eenvoudig maar krachtig: je luistert naar native Engelse audio en herhaalt het onmiddellijk hardop — als een schaduw die de spreker volgt met slechts 1–2 seconden vertraging. In tegenstelling tot passief luisteren of grammaticadrills, dwingt shadowing je hersenen en mondspieren om echte spraakpatronen tegelijkertijd te verwerken en te reproduceren. Onderzoek toont aan dat het de uitspraaknauwkeurigheid, intonatie, ritme, verbonden spraak, luisterbegrip en spreekvaardigheid aanzienlijk verbetert — waardoor het een van de meest effectieve methoden is voor IELTS Speaking-voorbereiding en echte Engelse communicatie.