Sensing What’s Ahead in 2022: Latest Breakthroughs Pave Way for Year of Autonomous Vehicle Innovation

2021 trends are charging into 2022, heralding a new era of autonomous transportation and opening up business models and services never before dreamed of.

In the next year, software-defined compute architectures, electric powertrains, high-fidelity simulation, AI assistants and autonomous trucking solutions are set to transform the transportation industry.

This past year, key technologies saw significant progress, including centralized high-performance compute, data center solutions, simulation and more. These breakthroughs will give rise to even greater innovation next year, ushering in new technology, improving current offerings and accelerating the deployment of safer, more efficient vehicles.

Following Mercedes-Benz’s announcement in 2020 of its upcoming software-defined fleets built on NVIDIA DRIVE Orin, 2021 saw nearly a dozen companies transition their vehicles to the high-performance, centralized compute platform, including NIO, SAIC, Xpeng and more.

Simulation, a crucial component of the autonomous vehicle development pipeline, further narrowed the gap between the virtual and real worlds, using technologies such as NVIDIA Omniverse and synthetic data generation.

And, as the pandemic continued, increased demand for delivery, as well as the worsening driver shortage, invigorated efforts to deploy autonomous trucking solutions.

An Always-New Set of Wheels

AI is transforming the personal vehicle experience. Vehicle development cycles have traditionally lasted around two years, and the end product is fixed with the technology it rolls off the manufacturing line with.

A centralized, software-defined vehicle architecture built on high-performance compute, such as NVIDIA DRIVE Orin, is richly programmable, streamlining development, and can continually improve over time.

In the next year, more automakers will move away from their traditional manufacturing practices and architect vehicles with high-performance compute headroom and full-stack software from the start. As a result, next-gen models can benefit from new apps and features, via over-the-air software updates, so the vehicle gets better and safer over time.

These vehicles will also continue to transition to electric powertrains for intelligent transportation that’s also more sustainable. Automakers have already pledged to increase the share of electric vehicles in their fleets, while newcomers begin to roll out cutting-edge production EVs.

Reality Goes Virtual

Autonomous vehicles are born in the data center, and simulation is a key component of this training and validation process.

In the past, simulation platforms have used gaming engines to generate virtual worlds. However, these engines have serious limitations in accurately recreating the physics and vehicle dynamics of a car driving in the real world.

NVIDIA DRIVE Sim is built on our core technologies, including NVIDIA RTX, Omniverse and AI, to create a true digital twin environment of the world. It uses NVIDIA Omniverse Replicator to generate physically based sensor data for camera, radar, lidar and ultrasonics, along with labeled ground truth data to reduce valuable development time and cost.

The combination of these technologies has significantly narrowed the gap between the virtual and physical worlds, delivering a comprehensive AV training, testing and validation platform. Equipped with DRIVE Sim, AV manufacturers can hit the accelerator on deployment plans in 2022.

Truly Personal Transportation

In addition to high-fidelity AV simulation, NVIDIA Omniverse is paving the way for a seamless intelligent assistant experience.

With NVIDIA DRIVE Concierge, vehicle occupants have access to AI services that are always on, using NVIDIA DRIVE IX and NVIDIA Omniverse Avatar for real-time interactions.

Omniverse Avatar connects speech AI, computer vision, natural language understanding, recommendation engines and simulation. Avatars created on the platform are interactive characters with ray-traced 3D graphics that can see, speak and converse on a wide range of subjects, and understand naturally spoken intent.

The technology of Omniverse Avatar enables DRIVE Concierge to serve as everyone’s digital assistant, providing recommendations and alerts, booking reservations and making phone calls. It’s personalized to each driver and passenger, giving every vehicle occupant their own personal concierge. And with Omniverse Avatar technology, these assistants will have incredible intelligence.

Keep on Trucking

As demand for ecommerce goods and freight continues to grow, the industry is increasingly investing in autonomous trucking solutions.

E-commerce orders increased nearly 60 percent year-over-year in 2020, according to last-mile technology vendor Convey Inc., with more than a third of shoppers opting for same-day delivery. At the same time, the trucking industry is experiencing a 90-percent-plus turnover rate; with the American Trucking Association estimating it will be short 160,000 drivers by 2028.

AI-enabled, highly automated and fully autonomous trucks as well as last-mile delivery vehicles, such as those under development by Volvo Autonomous Solutions, Kodiak Robotics, Embark, TuSimple, Plus, Einride and more, are an essential element of our transportation future.

These next-generation vehicles are built on the high-performance, energy-efficient compute of NVIDIA DRIVE to enhance the safety and quality of life for truck drivers and increase productivity and efficiency.

As the industry continues to adopt these transformative technologies, the next year will see rapid growth toward a truly autonomous future.

The post Sensing What’s Ahead in 2022: Latest Breakthroughs Pave Way for Year of Autonomous Vehicle Innovation appeared first on The Official NVIDIA Blog.

Read More

Forrester Report: ‘NVIDIA GPUs Are Synonymous With AI Infrastructure’

In a new evaluation of enterprise AI infrastructure providers, Forrester Research Monday recognized NVIDIA and three of its key partners — Amazon Web Services, Google and Microsoft — as the leaders in AI infrastructure.

The “Forrester Wave: AI Infrastructure, Q4 2021” report states that “​​NVIDIA’s DNA is in every other AI infrastructure solution we evaluated. It’s an understatement to say that NVIDIA GPUs are synonymous with AI infrastructure.”

The report recognizes NVIDIA DGX systems and NVIDIA-accelerated offerings not only from AWS, Google and Microsoft, but also from Dell, Exxact, Hewlett Packard Enterprise, IBM, Inspur, Lambda, Run: AI, Spell and Supermicro.

NVIDIA software, including NVIDIA AI Enterprise, brings full-stack AI development to the broad ecosystem of providers recognized in the Forrester report.

The news comes as multitrillion-dollar industries — from healthcare to finance to retail — are racing to put AI to work and relying on NVIDIA AI infrastructure, including NVIDIA DGX Foundry to accelerate their business transformations.

‘Rocking the World’

“AI is rocking the world,” Forrester’s team wrote.

The firm noted that 74 percent of surveyed global data and analytics decision-makers whose firm is implementing or expanding its use of AI said that adoption has had a positive impact.

“It’s rapidly gone from ‘if’ to ‘when’ to ‘now,’” Forrester reported.

The report from a leading independent research firm signals the arrival of enterprise AI in the mainstream and provides support for even more widespread adoption.

NVIDIA Positioned as a Leader for Its DGX Systems

And that requires flexible, enterprise-grade infrastructure.

“AI platform software that many of these enterprises rely on is all well and good, but it needs hearty infrastructure — compute, storage, networking — to keep AI teams working, not waiting,” Forrester’s team wrote.

NVIDIA’s DGX systems, engineered for enterprise AI workloads, scored the highest in the market presence category and received among the highest scores in the strategy category.

“Breakthroughs in deep learning around 2012 brought AI into focus, but only NVIDIA had the strategy, vision, and roadmap to invest in supporting these now mainstream AI workloads,” the Forrester report noted.

The Forrester report cited NVIDIA’s strengths in “architectural components, throughput, latency, and overall product strategy.”

“The vendor’s sweet spot for its DGX systems are for customers that want a complete system that is engineered by NVIDIA to include its latest component technology for AI workloads,” the Forrester report noted.

NVIDIA AI Available Across the Industry

With NVIDIA AI, customers can choose from any cloud provider and server maker and select from systems located in their data centers or colocation facilities, in the cloud and even on the desktop.
NVIDIA AI infrastructure supports every major cloud service provider. It’s available on the desktop from every major server and system vendor. And NVIDIA technologies can be deployed at the edge by enterprises in autonomous vehicles, robots and embedded systems.

As a result, every vendor mentioned in Forrester’s report is an NVIDIA customer, partner or NVIDIA Inception member, underscoring NVIDIA’s unique role in the industry as a full-stack AI company providing semiconductors, software and systems.

“Reference customers appreciate the vendor’s thought leadership in AI, its frameworks designed to run on NVIDIA GPUs, and having first access to chips coming out of NVIDIA R&D,” the Forrester report stated.

With widespread reports of positive results, universal support for NVIDIA enterprise AI and recognition from one of the most widely respected industry analyst firms, enterprise AI adoption is poised to accelerate.

Enterprises can experience NVIDIA-accelerated AI with NVIDIA AI Enterprise and NVIDIA DGX Foundry through the NVIDIA LaunchPad program, available free of charge in nine regions worldwide.

The post Forrester Report: ‘NVIDIA GPUs Are Synonymous With AI Infrastructure’ appeared first on The Official NVIDIA Blog.

Read More

Blender 3.0 Release Accelerated by NVIDIA RTX GPUs, Adds USD Support for Omniverse

‘Tis the season for all content creators, especially 3D artists, this month on NVIDIA Studio.

Blender, the world’s most popular open-source 3D creative application, launched a highly anticipated 3.0 release, delivering extraordinary performance gains powered by NVIDIA RTX GPUs, with added Universal Scene Description (USD) support for NVIDIA Omniverse.

Faster 3D creative workflows are made possible by a significant upgrade to Isotropix Clarisse’s redesigned renderer Angie, and Cyberlink’s PowerDirector integration with NVIDIA Broadcast technology — all backed by the December Studio Driver, ready for download.

Plus, NVIDIA Studio and Adobe continue to share the love this holiday season, offering three free months of Adobe Creative Cloud with the purchase of a select NVIDIA Studio laptop or desktop.

And, in the spirit of giving, check out the NVIDIA Studio Facebook, Twitter and Instagram channels all month long for a chance to win a new NVIDIA Studio laptop.

Blender and RTX Render Better Together

Blender 3.0 marks the beginning of a new era for 3D content creation, with new features including a more responsive viewport, reduced shadow artifacts, an asset library to access owned and borrowed assets quickly, and additional customization options.

Blender Cycles renderer has been completely overhauled, maximizing NVIDIA RTX GPU RT Cores for OptiX ray tracing and Tensor Cores for OptiX AI denoising.

 

This enables rendering nearly 12x and 15x faster than with a MacBook Pro M1 Max or CPU alone, respectively, with the GeForce RTX 3080 laptop GPU.

3D artists can get instant feedback when working in Cycles as the viewport renderer. OptiX support has also been added to model rendering with materials, delivering stunning performance.

Blender 3.0 also adds USD file importing. USD files are the foundation of NVIDIA Omniverse, allowing scenes to be edited by multiple creative applications simultaneously.

The new importer converts USD geometry, lights, cameras, time-sampled animation and preview surface materials to their Blender representations — a massive leap in the Omniverse ecosystem.

Omniverse users can access an alpha build of Blender 3.1, unlocking additional features such as  instancing and added support for USD material exporting, which includes basic NVIDIA Material Definition Language conversions.

To download Omniverse 3.1 alpha, open the launcher and look for the Blender 3.1 build.

Getting started? Check out the Omniverse Showroom app, which gives beginners a look into the foundational technologies of Omniverse, with new content releases over time.

A December (Studio Driver) to Remember

Isotropix Clarisse is a fully interactive computer graphics toolset specialized for set-dressing, look development, lighting and rendering.

The new release, Clarisse 5.5 with Angie, a redesigned renderer, significantly speeds up renders and enables interactive rendering of huge scenes with ray-traced acceleration, exclusively for NVIDIA RTX GPUs.

Clarisse 5.5 with Angie in beta is available for download today.

Cyberlink’s video editing creative app, PowerDirector, has added NVIDIA Broadcast integration and its advanced AI tools, including video denoising to remove grainy noise from video shot in low-light conditions; audio denoising to remove unwanted background noise; and audio dereverb to get rid of room echos.

Now, video and audio enhancements can be done in post-production, adding more flexibility and power to a video editor’s toolbox.

These incredible creator app upgrades — as well as optimizations in Blender 3.0, NVIDIA Omniverse, Isotropix Clarisse, Cyberlink PowerDirector, Blackmagic’s DaVinci Resolve, BorisFX Sapphire, JangaFX Embergen and more — are all supported by the December Studio Driver (472.84), available for download now.

Join the Studio Holiday Fun

NVIDIA Studio is sharing the love in December by way of featurette videos, created by some of the most popular content creators, who discuss their journeys into content creation and share tips on how to get started.

These one-of-a-kind insights into various creative fields will feature giveaways that include the same model of NVIDIA Studio laptops the creators use.

Visit the NVIDIA Studio Facebook, Twitter and Instagram channels to learn more and enter.

Get Studio Support During Winter Break

For new ways to create, including exclusive step-by-step tutorials from industry-leading artists, inspiring community showcases and more, visit the NVIDIA Studio YouTube channel.

This year, we’ve worked with 52 leading creative professionals to launch 137 videos, which feature 75+ RTX-accelerated apps.

The channel’s videos have over 3 million minutes watched and 14,000+ shares, so thank you for your continued support and be sure to subscribe for new weekly videos.

Finally, check out Adobe’s The Great Shoecase contest and customize a model shoe by applying and painting materials in Substance 3D Painter. Win epic prizes including an NVIDIA Studio laptop or NVIDIA SHIELD TV. Submissions end on Thursday, Dec. 16.

Stay up to date on all things Studio by subscribing to the NVIDIA Studio newsletter.

The post Blender 3.0 Release Accelerated by NVIDIA RTX GPUs, Adds USD Support for Omniverse appeared first on The Official NVIDIA Blog.

Read More

Forging New Pathways: Boys & Girls Clubs Teens Take AI From Idea to Application

Building AI projects to aid Alzheimer’s patients and monitor pedestrian safety might not be the typical way teens spend their summer.

But that’s what a dozen teens with the Boys & Girls Clubs of Hudson County, in densely packed northeastern New Jersey, did as part of the AI Pathways Institute program.

They spent three weeks brainstorming, coding and traversing spinning robots while using NVIDIA Jetson Nano 2GB developer kits and Jetbot robotics toolkits to create projects that tapped into a multitude of real-world issues. The aim was “to leave our environment and society better than we found it,” said Gail Grant, teen tech coordinator at the nonprofit.

The AI Pathways Institute program in Hudson County is an outgrowth of a successful 2019 pilot program that NVIDIA and the Boys & Girls Clubs of Western Pennsylvania partnered on. Its goals are to introduce high school students to AI and machine learning through a three-week summer camp and provide them with hands-on experience with relevant projects.

NVIDIA and the Western Pennsylvania Clubs announced this spring a new three-year partnership to scale the program to more students through the development of the AI Pathways Toolkit. The toolkit strives to make it easy for other clubs and organizations to deliver hands-on AI and robotics education to youth.

The Hudson County club — which has worked for nearly 130 years to enrich the lives of young people from disadvantaged circumstances — is among the first to adopt it.

Participating students received a cash stipend, new laptop and certificate of achievement from Carnegie Mellon University, which had previously worked with the Western Pennsylvania club. Students who scored well on a post-program exam qualified themselves for future internships.

Emboldening Students in AI

Grant said the program’s goal was to provide students with a broader sense of what AI truly entails. Moreover, she hoped to embolden students to develop and pursue newfound interests in AI and technology by providing speaker events where STEM and AI professionals highlighted their career pathways.

Sekou Sy, a 16-year-old in the AI Pathways program, was surprised to learn about the breadth of robotics — and just how much could be done with AI.

“AI is used in so many objects and ideas that I didn’t think of before,” Sy said. “It’s not just in robots, but other areas like healthcare and the environment, all of which will expand even more in the future.”

Another student, Moureau Tillman (pictured above), was already familiar with AI and the Python programming language, but AI Pathways’ focus on hands-on learning allowed her to dive deeper into AI’s real-world impact.

“Seeing as I already worked with AI, I thought the course was going to be a re-learning experience,” Tillman said. “But I learned a lot of new things through working with robots and coming up with a project that would help people other than myself.”

AI Projects in Action

The program culminated in a presentation in which students explained how they used Python to program NVIDIA Jetson-based projects that would respond to prominent, practical issues.

One project, titled “Forget-Me-Not,” employed AI to help elders and Alzheimer’s patients by alerting them about tasks and appointments, as well as providing medicine or prescription reminders.

“When brainstorming for this project, I thought about what I struggled with myself,” said Sy, who worked on the project with two teammates. “My memory is not so good, and I lose things a lot. We came up with this app where you can put in your data, and it gets to know your daily routines. Then, it reminds you about just about everything you might need.”

Other groups created proposals for projects like “Ecobot,” a robot that roams beaches and discards trash; “Safety First,” which uses AI to monitor streets and call the police when a pedestrian is in danger; and “Fresh,” a device to be placed in users’ cars and monitor outdoor air pollution.

Although not all were able to see their projects to completion, students witnessed how AI could be applied to a variety of problems. Some were even inspired to pursue tech as a career.

“These projects made me think about real-life situations that people are dealing with,” Sy said. “I loved taking it one step further by incorporating the AI aspect, as well as seeing the impact that AI can have in solving these problems. In fact, AI is a field I’m really excited to pursue in the future.”

The Hudson County club plans to reproduce the program early next year. Moving forward, Grant hopes that it’ll be a recurring one that’s implemented throughout the year.

To learn more about entry-level education on AI and robotics, watch the on-demand NVIDIA GTC sessions “Begin Your AI Journey With NVIDIA Jetson Nano” (A31723) and “Getting Started With the Edge AI and Robotics Teaching Kit” (A31535).

The post Forging New Pathways: Boys & Girls Clubs Teens Take AI From Idea to Application appeared first on The Official NVIDIA Blog.

Read More

Latest GeForce NOW Upgrade Rolling Out With Ubisoft Connect Account Linking and Improved PC Gaming on Mac

Get into the game quicker with the latest GeForce NOW update starting to roll out this GFN Thursday.

Learn more about our latest app update — featuring Ubisoft Connect account linking for faster game launches — now rolling out to members, and the six new games joining the GeForce NOW library.

The update also improves the streaming experience on Mac. So, this GFN Thursday also takes a look at how GeForce NOW transforms Macs into powerful PC gaming rigs.

Streamline Your Sign-In

The newest GeForce NOW app update is rolling out to members on PC and Mac, beginning this week. Version 2.0.36 includes a new feature that links NVIDIA and Ubisoft accounts to enable faster Ubisoft Connect game launches by automatically logging into a user’s account. Skip the sign-in process and stream your favorite Ubisoft games this week.

The update also includes a fix for streaming at the correct aspect ratio on the Apple MacBook Pro M1 Max, as well as improvements to the countdown timer when viewed on the in-game overlay.

PC Gaming on a Mac? Here’s How It Works

It used to be a difficult choice: do you want to be a Mac user or a PC gamer? With GeForce NOW, you can have your Mac and PC game, too.

GeForce NOW transforms nearly any Mac into a high-end gaming rig, thanks to the power of the cloud. NVIDIA data centers do the heavy lifting, rendering games at full quality and streaming them down to Macbook Pro, Macbook Air, iMac and iOS. Get all the benefits of PC gaming, without leaving the Apple ecosystem.

For the full RTX 3080 experience, connect your Macbook or other laptop via Displayport to a gaming monitor. It’s a beautiful thing.

On GeForce NOW, you play the real PC versions of your games, without having to worry if something has been ported to Mac. Software compatibility for the new M1 Mac isn’t a problem either, since the native PC version of games streams straight from the cloud.

GeForce NOW also handles game saves for supported games, so members can play on their Macs, as well as any other supported device, without losing progress.

That means the next time your squad readies up in Apex Legends, you can join the fray from your iMac. Jealous of your friends building their ultimate Viking community in Valheim? With GeForce NOW, you can join them without leaving your Mac. Build your gaming library with weekly free games from the Epic Games Store, with offers like Dead By Daylight.

Plus, GeForce NOW RTX 3080 members can now play at native resolution on their M1 Macbook Air or Macbook Pro, at glorious 1600p. Stream with even longer sessions lengths — up to eight hours. And with RTX ON for both RTX 3080 and Priority members, experience games like Cyberpunk 2077 and Control with real-time ray tracing, without upgrading to a PC.

Playing PC games with GeForce NOW on a Mac is like having your cake and eating it, too.

Yes, Your Mac Can Run Crysis Now

Can it run Crysis Remastered? Yep. Get the game for free with a six-month Priority sign-up or GeForce NOW RTX 3080 order.

Ready for the ultimate battle on your Mac? For a limited time, get a copy of Crysis Remastered free with select GeForce NOW memberships. Purchase a six-month Priority membership, or the new GeForce NOW RTX 3080 membership, and get a free redeemable code for Crysis Remastered on the Epic Games Store. Terms and conditions apply.

Do Pass Go. Do Collect New Games.

Rediscover the Monopoly game you love, in a way you’ve never seen before, in Monopoly Madness.

GFN Thursday always means new games coming to the cloud. Six titles are being added to the GeForce NOW library this week, including two day-and-date releases:

We make every effort to launch games on GeForce NOW as close to their release as possible, but, in some instances, games may not be available immediately.

Also, we had hoped to add both Syberia: The World Before in December. However, these games have shifted their release dates to next year and will be coming to the cloud in the future.

Finally, in case you missed it – Fortnite flipped. Explore new locations, take on enemies with new weapons, and discover what’s new on the Island in Fortnite Chapter 3 – streaming now!

For the members who have experienced the magic of PC gaming on a Mac, we’ve got a question for you. Tell us on Twitter or down below in the comments.

The post Latest GeForce NOW Upgrade Rolling Out With Ubisoft Connect Account Linking and Improved PC Gaming on Mac appeared first on The Official NVIDIA Blog.

Read More

Accelerating Financial Services With AI

AI is enabling brighter financial futures for consumers and businesses. From traditional banks to new fintechs, the financial services industry is powering use cases with AI such as preventing payments fraud, automating insurance claims, and accelerating trading strategies.

The latest episode in the I AM AI video series brings these technology stories to life by featuring global financial enterprises and startups transforming banking, insurance and payments.

Automating Insurance Claims and Document Processing

Ping An, China’s largest property and casualty insurer, uses NVIDIA GPU-powered image analysis and AI to rapidly calculate damages caused by vehicle collisions, automate claims handling for simple and clean cases, estimate costs and identify fraudulent claims. This automated experience leads to better customer service, fewer cases of insurance fraud and more efficient delivery of services.

CAPE Analytics, a computer vision startup, is transforming the property insurance industry by analyzing geospatial data to inform more accurate underwriting decisions and mitigate wildfire disasters. The NVIDIA Inception member uses AI to produce detailed data on the vegetation density, roof material and proximity to surrounding structures — more accurately calculating risk and helping homeowners take actions to reduce potential property damage.

Applica, a fintech, deploys progressive AI to streamline text-based workflows that deliver better-than-human performance. Its robotic text automation platform uses NVIDIA GPUs for training machine learning models and inference in production. This eliminates up to 90 percent of manual errors, boosts document turnover rate to less than one second, and reduces physical workforce effort by up to 75 percent.

Banks Adopt AI to Accelerate Model Training and Cut Costs

Bank of Montreal runs complex derivative models to find fair prices for financial contracts used in valuation and risk management. These AI-informed models — trained by Riskfuel, a Toronto-based startup and member of NVIDIA Inception, on 650 million data points and deployed for inference on NVIDIA A100 or T4 Tensor Core GPUs — can drive higher trade flows, generate new risk insights and lead to better product design and selection for Riskfuel’s clients.

Capital One uses Dask and RAPIDS, a suite of GPU-optimized libraries for accelerating data science and analytics pipelines, to achieve 100x improvement in model training times and reduce costs by nearly 98 percent. Its team of data scientists and machine learning engineers use accelerated and distributed data processing for financial and credit analysis.

AI Virtual Assistants Improve the Customer Experience

Square, a global leader in payments, powers its virtual assistant, Square Assistant, using conversational AI to schedule appointments with new and returning customers. These AI models are trained using large hyperparameter jobs running on NVIDIA GPUs in AWS. Once they’re trained and ready for deployment, Square found that inference jobs on large models such as RoBERTa run 10x faster on the AWS GPU service than on CPUs.

Intuit uses conversational AI and intelligent AI assistants to empower financial futures for individuals, self-employed workers and small business owners. The company uses AI technologies, such as knowledge engineering, machine learning and natural language processing and understanding, to provide targeted and personalized assistance with virtual experts, automate financial documents processing, and even forecast cash flow for small businesses.

Funding the Future of Financial Services with AI

NVIDIA’s full-stack accelerated computing platform enables banks, traders, payments providers, insurers and fintechs to deliver enhanced offerings that boost lifetime value for customers and reduce operational costs across their and their customers’ businesses.

Explore NVIDIA solutions for financial services and learn from more industry leaders, such as American Express and PayPal.

The post Accelerating Financial Services With AI appeared first on The Official NVIDIA Blog.

Read More

Artisan Baking: How Creators Worldwide Cooked Up GTC Keynote’s Virtual Kitchen

With their marbled counters, neoclassical oven alcove and iconic bouquets of spatulas, the “kitchen keynotes” delivered by NVIDIA founder and CEO Jensen Huang during pandemic-era GTCs have been a memorable setting for the highly anticipated events.

The keynotes were initially delivered from his real kitchen, in response to workplace closures. But last spring, the kitchen faded away to reveal a realistic digital replica — one that not only surprised viewers, but also showcased the powerful capabilities of the NVIDIA Omniverse virtual world simulation and collaboration platform.

Now, audiences can get a closer look at all the scenes from the latest virtual kitchen in the Virtual Kitchen Tone Poem.

The project, which launched at GTC in November, is a cinematic homage to the elaborate, painstaking work that went into recreating every detail of the kitchen, from its glistening chrome water fixtures to its earthenware salt cellar.

To accomplish the feat, a team of highly skilled artists collaborated across multiple continents and time zones using Omniverse.

It’s All in the Details

The virtual kitchen got its start during the video shoot for GTC in the fall of 2020, when an onsite crew captured high-resolution images of Huang’s kitchen. The lead environment artist used this footage as the main reference to build a virtual set.

The creative team’s project lead researched detailed references of everything in the kitchen, including the appliance models, oil tins, salt box brands, and even the screws within the cabinets.

A team of eight NVIDIA artists and 10 freelance creators built the cinematic with an Omniverse workflow. In Omniverse, each artist worked within their preferred software, then used Omniverse Connectors to bring all the models and data together, leading to a much smoother animation pipeline and publishing workflow.

The 3D modeling of 57 unique assets and 6,240 total scene objects was done in Autodesk 3ds Max, Autodesk Maya and Pixologic Zbrush. The artists used Adobe Substance Painter and Photoshop for texturing, and the rigging and animation was done in Maya. The team used Nuke for scene composition, while the editing was done with DaVinci Resolve.

Omniverse was where everything converged for lighting and rendering. Omniverse Nucleus acted as the universal exchange and collaboration hub for all the USD-based assets, which helped it all come together. Nucleus facilitated remote access, smart local caching and built-in versioning.

Producing the Virtual Kitchen Tone Poem was also an opportunity to further develop Omniverse Farm — a newly released systems layer that connects multiple computer systems to jointly execute batch operations — and Shot Manager extensions across multiple teams.

With Omniverse Farm, a team of artists can iterate on rendering in an organized, repeatable fashion, bringing flexibility and structure to the rendering process — similar to what animation and visual effects studios would expect.

Omniverse Farm enabled the team to easily batch render 40,000 frames for GTC totaling four terabytes of content, rendered across disparate workstations, on-premises data centers, and cloud servers with a peak of 1,200 GPUs running simultaneously. With the ability to easily contribute a workstation or new server to Farm, the teams could scale to meet their needs.

Visualizing the Future of VFX and Animation

The Virtual Kitchen Tone Poem showcases how it’s possible to have a workflow that’s iterative, scalable and streamlined under short deadlines. These are some of the biggest requirements for artists working in animation and VFX production studios.

Omniverse provided all the tools that enabled the creative team to efficiently render high-quality content for the latest GTC keynote, which shifted across virtual environments, including Huang’s kitchen, a data center, and NVIDIA’s campus in Silicon Valley. NVIDIA technology provided a new level of collaboration for people across the globe that wasn’t available before.

NVIDIA technology also allowed for a non-destructive workflow, which was crucial to a project of this nature and scale, as it helped the team streamline remote and cross-platform collaboration.

The Tone Poem showcases the potential of Omniverse, and how animation and VFX studios can use the platform to enhance workflows, including for production-style projects.

Learn more about NVIDIA Omniverse for professional media & entertainment teams and individual creators.

The post Artisan Baking: How Creators Worldwide Cooked Up GTC Keynote’s Virtual Kitchen appeared first on The Official NVIDIA Blog.

Read More

Silicon Express Lanes: AI, GPUs Pave Fast Routes for Chip Designers

AI can design chips no human could, said Bill Dally in a virtual keynote today at the Design Automation Conference (DAC), one of the world’s largest gatherings of semiconductor engineers.

The chief scientist of NVIDIA discussed research in accelerated computing and machine learning that’s making chips smaller, faster and better.

“Our work shows you can achieve orders-of-magnitude improvements in chip design using GPU-accelerated systems. And when you add in AI, you can get superhuman results — better circuits than anyone could design by hand,” said Dally, who leads a team of more than 200 people at NVIDIA Research.

Gains Span Circuits, Boards

Dally cited improvements GPUs and AI deliver across the workflow of chip and board design. His examples spanned the layout and placement of circuits to faster ways to render images of printed-circuit boards.

In one particularly stunning example of speedups with GPUs, he pointed to research NVIDIA plans to present at a conference next year. The GATSPI tool accelerates detailed simulations of a chip’s logic by more than 1,000x compared to commercial tools running on CPUs today.

GATSPI project from Dally keynote at DAC 2021
GATSPI, a GPU-accelerated simulation tool, completes work in seconds that currently takes a full day running on a CPU.

A paper at DAC this year describes how NVIDIA collaborated with Cadence Design Systems, a leading provider of EDA software, to render board-level designs using graphics techniques on NVIDIA GPUs. Their work boosted performance up to 20x for interactive operations on Cadence’s Allegro X platform, announced in June.

“Engineers used to wait for programs to respond after every edit or pan across an image — it was an awkward, frustrating way to work. But with GPUs, the flow becomes truly interactive,” said Dally, who chaired Stanford University’s computer science department before joining NVIDIA in 2009.

Reinforcement Learning Delivers Rewards

A technique called NVCell, described in a DAC session this week, uses reinforcement learning to automate the job of laying out a standard cell, a basic building block of a chip.

The approach reduces work that typically takes months for a 10-person team to an automated process that runs in a couple days. “That lets the engineering team focus on a few challenging cells that need to be designed by hand,” said Dally.

In another example of the power of reinforcement learning, NVIDIA researchers will describe at DAC a new tool called PrefixRL. It discovers how to design a circuit such as an adder, encoder or custom design.

PrefixRL treats the design process like a game where the high score is in finding the smallest area and power consumption for the circuit.

By letting AI optimize the process, engineers get a device that’s more efficient than what’s possible with today’s tools. It’s a good example of how AI can deliver designs no human could.

Leveraging AI’s Tool Box

NVIDIA worked with the University of Texas at Austin on a research project called DREAMPlace that made novel use of PyTorch, a popular software framework for deep learning. It adapted the framework used to optimize weights in a neural network to find the best spot to place a block with 10 million cells inside a larger chip.

It’s a routine job that currently takes nearly four hours using today’s state-of-the-art techniques on CPUs. Running on NVIDIA Volta architecture GPUs in a data center or cloud service, it can finish in as little as five minutes, a 43x speedup.

Getting a Clearer Image Faster

To make a chip, engineers use a lithography machine to project their design onto a semiconductor wafer. To make sure the chip performs as expected, they must accurately simulate that image, a critical challenge.

NVIDIA researchers created a neural network that understands the optical process. It simulated the image on the wafer 80x faster and with higher accuracy, using a 20x smaller model than current state-of-the-art machine learning methods.

It’s one more example of how the combination of accelerated computing and AI are helping engineers design better chips faster.

An AI-Powered Future

“NVIDIA used some of these techniques to make our existing GPUs, and we plan to use more of them in the future,” Dally said.

“I expect tomorrow’s standard EDA tools will be AI-powered to make the chip designer’s job easier and their results better than ever,” he said.

To watch Dally’s keynote, register for a complimentary pass to DAC using the code ILOVEDAC, then view the talk here.

The post Silicon Express Lanes: AI, GPUs Pave Fast Routes for Chip Designers appeared first on The Official NVIDIA Blog.

Read More

Majority Report: 2022 Predictions on How AI Will Impact Global Industries

There’s an old axiom that the best businesses thrive during periods of uncertainty. No doubt, that will be tested to the limits as 2022 portends upheaval on a grand scale.

Pandemic-related supply chain disruptions are affecting everything from production of cars and electronics to toys and toilet paper. At the same time, global food prices have jumped to their highest level in more than a decade as worker shortages, factory closures and high commodity prices shred plans at even the most sophisticated forecasting and logistics operations.

Last year, we asked some of our top experts at NVIDIA what 2021 would bring for the world of AI and accelerated computing. They predicted each would move from planning to production as businesses seek new avenues for product forecasting, supply chain management and scientific research.

Headlines over the course of the year proved them correct: To save Christmas, retailers Home Depot, Target and Walmart chartered their own cargo ships to deliver goods to their stores around the world. To speed time to market, BMW, Ericsson and other companies began using digital twin technologies to simulate real-world environments.

AI adoption isn’t limited to big names. Indeed, a midyear 2021 PWC survey of more than 1,000 businesses across nine sectors including banking, health and energy found that 86 percent of them were poised to make AI a “mainstream technology.”

This year, we went back to our experts at NVIDIA and asked them where enterprises will focus their AI efforts as they parse big data and look for new revenue opportunities.

Here’s what they had to say:

Bryan Catanzaro

BRYAN CATANZARO
Vice President of Applied Deep Learning Research

Conversational AI: Last year, I predicted conversational AI will be used to make video games more immersive by allowing real-time interaction to flesh out character-driven approaches. This year, conversational AI is all work and no play.

Companies will race to deploy new conversational AI tools that allow us to work more efficiently and effectively using natural language processing. Speech synthesis is poised to become just as emotive and persuasive as the human voice in 2022, which will help industries like retail, banking and healthcare better understand and better serve their customers.

Know Your Customer: Moving beyond natural language processing, companies using both speech and text for interaction with other businesses and customers will employ AI as they move to understand the context or sentiment in what a person might be saying. Is the customer frustrated? Is your boss being sarcastic? The adoption of tools like OpenAI Github copilot, which helps programmers be more effective at their work, will accelerate.

Sarah TariqSARAH TARIQ
Vice President of Automotive

Programmable Cars: The days of a car losing value once you drive it off the lot will soon be gone. We’ll see more automakers moving to reinvent the driving experience by creating software-defined architectures with headroom to support new applications and services via automatic over-the-air updates. Vehicles will get better and safer over time.

De-Stressing the Commute: The move to a software-defined approach also will help remove the stress and hassle of everyday driving. AI assistants will serve as your personal concierge, enhancing the vehicle journey for a safer, more convenient and enjoyable experience. Vehicle occupants will have access to intelligent services that are always on, allowing them to use real-time conversational AI for recommendations, alerts, vehicle controls and more.

Designing for the Long Haul: Automakers will begin to invest heavily in the use of simulation and digital twins to validate more of the end-to-end stack, and in training of deep neural network models. AI and data analytics will help train and validate self-driving cars for a broad range of driving conditions, delivering everyday safety that’s designed for the long haul.

Rev LebaredianREV LEBAREDIAN
Vice President of Simulation Technology, Omniverse Engineering

Emerging Standard for 3D: We’ll see advancing 3D standards for describing virtual worlds. Building accurate and rich digital counterparts to everything in the real world is one of the grandest challenges in computer science. Developers, enterprises and individual users will contribute to foundational open standards — analogous to the early days of the internet and the web.  Standards such as Universal Scene Description (USD) and glTF will rapidly evolve to meet the foundational needs of Web3 and digital twins.

Synthetic 3D Data for the Next Era of AI: The rate of innovation in AI has been accelerating for the better part of decade, but AI cannot advance without large amounts of high quality and diverse data. Today, data captured from the real world and labeled by humans is insufficient both in terms of quality and diversity to jump to the next level of artificial intelligence.  In 2022, we will see an explosion in synthetic data generated from virtual worlds by physically accurate world simulators to train advanced neural networks.

Re-Imaging Industry Through Simulation: Many industries are starting to examine and adopt digital twins and virtual worlds, thanks to the potential for operational efficiencies and cost savings. Digital representations of everything we build in the real world must have a counterpart in the virtual world—airplanes, cars, factories, bridges, cities and even Earth itself.  Applying high-fidelity simulations to digital twins allows us to experience, test and optimize complex designs well before we commit to building them in the real world.

Kimberly PowellKIMBERLY POWELL
Vice President & General Manager of Healthcare

AI Generates Million-X Drug Discovery: Simultaneous breakthroughs of AlphaFold and RoseTTAFold creating a thousandfold explosion of known protein structures and AI that can generate a thousand more potential chemical compounds have increased the opportunity to discover drugs by a million times. Molecular simulations help to model target and drug interactions completely in silico. To keep up with the million-x opportunity, AI is helping to introduce a new class of molecular simulations from system size and timescale to quantum accuracy.

AI Creates SaaS Medical Devices: The medical device industry has a game-changing opportunity, enabled by AI, to minimize and reduce costs, to automate and increase accessibility, and to continuously deliver innovation over the life of the product. Medical device companies will evolve from delivering hardware to providing software-as-a-service systems that can be upgraded remotely to keep devices usable after deployment.

AI 2.0 With Federated Learning: To help AI application developers industrialize their AI technology and expand the application’s business benefit, AI must be trained and validated on data that resides outside the possession of their group, institution and geography. Federated learning is the key to collaboratively building robust AI models and validating models in the wild without sharing sensitive data.

Anima AnandkumarANIMA ANANDKUMAR
Director of ML Research, and Bren Professor at Caltech

AI4Science: This area will continue to mature significantly and yield real-world impact. AI will deeply integrate with HPC at supercomputing scale and make scientific simulations and modeling possible at an unprecedented scale and fidelity in areas such as weather and climate models.

AI will lead to breakthroughs in discovery of new drugs and treatments and revolutionize healthcare. Federated learning and differential privacy will be widely adopted, making healthcare and other sensitive data-sharing seamless.

Algorithmic Development: Expect massive advancements in the algorithmic development that underlies simulations, as well as the capabilities of GPUs to handle reinforcement learning at scale.

Ronnie VasishtaRONNIE VASISHTA
Senior Vice President of Telecoms

AI Moves to the Telco Edge: The promise of 5G will open new opportunities for edge computing. Key benefits will include network slicing that allows customers to assign dedicated bandwidth to specific applications, ultra-low latency in non-wired environments, as well as improved security and isolation.

AI-on-5G will unlock new edge AI use cases. These include “Industry 4.0” use cases such as plant automation, factory robots, monitoring and inspection; automotive systems like toll road and vehicle telemetry applications; as well as smart spaces in retail, cities and supply chain applications.

Convergence of AI and OT Solutions: New edge AI applications are driving the growth of intelligent spaces, including the intelligent factory. These factories use cameras and other sensors for inspection and predictive maintenance. However, detection is just step one; once detected, action must be taken.This requires a connection between the AI application doing the inference and monitoring-and-control, or OT, systems that manage the assembly lines, robotic arms or pick-and-place machines.

Today, integration between these two applications relies on custom development work. This year, expect to see more integration of AI and traditional OT management solutions that simplify the adoption of edge AI in industrial environments.

Azita MartinAZITA MARTIN
Vice President & General Manager of Artificial Intelligence for Retail and C
onsumer Products Group

AI Addresses Labor Shortages: Amid a shortage of labor and increased customer demand for faster service, quick-service restaurants will employ AI for automated order taking. Thanks to advancements in natural language understanding and speech, combined with recommendation systems, fast food restaurants will roll out automated order taking to speed drive-through times and improve recommendations. In supermarkets and big-box stores, retailers will increase their use of intelligent video analytics and computer visions to create automated checkouts and autonomous or cashier-less shopping.

Enterprises Tap AI to Optimize Logistics:  AI’s greatest power is found in simplifying incredibly complex problems. Supply chain optimization will become a critical area for retailers to meet customer demands for product availability and faster delivery. AI can enable more frequent and more accurate forecasting, ensuring the right product is at the right store at the right time,

Computer vision and robotics will add AI intelligence to distribution centers. Solutions like autonomous forklifts, robots and intelligent multi-shuttle cabinets will reduce conveyor starvation and downtime and automate pick-and-pack of items to double throughput. Last-mile delivery leveraging data science will help dynamic rerouting, simulations and sub-second solver response time.

Becoming One With the Customer: Retailers sit on massive amounts of data but often have trouble processing it in real time. AI lets retailers parse the data in near real-time to have a 360 degree view of their customers,  in order to provide more personalized offers and recommendations that drive revenue and customer satisfaction. In 2022, you’ll see many retailers offering hyper-personalized shopping experiences.

Kevin LevittKEVIN LEVITT
Director of Industry and Business Development for Financial Services

Your Voice Is Your ID: Financial institutions will invest heavily in AI to fight fraud and adhere to compliance regulations such as KYC (Know Your Customer) and AML (Anti-Money Laundering). Some are using a customer’s unique voice to authenticate online transactions, while others are turning to eye biometrics for authentication.

Graph neural networks are at the forefront of the new techniques AI researchers and practitioners at financial institutions are using to understand relationships across entities and data points. They’ll become critical to enhancing fraud prevention and to mapping relationships to fight fraud more effectively.

AI for ESG: Consumers and government entities increasingly will hold enterprises accountable for environmental impacts, social and corporate governance (ESG). Companies will invest in significant computational power to run AI models, including deep learning and natural language processing models, that analyze all the data necessary to track company performance relative to ESG. It also will be needed to analyze the available data externally to measure which companies are excelling or failing relative to ESG benchmarks.

Charlie BoyleCHARLIE BOYLE
Vice President & General Manager, NVIDIA DGX Systems

Enterprises Deploy Large Language Models to Advance Understanding: In 2022, we’ll see accelerated growth in adapting large language models (LLMs) to serve more industries and use cases. Trained on massive amounts of general or industry-specific data, LLMs are able to answer deep domain questions, translate languages, comprehend and summarize documents, write stories and compute programs — all without specialized training or supervision. Already, LLMs are being used to build language- and domain-specific AI chatbots and services that improve connection and communication around the world.

Enterprises’ Next Data Centers Will Belong to Someone Else: Many businesses turned away from owning their own data centers when they moved to cloud computing, so, in 2022, companies will realize it’s time to start leveraging colocation services for high-performance AI infrastructure. The ease of deployment and access to infrastructure experts who can help ensure 24/7/365 uptime will enable more enterprises to benefit from on-demand resources delivered securely, wherever and whenever they’re needed.

Kevin DeierlingKEVIN DEIERLING
Senior Vice President of Networking

Data Center Is the New Unit of Computing: Applications that previously ran on a single computer don’t fit into a single box any more. The new world of computing increasingly will be software defined and hardware accelerated. As applications become disaggregated and leverage massive data sets, the network will be seen as the fast lane between many servers acting together as a computer. Software-defined data processing units will serve as distributed switches, load balancers, firewalls, and virtualized storage devices that stitches this data center scale computer together.

Growing Trust in Zero Trust: As applications and devices move seamlessly between the data center and the edge, enterprises will have to validate and compose from microservices. Zero trust assumes that everything and everyone connected to a company system must be authenticated and monitored to verify bad actors aren’t attempting to penetrate the network. Everything has to become protected both at the edge and on every node within the network. Data will need to be encrypted using IPSEC and TLS encryption, and every node protected with advanced routers and firewalls.

Scott McClellanSCOTT MCCLELLAN
Senior Director of the Data Science Product Group

Accelerated Data Science Platforms Thaw Enterprise Data Lakes: Much has been written about data lakes forming the foundation for enterprise big data strategies. Enterprise data lakes are effective for large scale data processing, but their broader usefulness has been largely frozen for the past few years, as they are isolated and decoupled from machine learning training and inference pipelines. In 2022, data lakes will finally modernize through end-to-end data pipelines because of three inflection points: centralized infrastructure, the agility of Kubernetes-based applications, and best-in-class, fit-to-task storage.

Mainstream AI Adoption Triggers MLOps Growth: The world’s AI pioneers built bespoke MLOps solutions to help them manage development and production AI workflows. Many early adopters that chose a cloud-based development path have been able to delay adding MLOps expertise. Enterprises are now uncovering a gap as companies expand their use of AI and bring their accelerated infrastructure on-prem. Addressing this need will trigger broad adoption of MLOps solutions in the year ahead. 

Entering the Age of Hyper-Accelerated AI Adoption

There’s no doubt the continuing pandemic has created an era of accelerated invention and reinvention for many businesses and scientific organizations. The goal is to create short-term measures that meet the needs of the day while building for long-term gains and radical change.

Will 2022 be another year of living dangerously, or smoother sailing for those businesses that tackle the uncertainty with a firmer embrace of AI?

The post Majority Report: 2022 Predictions on How AI Will Impact Global Industries appeared first on The Official NVIDIA Blog.

Read More

Omniverse Creator Takes Viewers Down an Artistic Time Tunnel in OmniRacer Video

Movies like The Matrix and The Lord of the Rings inspired a lifelong journey in computer graphics for Piotr Skiejka, a senior visual effects artist at Ubisoft.

A headshot of Piotr SkiejkaBorn in Poland and based in Singapore, Skiejka turned his childhood passion of playing with motion design — as well as compositing, lighting and rendering effects — into a career.

He was recently named a winner of the #CreateYourRetroverse contest, in which creators using NVIDIA Omniverse shared scenes that flashback to when and where their love for graphics began.

Skiejka uses the Omniverse real-time collaboration and simulation platform for his 3D workflows when designing animation, film and video game scenes.

Over the past 13 years, he’s worked on the visual effects for a filmography of nearly two dozen listings, including Marvel’s Avengers and an episode of Game of Thrones, as well as several commercials and video games.

“I enjoy learning new workflows and expanding my creative knowledge every day, especially in such an evolving field,” he said.

A Lord of the Rende(rings)

Skiejka’s creative process begins with collecting references and creating a board full of pictures. Then, he blocks scenes in Omniverse, using simple shapes and meshes to fill the space before taking a first pass at lighting.

After experimenting with a scene’s different layers, Skiejka replaces his blocked prototypes with high-resolution assets — perfecting the lighting and tweaking material textures as final touches.

Watch a stunning example of his creative process in this video, which was recognized in the NVIDIA Omniverse #CreateYourRetroverse contest:

According to Skiejka, the main challenges he previously faced were long rendering times and slow software feedback when lighting and shading.

“Now, with NVIDIA RTX technology, render time is greatly decreased, and visual feedback occurs in real time,” he said. “The Omniverse Kit framework and the Omniverse Nucleus server are superb game-changers and perfect additions to my workflow.”

Skiejka’s favorite feature of the platform, however, is the Omniverse Create scene composition application. He said it’s “packed with valuable extensions, like PhysX and Flow,” which he used while designing the retroverse scene above.

“I hope I showed the spirit of childhood in my #CreateYourRetroverse video, and that this artistic time tunnel between the past and present will inspire others to showcase their experiences, too,” Skiejka said.

Learn more about NVIDIA Omniverse.

The post Omniverse Creator Takes Viewers Down an Artistic Time Tunnel in OmniRacer Video appeared first on The Official NVIDIA Blog.

Read More