Posts in category: nVidia AI

Editor’s note: This post is part of our weekly In the NVIDIA Studio series, which celebrates featured artists, offers creative tips and tricks, and demonstrates how NVIDIA Studio technology improves creative workflows. We’re also deep diving on new GeForce RTX 40 Series GPU features, technologies and resources, and how they dramatically accelerate content creation.

NVIDIA Studio is debuting at CES powerful new software and hardware upgrades to elevate content creation.

It brings the release of powerful NVIDIA Studio laptops and desktops from Acer, ASUS, Dell, HP, Lenovo, MSI and Samsung, as well as the launch of the new GeForce RTX 40 SUPER Series GPUs — including the GeForce RTX 4080 SUPER, GeForce RTX 4070 Ti SUPER and GeForce RTX 4070 SUPER — to supercharge creating, gaming and AI tasks.

Generative AI by iStock from Getty Images is a new generative AI tool trained by NVIDIA Picasso that uses licensed artwork and the NVIDIA Edify architecture model to ensure that generated assets are commercially safe.

RTX Video HDR coming Jan. 24 transforms standard dynamic range video playing in internet browsers into stunning high dynamic range (HDR). By pairing it with RTX Video Super Resolution, NVIDIA RTX and GeForce RTX GPU owners can achieve dramatic video quality improvements on their HDR10 displays.

Twitch, OBS and NVIDIA are enhancing livestreaming technology with the new Twitch Enhanced Broadcasting beta, powered by GeForce RTX GPUs. Available later this month, the beta will enable users to stream multiple encodes concurrently, providing optimal viewing experiences for a broad range of device types and connections.

And NVIDIA RTX Remix — a free modding platform for quickly remastering classic games with RTX — releases in open beta later this month. It provides full ray tracing, NVIDIA DLSS, NVIDIA Reflex and generative AI texture tools.

This week’s In the NVIDIA Studio installment also features NVIDIA artists Ashlee Martino-Tarr, a 3D content specialist, and Daniela Flamm Jackson, a technical product marketer, who transform 2D illustrations into dynamic 3D scenes using AI and Adobe Firefly — powered by NVIDIA in the cloud and natively with GeForce RTX GPUs.

New Year, New NVIDIA Studio Laptops

The new NVIDIA Studio laptops and desktops level up power and efficiency with exclusive software like Studio Drivers preinstalled — enhancing creative features, reducing time-consuming tasks and speeding workflows.

The Acer Predator Triton Neo 16 features several 16-inch screen options with up to a 3.2K resolution at a 165Hz refresh rate and 16:10 aspect ratio. It provides DCI-P3 100% color gamut and support for NVIDIA Optimus and NVIDIA G-SYNC technology for sharp color hues and tear-free frames. It’s expected to be released in March.

The ASUS ROG Zephryus G14 features a Nebula Display with a OLED panel and a G-SYNC OLED display running at 240Hz. It’s expected to release on Feb. 6.

The XPS 16 is Dell’s most powerful laptop featuring a large 16.3” InfinityEdge display, available with a 4K+ OLED touch display, true-to-life color delivering up to 80W of sustained performance, all with tone-on-tone finishes for an elegant, minimalistic design. Stay tuned for an update on release timing.

Lenovo’s Yoga Pro 9i sports a 16-inch 3.2K PureSight Pro display, delivering a grid of over 1,600 mini-LED dimming zones, expertly calibrated colors accurate to Delta E< 1 and up to 165Hz. With Microsoft’s Auto Color Management feature, its display toggles automatically between 100% P3, 100% sRGB and 100% Adobe RGB color to ensure the highest-quality color. It’s expected to be released in April.

HP’s OMEN 14 Transcend features a 14-inch 4K OLED WQXGA screen, micro-edge, edge-to-edge glass and 100% DCI-P3 with a 240Hz refresh rate. NVIDIA DLSS 3 technology helps unlock more efficient content creation and gaming sessions using only one-third of the expected battery power. It’s targeting a Jan. 19 release.

Samsung’s Galaxy Book4 Ultra includes an upgraded Dynamic AMOLED 2X display for high contrast and vivid color, as well as a convenient touchscreen. Its Vision Booster feature uses an Intelligent Outdoor Algorithm to automatically enhance visibility and color reproduction in bright conditions.

Check back for more information on the new line of Studio systems, including updates to release dates.

A SUPER Debut for New GeForce RTX 40 Series Graphics Cards

The GeForce RTX 40 Series has been supercharged with the new GeForce RTX 4080 SUPER, GeForce RTX 4070 Ti SUPER and GeForce RTX 4070 SUPER graphics cards. This trio is faster than its predecessors, with RTX platform superpowers that enhance creating, gaming and AI tasks.

The GeForce RTX 4080 SUPER sports more CUDA cores than the GeForce RTX 4080 and includes the world’s fastest GDDR6X video memory at 23 Gbps. In 3D apps like Blender, it can run up to 70% faster than previous generations. In generative AI apps like Stable Diffusion XL or Stable Video Diffusion, it can produce 1,024×1,024 images 1.7x faster and video 1.5x faster. Or play fully ray-traced games, including Alan Wake 2, Cyberpunk 2077: Phantom Liberty and Portal with RTX, in stunning 4K. The RTX 4080 SUPER will be available Jan. 31 as a Founders Edition and as custom boards for partners starting at $999.

The GeForce RTX 4070 Ti SUPER is equipped with more CUDA cores than the RTX 4070, a frame buffer increased to 16GB, and a 256-bit bus. It’s suited for video editing and rendering large 3D scenes and runs up to 1.6x faster than the RTX 3070 Ti and 2.5x faster with DLSS 3 in the most graphics-intensive games. Gamers can max out high-refresh 1440p panels or even game at 4K. The RTX 4070 Ti SUPER will be available Jan. 24 from custom board partners in stock-clocked and factory-overclocked configurations starting at $799.

The GeForce RTX 4070 SUPER has 20% more CUDA cores than the GeForce RTX 4070 and is great for 1440p creating. With DLSS 3, it’s 1.5x faster than a GeForce RTX 3090 while using a fraction of the power.

Read more on the GeForce article.

Creative Vision Meets Reality With Getty Images and NVIDIA

Content creators using the new Generative AI by iStock from Getty Images tool powered by NVIDIA Picasso can now safely, affordably use AI-generated images with full protection.

Generative AI by iStock is trained on Getty Images’ vast creative library of high-quality licensed content, including millions of exclusive photos, illustrations and videos. Users can enter prompts to generate photo-quality images at up to 4K for social media promotion, digital advertisements and more.

Getty Images is also making advanced inpainting and outpainting features available via application programming interfaces. Developers can seamlessly integrate the new APIs with creative applications to add people and objects to images, replace specific elements and expand images to a wide range of aspect ratios.

Customers can use Generative AI by iStock online today. Advanced editing features are coming soon to the iStock website.

RTX Video HDR Brings AI Video Upgrades

RTX Video HDR brings a new AI-enhanced feature that instantly converts any standard dynamic range video playing in internet browsers into vibrant HDR.

HDR delivers stunning video quality but is not widely available because of effort and hardware limitations.

RTX Video HDR allows NVIDIA RTX and GeForce RTX GPU owners to maximize their HDR panel’s ability to display more vivid, dynamic colors, helping preserve intricate details that may be lost in standard dynamic range.

The feature requires an HDR10-compatible display or TV connected to a RTX-powered PC and works with Chromium-based browsers such as Google Chrome or Microsoft Edge.

RTX Video HDR and RTX Video Super Resolution can be used together to produce the clearest livestreamed video.

RTX Video HDR is coming to all NVIDIA RTX and GeForce RTX GPUs as part of a driver update later this month. Once the update goes through, navigate to the NVIDIA control panel and switch it on.

Enhanced Broadcasting Beta Enables Multi-Encode Livestreaming

With Twitch Enhanced Broadcasting beta, GeForce RTX GPU owners will be able to broadcast up to three resolutions simultaneously at up to 1080p. In the coming months, Twitch plans to roll out support for up to five concurrent encodes to further optimize viewer experiences.

As part of the beta, Twitch will test higher input bit rates as well as new codecs, which are expected to further improve visual quality. The new codecs include the latest-generation AV1 for GeForce RTX 40 Series GPUs, which provides 40% more encoding efficiency than H.264, and HEVC for previous-generation GeForce GPUs.

To simplify the setup process, Enhanced Broadcasting will automatically configure all open broadcaster software encoder settings, including resolution, bit rate and encoding parameters.

Sign up for the Twitch Enhanced Broadcasting beta today.

A Righteous RTX Remix

Built on NVIDIA Omniverse, RTX Remix allows modders to easily capture game assets, automatically enhance materials with generative AI tools, reimagine assets via Omniverse-connected apps and Universal Scene Description (OpenUSD), and quickly create stunning RTX remasters of classic games with full ray tracing and NVIDIA DLSS technology.

The RTX Remix open beta releases later this month.

RTX Remix has already delivered stunning remasters in Portal with RTX and the modder-made Portal: Prelude RTX. Now, Orbifold Studios is using RTX Remix to develop Half-Life 2 RTX: An RTX Remix Project, a community remaster of one of the highest-rated games of all time. Check out the new Half-Life 2 RTX gameplay trailer, showcasing Orbifold Studios’ latest updates to Ravenholm:

AI and RTX Bring Illustrations to Life

NVIDIA artists and this week’s In the NVIDIA Studio features Ashlee Martino-Tarr and Daniela Flamm Jackson are passionate about illustration — whether in work or at play.

They used Adobe Firefly’s generative AI features, powered by NVIDIA GPUs in the cloud and accelerated with Tensor Cores in GeForce RTX GPUs, to animate a 2D illustration with special effects.

To begin, the pair separated the 2D image into multiple layers and expanded the canvas. Firefly’s Generative Expand feature automatically filled the added space with AI-generated content.

Next, the team separated select elements — starting with character — and used the AI Object Select feature to automatically mask the layer. The Generative Fill feature then created new content to fill in the background, saving even more time.

This process continued until all distinct layers were separated and imported into Adobe After Effects. Next, they used the Mercury 3D Engine on local RTX GPUs to accelerate playback, unlocking smoother movement in the viewport. Previews and adjustments like camera shake and depth of field were also GPU-accelerated.

Firefly’s Style Match feature then took the existing illustration and created new imagery in its likeness — in this case, a vibrant butterfly sporting similar colors and tones. The duo also used Adobe Illustrator’s Generative Recolor feature, which enables artists to explore a wide variety of colors and themes without having to manually recolor their work.

Martino-Tarr and Jackson then chose their preferred assets and animated them in Adobe After Effects. Firefly’s powerful AI effects helped speed or entirely eliminate tedious tasks such as patching holes, handpainting set extensions and caching animation playbacks.

The artists concluded post-production work by putting the finishing touches on their AI animation in After Effects.

Firefly’s powerful AI capabilities were developed with the creative community in mind — guided by AI ethics principles of content and data transparency — to ensure morally responsible output. NVIDIA technology continues to power these features from the cloud for photographers, illustrators, designers, video editors, 3D artists and more.

Check out Martino-Tarr’s portfolio on ArtStation and Jackson’s on IMDb.

Follow NVIDIA Studio on Instagram, Twitter and Facebook. Access tutorials on the Studio YouTube channel and get updates directly in your inbox by subscribing to the Studio newsletter. 

Twitch, OBS and NVIDIA are leveling up livestreaming technology with the new Twitch Enhanced Broadcasting beta, powered by GeForce RTX GPUs. Available in a few days, streamers will be able to stream multiple encodes concurrently, providing optimal viewing experiences for all viewers. 

Twitch Enhanced Broadcasting

Today, many streamers must choose between higher resolution and reliable streaming. High-quality video provides more enjoyable viewing experiences but causes streams to buffer for viewers with low bandwidth or older viewing devices. Streaming lower-bitrate video allows more people to watch the content seamlessly, but introduces artifacts.

Twitch — the interactive livestreaming platform — provides server-side transcoding for top-performing channels, meaning it will create different versions of the same stream for different bandwidth levels, improving the viewing experience. But the audience of many channels are left with a single stream option.

Twitch, OBS and NVIDIA have collaborated on a new feature to address this — Twitch Enhanced Broadcasting, releasing in beta later this month. Using the high-quality dedicated encoder (NVENC) in modern GeForce RTX and GTX GPUs, streamers will be able to broadcast up to three resolutions simultaneously at up to 1080p.

In the coming months, Enhanced Broadcasting beta testers will be able to experiment with higher-input bit rates, up to 4K resolutions, up to 5 concurrent streams, as well as new codecs. The new codecs include the latest-generation AV1 for GeForce RTX 40 Series GPUs, which provides 40% more encoding efficiency than H.264, and HEVC for previous-generation GeForce GPUs.

To simplify set up, Enhanced Broadcasting will automatically configure all OBS encoder settings, including resolution, bit rate and encoding parameters. A server-side algorithm will return the best possible configuration for OBS Studio based on the streamer’s setup, taking the headaches out of tuning settings for the best viewer experiences.

Using the dedicated NVENC hardware encoder, streamers can achieve the highest quality video across streaming bitrates, with minimal impact to app and game performance.

Sign up for the Twitch Enhanced Broadcasting beta today at twitch.tv/broadcast. Twitch will enroll participants on a first-come, first-served basis, starting later this month. Once a creator has been enrolled in the beta, they’ll receive an email with additional instructions.

To further elevate livestreams, download the NVIDIA Broadcast app, free for RTX GPU owners and powered by dedicated AI Tensor Cores, to augment broadcast capabilities for microphones and cameras.

Follow NVIDIA Studio on Instagram, Twitter and Facebook. Access tutorials on the Studio YouTube channel and get updates directly in your inbox by subscribing to the Studio newsletter. 

Getty Images, a global visual content creator and marketplace, today at CES released Generative AI by iStock, an affordable and commercially safe image generation service trained on the company’s creative library of licensed, proprietary data.

Built on NVIDIA Picasso, a foundry for custom AI models, Generative AI by iStock provides designers and businesses with a text-to-image generation tool to create ready-to-license visuals, with legal protection and usage rights for generated images included.

Alongside the release of the service on the iStock website, Getty Images is also making advanced inpainting and outpainting features available via application programming interfaces, launching on iStock.com and Gettyimages.com soon. Developers can seamlessly integrate the new APIs with creative applications to add people and objects to images, replace specific elements and expand images in a wide range of aspect ratios.

Create With Im-AI-gination

Generative AI by iStock is trained with NVIDIA Picasso on Getty Images’ vast creative library — including exclusive photos, illustrations and videos — providing users with a commercially safe way to generate visuals. Users can enter simple text prompts to generate photo-quality images at up to 4K resolution.

New editing APIs give customers powerful control over their generated images.

The Inpainting feature allows users to mask a region of an image, then fill in the region with a person or object described via a text prompt.

Outpainting enables users to expand images to fit various aspect ratios, filling in new areas based on the context of the original image. This is a powerful tool to create assets with unique aspect ratios for advertising or social media promotion.

And coming soon, a Replace feature provides similar capabilities to Inpainting but with stricter adherence to the mask.

Transforming Visual Design

The NVIDIA Picasso foundry enables developers and service providers to seamlessly train, fine-tune, optimize and deploy generative AI models tailored to their visual design requirements. Developers can use their own AI models or train new ones using the NVIDIA Edify model architecture to generate images, videos, 3D assets, 360-degree high-dynamic-range imaging and physically based rendering materials from simple text prompts.

Using NVIDIA Picasso, Getty Images trained a bespoke Edify image generator based on its catalog of licensed images and videos to power the Generative AI by iStock service.

Customers can use Generative AI by iStock online today. Advanced editing features are now available via APIs and coming soon to the iStock website.

Whether building a super-capable truck or conjuring up a dream sports car, spending hours playing with online car configurators is easy.

With auto industry insiders predicting that most new vehicle purchases will move online by 2030, these configurators are more than just toys.

They’re crucial to the future of the world’s automakers — essential in showing off what their brand is all about, boosting average selling prices and helping customers select and personalize their vehicles.

It’s also a natural use case for the sophisticated simulation capabilities of NVIDIA Omniverse, a software platform for developing and deploying advanced 3D applications and pipelines based on OpenUSD. It provides the ability to instantly visualize changes to a car’s color or customize its interior with luxurious finishes.

Studies show that 80% of shoppers are drawn to brands that give them a personal touch while shopping.

Aiming to meet these customer demands, a burgeoning ecosystem of partners and customers is putting to work elements of Omniverse.

Key creative partners and developers like BITONE, Brickland, Configit, Katana Studio Ltd. (serving Craft Detroit), WPP and ZeroLight are pioneering Omniverse-powered configurators. And leading automakers such as Lotus are adopting these advanced solutions.

That’s because traditional auto configurators, often limited by pre-rendered images, experience difficulty achieving personalization and dynamic environment representation.

They use different kinds of data in various tools, such as static images of what users see on the website, lists of available options based on location, product codes and personal information.

These challenges extend from the consumer experience — often characterized by limited interactivity and realism — to back-end processes for original equipment manufacturers (OEMs) and agencies, where inflexibility and inefficiencies in updating configurators and repurposing assets are common.

Reconfiguring Configurators With NVIDIA Omniverse

Omniverse helps software developers and service providers streamline their work.

Service providers can now access the platform to craft state-of-the-art 3D experiences and showcase lifelike graphics and high-end, immersive environments with advanced lighting and textures.

And OEMs can benefit from a unified asset pipeline that simplifies the integration of design and engineering data for marketing purposes. Omniverse’s enhanced tools also allow them to quickly produce diverse marketing materials, boosting customer engagement through customized content.

Independent software vendors, or ISVs, can use the native OpenUSD platform as a foundation for creating scene construction tools — or to help develop tools for managing configuration variants.

With the NVIDIA Graphics Delivery Network (GDN) software development kit, high-quality, real-time NVIDIA RTX viewports can be embedded into web applications, ensuring seamless operation on nearly any device.

This, along with support for large-scale scenes and physically accurate graphics, allows developers to concentrate on enhancing the user experience without compromising quality on lower-spec machines.

Omniverse Cloud taps GDN, which uses NVIDIA’s global cloud-streaming infrastructure to deliver seamless access to high-fidelity 3D interactive experiences.

Configurators, when run on GDN, can be easily published at scale using the same GPU architecture on which they were developed and streamed to nearly any device.

All this means less redundancy in data prep, aggregated and accessible data, fewer manual pipeline updates and instant access for the entire intended audience.

Global Adoption by Innovators and Industry Leaders

Omniverse is powering a new era in automotive design and customer interaction, heralded by a vibrant ecosystem of partners and customers.

Lotus is at the forefront, developing an interactive dealership user experience using Omniverse and generative AI tools including NVIDIA Avatar Cloud Engine and NVIDIA Omniverse Audio2Face.

To dive deeper into the world of advanced car configurators, read more on Omniverse and GDN. 

NVIDIA is bringing more games, membership options and innovative tech to its GeForce NOW cloud gaming service.

The next Activision and Blizzard titles to join the cloud, Diablo IV and Overwatch 2, will be coming soon. They’ll be joined by a host of top titles, including Capcom’s Exoprimal, HoYoverse’s Honkai: Star Rail and Mainframe Industries’ Pax Dei.

Available starting in February, new day passes for Ultimate and Priority memberships will offer full premium benefits one day at a time.

NVIDIA is also bringing G-SYNC technology to the cloud, raising cloud streaming performance while lowering latency and minimizing stuttering for the smoothest gameplay. Paired with new 60 and 120 fps streaming options for GFN Reflex mode, the two together make cloud gaming experiences nearly indistinguishable from local ones.

Plus, mobile gamers are getting a boost to 1440p resolution on Android phones. And Japan is the newest region to be operated by NVIDIA, which will soon enable gamers across the country to play their favorite PC games in the cloud with Ultimate performance.

Here Come the Games

The GeForce NOW catalog features many of the most popular PC games — over 1,800 titles from Steam, Xbox and supported PC Game Pass titles, Epic Games Store, Ubisoft, GOG.com and other digital stores. Backed by up to GeForce RTX 4080 GPU-class graphics, GeForce NOW is bringing even more top titles to the cloud from celebrated publishers.

The latest games from top developer Blizzard Entertainment — Diablo IV and Overwatch 2 — are coming soon to GeForce NOW. They join the recent release of Call of Duty, the first Activision game in the cloud, as part of a 10-year NVIDIA and Microsoft partnership.

Fight the forces of hell while discovering countless abilities to master, legendary loot to gather and nightmarish dungeons full of evil enemies to vanquish in Diablo IV. Experience the campaign solo or with friends in a shared open world as the dark, gripping story unfolds.

Team up and answer the call of heroes in Overwatch 2, a free-to-play shooter featuring 30+ epic heroes, each with game-changing abilities. Join the battle across dozens of futuristic maps inspired by real-world locations and master unique game modes in the always-on, ever-evolving, live game.

Members will soon be able to stream the Steam versions of Diablo IV and Overwatch 2 on nearly any device with the power of a GeForce RTX 4080 rig in the cloud, with support for the Battle.net launcher to follow.

GeForce NOW also brings top role-playing games to the cloud. The immensely popular Honkai: Star Rail from HoYoverse will join Genshin Impact coming soon in the cloud. The space-fantasy RPG is set in a diverse universe filled with wonder, adventure and thrills, and expands the library of hit free-to-play titles for members. Plus, members can experience all the latest updates without worrying about download times.

Top publisher Capcom is working with NVIDIA to bring more of its hit titles to the cloud, including Exoprimal, an online, team-based action game that pits humanity’s cutting-edge exosuit technology against history’s most ferocious beasts: dinosaurs. Look forward to seeing it in the cloud on Jan. 18.

Mainframe Industries’ Pax Dei is a highly anticipated social sandbox massively multiplayer online game inspired by legends of the medieval era. It’s planned to release on GeForce NOW when it launches for PC.

Get ready to play these titles and more at high performance coming soon. Ultimate members will be able to stream at up to 4K resolution and 120 frames per second with support for NVIDIA DLSS and Reflex technology, and experience the action even on low-powered devices. Keep an eye out on GFN Thursdays for the latest on their release dates in the cloud.

Don’t Pass This Up

Day Passes, available in early February, will give gamers a fast pass to try out premium membership benefits before committing to one- or six-month memberships that offer better value. The passes provide access to all the same features as Priority and Ultimate members for 24 hours.

Day Pass users can experience RTX ON for supported games with Priority and Ultimate Day Passes. And Ultimate Day Pass users gain exclusive access to innovative technologies like NVIDIA DLSS 3.5, full ray tracing and NVIDIA Reflex.

These new membership options let gamers freely choose when to tap into the cloud.

The Ultimate Day Pass will be available for $7.99 and the Priority Day Pass for $3.99. The 24 hours of continuous play will begin at purchase. Day Passes can be combined for continued access to GeForce NOW high-performance cloud streaming.

Let That Sync In

NVIDIA continues to push the boundaries for cloud gaming. The Ultimate membership tier introduced many cloud gaming firsts, from 240 fps to ultra-wide streaming, making gameplay with GeForce NOW — streaming from GeForce RTX 4080-powered servers — nearly identical to a local gaming experience.

Coming soon, cloud G-SYNC technology will raise the bar even further, minimizing stutter and latency, with support for variable refresh rate monitors and fully optimized for G-SYNC-compatible monitors. With Cloud G-SYNC enabled, GeForce NOW will vary the display’s refresh rates to match the streaming rate, for the smoothest gameplay experience available from the cloud.

Ultimate members can also soon take advantage of expanded NVIDIA Reflex support in supported titles.  Building off of 240fps 1080p streaming from last year, Ultimate members will soon be able to utilize Reflex in supported titles at up to 4K resolution and 60 or 120 fps streaming modes, for low-latency gaming on nearly any device.  NVIDIA Reflex support is available in the top PC games on GeForce NOW, including Call of Duty: Modern Warfare III, Cyberpunk 2077, Diablo IV, Overwatch 2, The Witcher 3: Wild Hunt,  Alan Wake 2 and more.

With both Cloud G-SYNC and Reflex, members will feel as if they’re connected directly to GeForce NOW’s RTX 4080 SuperPODs, making their visual experiences smoother, clearer and more immersive than ever.

Mobile Phones Are Now PC Gaming Rigs

Mobile gamers will soon have the option to set streaming resolution to 1440p on Android devices, providing richer graphics on larger screens. Members will be able to turn an Android device into a portable gaming rig with support for quad-high-definition resolution (2,560 x 1,440 pixels), as well as improved keyboard and mouse support.

This offers a glimpse into the future of game streaming, with external displays connected to a mobile device. Using a USB-C docking station, gamers can connect an Android phone to a 1080p or 1440p gaming monitor or TV, with a keyboard and mouse or gamepad.

Paired with a GeForce NOW Ultimate membership, Android phones become portable gaming rigs on which to play the latest triple-A PC games, such as Baldur’s Gate 3, The Finals, and Monster Hunter: World. Now anything, even a phone, can be a high-performance gaming rig.

The above was on display this week at the CES trade show. The demo streams Cyberpunk 2077 and Alan Wake 2 from GeForce NOW servers in Los Angeles to a Samsung Galaxy S23 Ultra phone connected to a 1440p monitor in Las Vegas.

Clouds in Japan

NVIDIA will begin operating GeForce NOW in Japan in the spring, operating alongside GeForce NOW Alliance partner KDDI.

Gamers in the region can look forward to Ultimate memberships for the first time, along with all the new games and advancements announced at CES. Visit the page to learn more and sign up for notifications.

With a steady drumbeat of quality games from top publishers, new membership options and the latest NVIDIA technology in the cloud, GeForce NOW is poised to bring another ultimate year of gaming to members.

Generative AI is reshaping trillion-dollar industries, and NVIDIA, a front-runner in smart robotics, is seizing the moment.

Speaking today as part of a special address ahead of CES, NVIDIA Vice President of Robotics and Edge Computing Deepu Talla detailed how NVIDIA and its partners are bringing generative AI and robotics together.

It’s a natural fit, with a growing roster of partners — including Boston Dynamics, Collaborative Robotics, Covariant, Sanctuary AI, Unitree Robotics and others — embracing GPU-accelerated large language models to bring unprecedented levels of intelligence and adaptability to machines of all kinds.

The timing couldn’t be better.

“Autonomous robots powered by artificial intelligence are being increasingly utilized for improving efficiency, decreasing costs and tackling labor shortages,” Talla said.

Present at the Creation

NVIDIA has been central to the generative AI revolution from the beginning.

A decade ago, NVIDIA founder and CEO Jensen Huang hand-delivered the first NVIDIA DGX AI supercomputer to OpenAI. Now, thanks to OpenAI’s ChatGPT, generative AI has become one of the fastest-growing technologies of our time.

And it’s just getting started.

The impact of generative AI will go beyond text and image generation — and into homes and offices, farms and factories, hospitals and laboratories, Talla predicted.

The key: LLMs, akin to the brain’s language center, will let robots understand and respond to human instructions more naturally.

Such machines will be able to learn continuously from humans, from each other and from the world around them.

“Given these attributes, generative AI is well-suited for robotics,” Talla said.

How Robots Are Using Generative AI

Agility Robotics, NTT, and others are incorporating generative AI into their robots to help them understand text or voice commands. Robot vacuum cleaners from Dreame Technology are being trained in simulated living spaces created by generative AI models. And Electric Sheep is developing a world model for autonomous lawn mowing.

NVIDIA technologies such as the NVIDIA Isaac and Jetson platforms, which facilitate the development and deployment of AI-powered robots, are already relied on by more than 1.2 million developers and 10,000 customers and partners.

Many of them are at CES this week, including Analog Devices, Aurora Labs, Canonical, Dreame Innovation Technology, DriveU, e-con Systems, Ecotron, Enchanted Tools, GlüxKind, Hesai Technology, Leopard Imaging, Segway-Ninebot (Willand (Beijing) Technology Co., Ltd.), Nodar, Orbbec, QT Group, Robosense, Spartan Radar, TDK Corporation, Telit, Unitree Robotics, Voyant Photonics and ZVISION Technologies Co., Ltd.

Two Brains Are Better Than One

In his talk at CES, Talla showed the dual-computer model (below) essential for deploying AI in robotics, demonstrating NVIDIA’s comprehensive approach to AI development and application.

The first computer, referred to as an “AI factory,” is central to the creation and continuous improvement of AI models.

AI factories use NVIDIA’s data center compute infrastructure along with its AI and NVIDIA Omniverse platforms for the simulation and training of AI models.

The second computer represents the runtime environment of the robot.

This varies depending on the application: It could be in the cloud or a data center; in an on-premises server for tasks like defect inspection in semiconductor manufacturing; or within an autonomous machine equipped with multiple sensors and cameras.

Generating Quality Assets and Scenes

Talla also highlighted the role of LLMs in breaking down technical barriers, turning typical users into technical artists capable of creating complex robotics workcells or entire warehouse simulations.

With generative AI tools like NVIDIA Picasso, users can generate realistic 3D assets from simple text prompts and add them to digital scenes for dynamic and comprehensive robot training environments.

The same capability extends to creating diverse and physically accurate scenarios in Omniverse, enhancing the testing and training of robots to ensure real-world applicability.

This dovetails with the transformative potential of generative AI in reconfiguring the deployment of robots.

Traditionally, robots are purpose-built for specific tasks, and modifying them for different ones is a time-consuming process.

But advancements in LLMs and vision language models are eliminating this bottleneck, enabling more intuitive interactions with robots through natural language, Talla explained.

Such machines — adaptable and aware of the environment around them — will soon spill out across the world.

To learn more, attend a virtual CES session and watch Talla’s full talk below.

Celebrate the new year with more cloud gaming. Experience the power and performance of the cloud with more than 20 new games to be added to GeForce NOW in January.

Start with five games available this week, including The Finals from Embark Studios. 

And tune in to the NVIDIA Special Address at CES on Monday, Jan. 8, at 8 a.m. PT for the latest on gaming, AI-related news and more.

It’s the Final Countdown

Fight for fame on the world’s biggest stage with Embark Studios’ The Finals. The free-to-play, multiplayer, first-person shooter is newly supported in the cloud this week, with RTX ON for the most cinematic lighting and visuals for GeForce NOW Ultimate and Priority members.

In The Finals, take part in a deadly TV game show that pits contestants against each other as they battle for a huge reward. Fight alongside teammates in virtual arenas that can be altered, exploited and even destroyed. Manipulate the environment as a weapon itself and use it to take down other players. Drive viewers wild with thrilling combat and flair, using tricks like crashing a wrecking ball into opponents.

Harness the power of the cloud and reach the finals anywhere with the ability to stream across devices. Ultimate members can fight for glory with the advantage of longer gaming sessions, the highest frame rates, ray tracing and ultra-low latency.

In With the New

In Enshrouded, become Flameborn, the last ember of hope of a dying race. Awaken, survive the terror of a corrupting fog and reclaim the lost beauty of the kingdom. Venture into a vast world, vanquish punishing bosses, build grand halls and forge a path in this co-op survival action role-playing game for up to 16 players, launching in the cloud Jan. 24.

Don’t miss the five newly supported games joining the GeForce NOW library this week:

• Dishonored, for Hungary, Czech Republic and Poland (Steam)
• The Finals (Steam)
• Redmatch 2 (Steam)
• Scorn (Xbox, available for PC Game Pass)
• Sniper Elite 5 (Xbox, available for PC Game Pass)

And here’s what’s coming throughout the rest of January:

• War Hospital (New release on Steam, Jan. 11)
• Prince of Persia: The Lost Crown (New release on Ubisoft, Jan. 18)
• Turnip Boy Robs a Bank (New release on Steam and Xbox, available for PC Game Pass, Jan.18)
• Stargate: Timekeepers (New release on Steam, Jan. 23)
• Enshrouded (New release on Steam, Jan. 24)
• Bang-On Balls: Chronicles (Steam)
• Firefighting Simulator – The Squad (Steam)
• Jected – Rivals (Steam)
• The Legend of Nayuta: Boundless Trails (Steam)
• RAILGRADE (Steam)
• Redmatch 2 (Steam)
• Shadow Tactics: Blades of the Shogun (Steam)
• Shadow Tactics: Blades of the Shogun – Aiko’s Choice (Steam)
• Solasta: Crown of the Magister (Steam)
• Survivalist: Invisible Strain (Steam)
• Witch It (Steam)
• Wobbly Life (Steam)

Doubled in December

In addition to the 70 games announced last month, 34 extra joined GeForce NOW:

• Avatar: Frontiers of Pandora (New release on Ubisoft, Dec. 7)
• Goat Simulator 3 (New release on Xbox, available on PC Game Pass, Dec. 7)
• LEGO Fortnite (New release on Epic Games Store, Dec. 7)
• Against the Storm (New release on Xbox, available on PC Game Pass, Dec. 8)
• Rocket Racing (New release on Epic Games Store, Dec. 8)
• Fortnite Festival (New release on Epic Games Store, Dec. 9)
• Stellaris Nexus (New release on Steam, Dec. 12)
• Tin Hearts (New release on Xbox, available PC Game Pass, Dec. 12)
• Amazing Cultivation Simulator (Xbox, available on the Microsoft Store)
• Blasphemous 2 (Epic Games Store)
• Century: Age of Ashes (Xbox, available on the Microsoft Store)
• Chorus (Xbox, available on the Microsoft Store)
• Dungeons 4  (Xbox, available on PC Game Pass)
• Edge of Eternity (Xbox, available on the Microsoft Store)
• Farming Simulator 17 (Xbox, available on the Microsoft Store)
• Farming Simulator 22 (Xbox, available on PC Game Pass)
• Flashback 2 (Steam)
• Forza Horizon 4 (Steam)
• Forza Horizon 5 (Steam, Xbox and available on PC Game Pass)
• Hollow Knight (Xbox, available on PC Game Pass)
• The Front (Steam)
• Martha Iis Dead (Xbox, available on the Microsoft Store)
• Minecraft Dungeons (Steam, Xbox and available on PC Game Pass)
• Monster Hunter: World (Steam)
• Neon Abyss (Xbox, available on PC Game Pass)
• Ori and the Will of the Wisps (Steam, Xbox and available on PC Game Pass)
• Ori and the Blind Forest: Definitive Edition (Steam)
• Raji: An Ancient Epic (Xbox, available on the Microsoft Store)
• Remnant: From the Ashes (Xbox, available on PC Game Pass)
• Remnant II (Xbox, available on PC Game Pass)
• Richman 10 (Xbox, available on the Microsoft Store)
• Spirittea (Xbox, available on PC Game Pass)
• Surgeon Simulator 2 (Xbox, available on the Microsoft Store)
• Sword and Fairy 7 (Xbox, available on PC Game Pass)

Terminator: Dark Fate – Defiance didn’t make it in December due to a change in its publish date. Stay tuned to GFN Thursday for updates.

What are you planning to play this weekend? Let us know on X or in the comments below.

what was the final game you played in 2023?

— NVIDIA GeForce NOW (@NVIDIAGFN) January 3, 2024

An avid cyclist, Thomas Park knows the value of having lots of gears to maintain a smooth, fast ride.

So, when the software architect designed an AI inference platform to serve predictions for Oracle Cloud Infrastructure’s (OCI) Vision AI service, he picked NVIDIA Triton Inference Server. That’s because it can shift up, down or sideways to handle virtually any AI model, framework and hardware and operating mode — quickly and efficiently.

“The NVIDIA AI inference platform gives our worldwide cloud services customers tremendous flexibility in how they build and run their AI applications,” said Park, a Zurich-based computer engineer and competitive cycler who’s worked for four of the world’s largest cloud services providers.

Specifically, Triton reduced OCI’s total cost of ownership by 10%, increased prediction throughput up to 76% and reduced inference latency up to 51% for OCI Vision and Document Understanding Service models that were migrated to Triton. The services run globally across more than 45 regional data centers, according to an Oracle blog Park and a colleague posted earlier this year.

Computer Vision Accelerates Insights

Customers rely on OCI Vision AI for a wide variety of object detection and image classification jobs. For instance, a U.S.-based transit agency uses it to automatically detect the number of vehicle axles passing by to calculate and bill bridge tolls, sparing busy truckers wait time at toll booths.

OCI AI is also available in Oracle NetSuite, a set of business applications used by more than 37,000 organizations worldwide. It’s used, for example, to automate invoice recognition.

Thanks to Park’s work, Triton is now being adopted across other OCI services, too.

A Triton-Aware Data Service

“We’ve built a Triton-aware AI platform for our customers,” said Tzvi Keisar, a director of product management for OCI’s Data Science service, which handles machine learning for Oracle’s internal and external users.

“If customers want to use Triton, we’ll save them time by automatically doing the configuration work for them in the background, launching a Triton-powered inference endpoint for them,” said Keisar.

His team also plans to make it even easier for its other users to embrace the fast, flexible inference server. Triton is included in NVIDIA AI Enterprise, a platform that provides full security and support businesses need — and it’s available on OCI Marketplace.

A Massive SaaS Platform

OCI’s Data Science service is the machine learning platform for both NetSuite and Oracle Fusion software-as-a-service applications.

“These platforms are massive, with tens of thousands of customers who are also building their work on top of our service,” he said.

It’s a wide swath of mainly enterprise users in manufacturing, retail, transportation and other industries. They’re building and using AI models of nearly every shape and size.

Inference was one of the group’s first services, and Triton came on the team’s radar not long after its launch.

A Best-in-Class Inference Framework

“We saw Triton pick up in popularity as a best-in-class serving framework, so we started experimenting with it,” Keisar said. “We saw really good performance, and it closed a gap in our existing offerings, especially on multi-model inference — it’s the most versatile and advanced inferencing framework out there.”

Launched on OCI in March, Triton has already attracted the attention of many internal teams at Oracle hoping to use it for inference jobs that require serving predictions from multiple AI models running concurrently.

“Triton has a very good track record and performance on multiple models deployed on a single endpoint,” he said.

Accelerating the Future

Looking ahead, Keisar’s team is evaluating NVIDIA TensorRT-LLM software to supercharge inference on the complex large language models (LLMs) that have captured the imagination of many users.

An active blogger, Keisar’s latest article detailed creative quantization techniques for running a Llama 2 LLM with a whopping 70 billion parameters on NVIDIA A10 Tensor Core GPUs.

“Even down to four bits, the quality of model outputs is still quite good,” he said. “I can’t explain all the math, but we found a good balance, and I haven’t seen anyone else do this yet.”

After announcements this fall that Oracle is deploying the latest NVIDIA H100 Tensor Core GPUs, H200 GPUs, L40S GPUs and Grace Hopper Superchips, it’s just the start of many accelerated efforts to come.

Editor’s note: This post is part of our weekly In the NVIDIA Studio series, which celebrates featured artists, offers creative tips and tricks, and demonstrates how NVIDIA Studio technology improves creative workflows. We’re also deep diving on new GeForce RTX 40 Series GPU features, technologies and resources, and how they dramatically accelerate content creation.

A new year means new creative opportunities and new In the NVIDIA Studio beats.

Each week, featured In the NVIDIA Studio artists share their unique artwork and content creation processes, as well as how NVIDIA Studio — a platform comprising fine-tuned hardware and efficient software powered by NVIDIA and GeForce RTX GPUs — elevates their work.

This week’s featured 3D content creator, Pedro Soares, aka Blendeered, created a stunning NVIDIA-themed New Year’s celebration animation.

Plus, tune in to the NVIDIA Special Address at CES on Monday, Jan. 8, at 8 a.m. PT for the latest on content creation, AI-related news and more.

Blendeered’s Beguiling Renders 

Blendeered’s latest animation was inspired by NVIDIA and the power of technological innovation.

“The scene, New Year’s, showcases a futuristic city with all the buildings funneling to the center point,” said Blendeered. “This evokes the feeling of accelerating toward a brighter future, which is what NVIDIA is all about: taking tech to the next level, every day.”

Happy New Year from NVIDIA Studio!

May your next year be filled with many beautiful renders.

Credit: @Blendeered pic.twitter.com/dCM3Nq1ZeE

— NVIDIA Studio (@NVIDIAStudio) January 1, 2024

The Portugal-based creator first conceptualized the scene.

“The futuristic city needed to give a sense of speed,” he said. He accomplished this using highlighted arrows, neon-green street lines and light beams on digital screens across various high-rise buildings.

Blendeered then built individual assets in Blender version 3.6 — by far his favorite 3D app, in case his stage name didn’t give it away.

“Blender captivates users with its friendly interface, speed, power, real-time rendering and vibrant community — and the best part is that it’s free!” he shared.

His NVIDIA GeForce RTX 4090 GPU unlocked Blender Cycles’ RTX-accelerated OptiX ray tracing in the viewport for interactive, photorealistic modeling sequences. He also textured and applied color schemes to his 3D assets in Blender.

Next, the artist began lighting the scene using the new Panorama feature in the NVIDIA Canvas app. He tapped OptiX denoising to preview final render results in real time, speeding his workflow.

Available for GeForce RTX GPU owners and free to download, NVIDIA Canvas uses AI to turn brushstrokes into realistic landscape images for quick creation of backgrounds and concept exploration.

Blendeered generated a full, spherical, high-dynamic-range imaging (HDRi) backdrop for his computer-generated imagery workflows — based on AI rendering — with a few simple sketches. He then exported it as an HDR file and imported it into Blender. YouTuber Timo Helmers demonstrates this type of workflow in the video tutorial below.

“NVIDIA Canvas is amazing software that allowed me to make an HDRi backdrop that fit my scene perfectly,” said Blendeered.

From there, he completed the animation process before exporting the files to Blackmagic Design’s DaVinci Resolve version 18.

DaVinci Resolve is a key app for GPU acceleration and AI-powered workflows. All of the AI effects in DaVinci Resolve version 18.6 run twice as fast on NVIDIA RTX GPUs with acceleration using the NVIDIA TensorRT software development kit.

Blendeered’s post-production work included GPU-accelerated color grading, video editing and color scopes. And NVENC, a GPU hardware accelerator engine for video decoding, enabled faster, smoother playback and scrubbing of high-resolution video files.

For the final export, the eighth generation NVENC worked together with the built-in dual encoders on the artist’s GeForce RTX 4090 GPU to generate video files twice as fast. For Blendeered, NVIDIA GPUs are the clear choice for content creation because they provide “power, efficiency and reliability.”

When asked to give advice for aspiring artists, Blendeered encouraged beginners to “embrace consistent practice, learn from failures, seek feedback and stay true to the inner artistic voice.”

Check out Blendeered’s portfolio on Instagram.

Follow NVIDIA Studio on Instagram, Twitter and Facebook. Access tutorials on the Studio YouTube channel and get updates directly in your inbox by subscribing to the Studio newsletter. 

Whether abundant, endangered or extinct, animal species are the focus of countless AI-powered conservation projects.

These initiatives — accelerated using NVIDIA GPUs, deep learning software and robotics technology — are alerting conservationists to poaching threats, powering more sustainable aquaculture and helping scientists monitor coral reef health.

Take a safari through the NVIDIA Blog’s top animal stories of 2023 below.

As a bonus, discover how animals — whether beautiful butterflies, flashy fish or massive mammoths — are inspiring a herd of digital artists.

Protecting Pangolins From Poachers

Conservation AI, a U.K.-based nonprofit, is preserving biodiversity with an edge AI platform that analyzes camera footage in real time to identify species of interest, rapidly alerting conservationists to threats such as wildfires or poachers.

Founded by researchers at Liverpool John Moores University, the nonprofit now has dozens of cameras deployed across the globe running an AI platform built using NVIDIA Jetson modules, the NVIDIA DeepStream software development kit and NVIDIA Triton Inference Server.

The AI software is being deployed in Uganda and South Africa to keep an eye on pangolins and rhinos at risk of being hunted by poachers.

Video courtesy of Chester Zoo, a U.K.-based conservation society. 

Bringing Colossal Insights to a Woolly Problem

Colossal Biosciences is tackling endangered species conservation and de-extinction using computational biology.

Using gene editing technology, AI models and the NVIDIA Parabricks software suite for genomic analysis, scientists at Colossal are working to bring back the woolly mammoth, the dodo bird and the Tasmanian tiger — and protect dwindling species such as the African forest elephant.

After combining incomplete DNA sequences from extinct species’ bone samples with genomic data from closely related creatures, the team uses Parabricks for sequence alignment and variant calling — enabling them to complete analysis 12x faster.

Enabling Efficient Fish Farming

GoSmart, a member of the NVIDIA Inception program for cutting-edge startups and the NVIDIA Metropolis vision AI partner ecosystem, is deploying AI for more efficient and sustainable fish farming.

The company’s compact edge AI system, powered by the NVIDIA Jetson platform, analyzes a pond or tank’s temperature and oxygen levels, as well as the average weight and population distribution of fish — information farmers can use for decisions around fish feeding and harvesting.

The team is also adding AI models that analyze fish behavior and indicators of disease and plans to integrate its solution with autonomous feeding systems.

AI Can See Your (Coral Reef) Halo

Researchers at the University of Hawaii at Mānoa are analyzing satellite imagery using NVIDIA GPU-powered AI to track halos — the rings of sand that surround coral reefs — as a way to assess ecosystem health.

The presence of halos indicates that a coral reef has a healthy population of marine life, including fish and invertebrates. A change in their shape suggests a degrading environment that needs attention from conservationists.

The researchers’ AI tool, which runs on an NVIDIA RTX A6000 GPU, can analyze hundreds of coral reef halos in around two minutes, a task that would take 10 hours for a human to complete.

Reef-Roving Robot Tracks Undersea Life

An autonomous underwater robot powered by the NVIDIA Jetson Orin NX module is roaming reef ecosystems to help scientists understand human impact on reefs and surrounding sea creatures.

Developed by researchers at MIT and the Woods Hole Oceanographic Institution’s Autonomous Robotics and Perception Laboratory, the CUREE robot collects environmental data that informs 3D models of reefs.

The team developed an AI model called DeepSeeColor that cleans up blurry underwater footage to enable more accurate fish detection by another neural network. They’re also working on detection models to identify audio samples from different creatures.

Fantastic Fauna: Animals Inspire AI-Powered Digital Art

Greek philosopher Plato said that art imitates life — and digital art is no exception, as exemplified by artists who this year used NVIDIA technology to develop stunning animal-inspired visuals.

Honoring marine life, BBC Studios’ Alessandro Mastronardi created a series of incredibly realistic shark videos and renders in Blender and NVIDIA Omniverse, a platform for connecting and building custom 3D tools and applications with Universal Scene Description (OpenUSD).

Taiwanese artist Steven Tung took a more whimsical approach in The Given Fish, an animation depicting stone fish created using Adobe Photoshop, Adobe Substance 3D Painter and Blender — all accelerated by an NVIDIA GeForce RTX 4090 GPU-powered system.

London-based Dominic Harris used GPU-accelerated AI to render a real-time collage of 13,000 imagined butterflies, which exhibit-goers could make flutter or change color. And Keerthan Sathya, based in Bangalore, used the NVIDIA Omniverse platform to render a mammoth-themed animation.