{"id":13481,"date":"2021-11-10T15:19:31","date_gmt":"2021-11-10T13:19:31","guid":{"rendered":"https:\/\/www.samdb.co.za\/blogs\/?p=13481"},"modified":"2021-11-10T15:19:32","modified_gmt":"2021-11-10T13:19:32","slug":"nvidia-announces-platform-for-creating-ai-avatars","status":"publish","type":"post","link":"https:\/\/www.samdb.co.za\/blogs\/blog\/2021\/11\/10\/nvidia-announces-platform-for-creating-ai-avatars\/","title":{"rendered":"Nvidia Announces Platform For Creating AI Avatars"},"content":{"rendered":"\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><a href=\"https:\/\/i0.wp.com\/www.samdb.co.za\/blogs\/wp-content\/uploads\/2020\/08\/nvidia-1.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"200\" height=\"59\" src=\"https:\/\/i0.wp.com\/www.samdb.co.za\/blogs\/wp-content\/uploads\/2020\/08\/nvidia-1.jpg?resize=200%2C59&#038;ssl=1\" alt=\"\" class=\"wp-image-10580\"\/><\/a><\/figure><\/div>\n\n\n\n<p>NVIDIA today announced NVIDIA Omniverse Avatar, a technology platform for generating interactive AI avatars.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><a href=\"https:\/\/i0.wp.com\/www.samdb.co.za\/blogs\/wp-content\/uploads\/2021\/11\/toy-jhh.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"550\" height=\"309\" src=\"https:\/\/i0.wp.com\/www.samdb.co.za\/blogs\/wp-content\/uploads\/2021\/11\/toy-jhh.jpg?resize=550%2C309&#038;ssl=1\" alt=\"\" class=\"wp-image-13482\" srcset=\"https:\/\/i0.wp.com\/www.samdb.co.za\/blogs\/wp-content\/uploads\/2021\/11\/toy-jhh.jpg?w=550&amp;ssl=1 550w, https:\/\/i0.wp.com\/www.samdb.co.za\/blogs\/wp-content\/uploads\/2021\/11\/toy-jhh.jpg?resize=300%2C169&amp;ssl=1 300w\" sizes=\"auto, (max-width: 550px) 100vw, 550px\" \/><\/a><\/figure><\/div>\n\n\n\n<p>Omniverse Avatar connects the company\u2019s technologies in speech AI, computer vision, natural language understanding, recommendation engines and simulation technologies. Avatars created in the platform are interactive characters with ray-traced 3D graphics that can see, speak, converse on a wide range of subjects, and understand naturally spoken intent.<\/p>\n\n\n\n<p>Omniverse Avatar opens the door to the creation of AI assistants that are easily customizable for virtually any industry. These could help with the billions of daily customer service interactions \u2014 restaurant orders, banking transactions, making personal appointments and reservations, and more \u2014 leading to greater business opportunities and improved customer satisfaction.<\/p>\n\n\n\n<p>\u201cThe dawn of intelligent virtual assistants has arrived,\u201d said Jensen Huang, founder and CEO of NVIDIA. \u201cOmniverse Avatar combines NVIDIA\u2019s foundational graphics, simulation and AI technologies to make some of the most complex real-time applications ever created. The use cases of collaborative robots and virtual assistants are incredible and far reaching.\u201d<\/p>\n\n\n\n<p>Omniverse Avatar is part of&nbsp;<a href=\"https:\/\/www.nvidia.com\/en-us\/omniverse\/\" rel=\"noreferrer noopener\" target=\"_blank\"><u>NVIDIA Omniverse<\/u><\/a>&#x2122;, a virtual world simulation and collaboration platform for 3D workflows currently in open beta with over 70,000 users.<\/p>\n\n\n\n<p>In his keynote address at&nbsp;<a href=\"https:\/\/www.nvidia.com\/gtc\/\" rel=\"noreferrer noopener\" target=\"_blank\"><u>NVIDIA GTC<\/u><\/a>, Huang shared various examples of Omniverse Avatar: Project Tokkio for customer support,&nbsp;<a href=\"https:\/\/blogs.nvidia.com\/blog\/2021\/11\/09\/drive-chauffeur-and-concierge\/\" rel=\"noreferrer noopener\" target=\"_blank\"><u>NVIDIA DRIVE Concierge<\/u><\/a>&nbsp;for always-on, intelligent services in vehicles, and&nbsp;<a href=\"https:\/\/developer.nvidia.com\/maxine\" rel=\"noreferrer noopener\" target=\"_blank\"><u>Project Maxine<\/u><\/a>&nbsp;for video conferencing.<\/p>\n\n\n\n<p>In the\u00a0<a href=\"https:\/\/youtu.be\/U9Zh57dGsH4\">first demonstration of Project Tokkio<\/a>, Huang showed colleagues engaging in a real-time conversation with an avatar crafted as a toy replica of himself \u2014 conversing on such topics as biology and climate science.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Expert, Natural Q&amp;A with NVIDIA Omniverse Avatar for Project Tokkio\" width=\"750\" height=\"422\" src=\"https:\/\/www.youtube.com\/embed\/U9Zh57dGsH4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>In a\u00a0<a href=\"https:\/\/youtu.be\/ox2Cc88I-Os\">second Project Tokkio demo<\/a>, he highlighted a customer-service avatar in a restaurant kiosk, able to see, converse with and understand two customers as they ordered veggie burgers, fries and drinks. The demonstrations were powered by NVIDIA AI software and Megatron 530B, which is currently the world\u2019s largest customizable language model.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Customer Service Kiosk with NVIDIA Omniverse ACE for Project Tokkio\" width=\"750\" height=\"422\" src=\"https:\/\/www.youtube.com\/embed\/ox2Cc88I-Os?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>In a demo of the DRIVE Concierge AI platform, a digital assistant on the center dashboard screen helps a driver select the best driving mode to reach his destination on time, and then follows his request to set a reminder once the car\u2019s range drops below 100 miles.<\/p>\n\n\n\n<p>Separately, Huang showed Project Maxine\u2019s ability to add state-of-the-art video and audio features to virtual collaboration and content creation applications. An English-language speaker is shown on a video call in a noisy cafe, but can be heard clearly without background noise. As she speaks, her words are both transcribed and translated in real time into German, French and Spanish with her same voice and intonation. &nbsp;<\/p>\n\n\n\n<p><strong>Omniverse Avatar Key Elements<\/strong><br \/>Omniverse Avatar uses elements from speech AI, computer vision, natural language understanding, recommendation engines, facial animation, and graphics delivered through the following technologies:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Its speech recognition is based on&nbsp;<a href=\"https:\/\/blogs.nvidia.com\/blog\/2021\/11\/09\/riva-enterprise-custom-voice-speech-ai\/\" rel=\"noreferrer noopener\" target=\"_blank\"><u>NVIDIA Riva<\/u><\/a>, a software development kit that recognizes speech across multiple languages. Riva is also used to generate human-like speech responses using text-to-speech capabilities.<\/li><li>Its natural language understanding is based on the&nbsp;<a href=\"https:\/\/developer.nvidia.com\/blog\/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model\/\" rel=\"noreferrer noopener\" target=\"_blank\"><u>Megatron 530B<\/u><\/a>&nbsp;large language model that can recognize, understand and generate human language. Megatron 530B is a pretrained model that can, with little or no training, complete sentences, answer questions of a large domain of subjects, summarize long, complex stories, translate to other languages, and handle many domains that it is not trained specifically to do.<\/li><li>Its recommendation engine is provided by&nbsp;<a href=\"https:\/\/developer.nvidia.com\/nvidia-merlin\" rel=\"noreferrer noopener\" target=\"_blank\"><u>NVIDIA Merlin<\/u><\/a>&#x2122;, a framework that allows businesses to build deep learning recommender systems capable of handling large amounts of data to make smarter suggestions.&nbsp;&nbsp;<\/li><li>Its perception capabilities are enabled by&nbsp;<a href=\"https:\/\/developer.nvidia.com\/metropolis\" rel=\"noreferrer noopener\" target=\"_blank\"><u>NVIDIA Metropolis<\/u><\/a>, a computer vision framework for video analytics.<\/li><li>Its avatar animation is powered by NVIDIA Video2Face and&nbsp;<a href=\"https:\/\/www.nvidia.com\/en-us\/omniverse\/apps\/audio2face\/\" rel=\"noreferrer noopener\" target=\"_blank\"><u>Audio2Face<\/u><\/a>&#x2122;, 2D and 3D AI-driven facial animation and rendering technologies.<\/li><\/ul>\n\n\n\n<p>These technologies are composed into an application and processed in real time using the NVIDIA&nbsp;<a href=\"http:\/\/developer.nvidia.com\/ucf\" rel=\"noreferrer noopener\" target=\"_blank\"><u>Unified Compute Framework<\/u><\/a>. Packaged as scalable, customizable microservices, the skills can be securely deployed, managed and orchestrated across multiple locations by&nbsp;<a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/products\/fleet-command\/\" rel=\"noreferrer noopener\" target=\"_blank\"><u>NVIDIA Fleet Command<\/u><\/a>&#x2122;.<\/p>\n\n\n\n<p>Learn more about&nbsp;<a href=\"https:\/\/www.nvidia.com\/en-us\/omniverse\/?activetab=explore-omniverse-3\" rel=\"noreferrer noopener\" target=\"_blank\"><u>Omniverse Avatar<\/u><\/a>.<\/p>\n\n\n\n<p>Register for free to learn more about NVIDIA Omniverse during&nbsp;<a href=\"https:\/\/reg.rainfocus.com\/flow\/nvidia\/nvidiagtc\/digitalreg\/login\" rel=\"noreferrer noopener\" target=\"_blank\"><u>NVIDIA GTC<\/u><\/a>, taking place online through Nov. 11. Watch&nbsp;<a href=\"https:\/\/www.nvidia.com\/gtc\/keynote\/\" rel=\"noreferrer noopener\" target=\"_blank\"><u>Huang\u2019s GTC keynote address<\/u><\/a>&nbsp;streaming on Nov. 9 and in replay.<img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/ml.globenewswire.com\/media\/MmZmYmM4NTUtODVmNC00MTZiLTg5M2QtYzJiNDIyYTU4YWU2LTEwMTg0ODU%3D\/tiny\/NVIDIA-CORPORATION.png?w=750&#038;ssl=1\"\/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>NVIDIA today announced NVIDIA Omniverse Avatar, a technology platform for generating interactive AI avatars. Omniverse Avatar connects the company\u2019s technologies in speech AI, computer vision, natural language understanding, recommendation engines and simulation technologies. Avatars created in the platform are interactive characters with ray-traced 3D graphics that can see, speak, converse on a wide range of&hellip; <a class=\"more-link\" href=\"https:\/\/www.samdb.co.za\/blogs\/blog\/2021\/11\/10\/nvidia-announces-platform-for-creating-ai-avatars\/\">Continue reading <span class=\"screen-reader-text\">Nvidia Announces Platform For Creating AI Avatars<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[213],"tags":[234],"class_list":["post-13481","post","type-post","status-publish","format-standard","hentry","category-hardware-software","tag-nvidia","entry"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/posts\/13481","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/comments?post=13481"}],"version-history":[{"count":0,"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/posts\/13481\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/media?parent=13481"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/categories?post=13481"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.samdb.co.za\/blogs\/wp-json\/wp\/v2\/tags?post=13481"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}