{"id":67005,"date":"2023-01-02T15:45:31","date_gmt":"2023-01-02T10:15:31","guid":{"rendered":"https:\/\/www.the-next-tech.com\/?p=67005"},"modified":"2023-01-02T15:45:31","modified_gmt":"2023-01-02T10:15:31","slug":"pointavatar-ai-based-deformable-point-based-head-avatars","status":"publish","type":"post","link":"https:\/\/www.the-next-tech.com\/artificial-intelligence\/pointavatar-ai-based-deformable-point-based-head-avatars\/","title":{"rendered":"PointAvatar: Reading Raw Captured Videos &#038; Converting Into Deformable Point-Based Head Avatars"},"content":{"rendered":"<p><em><strong>PointAvatar methods are fascinating and it is especially used in the gaming industry simultaneously in the Metaverse.<\/strong><\/em><\/p>\n<h2><strong>Abstract<\/strong><\/h2>\n<p>The accomplishment of achieving a 3D head avatar from raw sources (video or image) possesses a number of breathtaking processes.<\/p>\n<p><strong>The hardest part is to make it realistic, animatable, and relightable. Current methods rely on explicit 3D morphable meshes (3DMM) or exploit neural implicit representations.<\/strong><\/p>\n<p>However, both are fantastic but lag to offer a smug experience in development. For instance; fail to provide thin hair strands, the ability to read light-shifting terminology, shading, and so on.<\/p>\n<p><mark class=\"mark\">It is because some applicants are limited by fixed topology and potentially do not offer fully immersive deform and are inefficient to render, too.<\/mark><\/p>\n<p>This is why 3D designers and developers in large-scale industries are using <strong>PointAvatar as not a software or a service, but a robust method that is capable of offering a deformable point-based portrayal<\/strong> that unravels the source color into intrinsic albedo and normal-dependent shading.<\/p>\n<p><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\"><\/script><br \/>\n<ins class=\"adsbygoogle\" style=\"display: inline-block; width: 728px; height: 90px;\" data-ad-client=\"ca-pub-9864771813712812\"><\/ins> <script>\n(adsbygoogle = window.adsbygoogle || []).push({});\n<\/script><\/p>\n<p>In alternate terms, it bridges the slit that is currently being faced i.e. implicit representation, merging high-quality geometry, and ease of deformation and rendering efficiency.<\/p>\n<p>Will sure be helpful for 3D designers and aid them in their projects with efficient rendering, easy animation, and surface geometry.<\/p>\n<h2>Method\/Function<\/h2>\n<p>This renowned invented method, deformable point-based head avatars from video; generate animatable 3D avatars using monocular videos from multiple sources including smartphone cameras, DSLR, laptop webcams, and internet videos.<\/p>\n<p><mark class=\"mark\">The method is overwhelming as it provides state-of-the-art quality in challenging cases. For example; presenting an accurately matched head avatar of the player in the <a href=\"https:\/\/www.the-next-tech.com\/future\/how-to-access-the-metaverse\/\" target=\"_blank\" rel=\"noopener\">Metaverse<\/a>.<\/mark><\/p>\n<p>When captured from a monocular medium or any other subject, it may perform a number of expressions and poses which this so-called method learns jointly.<\/p>\n<p><img loading=\"lazy\" class=\"size-full wp-image-67006 aligncenter\" src=\"https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure.png\" alt=\"pointavatar method figure\" width=\"1245\" height=\"530\" data-wp-editing=\"1\" srcset=\"https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure.png 1245w, https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure-300x128.png 300w, https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure-1024x436.png 1024w, https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure-768x327.png 768w, https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure-20x8.png 20w, https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure-30x13.png 30w, https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure-80x34.png 80w, https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152124\/pointavatar-method-figure-150x64.png 150w\" sizes=\"(max-width: 1245px) 100vw, 1245px\" \/><\/p>\n<ul>\n<li>First, a point cloud (3D head geometry) learns about the appearance of the subject in a canonical space.<\/li>\n<li>Second, using a deformation network which brings in change in the subject by transforming the point cloud into new poses using a FLAME expression extracted from the RGB frames.<\/li>\n<li>At last, a shading network gives a vector based on the point normals in the deformed space. These three jointly can be optimized by comparing the rendering with the inputs.<\/li>\n<\/ul>\n<span class=\"seethis_lik\"><span>Also read:<\/span> <a href=\"https:\/\/www.the-next-tech.com\/review\/walmart-eye-center\/\">Walmart Eye Center Review: Is It Worth The Money?<\/a><\/span>\n<h2>Previews<\/h2>\n<p>I have collected and shared the results of how a 3D avatar model looks with various parameters from learned 3D point clouds, Animation, and Relighting, respectively.<\/p>\n<h3>Learned 3D point clouds<\/h3>\n<div style=\"width: 800px;\" class=\"wp-video\"><!--[if lt IE 9]><script>document.createElement('video');<\/script><![endif]-->\n<video class=\"wp-video-shortcode\" id=\"video-67005-1\" width=\"800\" height=\"341\" loop=\"1\" autoplay=\"1\" preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152450\/PointAvatar-Learned-3D-point-clouds.mp4?_=1\" \/><a href=\"https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152450\/PointAvatar-Learned-3D-point-clouds.mp4\">https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152450\/PointAvatar-Learned-3D-point-clouds.mp4<\/a><\/video><\/div>\n<h3>Animation<\/h3>\n<div style=\"width: 800px;\" class=\"wp-video\"><video class=\"wp-video-shortcode\" id=\"video-67005-2\" width=\"800\" height=\"200\" loop=\"1\" autoplay=\"1\" preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152601\/Animation-Sample.mp4?_=2\" \/><a href=\"https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152601\/Animation-Sample.mp4\">https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152601\/Animation-Sample.mp4<\/a><\/video><\/div>\n<h3>Relighting<\/h3>\n<div style=\"width: 800px;\" class=\"wp-video\"><video class=\"wp-video-shortcode\" id=\"video-67005-3\" width=\"800\" height=\"200\" loop=\"1\" autoplay=\"1\" preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152636\/Relighting-Sample.mp4?_=3\" \/><a href=\"https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152636\/Relighting-Sample.mp4\">https:\/\/s3.amazonaws.com\/static.the-next-tech.com\/wp-content\/uploads\/2023\/01\/02152636\/Relighting-Sample.mp4<\/a><\/video><\/div>\n<h2>Future Scope<\/h2>\n<p><em>There is no doubt in saying that <a href=\"https:\/\/www.the-next-tech.com\/artificial-intelligence\/artificial-intelligence-predictions\/\" target=\"_blank\" rel=\"noopener\">AI is the future<\/a> of this planet.<\/em><\/p>\n<p>With ever-growing advancements in gaming, 3D modeling, robotics, and the practices of developing 3D avatars would open up wide-ranging applications in communication and entertainment.<\/p>\n<p>In the entertainment industry, PointAvatar would bring significant growth. While in communication context, it would provide a new way of conversation experiences.<\/p>\n<p><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\"><\/script><br \/>\n<ins class=\"adsbygoogle\" style=\"display: inline-block; width: 728px; height: 90px;\" data-ad-client=\"ca-pub-9864771813712812\"><\/ins> <script>\n(adsbygoogle = window.adsbygoogle || []).push({});\n<\/script><\/p>\n<h2>Final Thought<\/h2>\n<p>3D head avatars have been used since the development of 3D games began. After so many years, the industry has gained a plethora of growth, and enterprises anticipated more and more 3D character design, 3D avatars, and more.<\/p>\n<p><strong>With a new method; deformable point-based head avatars, there would be a probability of completing challenging tasks in a minute.<\/strong><\/p>\n<p><em>Image &amp; Video Source: zhengyuf.github.io<\/em><\/p>\n<p><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\"><\/script><br \/>\n<ins class=\"adsbygoogle\" style=\"display: inline-block; width: 728px; height: 90px;\" data-ad-client=\"ca-pub-9864771813712812\"><\/ins> <script>\n(adsbygoogle = window.adsbygoogle || []).push({});\n<\/script><\/p>\n","protected":false},"excerpt":{"rendered":"<p>PointAvatar methods are fascinating and it is especially used in the gaming industry simultaneously in the Metaverse. Abstract The accomplishment<\/p>\n","protected":false},"author":146,"featured_media":67010,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[36],"tags":[17128,17127,17129],"_links":{"self":[{"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/posts\/67005"}],"collection":[{"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/users\/146"}],"replies":[{"embeddable":true,"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/comments?post=67005"}],"version-history":[{"count":3,"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/posts\/67005\/revisions"}],"predecessor-version":[{"id":67013,"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/posts\/67005\/revisions\/67013"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/media\/67010"}],"wp:attachment":[{"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/media?parent=67005"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/categories?post=67005"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.the-next-tech.com\/rest\/wp\/v2\/tags?post=67005"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}