Xinchangyuan in China sets new standards within the Metaverse, harnessing cutting-edge multimodal AI to create hyper-realistic 3D avatars.
China is gearing up to leave its imprint by filling the Metaverse with three-dimensional digital beings. Chinese startup Xinchangyuan The company introduces an innovative platform powered by multimodal AI for generating impressively realistic 3D virtual beings, which can either be digital versions of actual individuals or entirely imaginative avatars.
Their technology is highly intricate, featuring a network of 22 cameras—16 dedicated to capturing full-body movements and 6 focused on the nuances of facial expressions. This data is then used to refine their generative model, producing avatars that are astonishingly lifelike, capable of being rendered in real-time at a resolution of 1024×1024 pixels and 25 frames per second.
What makes Xinchangyuan stand out is its unique training technique known as AvatarReX, which utilizes Neural Radiance Fields (NeRF) sourced from video data. This allows the avatars to express rich body language, varying facial expressions, and in future updates, lifelike eye movements.
The platform grants comprehensive control over the avatars' body, facial features, and hand movements. Additionally, it incorporates features for lip-synchronization and an emotion generator that can convey a wide spectrum of feelings—from anger and sorrow to exuberance and joy. These digital personas can also seamlessly integrate into real-world environments, adhering to the principles of physics.
The achievements of Xinchangyuan, a young Chinese startup backed by angel investors, in transforming engineers into key contributors within the Metaverse are quite impressive.
Qiu Jianming, the co-founder and CEO of Xinchangyuan, comes equipped with nearly 20 years of experience in the tech sector and holds a Ph.D. in Electronic Engineering from Tsinghua University, where he currently leads the Virtual Digital Human R&D Center.
The startup boasts a team of adept engineers hailing from illustrious institutions such as Tsinghua University, Microsoft, and Alibaba, among other industry giants.
The creators behind the AvatarReX platform tout its rapid production timelines, cost-efficiency, user-friendly design, and straightforward maintenance. It’s expected that come next year, China will embark on a vigorous campaign to fill the Metaverse with its digital populace. As Elon Musk works toward his Mars vision, the Chinese may well be on their path to creating a bustling digital society within the Metaverse.
For a visual representation of this groundbreaking technology, you can view a demonstration video. here If you're interested in a deeper understanding, you can check out the detailed write-up we provided. here .
Read more related topics:
Disclaimer
In line with the Trust Project guidelines Please remember that the content here is not designed to serve as legal, tax, investment, financial, or similar advice. Always invest only what you can afford to lose and seek independent financial counsel if uncertain. For more information, reviewing the terms and conditions along with the help resources on offer is recommended. MetaversePost is dedicated to unbiased, accurate reporting, yet market conditions can shift unexpectedly.
