There was a lot of interest in the potential of the Metaverse captured during the pandemic as people were looking for more meaningful ways to connect with each other. Since then, however, the hype about the Metaverse has diminished. After all, the latest technology in the public eye, generative AI, could play a key role in enhancing interaction and development on the metaverse. Creative applications of generative AI can fill the enormous demand for content that a developer needs to create in virtual worlds using his 3D assets.
Fast paced and imaginative
Prajod Vettiyattil, Fractal’s principal architect, explains how. “Generative AI is useful because it can create metaverse content from textual descriptions. 3D modeling is typically a labor-intensive task. artistic knowledge is required, which is not only to create 3D models, but for banks, schools and shops, for example, to envision and use certain types of color combinations and lighting that illustrate these themes. Then we have to create some videos and images and integrate them into the 3D model,” he explains.
Generative AI makes it easy to create virtual spaces, and the customization offered by generative AI tools makes the artistry even more appealing and expands the options available. Today, each space and experience within the metaverse has been painstakingly crafted and curated by human designers and developers. It takes weeks, sometimes months, to generate each space.
“Generative AI can be a great tool not only when creating the final environment, but also when coming up with ideas. The AI tool can be asked to emulate the style of any artist you choose, such as Van Gogh,” said Vineet, senior consultant at Fractal.
“The ability to create avatars in the Metaverse is the most interesting and complex aspect of the Metaverse. Avatars become bots that can move, talk and interact like humans. Avatars are representations of humans that exist in the real world. , or may be only virtual beings that have no representation in the real world.Generative AI allows you to simulate realistic thoughts, physical appearances, voices, and movements within the metaverse. Prajod said it will help build AI bots with emotional and conversational traits customized to the user’s preferences, like the AI virtual assistant in the movie “Her.”
However, the simplicity of what generative AI does makes a difference in the world. Prajod explained: “A big part of the value of generative AI is that it makes it very easy to automate the creation of interactive content and experiences. It takes years because it requires a lot of iteration, but with generative AI, we can do it in months.”
Increased immersion
Vineet believes that these applications can improve the overall quality of social interaction through various means. “Just as voice communication underwent a big change after letters and telegrams, video became another big step in interactivity. A piece can be made to make you sound like Mozart, who left a number of unfinished symphonies before he died. You can also create music in the style of “Led Zeppelin”. Similar to ChatGPT, it can be used to build narratives. In the future, generative AI will also be available in other modes such as audio,” he explained.
All this means that the Metaverse could finally become the fully immersive experience it was promised. Prajod added, “Unlike text interfaces in chat apps or 2D interfaces in video conferencing apps, the Metaverse allows for kinesthetic interactions like turning your head or moving your hands. It’s a more immersive social experience compared to
Adds significant value to the financial and education sectors
In particular, not only entertainment, but also business and education can find value in the Metaverse through generative AI. “This technology opens up new opportunities not only for human interaction and entertainment, but also for education. could be much easier,” Prajod said.
Banks and other businesses that are already leveraging the metaverse can help themselves further. “Nowadays, especially in the banking sector, there is a lot more that can be done with physical virtual interactions than just automated chats. No cost to physically go to the bank or even the hassle of contacting someone at a call center or waiting for a call. There is a virtual bank that makes
He added, “Instead, even banks can invest their resources elsewhere. You can have a customer service representative, not just audio, but also a visual aspect, and you can see their facial expressions when they speak, making the experience even more fulfilling. It’s worth it compared to selling .”
Like human customer support assistants, these bots can access internal data and respond to customer inquiries. Plus, with virtual customer support assistants like this one, you won’t have to wait forever on a phone line. These AI bots can learn from customer reactions and better explain and converse based on each customer’s history.
“Normally, if you are calling a customer rep, when you call the second time you are often on another call, so you lose context. This is not a problem because we can preserve context at times,” Prajod said.
But the positives don’t end there. “Thanks to automatic translation, there are many areas where we can create content especially for visually impaired users. We can also use the automatic speech translation feature to have real-time conversations with people around the world.” he explains further.
Other uses
Regarding the application, digital twin is another space with underlying technology similar to the metaverse where generative AI can help. “Digital twin technology requires high-resolution rendering and real-time data transfer. For example, if you are creating a digital twin of New York or Mumbai, you can view the virtual space of the roads and traffic lights and the reality of how they control traffic flow and show alternative traffic routes. We can solve the world’s problems and get to our destinations faster,” said Vineet.
There are other challenges around the metaverse that generative AI can solve. “To enable our customers to experience the Metaverse, we need a lot of bandwidth. Power and compute are pretty much the limiting factor right now. Content can be regenerated on the device, making it possible to display high-definition content.Currently, most metaverses have a cartoon-like look and low resolution,” Prajod shared. .
