Generative AI and Virtual Worlds. A few days ago, my team won grant prize… | by Jon Radoff | Building the Metaverse | Jun, 2023

    Published on:

    Building the metaverse

    A few days ago my team created a role-playing game at a16z Tech Week and won a grant at the LA AI Virtual Worlds Hackathon. one day.

    It’s the result of the last few years that I’ve been obsessed with accelerating game development. Most of it is generative AI. And so is the work we’re doing at Beamable to be able to set up servers for the world wide setup on “day zero”.

    Along the way, I’ve conducted numerous experiments and had hundreds of conversations with people (including a dozen conversations I recorded for a video podcast). Building the metaverse).

    Read on for a rundown of the most relevant articles and conversations I’ve had over the past three months.

    By the way, did you know that I mainly write in ? substack, metabert meditation? Link there to see the latest information.?

    This is an article about the programming techniques that enabled my team to win the LA AI TechWeek Virtual Worlds Hackathon and build a playable RPG in one day.we used humanClaude LLM with 100K contexts, blockade lab, scenario, Beamable and unity as a key technology. See how we made it happen:

    Part of an early experiment by me and the Beamable team (open sourced). This demonstrates his use of GPT for game development and real-time manipulation, as well as the use of generative images from scenarios.

    This isn’t exactly generative AI, but it’s a lesson I’ve learned the hard way myself from building the game and delivering it to over 20 million players, and some of the mistakes and learnings I’ve gleaned along the way. There is also. If generative AI can accelerate development speed, it will support more “shots in goal”, one of the most important pillars of my theory, to make the game more suitable for the audience. I will support you.

    announced at MIT Media LabThe Metaverse course explains how the virtual world began as a place to express our digital identity, became a platform for our creativity, and eventually our will. The latter is achieved by generative AI agents.

    in this season Building the Metaverse (, I’ve been talking to builders and leaders who are building their businesses using generative AI. Although the focus is on games and virtual worlds, many of these technologies can potentially be applied to a wide range of use cases.

    Below is a direct link to the conversation on YouTube, but clicking the title will take you to an overview article with supporting material and a note.

    conversation with me Kayla Komari It was about her startup generating entire worlds to explore using text prompts. We explored her products and her technology supporting Sloyd, Polyhive, Unreal Engine 5 and more.

    Bilawal Sidu does some of the most interesting and creative work with generative AI, neural radiation fields (NERF) and photogrammetry. Some of his examples have been widely shared, and his augmented reality filters for TikTok have been downloaded over 100 million times. Learn more about his work and methods in our conversation:

    I recorded a conversation with Zach Johnson How generative AI is changing the way we incorporate voice into games and simulations. We’ll also show you some amazing demos of Zac’s text-to-speech technology inside his flight simulator. We will also talk about the nature of art and his economy as a creator evolving around AI.

    Avatar representation is one of the most complex frontiers in generative AI, covering everything from modeling to rigging to animation. in a conversation with me Yassin TahiSo, we discussed how Kinetix brings all these pieces together and simplifies access through text prompts and the Creator Economy.

    Linus Ekenstam uses generative AI to create storytelling products. We talked about how artificial intelligence is changing product design, and civilization itself.

    Cameron Willis We have created the most downloaded AI tools on the Unity Asset Store. We sat down with Indie to discuss his journey as a game developer and what inspired him to create generative AI tools to speed up development.

    Christina Kashtanova Acquired the first copyright of the comic book “Zarya at Dawn”, an AI-generated work. She discussed her journey from photographer to AI her artist, and what she learned from her quest to copyright her work.

    Jussi Peteri Kempainen builds indie games using generative AI. He created and documented a workflow that included tools to take art from Midjourney, create projection maps, set it up in Blender, and then set it up in Unity. If you’re an artist or game developer looking to learn how to incorporate generative concept art directly into your game engine, watch this video.

    Inspired by Ian Banks’ Culture Series, Edward SaatchiThe vision is to build a virtual society with millions of AI-powered virtual beings. We discuss the importance of creating pseudo-environments in which virtual entities take action, rather than just having conversations.

    scenario has created a generative AI tool that can train its own generator to create game assets, prompting the presence of individual assets with text. Discuss how the scenario works. Emmanuel de MestreHis vision for the future of game development and his entrepreneurial journey.

    Hillary Mason Hidden Door is a startup that develops multiplayer games built around Large Language Models (LLM). Prior to Hidden Door, Hillary headed his Cloudera machine learning and formerly computer science professor. He discussed how language models could enable entirely new categories of games. Some of the language models that could be put to practical use are simpler CPU-driven models rather than the well-known ChatGPT-style gigantic models. learn more:

    For the latest information from me, please visit my site. substack, metabert meditation.


    Leave a Reply

    Please enter your comment!
    Please enter your name here