Mark Zuckerberg: First Interview in the Metaverse | Lex Fridman Podcast #398

Mark Zuckerberg: First Interview in the Metaverse | Lex Fridman Podcast #398 thumbnail

Added: Sep 29, 2023

In this podcast episode, Lex Fridman interviews Mark Zuckerberg, the CEO of Meta, formerly known as Facebook. The conversation takes place inside the metaverse, where both Mark and Lex appear as photorealistic Kodak avatars in 3D with spatial audio. They discuss the incredible technology behind these avatars and how it can revolutionize human connection on the internet.

Mark explains that the avatars are created by scanning individuals in various expressions and building a computer model of their faces and bodies. This allows for photorealistic representations that capture the nuances of facial expressions and emotions. The avatars are more bandwidth-efficient than transmitting full videos and can be used to create a sense of presence and immersion.

They discuss the future of this technology and its accessibility. Currently, the scanning process is time-consuming, but the goal is to develop a quick scan using a smartphone that produces the same quality as the current scans. Mark mentions the upcoming release of Quest 3, a mixed reality device that combines virtual reality and augmented reality. It features improved resolution and mixed reality cameras that allow for the integration of digital objects into the physical world.

They explore the potential applications of photorealistic avatars and mixed reality. Mark envisions a world where digital and physical realities merge, allowing for the creation of holograms and interactive experiences. He suggests that photorealistic avatars could be used to interact with loved ones who have passed away, although ethical considerations and psychological impacts need to be carefully studied. Additionally, Mark discusses the possibility of creating AI versions of oneself that can interact with others, providing assistance and building communities.

Mark acknowledges the philosophical questions raised by this technology, such as the nature of identity and the balance between physical and digital representations. He believes that the photorealistic avatars may serve as a bridge between the physical and digital worlds, but the long-term preference for expressive or photorealistic avatars remains uncertain.

They also touch on the challenges of developing AI personalities and the vision behind Meta's AI initiatives. Mark emphasizes the goal of empowering individuals with AI tools rather than relying on a single superintelligence. He discusses different use cases for AI, including personal assistants, business interactions, and entertainment.

Zuckerberg continues by discussing the concept of the metaverse, which he defines as a virtual space that allows people to connect and interact with each other in a more immersive and natural way. He believes that the metaverse will be the next major computing platform, surpassing the internet and mobile phones in terms of its impact on society.

One of the key aspects of the metaverse that Zuckerberg is excited about is the potential for AI to facilitate connections between people. He envisions AI-powered virtual assistants that can enhance group chats and make them more interesting, based on the participants' interests, such as sports, fashion, trivia, or video games. He also believes that AI will greatly improve non-player characters (NPCs) in video games, making them more realistic and engaging.

Zuckerberg mentions an AI they have built internally called the "adventure text-based dungeon master," which has received positive feedback during testing. He explains that they have enlisted cultural figures like Snoop Dogg to play the role of the dungeon master, adding humor and entertainment value to the experience. He also discusses the technical challenges of creating AI personalities inspired by real people, ensuring that the AI represents the creator's intentions and avoids saying things they wouldn't want.

The conversation then shifts to the recent release of Llama 2, an open-source AI model developed by Meta. Zuckerberg expresses his satisfaction with the reception of Llama 2 and the excitement it has generated. He mentions that they are working on integrating Llama 2 into various consumer products and are also developing future foundation models. While he doesn't provide specific details about Llama 3, he hints that it is in the works and may be open-sourced in the future.

Fridman commends Meta for open-sourcing Llama 2 and fostering transparency in AI development. He believes that this contributes to a broader conversation about the future of AI and allows society to collectively learn and understand the boundaries and possibilities of these technologies.

The discussion then delves into the potential ethical and philosophical questions raised by the metaverse. They explore the distinction between what is allowed in the metaverse compared to the physical world, considering the different rules and consequences. They touch upon issues of harm, anonymity, and the need to strike a balance between freedom and responsibility in the digital realm.

Zuckerberg emphasizes the importance of maintaining a blend of physical and digital experiences in the metaverse. He believes that the physical world is integral to the human experience and that the metaverse should enhance and complement it rather than replace it. He envisions a future where people can work remotely but still feel physically present with their colleagues, fostering better relationships and trust.

The conversation concludes with a reflection on the profound nature of the metaverse and its potential to redefine reality. They discuss the subjective experience of reality and consciousness, highlighting the importance of the conscious experience and the social and psychological benefits of feeling present with others in the metaverse.

Zuckerberg expresses his excitement about the metaverse and its potential to create a more human and social computing platform. He acknowledges the technological challenges involved in building such a platform but believes that it is worth pursuing to unlock the benefits of immersive and connected experiences.

Videos

Full episode

Episode summary