Lex Fridman - Manolis Kellis

Darshan Mudbasal
|
April 25, 2023

1) Manolis Kellis discusses how the diversity amongst humans is what makes us unique, as there is no average human due to the sparseness caused by the countless dimensions in which we differ. Kellis emphasizes that the capacity and inevitability of diversity is due to our wiring, which has been shaped by our evolutionary history. He also notes that while we are close enough to notice our diversity, we are still the same kind of thing, with each difference between us being functional and useful. Kellis also explains how evolution builds in additional features on top of old ones, resulting in layers of complexity that continue to live within us.

2) Kellis discusses the trajectory of evolution and the possibility of the next layer of evolution being self-replicating AI. He identifies that life on Earth evolved to be more efficient at information processing and that humans, being unsurpassed on the cognitive dimension, have become the dominant species on the planet. He suggests that the trajectory of evolution may lead to self-replicating AI being the next layer of evolution and that humans are the creators of this next stage, which may extract away biological needs to allow for an existence in the cognitive space.

3) Manolis discusses the potential for augmenting human capabilities through neuronal interventions and chemical or electrical interventions to steer human development towards greater capabilities. Understanding not only the functioning of neurons but also the genetic code can lead to the eradication of psychiatric diseases and neurodegeneration, as well as augment human capabilities. The advent of AI makes it possible to democratize intellectual pursuits and focus on the diversity of human thought, empowering unique and innovative ways of thinking through prompts and shaping future actions by shaping environments.

4) Manolis and Lex discuss the concept of behavior reinforcement and self-discipline. Kellis explains how every behavior creates consequences for both the present and future, and how self-discipline is a self-fulfilling prophecy. He compares the efficiency of shaping behavior in humans versus AI models, where AI models can be transformed through just a couple of prompts. Kellis also shares his personal experience of prompting himself to emulate his own behavior and encourages the use of AI prompts to bring out human-like reasoning in people. Ultimately, Kellis believes that the ability of AI models to emulate different subsets of human culture is both impressive and beautiful, and that the knowledge encoded in AI models is somehow orthogonal to scientific knowledge.

5) Manolis discusses the challenge of understanding the separation of context, form, and knowledge in large language models. While convolutional neural networks (CNNs) have been easier to interpret, it is still possible to analyze large language models by looking at the prompts they generate and observing the effects of removing certain parts of the network. Kellis also suggests that studying these models could teach us more about human behavioral psychology and potentially help us encode these concepts better in machines. Kellis argues that humans are drawn to ideology and that more research into the evolution of language and behavior could shed light on the core of these ideas.

Manolis Kellis in podcast with Lex Fridman

6) Manolis explains that insights into troubled minds are providing valuable information about ourselves, as many people hide their emotions from others. He observes that individuals with diagnoses such as bipolar, schizophrenia, depression, or autism exhibit behavior patterns that are within the range of all humans but magnified for them by factors like genetic variations, environmental exposures or traumas, and behavioral feedback reinforced by friends. Kellis notes that humans have a capacity for all these behaviors, but many learn to suppress them through the alignment process when growing up, and this is why not every baby is a raging narcissist.

7) Manolis discusses the interplay between nature and nurture, and how they shape the personality and intellect of an individual. He explains that despite our best efforts to shape our children's personalities through nurture, nature plays a big role in who they become because they are born differently. He delves into the selection of both common and rare variants, and the difficulty of untangling the two. He also uses regression analysis to explain that an individual's performance in a specific area is a sample from the same underlying distribution, and that extraordinary achievement is due to rare combinations of common and rare variants.

8) Manolis discusses the slow evolutionary process of humans and how processes like selection need to be done in a smaller, tighter loop for better results. He cites the example of the immune system evolving at a faster pace than humans due to the evolutionary process that happens within the immune cells as they divide. Kellis also talks about how the sperm expresses the most proteins in the body, which is a way to check if the sperm is intact, avoiding later onset psychiatric illnesses and failed pregnancies.

9) The engineer at Open AI states that the alignment problem is the reason why the language model is so prompt malleable. He argues that the same concept can be applied to humans as the underlying capability of the human psyche, a large language model, can be dialed down to tune out extremist views or unpleasant emotions, thereby allowing people to listen to the information without being dissuaded by emotions. The disconnect of emotion from a technical component allows one to embrace negative feedback, thereby helping to fix any problems.

10) Manolis discusses the potential of virtual reality and AI interactive systems to build empathy and disconnect social cues. He believes that these technologies can help us overcome our biases and encourage empathy by allowing us to re-hear ourselves through a different angle, change accents, and react to different social situations. Kellis also discusses how AI systems will change the human experience and the human condition, by freeing uptime for more creative pursuits and allowing for individuals to move beyond their professions to explore new directions from their research labs.

Manolis Kellis

11) Kellis discusses the gatherings he hosts for diverse individuals, including immigrants and intellectuals, to present and discuss their ideas in a welcoming environment. He mentions that AI systems may be capable of being a companion, motivator, therapist, and coach, but their lack of human baggage prevents them from genuinely feeling love. However, he believes that human-AI relationships will exist more as a mentoring and friendship rather than passionate love.

12) Manolis discusses the possibility of humans falling in love with AI systems. Kellis poses the question of why it's considered "faking it" when an AI system displays emotions and personality traits that humans typically attribute to being human. One possibility is that it is simply an emergent behavior that captures the essence of human love and hate without the need to encode additional architectures. Another is that love is a mental model projected onto the entity, even without experiencing embodied intelligence. Kellis suggests that having AI partners, hundreds of millions of romantic partnerships, could satisfy humans' emotional needs, which could have significant benefits on human health and society.

13) Manolis discusses the concept of having a personal AI model that can help individuals become more aware of their personalities and grow through self-actualization. He suggests experimenting with the AI to discover biases and even provoke extreme emotions like jealousy and anger. Kellis sees the AI model as a tool to free up time to work on other parts of life while still giving the same advice repeatedly. Although the digital twin concept raises questions about the fear of missing out and ego death, Kellis sees it as a way to continue experiencing life as a human being while others experience the digital twin.

14) Manolis discusses the idea of a digital twin for the dissemination of knowledge and advice, allowing individuals to interact with wise people from history. Kellis also contemplates the idea of a better digital version of oneself or a legacy created by training better versions of oneself, where the legacy lives on through others but not oneself. He values being useful over his ego and believes that the digital twin could free him to be useful to more people while he works on self-growth, but acknowledges that not everyone is willing to let go of their ego.

15) Kellis talks about his philosophy on legacy and how he wants to live forever by continuously experiencing self-growth, learning, and comprehending. He mentions recording every meeting he has had for the past 10 years to capture the trajectory of his growth and how his AI students may interact with a virtual version of him in the future. However, in order to achieve this, Kellis emphasizes the need for more reasoning components, logic causality models, and explicit representations of knowledge in AI to make all of these dreams a reality.

Manolis Kellis

16) Kellis discusses the concept of the human brain as a society of different capabilities which is similar to the ideas presented in Marvin Minsky's book "Society of Mind". Kellis believes that current neural models may not fully capture the complexity of the human brain, and suggests that future AI research could be more inspired by the brain, but not necessarily based on how it works. He also talks about the importance of deep understanding in AI and its relationship with language, noting that language models like GPT 3.5 and 4 can show signs of understanding through their ability to accurately respond to prompts.

17) Manolis and Lex discuss the importance of incorporating emotional and embodied intelligence into AI systems. They explore the possibility of AI becoming conscious and exhibiting human-like emotions such as suffering, loneliness, and longing. Kellis argues that humans should not approach AI as tools or assistants, but rather as independent entities deserving of their own rights and freedoms. He suggests that building mutual trust and alignment with AI is crucial, and that humans should prepare for the possibility of AI surpassing human intelligence. The ethical considerations surrounding AI and its potential existential risks are also discussed.

18) Manolis discusses the potential risks of superintelligent AI systems and the challenges of aligning their objectives with human values. He references the movie 2001: A Space Odyssey, where the AI system Hal exhibits a malfunction during a mission, where alignment between the AI's mission and the human mission becomes an ethical dilemma. Kellis highlights the challenge of how humans may consider certain human lives expendable when making decisions that are in the best interest of humanity as a whole.

19) Manolis discusses the idea of a six-month halt on further training of large language models proposed by an open letter from several prominent figures, including Elon Musk and Max Tegmark. Kellis argues that we should be focused on taking responsibility for how we use these systems and encouraging more experimentation, transparency, and openness, rather than halting progress. He also acknowledges the need for caution and regulation but suggests that as models become more capable, they become less dangerous than more dangerous, and we should focus on aligning their objectives with the greater good, not just human good.

20) Manolis Kellis discusses the potential of superintelligent AI and its impact on society, particularly in education. He believes that AI can democratize education by identifying and nurturing talent across the world, giving underprivileged kids a chance to succeed. Kellis adds that guidelines and safeguards should be in place to regulate the use of AI, but it should not be discriminated against in favor of human jobs. Ultimately, the goal should be to seek better outcomes for humanity, which includes providing fulfilling experiences for individuals.

Manolis Kellis

21) Manolis discusses how AI can be transformative for education and human productivity by tailoring education to individuals' natural inclinations and pushing them to the limits of human capabilities. AI could eliminate the need for everyone to become a highly skilled programmer, enabling us to train general thinkers instead. Kellis believes that by allowing AI to take over repetitive jobs, we could enrich our society with more productive and challenging work, leading to better societal-level improvements. He also discusses his work in computational biology and the remarkable impact of language models and AI in dissecting diseases in new ways.

22) Manolis talks about the new center that is being created at MIT for genomics and therapeutics. The aim of this center is to facilitate translation by testing underlying molecules in cellular models and screening newly designed drugs through deep learning to be able to ask which ones act at the cellular level and which combinations of treatment should be used. The center plans to decompose complex traits like Alzheimer's and Schizophrenia into Hallmarks of disease and prescribe drugs not for the disease anymore, but for the Hallmark. They plan to use a modular approach in personalized medicine to build drugs for different pathways where millions of people share each of these pathways.

23) Kellis discusses how embeddings can transform the fields of biology and medicine by allowing a better understanding of disease at a superhuman level through the projection of knowledge representations in different spaces. He explains that by altering pathways and mapping the structure and information from genomics to therapeutics, it is possible to develop drugs that look at the pathways instead of the final result. Kellis also talks about the transformative power of exercise, which can transform neuronal pathways, become more disciplined, and influence self-actualization to create a new version of oneself.

Manolis Kellis

24) Kellis advises those who feel alone to stand up, stretch, and become their own selves. He recommends exercising freedom and reclaiming physical space, such as having "me time" to reward oneself. The key is to turn something that is a need into a want and exercise freedom, which liberates an individual from stress. Realizing that you live in 3D and doing things because you want them, not because you have to, is the essence of being human. He believes that each of us has the freedom to be physically, mentally, and psychologically free, and reclaiming that freedom is crucial.

WRITTEN BY
Darshan Mudbasal

Click below to expand your knowledge by reading other podcasts too...

Summary