Parth Patil on Deep Research, Vibe Coding, and AI Copilots
- Kind
- episode
- Format
- video
- Season
- 2025
- Episode
- 18
- Duration
- 27:31
- People
- Parth Patil, Reid Hoffman, Aria Finger
- Topics
- deep research, vibe coding, coding agents, AI copilots
Original source: https://www.possible.fm/podcasts/riffs018/
My first Possible guest spot
I joined Reid Hoffman and Aria Finger near the end of Possible Riffs 018. The video starts at my segment. The full episode also covers AI wearables, quantum computing, and copyright.
We talked about Deep Research, vibe coding, and what happens when you can build software by describing what you want.
The useful part
- Deep Research can save a lot of time. But weak output just creates more work to verify.
- Vibe coding lets you start building before you know every implementation detail.
- A rough prototype can show you that a new capability is real. Making it reliable and scalable still takes engineering.
- My job is to choose the problem, set the bar, inspect the result, and decide what I can trust.
Chapter guide
- 16:01 Parth joins the conversation
- 16:31 Reid asks about Deep Research
- 19:03 Building research workflows before Deep Research
- 20:59 The vibe-coding inflection point
- 21:54 Prototypes, robustness, and scale
Sources and transcript
- Read the official Possible episode and edited transcript
- Watch the complete episode on YouTube
- Read the local, machine-generated plain-text transcript
Transcript
FULL TRANSCRIPT Episode: Parth Patil on Deep Research, Vibe Coding, and AI Copilots Official source: https://www.possible.fm/podcasts/riffs018/ This transcript was generated from the local video and formatted by detected speaker. Minor transcription or speaker-label errors may remain; use the official source for the edited transcript. [00:00] Aria Finger: Humane Pin, the AI, the, the AI pin, it recently shut down, and people love to dunk on companies. You know, it raised $241 million, you know, from all the, um, uh, lots of big investors, Microsoft, OpenAI, CEO Sam Altman, et cetera. Um, but, uh, and maybe you disagree, but, uh, they were trying to do something. They were trying to do something big, it didn't work out, they shut down, and now it was, uh, it was acquired by HP, um, for $116 million. And so, you know, a lot of people would say, "Well, see? They, they tried something in the hardware space, they tried something in the wearable space, and it didn't work out." I know you don't like predicting the future per se, but like if you had to give a guess, like, and maybe do the year time horizon or 10-year time horizon- [00:43] Reid Hoffman: Mm-hmm. [00:43] Aria Finger: ... like what will the commercialization breakthrough be for wearables and AI? People love to sort of theorize, "Oh, it's dead," or like, "Oh, it's happening tomorrow." [00:54] Reid Hoffman: Yeah, 'cause it classically it's, you know, how can you soapbox posture and- [00:59] Aria Finger: Exactly. (laughs) [00:59] Reid Hoffman: ... it's, you know, and that's, that's whether it's the press or people on social media or everything else is kind of the way of doing it, and, you know, mostly you would say it's clear that wearables will be spectacular and will be there. [01:14] Aria Finger: Yep. Yep. [01:14] Reid Hoffman: And so for example- [01:14] Aria Finger: Yeah. [01:16] Reid Hoffman: ... you know, glasses that could help parse your world, and like for example if you have you kind of staring at the washing machine in your Airbnb going, "How does this work?" (laughs), right? And it goes, "Oh, y- you look like you're staring at this thing. Are you trying to figure out how to make this work? Here's the, he- you, you, y- you know, you're, for a washing load, you do this, and you know, da-da-da-da," and that obviously could be very helpful. You know, you're walking down the street and you're trying to figure out things, you know, one of the things we, you know, heard was the amazing thing about the Ray-Bans and other things b- being used by blind people 'cause it helps them solve some problems that weren't otherwise solv- like where's the door? And, you know, all of those things, that's just clearly the future. And then, you know, I, I tend to think for a lot of these wearables, they'll start actually in kind of a more of a, you know, a kind of a professional circumstance, like I think we're gonna want nurses and doctors and, and firefighters and policemen and, you know, community workers and everyone else to be wearing them, and I think it'll make the whole thing better. Now, the last part of that is the timing question which is frequently the venture investing question, and it's a reason why as a venture investor I tend to orient deeply to things that are within software. So like, you know, co-founding Inflection or co-flounding Manus, you know, you know, th- like one is drug discovery, one is a chatbot, but they're both intensely within the kind of the, you know, how do we use bits intensely to make atoms better? And, you know, going into atoms, you know, directly is always a much more fraught investing and much more fraught on time. [02:55] Aria Finger: I mean, all of us children of the '80s and '90s can remember the like one parent's friend who had the car phone and you were like, "You must be rich!" Like little did we know that 20 years on it would be, like who doesn't have a smartphone? Like what are we doing here? [03:09] Reid Hoffman: Yes. [03:09] Aria Finger: Um... [03:09] Reid Hoffman: Yeah, why doesn't the 12-year-old have a smartphone, you know? (laughs) [03:11] Aria Finger: (laughs) Right, exactly. What's going on? Um, I do think it's interesting though to think about what are the ways that we can use, you know, now that AI can see, whether it can see from your smartphone or see from your glasses, like it, there might be so many things that we can do that it can see from your smartphone first because that's sort of the easier way to make it happen, and there's all sorts of computer vision and it can see your computer screen and sort of all those other things that can get us there. Um, although that being said, one thing I think's interesting is, you know, you mentioned, um, we talked a lot about like everyone when they wear glasses they think about the, "Oh my God, if it could just tell me that the approaching person I met one year ago and they were, you know, their name is John..." But the thing we don't think about is actually the fact that people with poor vision have a much harder time remembering people because they can't see their facial features as well, so there is actually such a democratizing, um, thing that we can do with glasses that isn't just, "Oh yeah, it'd be nice to remember people's names better," that it actually does sort of help equalize for things that people need. Um, one of the sort of advances that I have to admit like truly boggles my mind, (laughs) I like try to wrap my head around it, is Microsoft's recent announcement of Majorana 1 chip. It, this is quantum computing. This is, like this is just like a whole new realm of innovation that I think a lot of people wouldn't have guessed we were gonna get into 2025. Um, and I just like, I feel like quantum is all the rage these days. People are talking about it all the time. Like can you break it down for us, like why is quantum so important, and is this gonna be tangible for us in the near future for us to see the benefit? [04:57] Reid Hoffman: Here is why quantum is important, which is there's a whole bunch of problems that are really great to solve, that by the way AI does help us a bunch with, but are still better with quantum computing, and probably with quantum computing and AI. And, you know, m- most of the dialogue tends to be people think, "Oh, well actually you need quantum security, and what happens with Bitcoin with quantum" and so on. By the way, that's, um, th- there's this notion of kind of logical qubits, e.g. logical quantum bits, and probably to get into the security realm you need, you know, call it 2,000 to 5,000 logical qubits to really change that. Interesting, and there's ways to do quantum secu- security, and when you kind of think, well, the current quantum computers are like 70 or 80, you know, qubits, you're like, well, that's a ways away. There's definitely some smart people who think it will be tangible in the near future. Um, I still tend to think that we may be kind of m- a few more years out than the, the, the loudest, you know- [06:02] Aria Finger: Mm-hmm. [06:02] Reid Hoffman: ... um, proponents. But-... at a hundred and plus, maybe call it 150, 200, you begin to be able to solve problems in quantum that are hard for traditional computing, AI makes it much better but not perfect, which are like small molecule things. So that could be drugs, that could be materials, semiconductors, you know, other kind of things. [06:28] Aria Finger: Well, I think one of the reasons why AI is so... I mean, there's many reasons why AI is so exciting but it's also accessible in the way that, yes, I'm not gonna go out and discover new drugs with AI tomorrow, but I can go and use Pi or ChatGPT or Claude and like, I, just as a consumer can go, "Whoa, the benefits of AI are truly mind-blowing." Are there gonna be sort of ways that consumers can understand the benefits of quantum or is it mostly gonna be sort of in the scientific realm for accelerating those things? [07:03] Reid Hoffman: Well, I don't know, you know, like kind of is there like a consumer ChatGBT of quantum. I mean, that- [07:09] Aria Finger: Right. [07:09] Reid Hoffman: ... that's kind of a, you know, um, you know, maybe that's a Schrodinger cat problem. [07:14] Aria Finger: (laughs) Yeah. [07:14] Reid Hoffman: And when we, and when we evaluate it, you know, the cat's either alive and kicking or, you know- [07:20] Aria Finger: Or, or not. (laughs) [07:20] Reid Hoffman: ... not dead yet. Um, and so but, you know, like for example, the derivative benefits, like s- example, you say, "Hey, we can suddenly accelerate..." Just like, you know, um, Siddhartha Mukherjee and I are with Manus, using AI to accelerate drug discovery for curing cancer and to make that, you know, much closer in reality and adaptive to make this happen, AI's gonna be a great accelerant. Quantum can be another great accelerant. You put the two together, you might even get to something that's like, you know, massively more accelerated and that could be very good and the consumers will get the benefit of, you know, what the, what the, what the drugs are even if, you know, they don't, they're not carrying around, you know, qubit processors on their smartphone. [08:05] Aria Finger: Mm-hmm. They don't, they don't know that quantum was helping them, uh, uh, be cured of cancer. No, that makes sense. So sort of thinking about, uh, AI in the global context and, you know, this question I feel like is one that people really come back to to criticize AI. I don't think you agree but I would love to hear more. So, the UK government, they recently launched a consultation process, um, on proposals to give creative industries and AI developers clarity over copyright laws. So I certainly agree that clarity is key for any business environment. We wanna understand sort of what are the rules of the road, and that included an exception to copyright law for AI training for commercial purposes. So, Nobel Prize-winning author, Kazuo Ishiguro, mentioned that we're at a fork in the road moment regarding creative works. At the dawn of the AI age, why is it just and fair to alter our time-honored copyright laws to advantage math- mammoth corporations at the expec- at the expense of individual writers, musicians, filmmakers, and artists? So when you think about, you know, people ask you time and time again, is allowing LLMs to train on authors' work theft? Like, how should governments strike this balance between protecting creative content but also giving tech firms, you know, the freedom to innovate that they need? [09:25] Reid Hoffman: Look, the clarity thing, I totally agree with, um, 'cause, you know, clarity, you know, creates uncertainty in all areas. Now the problem, of course, is one can make both very compelling arguments about, you know, kind of how this is a fair use under copyright- [09:43] Aria Finger: Mm-hmm. [09:43] Reid Hoffman: ... because, for example, I can take, you know, Ishiguro's work, I can hand, you know, Clara and the Sun to someone. I can have that person, I can teach them, they can learn to write, they can learn ideas from it, they could be inspired to do other things, they could generate other creative work after having read it, you know, et cetera, et cetera. And so, you know, the whole notion around kind of like, well, what does it mean when it's machine reading? And of course, the critics try to say, "Well, but that, because it can reproduce it," right? It can, and it's like, well, but what if it doesn't reproduce it at all? Or in the case of like, the New York Times lawsuit, it was like, "Well, the only way you could reproduce the article is when you put in the first half of the article and say, 'Now please complete this.'" And it goes, "Okay, well, I presume you're referring to this article, so I'll do that." You know, you could obviously train it to not do that but like, the presumption is you're not actually doing the harm because if you had the first half of the article, you probably had the whole article. [10:35] Aria Finger: Right. [10:35] Reid Hoffman: So you probably, whatever way you got the article, by purchasing it or anything else, is the way you got it 'cause, uh, articles are not handed out in halves. [10:42] Aria Finger: Mm-hmm. [10:43] Reid Hoffman: (laughs) Right? And, you know, so, so it's kind of like, okay, um, you know, the fact that, that something is learning and training on this isn't necessarily theft from any particular person. Just like when I'm reading- [10:57] Aria Finger: Yep. [10:57] Reid Hoffman: ... Clara and the Sun, I'm not stealing from Ishiguro, (laughs) right? In terms of, you know, I, I bought my copy, I bought my copy on Kindle, I bought my physical copy, you know- [11:06] Aria Finger: Yeah. [11:06] Reid Hoffman: ... et cetera, et cetera. [11:07] Aria Finger: Yeah, think of a thought experiment where, yes, let's assume it absolutely is legal and we just think it's good for innovation. We're, we're happy that it is legal and that it's good for innovation for LLMs to be able to use this, this data and these copyrighted works. What are, are there any downsides? Are there any like, "Yeah, no. I think this is right but yeah, in four or five years, we'll have to worry about XYZ," or you think the critics are overblown? [11:29] Reid Hoffman: Look, I think the underlying unspoken thing, the reason why it goes to something more sloganistic about theft or something like, is like, "Oh, does suddenly the value of my creative work go way down because now a whole bunch of things can be created by this new machine, which is partially enabled by- [11:48] Aria Finger: Right. [11:48] Reid Hoffman: ... the work that I've done before?" Um, and I think that the notion of, you know, will my creative work be valued, um, you know, is a kind of a classic, you know, kind of, it's a muddy issue that we tend to navigate poorly. So a current one in the music industry tends to be the vast majority...... of musicians benefit from live concerts. [12:16] Aria Finger: Mm-hmm. [12:17] Reid Hoffman: Merchandise, et cetera. 'Cause streaming and the change of the things has made the economics, you know, very different. [12:24] Aria Finger: Right. [12:24] Reid Hoffman: And they just say, "Well, that's a huge tragedy." 'Cause the previous economics with selling CDs was, like, really good, and it's so... "Th- th- that, that, that's unfortunate." It's like, well, but it's not clear that the selling CDs thing is, like, the, the e- the thing that should be through eternity, (laughs) right? That, that each change is a thing. But we want to have these laws respecting kind of creators when that kind of stream of creative output is something we value as individuals in a society so that we have the right kind of incentive loop. So I do think that the kind of figuring out how that works... Now, of course, part of what I think about AI tools is right now, of course, everyone's like, "Oh my god. End of the world," part of the reason I wrote Super Agency with Greg, but I think that, you know, what's gonna really start happening is you're gonna start going, "Oh, this will really enable me to do so much better, faster creative work and to make it happen." 'Cause, you know, for example, I've, you know... You've been part of this journey with me too. You know, I've been trying to say, "Okay, like, can I get, you know, the e- various AI tools to help me write some of the science fiction that I've been thinking about?" And it's not very good, (laughs) right? So, so it's like, well, uh, it's not... It, it might. It get to a competitive threat with the very good science fiction writers, but not right now. [13:47] Aria Finger: Exactly, yeah. [13:47] Reid Hoffman: And by the way, one of the things that's interesting is even as it gets there, like, like, the good science fiction writers writing it suddenly might be able to write so much better, so much faster. Like, you know, one of the things that I always find frustrating about the series that I really like is I find the series I really like, and you go, "Okay, I got to the last book. How many years until the next book?" (laughs) [14:09] Aria Finger: (laughs) [14:10] Reid Hoffman: You know? It's like, "I'm, I'm in it right now. I'm in that universe right now." And so you'd be like, "Well, actually, in fact, if I could be doing this, I could be producing a book, you know, for this series every month," (laughs) right? And as I'm going down the journey with it, I think it could be enormously beneficial to some creators doing that. And so... But I understand the, the first reaction of, "Oh, God." Like, I... For example, you take someone as amazing as Yeoshuguro, is, "I have done this, this, this, this really hard thing of creating these masterpieces, um, and I've been, I'm at, you know, I'm one of the, the world's most, you know, celebrated authors doing this, and now you're changing the game," (laughs) right? [14:52] Aria Finger: Mm-hmm. [14:53] Reid Hoffman: Like, I get that as a, "Ah." [14:55] Aria Finger: And I, I would be remiss because if Greg was here, your co-author on Super Agency, he would also point out that on the music front, you know, CDs were technology. And before that, you couldn't even make a living as a musician, you know? Before that, we had radio for a little bit, but before that, ah, you were just strumming along in your, you know, (laughs) in your basement. And so technology also has actually enabled a lot of this amazing creativity, you know, not... We don't even have to go back to the printing press to get the fact that, um, you know, CDs opened up this whole new world. And then ringtones for, like, a minute made a lot of money, and then we came onto how can, um, even more musical artists, you know, make a living? And so I think to your point, this is the right way to go, and how can we navigate so that people can, honestly, h- have agency (laughs) um, to make their careers better, make more beautiful art, and sort of do all the things that they want to do, just in a new technological context? [15:53] Reid Hoffman: And the transitions will be painful. You can't stop the future, but what you can do is you can try to navigate to what the better futures are. [16:01] Aria Finger: All right. So to end our episode, we have a special guest with us on Possible today, Parth Patil. He is one of the creators of ReidAI and was the first data scientist at Clubhouse. And as you all know, we talk a ton about AI with Reid and many of our guests, and Parth is one of those resident AI experts. And so Parth, I am so excited for you to come on Possible and help us break down some of the most recent AI happenings. Hi, Parth. [16:31] Parth Patil: Thanks, Arya. Glad to be here. [16:32] Reid Hoffman: So, um, I wanna share with you, uh, a recent experience I had and then ask you for your kinda diagnosis of it and then kind of going in the future. So I was, you know, kinda recently, um, you know, kinda hanging out with Atul Gawande, and I was like, "Have you tried Deep Research?" And he's like, "No. I don't know what you're talking about." I'm like, "Okay. Like, what's a book you're, you're working on?" And he was like, "Okay, I'm working on the following thing that has a chapter on anesthesiologists." And so we pulled up, you know, ChatGPT, you know, O1 Pro, Deep Research. Then we pull up Gemini, and we asked the questions for, for getting answers. And let me run you through kinda what our discovery was that was really interesting, and then this will be the diagnosis of what is the current state of Deep Research and where we're going and how does this play, which is ChatGPT generated, like, just some... Like, he's like, "Oh my god, this is amazing." Like, like, "This, this, this just saved me thousands of hours and my research assistant." And, and so he fired... He, he, he, you know... We, we, we cut and pasted it and fired it off to his research assistant. And then we did Gemini, and it was like, "Well, you know, it was much less inspiring, but, you know, okay, fine. We'll fire that off too." Now, what the research assistant came back with was, well, on the ChatGPT answers, 90% of them were inaccurate, (laughs) right? Like, like the quote that the surgeon so- said, "Anesthesiology helped me in my policy," and then it's like, "That quote doesn't exist. That source isn't there the right way. It's kinda misquoted, et cetera." Um, so, like, that was a problem, and, and... But the thing that was interesting was... But it pointed me to interesting documents. It was almost like, like, where to look at to find the kinds of things that we want was in doing the research cross-checking actually, in fact, did save me many, many hours because I went to a bunch of different sources which actually had some of the stuff that could be interesting.And so, you had this kind of thing where Gemini didn't have any factual inaccuracies, but was less exciting and interesting, and so could have been used a little bit more just kind of flat. And the ChatGPT one was, like, if you just quoted it, you would have been like, "Oops, I wrote something, like, I-I wrote something as fact that was wrong." But it was a, it was a doorway into the right thing. So how does that ... What does that make you think about the current state of Deep Research tools, how people should be thinking about using them, et cetera? [19:03] Parth Patil: Yeah. So I- I've been, I've been working on similar tools to Deep Research for, uh, like over a year now. And my early e- experience was like, "Wow, we can do a lot of work." But then you realize if the work isn't high quality, it creates work because now you have to go and verify, like, all the things that it's coming to you with. And, uh, yeah, it's definitely a downside to certain ... I think, I think it means that it's a downside to, like, asking certain types of questions. Like, you should not expect fact in, in the response, which is kind of a ... You know, the LLMs can be confidently presenting information, but we should always, um, you know, take that with a grain of salt right now while the, it's hard to verify. But on the other hand, the way I like to use Deep Research is more for like subjective intro/exploration into a space, usually for something that I wouldn't have the time or energy to do anyways, right? So if I'm like, oh, I'm like brainstorming a new, like, a concept for a new app, and I'd be like, oh, where do the people who are interested in this, in this fandom exist? What are they talking about? Um, and, and, and then Deep Research can go find where on the internet, like, I might find the answer to those questions. So I, I think you're right there. Um, it's, it's, I think it'll get better, but the, the real magical feeling is that it can do in 10 minutes what would otherwise take me a couple of days to do. And being that, that, that kind of like accelerated kind of information synthesis is actually really valuable as it gets more and more high quality, um, like the reasoning kicks in and, and, and the quality of the response starts getting higher. [20:29] Reid Hoffman: And, and what are some of the, you know, one of the things that, as you know, I describe you to other people as the, the person who has not only taken the red pill but is bathing in the red pill. You know, what are some of the, the, the current kind of like, "Oh gosh, this is some of the stuff that, that, that, you know, the future is already here, just unevenly distributed"? What's some of the, kind of the use of, of kind of AI that you're, that you, that's caught your attention in the last month? [20:59] Parth Patil: Um, I think, I think for me, it's, it's something that I've been hacking on for two, an idea that I've been hacking on for, for almost two years now, is now starting to, like, a lot of other people are starting to experience this red pill moment of, um, I, I think Karpathy calls it vibe coding, where you kind of just lean into the exponentials and the general awareness of these models to just be, a- as programming assistants, and you're like, "Oh, why don't I just make this, make this, like build this feature, think of an, a game idea?" And, and you kind of just let the model, uh, you know, generate a lot of the code, and you, you, you shift more to like speaking. And a lot of people use Super Whisper, so they'll, they'll literally press a button and describe the app that they want, and then they let the model make the first version of it. But what's happened in the last month, that Claude 3.7 Sonic came out. It's one of the best coding models out there right now. And more and more people are realizing this, and you can tell because you have non-technical people that are like, "Oh my God, look at this game that I made with AI." [21:54] Reid Hoffman: (laughs). [21:54] Parth Patil: And then you have like experienced technical people that are like, "Oh, but it's not robust and scalable." And in my mind I'm like, the fact that we can even just create software by describing it is the magic. And yes, the models aren't perfect, but this is a, this is exactly the direction we should be going in. And the reason I say that is because fif- My, my mom is a programmer, and 15 years ago she developed carpal tunnel, and I thought that was like crazy. Now, now it's like every button she presses is actually like deteriorating like her, her, her, her hand and it hurts, right? But that's your career. And so 15 years ago, she, she got the company to pay for Dragon NaturallySpeaking, which is a transcription software. Transcription cost $500. Like, high quality transcription was expensive back then. And then she would connect it to, she would give it blocks of code, so she would be like, "Write a for loop. You know, write an if statement," and those predetermined blocks of code would be inserted into her code while she spoke. And that was the first time I had this, I got the idea of like, what if we just talked, talked to the computer and it wrote the code? And of course we didn't have language models then, so it was really like rudimentary. But then, you know, now that we have, we have Whisper technology, we've got language models that can write a lot of code very quickly and at higher quality, I came back and I showed her and I connected Whisper to these Codegen and it's like, 100 lines of code, that's 51 characters per line. That's, that's 5,000 button presses, but now you can just, you can just talk to the program and it just exists. So I think, uh, yeah. So I- I'm excited for more people to experience vibe coding, even if it's not the same as normal coding, because I think in certain ways it's, it's just 100 times better. Um, all right, Reid. Um, yeah, I got, I got, I got a question for you. So, so we were, when we, when we were talking about code generation, uh, early on when we met, I, I was like, "Wow, this thing can write perfect SQL. Doesn't that mean that like conversational data analytics is like basically here, where instead of an analyst writing queries by hand you should just talk to an analyst that talks, the, your, your analyst should just be talking to an analytical agent and it should write the queries?" And then you made the comment that was like, "Yeah, but you know, that's really scripting. It's not programming." And, and that's because I think the, at the time, the models were kind of limited, but I think we've come a long way since then and curious what your thoughts are on, uh, like coding co-pilots and what it means [24:08] Reid Hoffman: Well, I definitely think that, you know, and I know we're aligned in this, that, that this year all of the major shops are working intensely on increasing the coding capabilities for co-pilots, for kind of press button, get, you know, kind of software engineer, you know, a-, you know, active agent. And, you know, one of the things that people always think is that, "Well, what is that gonna mean for software engineers?" Now, in parallel to the data scientists, I actually think that w-... there will, there's still infinite demand for software engineers. They just may be, be deploying with a set of agents in terms of how they're operating. And so, so I think that the, the, the same thing is now true and I think the coding capabilities are way up. But the thing that your question also gestures at, which I know, um, you think about in depth too, is that actually in fact every professional is gonna have not just a set of agents working on the thing they're doing, but also some of, like some of these agents or, you know, all of these agents having coding capabilities which, you know, like eventually as you get from scripts and other things, those coding capabilities get very deep, and that the most, you know, prominent programming languages, you know, won't be C++ or Pascal or anything else. They will be, you know, kind of English, Chinese, uh, you know, in terms of, in terms of how generating, and we're all gonna be using it. Now, the reason why there's still room for a lot of kind of human activity, data science is a parallel, is because the way you think about it and the kinds of things you do, like as opposed to the, "Hey, I'd like you to run a query to say, you know, how active are all of our users who've been here for over a year?" And it's like, well I could just ask the thing myself and then kind of generate the thing. But if you might say, "Well what are the different ways that we should try to understand churn?" Um, then actually in fact, you know, you also working with, or someone, data scientists, also working with these tools would say, "No, no, I can actually generate a whole bunch of stuff that's really interesting to you," that you as, you know, call it the general manager, might not have actually in fact known exactly which kind of questions and analyses to run through. And so I think we're making great progress, um, although I think that there is still, you know, just like, you know, writing other things, um, you know, I suspect we're still some ways away from where you should get a large block of code from a, uh, AI co-pilot and just check it in without looking at it. (instrumental music) Possible is produced by Wonder Media Network. It's hosted by Aria Finger and me, Reid Hoffman. Our showrunner is Sean Young. Possible is produced by Katie Sanders, Edie Allard, Sara Schleede, Vanessa Handy, Aliyah Yates, and Paloma Moreno-Gimenez. Jenny Kaplan is our executive producer and editor. [27:07] Credits: Special thanks to Suriya Yalamanchili, Saida Sapieva, Thanasi Dilos, Ian Alas, Greg Beato, Parth Patil, and Ben Relles. And a big thanks to Janet Ohm, Tiffany Friesa, Malia Agudelo, Clean Cuts, and Little Monster Media Company.