If you're seeing this message, it means we're having trouble loading external resources on our website.

If you're behind a web filter, please make sure that the domains *.kastatic.org and *.kasandbox.org are unblocked.

Main content

Course: Talks and interviews > Unit 1

Lesson 3: Khan Academy chats
Life skills
Talks and interviews
Talks and interviews
Khan Academy chats
© 2024 Khan AcademyTerms of usePrivacy PolicyCookie Notice

A conversation with Eric Schmidt and Jonathan Rosenberg

Google Classroom

Want to join the conversation?

Log in

Video transcript

- Good evening, and welcome to tonight's program, hosted by the Commonwealth Club of Silicon Valley. My name is Chuck Geschke, and it's my pleasure to be introducing Eric Schmidt and Jonathan Rosenberg, Co-Authors of their new book, How Google Works. Eric is Google's Executive Chairman and former Chief Executive Officer. He joined the company in 2001, and during his tenure has helped Google grow from a Silicon Valley startup to a global technology leader. Previously, Eric was the Chairman and CEO of Novell, and Chief Technology Officer at Sun Microsystems. He served on the research staff at Palo Alto Research Center here in Northern California, as well as, Bell Laboratories and Zilog. Eric received his Bachelor's Degree in Electrical Engineering from Princeton, and his Master's Degree and PhD in Computer Science from the University of California Berkeley. Eric is a member of the President's Council of Advisors on Science and Technology, and the Prime Minister's Advisory Council in the UK. He serves on several boards, including the New America Foundation, Khan Academy, and the Economist. Jonathan serves as an Advisor to Google's CEO, Larry Page. He joined the company in 2002, and managed the design and development of Google's consumer, advertiser and partner products, including Search, Ads, Gmail, Android, Apps, and Chrome. Previously, Jonathan was the Vice President of Software for palmOne, and Senior Vice President of Online Services and Products at @Home. He received his Bachelor's Degree in Economics from the Claremont McKenna College, and his MBA from the University of Chicago. The moderator for this evening's discussion is Sal Khan, the Founder of the Khan Academy. The Khan Academy is a non-profit learning platform, that provides free, world-class education for anyone, anywhere. The Academy has over 15 million users in nearly 200 countries around the world. So ladies and gentlemen, please join me in welcoming Eric Schmidt, Jonathan Rosenberg, and Sal Khan. (people applauding) - Well, this is very exciting. I'll just start off, you know, a lot of business books kind of show up on my desk every now and then, and I tend to be somewhat skeptical of most of them. But, you know, as a aspiring Jonathan/Eric Schmidt, and I said, well, maybe maybe I should see what's... - It's entirely because of the title. - It is. - It has the word Google in it. - That's right, it makes it very marketable. (people laughing) But, I have to say, I mean, just to preface... - How Google Academy works. - How Google... (laughs) But, this was useful, this is useful, I learned a lot, so I'll just start with that. Kind of going into the meat of this book, I'll open up with a question for both of you. And I'll start with Eric. At what point, when you joined Google, did you realize that it was a different kind of company? - Pretty much the first day. (people laughing) My initial office, I showed up and I wasn't quite sure what to expect, my initial office was, there was a group of five people and they gave me a corner of one table. And I thought, this is interesting. They soon moved me to a very large office, which was eight feet by 12 feet, and I was quite happy there for the first few weeks. And then, one morning I come in, and there's a gentleman who has moved into my office, we're sitting tandem, you know, next to each other like this. And he's wearing his headphones and he's working. I figured it must be an engineer. So I said hello, and he says, "Hello, I'm Ahmeet." And I say "Hi" and there's this sort of awkwardness of like what are you doing here? And I said, "Yes, hi" and I said "Yes, hi, and very good." "So I know who you are, Eric." And I go, "Yes?" He goes, "Well, you know, I've moved in." And I said, "Okay." And he goes, "Well, actually, you know, my office is over there, but, it was always crowded there "with six people in an office, "and your office was always empty." (people laughing) At this point, the light bulb goes off and I think, there's no thing I can say now that's okay. (people laughing) Like get the heck out of my office, bad answer. Oh, I love you, I love this engineer, this is great. Can't do that either. So I figured I'll just sit down. (people laughing) And I said to myself, oh, my God. We became best friends, and we shared an office for three years. - Wow! - I was a little slower than Eric. I would say it took me about 90 days. I had a lot of experience doing product management and product planning, and I figured I was brought in as the adult supervision, to explain to the company and the engineers how to do product management. And the way you do product management is the MBA comes in and writes a plan. And there's lots of details in the plan, and it explains kind of the concept phase, and the investigation stage, and the development phase, and at every spot, if everybody delivers you dole out a little bit more resources. And you document this thing, and then you dictate that everybody produce what's in it. And I was really good at that. So I produced a really, really pretty version of the mother of the greatest product plans that you'd ever seen. And I dump it on Larry's desk, which was my first mistake, instead of emailing it to him. (people laughing) But, I dumped in on this desk, and he asks me to sit down with him. And he goes to like the first page, and the second page, and he says, "Well, these are very pretty, pretty pictures "that you've made, that's very impressive." And he goes to the third and fourth page, and he just looks and me and says, "No!" (people laughing) I'm like, "What's wrong?" He says, "Well, when have you ever produced "a plan like this, where the engineers stuck features in "that weren't in your plan?" And I was like, "Well, never." And he says, "Well, when did the engineers ever finish "a product faster than was in that, what's that thing "you call it, a Gantt chart?" I said, "Yeah, Larry, that's a very important thing, "well, never." And he said, "Well, then your plans are stupid." (people laughing) "Please, stop doing them." (people laughing) And so I was like, "What am I doing here?" And he said, "Go sit with the engineers." And that's what I started to do. - That raises an interesting question. Because, when you guys, when both of you all came, Google was still in its startup phase, and it was already clearly on an exponential growth trajectory. But, as you mentioned, Jonathan, you were brought in as kind of, potentially, the adults, the management experts. How do you navigate that? How much, like in your own head? - It helps if you have teenage girls. (people laughing) - Explain. - I managed fine and I didn't have any teenage girls. But, please-- - You had a teenage girl and a boy. - Well, 10 years later. You're older than I am. - Well, in any case. So if you think about your teenagers, they sort of tolerate you, and every once in awhile you say to something, which they reject, and then sometime later, it comes back out of their mouth as though they have invented it. (people laughing) - Had... (people laughing) And so... - Your children are young. - They're very young, yes. - But, trust me on it. This is going to happen. - Yes. No, I look forward to that. (people laughing) - You really don't, by the way. (people laughing) - But, you know, this is a tension, is it? Okay, you all notice it's a different kind of company. A lot of what you had practiced in your different orgs, in your successful career up to this point, these people just kind of an immune response to it. How, you know, as leaders in this nascent organization, how do you decide how much to push-back, and say, no-no-no Larry, look, this is the way it really should be done, if we want to scale, versus no, you're right, this is a new type of organization? - I think what I figured out was I couldn't tell them how to think. Right, they already knew how to think. But, we could manage the environment in which they thought. And that's why in the book we really talk a lot about the culture, the approach we took to decision making, running meetings, the manner in which we really focused on transparently sharing information. So we created a structure where we were gonna scale, by helping them understand; they all understood the mission, they all believed the slogans. And rather than telling them what to do, we were kind of give them the vision, and then let them manage as we scaled. - Eric? - You know, I think it's also helpful with people who are this sort of brilliant and forward thinking, to understand what they're really trying to do, and try to say yes, as long it's legal. (people laughing) I still remember, we were sitting in our little office, and then Larry and Sergey had gone roller blading, as they often did. And they came back and they said, "We want to move our offices over there," referring to the then SGI campus. It's an immense campus, and I said, "That's not gonna happen." And duly, we ended up acquiring it and making it our headquarters. Sometimes, it's easy to misunderstand the power of compound growth. We would do things, like we would do, let's say, let's have a five-year conversation. And we would plot our growth rate, and I'd say, oh, my God, look at the number of people! And they would say, it's not enough. So again, my instincts were always manage to what we have, and their was always manage to what is possible. The later is a better way to lead. - One thing that I found here, which I found pretty powerful, especially, from your point, because you come as the CEO. But, you know, even in your answer just now, there was a humility in how you approached it, because you did have these kind of two strong iconic founders. I mean, were there times where it was just incredibly frustrating? - Sure. - Or, incredibly-- - Sure, but I think it's important to remember, when you're the hired help, Jonathan? - I've heard this lecture, but go ahead. (people laughing) - It's important to remember who the owners are. And I think, in Silicon Valley, one of the great strengths is having founder-led companies. And there's something very special about successful founders in terms of their reach and their vision. I don't need to tell our audience who here they are, the names come off everyone's lips. To start with, Steve Jobs, and move forward. These are exceptional people, and we need to find them, we need to mint them, we need to support them, we need to let them come in the country, and you need to figure out a way to work with them, because they're gonna change the world. And I understood that. What I also learned, was that while there were things that they knew far better than I, there were things that I could help them with. I could help them achieve their vision. In a partnership, if you're helping somebody else achieve their vision, then it's gonna be a great partnership. - I mean, in one of the, and you already touched on this idea that, you know, you both identified that these people are, you know, this is special type of organization. Not just Larry and Sergey, the whole organization, the engineers, everyone. And it's a central theme in the book, this idea of the smart creative. What is a smart creative, and how is that different than the way that people might have imagined your Silicon Valley tech worker of the past? - Actually, Jonathan, it's quite a term, but I think, I would argue that we started writing the book because I said to Jonathan, there's some kind of a problem here. People are coming out of these universities. They're very, very ready to work in organizations that are interesting, and power, powerful, and they, you know, listen to them, and they give them what they need, and they change the world. And the problem is, that almost everyone who comes out of undergraduate and graduate school finds the organizations that the join sclerotic, unchanging, poorly led, right? It's a huge sort of a whack to these young people. We've got a disconnect between the training and the inspiration of our young people, and the institutions and organizations that they are joining. - So, Eric decided he liked this term smart creatives, which I actually didn't like. And then, he asked me to try to figure out how to define it. The way we really defined it is, it starts with a person who's really highly technical. But, then, beyond being highly technical, they have some level of business savvy. They actually have an interest in the business. And the third thing is, they're curious. But, they're curious in the passionately curious kind of way, and they're very facile with the tools of today's age in manipulating data, and creating prototypes. So unlike most technical people, instead of pitching you with something, they show you, they quickly produce and show you a prototype. - I mean, given that, given that these are people, one thing, they're not just your kind of, I feel like a word, stereotypical engineer, they have a business interest, they have a design interest, they have passions about what they're doing, the consumer. And you all already touched on decision making a little bit. How do you, and you talk a lot about it in this book, and it's fascinating, how do you do that? How do you give this person the autonomy, make them feel like they have a voice, while at the same time being able to make decisions, and guide the organization? - Well, I think there are different levels of answers to that. I think one, is people have to actually believe that the time and value they put in these ideas will be listened to. But, you also don't want sort of random things occurring at random places, you have to have some kind of a review process. So we instituted a set of meetings, that ultimately became Tuesday Google Product Strategy Meetings, which were brutal. And we would go through these things in enormous detail, and try to figure out, did they need more resources, did they need support help, or were they a good idea or a bad idea? And then, eventually, we started having serious concerns about regulatory issues, privacy issues, and so forth, and we added that, as well. In the early years, there was simply a list called The Top 100, which of course had 300 things on it, that Marissa maintained. And we would say, this is roughly what we're working on. - I think we were also very structured in the way we made decisions, and the way we ran meetings. We would always start meetings with data, right? You know, Jim Barksdale used to say, if all we have are opinion, if we have data, let's use data, if all we have are opinions, we'll go with mine. (people laughing) - And really, can you imagine if the way our country worked, and the way your companies worked, and so forth, every meeting began with here are the facts. - Yeah. - Mm-hmm. - It'd be a very different set of conversations in almost every aspect of that. - So we start with the facts, and then we argue. And Eric was always very good at making sure that everybody got to argue, not just what we call the HIPPOs, the highest-paid person's opinion. Eric would always make sure-- - Are you the author of that acronym? (people laughing) - Well, yeah. - Highest-paid person's opinion. - HIPPO, we just had cartoons about them all over the web. People like that one. It was that one, or Fat Cat, and we decided to go with HIPPOs. But, you want the most senior person running the meeting, but, that person's job is also to elicit opinions out of the everyone in the room. If people aren't gonna provide opinions, then they don't need to be in the room. So you get everybody focusing on the data, sharing their opinions, and then, eventually, you ring the bell. That's the job of the person who's running the meeting. - In theory, it sounds great, but, how you do it in practice, I mean, I could imagine being a Junior Googler, and being in a meeting with you guys, even today. It would be intimidating, how do you get that out of, out of that employee? - Well, I think there's a bunch of ways, but, a simple way, and we actually published a set of rules for running effective meetings, and it starts with somebody's gotta be in charge of the meeting. There has to be some kind of an outcome. Somebody's gotta take notes. Jonathan pioneered this, and it was this huge thing, because every room had to have to two projectors, one to project what somebody was projecting, and the other one was projecting the notes, so you could see what somebody was writing. And every once in awhile, I'd be reading the notes and say, I didn't say that! Right, it was, (laughs) you know, the person would have to. But, it worked. - Right. - The reason that I did that, was I was a master at product management in crafting the minutes after the meeting. Because, when you could give everybody the action items that you wanted, and articulate them the way you want it. And so, once I moved into management, I wanted to make sure that none of the people who worked for me could get away with that. (people laughing) - So anyway, when you're running these meetings, and I think the fact of the matter is, for managers, their job is to manage to sit in meetings. It's unfortunate, you think that managers should not be doing that, but, in fact, you spend most your time in meetings. So making them more efficient, even if you make them 10% or 20% efficient, more efficient, it makes a huge difference in the productivity of the firm. So we spent a lot of time looking at this. And I think there's a bunch of principles beyond that. You need to make sure that everyone feels included, which means that the people who never say something need to say something. You need to actually pause and let the women speak, which is difficult for the men. Right, it's a fact. And then the third thing is, you have to tell people, we're gonna not make a consensus decision here, we're gonna try to figure out what the best idea is. And if you're sincere about that, and it's not the HIPPOs opinion, but really, the best one, you'll get conflict, but everyone's kind of shooting for the prize, which is how do we solve this problem? - And you really, and you all mention this kind of term, I mean, consensus in everyday language just means, hey, everyone has to agree. But, you guys, you kind of go to the Latin roots, and you say, hey, no, it's to get everyone's opinion out of 'em. - And every once in awhile, every once in awhile we would have situations where people were not gonna come to agreement. And we used the China example, which was very controversial inside the company, as an example, where we had the debate, we followed our process, we ultimately had a vote. The vote was clearly in the majority to do what we did, and then everyone, including the people who disagreed, set out to implement it as fast as possible. It's a simple rule, businesses are run by making decisions, you make them fast, you fail quick, all those kinds of things, you can be very, very responsive to what you're dealing with. - I love Sal Khan is the only person who actually reads the Latin footnotes, because we wrote the footnotes for a reason. Consensus doesn't mean-- - I think he has a class on Latin in the Sal, in the Khan Academy. - It doesn't mean agreeing. It means to come together and feel, to come together with feeling, right? - Yeah, no, I'm a curious person, I read the footnotes. (people laughing) - Do you realize that we're sitting next to the most famous educator in the world today? - I know, I keep hearing his voice, you know, like, is my kids in the other room looking at geometry? - Put headphones on them. - Sorry, please continue. - No, I like that, that was very flattering, thank you. - What, the putting headphones on? - Either way, it is. And one thing that fascinated me, and you know, and I'm asking these questions, really, from the vantage point of someone who is, you know, at least 10 or 15 years behind you guys, trying to kind of get some of your wisdom. You know, one of the fascinating things about Google, and you mention this in the book, is the kind of triumvirate of leadership, between Eric, Larry, and Sergey. Traditional business practice, or leadership would say, hey, that's gonna be tough, that's going to be, it's gonna be hard to make decisions. How did that work? - Well, I think it obviously worked pretty well. - Yes. - I think you should judge leadership teams by their accomplishments, not by their rhetoric. So a leadership team that keeps its mouth shut, and just executes well, deserves our praise and our attention. I'd also observe that the most successful companies, literally, in tech, and I suspect worldwide, were more than one person. And the media ultimately lionizes a single individual, which is great, and they certainly deserve it. But, the fact of the matter is, that's there's always a few people who collectively have the same incentives. One of the great things about the partnership that I built with Larry and Sergey, was we would argue very, and continue to argue very, very strongly with each other. But, there was never a nanosecond when we had any question as to the incentives of the other. Because, we were locked together in an ownership structure, and in a management structure, and a board structure, we all knew we were fighting to win. We may have disagreed on a tactic, but, it's a wonderful thing. In your case at the Khan Academy, you have a very, very effective chief operating officer and president, who you've worked with for years. Imagine if he had not been there, right, and you'd had to do all the things that he did. The two of you deserve the credit. You get a lot of the media credit, he deserves a whole bunch more. That's my point, that if you study each successful company, here we are in Silicon Valley, look at Intel, look at Oracle, look at Sun, look at Cisco, go through the list. In every case they had two or three key people who made that happen. Apple, people have forgotten the role of Steve Wozniak, and the others. - Jonathan, from your point of view, I mean, did that... And I completely, I'm obviously Googled and wildly successful. But, did that ever make it confusing for the team? Was it ever a who do I go to, who was it? - You know, it actually worked surprisingly well. The dynamic and the reason that it worked, is that they met once a day, all the time. And so, in this crazy maelstrom of very, very fast hyper-growth, when you needed someone, you just went and hunted down one of them. And we did often kind of pick and choose, right, there were things you'd know you'd go to Sergey for. - Everyone was out. - If you like wanted resources to build some, you wanted a trampoline somewhere or something, you'd ask Sergey. (people laughing) But, the beauty was, you could find anyone of them. You could tell them what you needed, and then, somewhere by the end of the day, they'd get back to you if they were concerned. And if you didn't hear back, you just did it. - And I tried to run that process as efficient as I could. Our actual agreement was the following. We knew roughly what the other cared about, and we agreed not to surprise the other on something important. In other words, if it was something relatively straightforward, just do your thing. But, if it's something that I care a lot about, and you know it, don't annoy me, don't go around me. And that, that partnership model is a good one, and I think it scales to three or four people. And it takes three or four people, as I said, to really run at full blast. Now today, of course, we've reorganized the rules. As always, Sergey does whatever he wants. (people laughing) Sergey is busy doing Google X. I can describe to you the possible, both the current and, and future impact of Google X by just describing the contact lens. A team that was hired by Sergey, figured out the a way to imbed a computer chip in the lens of a contact lens, with a small battery. That lens detects the conditions the diabetics need to know when to take shots, and so forth, and so on. This is life-changing for the hundreds of millions of people who are or will be affected by diabetes. And, of course, the financials for the royalties that we'll get, will far outweigh any of the cost. You don't think this is good business? Google X is great business, but even more important, it changes peoples' lives. We now have organized it so Larry's the CEO, largely focused internally running everything, and I do everything everything externally, which means that I'm dealing with all of the political, and government, and partner issues. But, we still basically meet, we still are basically in alignment. We know each other so well, we can anticipate each other's concerns. - And then bringing up Google X, and this I actually one of the really fascinating things about Google. It's actually changed my perception of Google in the last few years. How did that happen, especially, as an organization grows, you know, write a lot about this. You know, there tends to be an organizational inertia. There tends to be a desire to just work on things that are adjacent to where you already are. When someone talks about self-driving cars, or-- - But, this is the benefit of having brilliant founders. So, in the first place, these are founder decisions, and nobody else should get the credit, it's really Larry and Sergey. And what happened at the time, this was maybe five years ago, is that I had wanted to put a lot more money into science. As you all heard, I worked with and for Chuck Geschke at Xerox PARC, one of the great heroes of my life. I understood the importance of investing in the seed core, and for 10, 20, 30 years from now. And I wanted us to do it directly. And Sergey said, well, that's okay, but, universities do that. Why don't we pick things which not only have that aspect, but, have a significant potential upside business with a lot of risk. Right, let's take the risk. Again, founder decision. We hired this fellow, Sebastian Thrun, who was the inventor of the modern version of the autonomous car. Larry had known and worked with him at Stanford, and he setup Google X initially to work on the car maneuver. And once that model worked, we were inundated by people who needed the support, the hiring, and the mechanisms. They couldn't these new ideas by themselves. And so, Sergey set out to start working on them, right? So one day he walks in, and every once in awhile they'll come in and tell me, they'll fool me. So one day I went into their office, and they share an office. They said, "We're gonna go into the hardware business." And I said, "Oh, my God." The last thing we need to be is in the hardware business, sort of my typical reaction to every one of their ideas. (people laughing) And by the way, I'm always wrong, right? (people laughing) So they go on about the importance of refrigerators. I think everybody understands how important refrigerators are, refrigeration, and they had studied this at some length, and the importance of automating the refrigerator, and the way it behaved, and the monitoring of refrigerators. And about 20 minutes into this, it became clear that they were joking, right? (people laughing) So we're clear, we're not going into the refrigeration business at the moment, but you never know. - Onto the next acquisition, anyway. - The next acquisition may lead to that, you know, we'll see. - Okay, I get it now. - But, and so then, they announced we were gonna go into the balloon business. And I said, like, give me a break! (people laughing) But, in this case, it was the right decision, because, they had figured out how to use the existing handsets. So the breakthrough of the balloons is not the balloons, which in and of themselves are quite impressive, but the fact that they could use existing handsets to empower connectivity, to people who do not otherwise have digital bandwidth in the world. Again, this is life-changing and it works. - And I think this also sort of showcases Larry's principle of think 10X, which really is not the kind of things that most companies do. Most companies think very incrementally. And Larry really tries to encourage people pick a vision that's 10 times better, an order of magnitude better than the alternative. If you fail, it's okay. But, you'll probably learn something in the process. And Astro Teller likes to say, that if you give him a project to build a car that gets 70 miles per gallon, that's one project. If you give him a different project and say, build a car that gets 500 miles per gallon, that's a completely different project. If you fail, you'll probably learn something. So just go back to the project Loon that Eric mentioned. If this project provides connectivity to people in the third world, in the next five years, we're gonna have 2.5 billion more cell phones in the third world. Imagine what that's gonna do for those people. People in many of these areas don't have access to newspapers, they don't have access to libraries, they don't have access to what their government is doing, they don't have access to Khan Academy. - No, but, let's use a more tangible example. We have this horrific tragedy in Liberia. Imagine if all of those people had a reasonable cellular network, I'm sure we could have saved many lives by earlier prevention, earlier monitoring, earlier treatment, earlier awareness. Right, so this is more than just entertainment, this is life. - Sure. - Then, from an outsider's point of view, this level of kind of breakthrough innovation, you know, it's the envy of the rest of corporate America, or global, you know, everyone. I can understand how having these strong founders who are very kind of thinking 10X could drive that. But, how does it become more ingrained in the organization? How does it, you know, how do you all feel this will continue to happen, say, 50 years in the future, potentially, for the organization? - Well, if you think about it, we're likely to have the general idea, and we're likely to have the cash, because we have lots of cash. Will we have the people? - Right? - It's very much leader-dependent. And it became fairly clear that the limit on the growth of the company was not the brand, and it wasn't the vision, because I think we had plenty of that, but, it was literally recruiting the leaders. It's interesting, that Jonathan and Marissa setup this associate product management program, where they would take people who were very young, 22-23 years old, right out of college with a technical degree, and turn them into product managers. Well, over a five or 10 year period, those people have become not just the executives that run large parts of Google, but they've also become the CEOs of many of the startups that hear about being funded today. I would say that that model is, the model works, it's clear, we discuss it in the book at some length, and it does scale. Alright, so subject to continued focus, I think this scales for a long time. - I think it scales if you give people flexibility to move, and you really espouse a model of innovation by prototyping. Because, it's much easier to today to create prototypes, it's much easier to experiment. And if management kind of stays out of the way, and you get a bit of a Darwinian process of the experts lower in the organization voting with their feet, voting by participating with 20% time, voting by gravitating towards the projects that they think are gonna be successful. It's much easier to let some of the nascent things emerge without top management looking at all of them and dictating which are gonna work, and which aren't. - Yeah. And with that same lens, you know, a lot of what we've just been talking about, Google X, and the contact lens for blood sugar, and self-driving cars, and project Loon. You know, if someone 10 years ago, no one would have predicted Google would have, Android, you know, and now we're just going, yeah, that's what Google does. - I can assure you we didn't predict it. (person laughing) - Would, I mean, any, go ahead. - Oh, no, go ahead. - I wouldn't have predicted 10 years ago. 10 years ago, let's think of the things I had in my pocket. And address book, an answering machine. At home I had an alarm clock. I needed the Yellow Pages. I had a page, you had a pager. (people laughing) I had a Rand McNally map. I needed to look up the weather. Today, all of this is in a smartphone, right? I mean, look at, imagine 20 years ago you thought about Star Trek, and the Tricorder that measured geological, physiological, and meteorological stuff, and Kirk had a communicator in his other hand. Now, he has both of these things in a smartphone. - And one of the great sort of startups that are happening in the Valley, are ones which are medical device monitoring that are connected to phones. Transdermal patches, other ways in which they can monitor what's going in human's bodies. And in theory, the patch goes off, the phone calls the doctor, and the doctor says something to the phone, and the phone, is it calls you and said, you know, get your butt over to the hospital, you're gonna die in 10 minutes. And then it calls the doctor and says, I scared him enough, (people laughing) that he's coming. - So with that lens, you know, what, where do you... You know, this is kind of an open-ended question, I know it's impossible to predict the future. But, I'd love to get your, both our your takes on what will surprise us about Google in the next 10 years? - Oh, I think you'll see it may be Google, or it may be firms that build things based on platforms that Google is creating. But, I think if you look at the whole Android ware world, the opportunities there are enormous. The whole point about healthcare, and longitudinally being able to track information about individuals has enormous opportunity. There are apps... Somebody was working on an app, a psychology app, that would, instead of having the teenagers show up at their psychologist, and you know, give some monosyllabic answer, how you doing, oh, right? The phone, with of course, the person's permission, if this an at risk teenager, would tell the psychologist whether or not they were at risk. Are they getting more depressed? Well, let's see, your phone can tell you how many calls did it get in, how many calls did it make out, are you responding to your text messages, are you leaving the house at a different time of the day? So I think all of these things, including all the big data that we're gonna get, that won't be associated with individuals, but will inform the healthcare world, is gonna lead to huge, huge changes. - Let me answer that, by talking about the industry as a whole. I have consistently in my career underestimated the scale of the disruption, and the scale of the positive impact from the use of software to redo systems, human systems of one kind or another. We're at a point now, where the combinatorial innovation, the ability to mix and match things together is going to produce a very large number of new things that are very useful, that other people will fight about. I think the best current example is Uber. Right, which uses Google Maps, and as a disclosure, Google is an investor. But, Google is a good example of the fight for the user, right, and provides something new, and then deal with all the regulatory pushback. Your well aware at Khan Academy, of the issues of trying to change education, but changing it from within. You are yourself a veteran of that. But, what is more important than getting the education for our kids right? - Yeah. - You're willing to use the tools, you started off using YouTube. Now, at Khan, you've got these amazing new tools that are getting built by engineers that work for you, that can do things that use predictive analytics to figure out what math problems you don't understand, and so forth. It's a quantum change in learning that we've never seen before. So now, replicate that in each and every business, and if your an incumbent, you worry about it. If you're a user, you benefit from it. - Since we have an economist in the audience, I would also add, that if you think about information costs and transaction costs is going to zero, which is kind of the Uber example. That's gonna spawn massive commerce. Because, every single person in the world can now reach every other person in the world. And as soon as that can happen, the number of things that somebody over here has, that he would be willing to sell for a very low price, the number of things that somebody over here would be willing to buy, whether or not it's a good or a service, or it's a ride in an Uber, is gonna expand exponentially. Because, everyone know what everyone else has, and it becomes very seamless to buy and sell. - Yeah, wow, well, I could ask questions for the next five hours, as a curious person. But, I will not monopolize your time. We have some questions from the audience. So I'll start with this first one. How is Google's motto, don't be evil, been an ethical choice that directed its impact on the world? - You know, I think Eric may have a different answer, but, I think of don't be evil as kind of this cultural lodestar, that guides us internally. And I think a lot of people have misinterpreted what we mean by don't be evil. I can remember many meetings within the company, where we'd be talking about a concept and somebody would just stop and (bangs fist down) pound their fist against the table and say, we can't do that, that would be evil. (people laughing) And suddenly, everybody stops and they say, yeah, we should keep those search results separate from that commerce opportunity. I think it really does continue to guide the way people think internally. It's kind of like the Kanban line being pulled in a, when a car is being built, somebody sees something broken and just says, it doesn't matter how junior I am, I'm gonna stop this thing. - This is an interesting one. Who are, and I'd like both of y'all to answer this, who are your personal heroes, both in tech and outside of the tech industry? - Well, for me it's easy, Steve Jobs. - Right. - I had the privilege of knowing him, working with him, serving on the Apple Board. And when I look at what he achieved, in terms of impact on society, we could all aspire to be a small percentage of Steve. - You talk about in the book, as one of your heroes, and you know, in the not too distant past there was some, you know, obviously, Google and Apple are now kind of in, both in the, in the phone space, I mean, was that hard for you? Intention-- - Yes, but, in the first place, we were both respectful to each other. But, exceptional people, remember what I said earlier, exceptional people are worth hanging out with, because, there's a good chance they'll change the world. - Jonathan? - Steve Jobs is certainly a hero of mine, as well, but I'm gonna go with a more personal hero. Milo Madine who hired me at @Home, which was the two-way cable modem company that I worked on before I came to Google, he drew a vision of what broadband access could look like in the world one day, and I wasn't really sure that I believed that it was correct. And before I left his office, he said, "Jonathan, with enough thrust anything can fly." That's what he learned at NASA. With that, I decided, with-- - Yeah, we forget that, we forget that the first trials of all of that were done in Sunnyvale, right near here. And I remember going to Milo's house, and having him show me this. And I said, "Is this thing really gonna work?" Today, there are 70 million American households that have access for that. Pretty good. - And personal heroes are in doodles on my walls, so if I only were to pick one, Martin Luther King. - So this is another interesting one. Are we in another tech bubble? If so, what sug-- - No, we're not! - No. - Valuations are low, but, occupancy is low, salaries are low. It's so easy to hire talent. - Mm-hmm. - I mean, look at the quality of the people you've been able to get, and you pay them nothing! (people laughing) - That's called leadership. (people laughing) - Woo-hoo! - Yes. (people laughing and clapping) So, I'll ask the second part of that question. - Oh, there's more. - Even though we are absolutely not in a tech bubble, hypothetically, if we were. - Should we be in a tech bubble? - Or what advice, what suggestions do you have for startups and I would say even individuals, to survive the burst? - Okay. - [Jonathan] Sell, sell early. - The general rule of bubbles is (loses sound) the top. And I have failed to do that, so far. But, this audience is probably smarter. - I think the way to really tell whether or not you're in a bubble, comparing today versus the last tech bubble, at the beginning of the last decade, is look at the Mary Meeker slides. If you want to learn a lot of tech, just search Mary Meeker, she's at Kleiner Perkins, and look at her last presentation. And compare the level of e-commerce that we have today, to the valuations that we have today, versus the valuations that we had back then, and the level of e-commerce that we had then. We're now at this point where these information costs and transaction costs are going to zero, and people are buying everything online. And soon, they're gonna be buying all of these things online and consummating the transactions on their phone. And when this stuff moves to phones, the valuations are gonna feel even more justified. - Right. - There's always an argument, it's different this time. If you want to, so if you want to make that argument, I think it goes something like this. First, the NASDAQ is not as high as it was in March of 2000. So we forget what the bubble was really like. Trust me, the bubble was great, let's bring back that bubble, I love that bubble. But, the fact of the matter is, that valuations have been going up, because people can credibly now see that the impact of scale from the internet means that if you have a successful product, that product can get global distribution very quickly. Jonathan makes the point, and makes it in the book quite cogently, I think, that it used to be you had to worry about distribution issues, and branding issues, and so forth. Now, if you produce a much better product, it will scale so very quickly, that you get this sort of phenomena, where the winner gets incredibly high valuation. And so far, the markets are rewarding them. - Just look at your product, and the number of eyeballs that you get coming to your, albeit, non-profit site. But, think about all of the apps that you have, right? I doubt there was a lot of marketing that caused you to download Instagram, or WhatsApp, or any of the Google products that, hopefully, you have on your phones, as well. (people laughing) Angry Birds, right, these things take off and the skip all that stuff like Geoffrey Moore and the Crossing the Chasm people used to write about, right, innovators, early majority, late majority. It's just like suddenly there's this thing. - And it just goes. - It's just boom! - They just go to superstar. - Yeah, right. - This is something we talked a little bit about, but this is an interesting frame of it. And I'll put it the angle of, if you were talking to another manager, I mean, you guys kind of walked into a culture that was already innovative, and you helped foster that further. But, what, and the question here is: how to create and build Google's culture, what was the challenge while building it, how the challenges would be different in a different country? And I think that last part is especially interesting. Or, I would say even in a different company. Like, if, could you create a Google in another company? - The culture of a company is set at the top, right? And so, we have a section in the book about famous slogans. What was the one that you liked the most, who was it? - The one, well, there's Enron, which, well, there's Lehman, which is to build something like, it's almost impossible to remember, but it's something like to build unrivaled partnerships through the dedication, perseverance, and hard work of our employees, to generate shareholder value for our investors. - You can be quite sure that they hired a branding company to write that sentence, and they put it on their website, right, or the equivalent. I mean, that's not real. Companies have real cultures, and employees will tell you what they are. If you do parachute yourself into an existing company, ask the employees, not necessarily the founder or the CEO, what's the culture really like? And you'll get an honest answer. And then try to make it better. Another observation, and people always say, well, you know, you could do this at Google because it was special, and new, and fast. I just don't agree with that. The fact of the matter is, the average company in America hires, turns over 5% or 10% of its employees every year. So there you have an opportunity, right, you actually have an opportunity to change the culture person-by-person, by changing your hiring practices along the lines that our book talks about, and telling people, you know, we expect something different. And every company has at least some kind of strategy. Put in a hard-bitten, hard-fought five-year strategy that employees believe in, and march to it and you'll do great. - So this next question, this is kind of a hot topic, (garbling words) especially, it's: What efforts do you all personally undertake to improve gender diversity in the company? - We say, actually, that diversity is your best defense against myopia. We are investing quite a bit in girls who code, and various initiatives to get more minorities coding. And, in fact, we were just in Toronto, where we visited, we had demos from a bunch of kids who were showing us 3D printing and games. I do a lot of mentoring of women at Google. I also participate in a lot of the BOLD Diversity programs that we have in recruiting, on an annual basis. - We have a very serious problem in our industry about a lack of supply of, just literally, the incoming number of women versus men. And it's quite perplexing, because, if you look in other fields like biology, a majority of the PhDs, and the Masters Degrees are now female. There's something about what we are doing that's a problem, and we need to be honest about it, and figure out a way to fix it. - We did recently release our internal numbers, with respect to the numbers of women and minorities. And, we were very pleased to see that a number of other Silicon Valley companies followed suit, which is a very good start. - In y'all's estimate, I mean, do you think it's a pure inbound kind of supply shortage, or do you think there are things in kind of the culture that are making it hard? - There's plenty of evidence of hidden bias. And even these nice pleasant liberal tech companies have all sorts of biases. And we try to do a bias check. But, the fact of the matter is, I'm sure. In our case, we have three female on our board of directors. A number of our most senior female leaders have now left to run their own companies, and so forth. So we think we're making a good contribution, but, it could be so much better. - Yeah. - Yeah, absolutely. So this is an interesting question. Would you apply for a job at Google today? If yes, would it be a, what project would you be most interested in? (people laughing) - Sure, I'd apply for a job at Google today, I don't know that I'd get one. (people laughing) - What, I'm worried about the same. You know, we put in those hiring practices. We never actually subjected ourselves to them. - But, you're my friend, and maybe you'd help me. I don't know that I'd get through one of the committees. I think the fascinating thing today, is that there's different sets of choices. I think for a young person today, learning or ad systems is a hugely valuable long-term skill, because, it's critical internally, but it's also, it also gives you the opportunity at some point to go to a startup that needs to understand how to monetize online. And again, since it's so much easier to create prototypes and get funding today, I think if you understand how to join a startup that's already built a good product, and then help it monetize, that's a really good career strategy. I think on the other side of the established products, there's great opportunities to pick something that fundamentally is gonna change the world. The contact lens would be a good example. The self-driving car is another great example. So pick something at one of those ends of the spectrum. - As a computer scientist, my work was operating systems and its programming languages. If I had to take my historic training, I would join the Android team. It's inconceivable to me, that Android would have a billion and a half platforms, or whatever the number is today. And I was sure I'd want to work on that. But, if I were a young person today, with a different educational background, I'm sure I'd be attracted to some of the Google X projects, because, they integrate software and hardware in ways that no one has ever imagined. - As a corollary to that question, I mean, what advice would you give to a, you know, a young 12-year-old, or 15-year-old, if he or she is aspiring to be a Googler, and kind of grow a career in Silicon Valley? - The first place, I think, is if you look at teenagers today, there aren't, at least a sort of the high-performing ones, are under enormous pressure from their parents and society to overachieve. And I think that I benefited from the fact that I just naturally enjoyed computers, and I just sort of did my thing. So I would be careful not to over-manage this outcome. Right, and again, you want it to be natural and native, and not have a burned-out 18-year-old who's busy, you know, on psychiatric drugs, or whatever, stressing out, you know, is more stressed out than you are. You just don't want that, it's not a good human outcome, especially, for young and developmentally still developing brains. So I think that would be, that would be the first thing. I think the second thing is, that early exposure to programming, is probably as important as early... There's a lot of evidence that early reading, and you understand this as an educator very well, early reading skills correlate very well to subsequent performance. Early reading comprehension, and then later, programming skills. And I'm not talking about hard-core C and C++. I'm talking about manipulating games, understanding graphics, learning how these things work, it structures your mind, it gets you to be organized, it gets you to think clearly. And even if you ultimately do not end up as a programmer somewhere, that will probably help you as a lawyer, right, as a doctor, as a whatever, whatever you ultimately become. - I have a very different answer. Right, the graduate plastics answer would be statistics. And the reason I say statistics, or computer science, is that if you think about what Bill Gates said, he went into software, because, the cost, he foresaw that the cost of computing was becoming cheap. So now, think about this concept of big data. There's data everywhere. The internet makes that data accessible for free. So what becomes the complimentary scarce resource to free data? The ability to analyze the data. So statisticians, I think, are gonna be the most highly paid people - And by the way, Jonathan, - In 20 years. - Just to update to you, these are now called data scientists. (people laughing) - Thank you, Eric. - So had you said the word data scientist, and statistician, you would have had a perfect answer. - I'll do that next week. - Good. (people laughing) - One outcome, and I do think you should think about this for Khan Academy, is that there's a lot of evidence that the analytical skills, simple programming skills, and simple data science and statistic skills, you're gonna need them as a young adult, because everything is gonna be measured, everything is gonna be in front of you. How do you reason about it, how do you think about it, how you analyze it? - Yeah, no, absolutely. So this is an interesting question, one that I'm fascinated about, as well. When do you realistically think self-driving cars will be introduced to the general public? What process goes into the testing? - I have been told that the correct answer is about 10 years. But, I think it could be less. - The testing consisted of Jonathan getting behind the wheel. - And going, well, I... When you get in one of these cars, first, I love that I've driven a self-driving car. I have not, I have been driven by a self-driving car. (people laughing) You get in, and if you've ever taught your teenage kid to drive, you sit on the right side, and you're hitting that imaginary brake pedal. (people laughing) It takes like 20 minutes. And after 20 minutes, this calm sort of comes over you, and you realize that this thing isn't gonna get distracted, and it isn't gonna stop and have a drink. (people laughing) The laser that's it's using to look at the car ahead of you works better than your eye. And it cannot crash into the bumper of the car ahead of you. And you get really accustomed to accepting that it just works better. It's safer, and ultimately, the self-driving cars are gonna save lots and lots of lives. - I think we don't really know how long it will take. We're working with the regulatory authorities, they obviously have a lot to say, as to whether these kinds of cars are gonna coexist in the form that we have mentioned. We'll certainly be doing testing on autonomous courses, and specialized places. But, the real question is, when are they let into the wild, if you will, right? - And I know Sebastian, he's also kind of in the education space, and I mean, he talks about kind of, you know, once every 400,000 miles, so they're already, it's already quite good. - We've not had an accident. - It's better than you. - Yes. (people laughing) - Better than you generically. - That's what I meant. - I'm a defensive driver. - You are a defensive driver? - Yeah, I drive like a grandmother. But, that's... (people laughing) - It's not you, it's the other car, right? - Right, yeah. My mother actually told me that, the last time she was in the car. (people laughing) So this is an interesting question. You know, Apple, a lot of fanfare about kind of the financial portion of the new iPhone. What is Google doing in the area of mobile purchasing apps and phones in the future? - Well, we have a mobile wallet. I think Apple has introduced something reasonably similar. I think as Apple makes progress, it'll be good for us. We'll certainly see more retailers with working NFC systems. So I think as we build all of those into more phones, and as we get phones down in price, which I think we've started to see with a lot of the Android phones, we'll get more wallets, and as we get more wallets, you're gonna get much, much more acceptance at the retailer level. - I think it's helpful to say, that this is a platform that Apple, Google and others, and let me include Amazon and a few others, that platform, all of us will be using in some form. And as a group, we're all gonna benefit from all of these innovations. It was true in the earlier sets of platforms. But, think about commerce, and buying things, and making it easy. Jonathan always talks about trying to get to friction-free markets, you have a nice way of describing this as an economist. But, the fact of the matter is, you're gonna buy more stuff if it's easier. - Yeah, yeah. And this is an interesting one. How do you inculcate a sense of entrepreneurship among people who are not natural entrepreneurs? And I'll add the corollary, can you? - Well, I think the one thing we've learned that you can't teach is passion. And that's why that's what we interview, that's why we're so careful about interviewing for passion. I think you can get somebody addicted to a positive experience, where they build something that is ultimately successful. So I think you can teach technical people, who haven't had a wonderfully positive experience, certainly, somebody who hasn't marketed an app, or earned money from an app. You show them, once they build something that they can actually monetize it, suddenly, they get excited about entrepreneurship. So I think entrepreneurship is easier to teach someone, than passion. - Eric? - I agree. - Yeah. So this one, and I didn't plant this, but, I'll just, I'm going in order now. How do you see the future of using technology to improve education? - Sal, perhaps, you could answer that question? - Not my handwriting, not my handwriting. - Go ahead, and answer the question. - I don't want to take your stage time. - Look, you asked the question, you answer the question. - Someone else asked this question. - Okay, I'll make up your answer - Okay. - Look, it goes something like this. We were all educated, all of us in this room in pretty much the same way. But, there's a lot of science that says that people learn in different ways. And with the combination of gamification, new kind of testing, new ways we're experimenting learning, we can prove that you'll learn quicker with some of these new tools that are online. And by the way, that doesn't mean the teacher goes away. It means the teacher is more effective, because the teacher is supervising the entire process. How did I do? - Excellent. I would say, you're probably on the... - Probably on the board. - A board of the Khan Academy. (people applauding) - This is why they put me on the board. (people laughing) That was my pitch. - We'll see more of the model of what people call the flipped classroom. And I think that we'll-- - I wonder who pioneered that term? - You? - No, Sal! - Ah. - I didn't pioneer it, but, it got associated with me, that's all. - The concept that any student in a college can see, let's pick the best version of a physics professor who does Einstein's Theory of Relativity. We record these things, the students watch them, and then they come into their classroom, and they have their own physics professor, who then talks to them about what they saw. That model, I think, is gonna become more and more popular. The other thing that's wonderful about that model, is again, if we have these phones everywhere in the world, people who don't otherwise have access to any education at all, can watch them for free. - You want to (loses sound) when people who don't have access to high-quality learning, and the stuff that Sal and company are doing is revolutionary, so we should just clearly do that. But, even for us, even the elites, the well, the genetically fortunate who end up in America at the top universities, and so forth, and so on, whatever position you have on that, they can benefit, too. There was a study of a particular physics class, where they ran an experiment, and it went something like this. We're gonna show you a 10-minute lecture, and then we're gonna describe how to answer the questions. Then you're gonna answer the questions, and they want to dissect the approaches you took. And that worked better than the traditional physics lectures. And they proved, using their metrics that it was twice effective, two better. Alright? So that's an example of the kind of learning. It's unclear, by the way, whether that result applies to other fields, but, it appears to apply to physics. - Yeah. - Yeah. This is a question that we've touched on a little bit, but with a slightly different spin. As Google grows and expands, how do you ensure the culture stays healthy? What changes have you made to handle growth, and keep the culture true to its roots? And I'll another corollary, what are you all most concerned about, as Google continues to grow? - We've actually written a book about it. (people laughing) And we're sharing it externally. - And we gave a copy to every employee. - A digital copy, actually. - Thank you. - We actually spent this morning in a big meeting with all of the employees, where we were asking those who have read the book what their thoughts were? What are some of the things that we're not doing today, that we talk about in the book? And, we've given this talk recently, we just gave in Toronto, Washington, and New York. Where are all the places we've been? And Mountainview. And LA next week. So I think lots of engagement, after kind of documenting the tribal wisdom, is the focus. We had been doing some of that. In fact, the book evolved out of a talk that I gave in 2009, when we were scaling very, very quickly, and we tried to write down all of the rules that we'd had within the company. - And by the way, what was the title of this talk? - Not a particularly impression of choice, Notes for the Bestseller I'll Never Publish. - I remember that. - Yes. - And as of yesterday? - As of yesterday? - We're a bestseller, woo-hoo! (people applauding) - Congratulations. You have-- - Finally, we've done something valuable. - Yes, exactly, you're finally successful in your life. I'm sure there's a lotta (people laughing) people feeling insecure right now, but anyway. I'm one of 'em. My book did not get as many, but anyway, that's a separate thing. - You have millions of viewers every day. - That's right, that's right. But it's-- - Sal, Sal, would you stop complaining. - No, that's, no, I'm just-- - The most famous educator in the world, and you're unhappy? - I'm rich in other ways. (people laughing) With that, you know, I think, well, there's one more question, we have time for one more. Eric Schmidt: Thank you, for making Google a strong leader on clean energy. What will Google do to help pass climate legislation through Congress? (people laughing) Because, that's a very easy thing to do. You guys should have no trouble passing things through Congress. - Yeah, yeah, I don't know if anybody's noticed, but Congress has largely stopped passing laws of any kind. (people laughing) If you assume that more laws are good, then their productivity is poor. If you assume fewer laws are good, then their productivity is high. (laughs) Look, we elected these guys, I think we get the government that we've elected. On the climate change thing, what I would tell you is climate change is very real. We need to begin to address it in lots of ways. And my sort of joke on this is, I sort of like Florida, and don't want to lose half of it. And the modeling indicates that in at least young people's lives, there's a reasonable chance of severe flooding, because of the way that sea level rise works. So it's a very, very serious matter. And if you don't care about Florida, which I do, you might care about the water sources in the Himalayas that provide water for a billion people, who you might care about. Genetic biodiversity, which provides genetic health and other sort of biological resistance to drug, to disease and things that affect humans, and on, and on, and on. Or the wars that have, the appear to be coming up, because of lack of things. And by the way, has anybody noticed the temperature today? (people mumbling) There's lots of it, and the West in a long-term cycle, which may or may not be related to climate change. You go on, and on, and on. I think the climate change is very real. I think we can debate how to address it. But, it's important to start with the facts, and those are the facts. - Yeah, (loses sound) pretty much, you know, this was a lot of fun, we could go on or hours. But, I recommend to everyone, and I found a lot of value in this, How Google Works, thank you, very much. - Thank you. (people applauding) Thank you, Chuck. - I hope you all enjoyed this evening's program. I know that I certainly did, and by your reaction, I think you did, as well. We'd like to once again thank Eric Schmidt, the Chairman of Google, Jonathan Rosenberg, the Google Advisor, and Sal Khan, the Founder of Khan Academy. I know that our audience here in Santa Clara, and those of you joining us on the radio have enjoyed it, as well. And now, the meeting of the Commonwealth Club, which is celebrating over 100 years of enlightened discussion is adjourned. (hits gavel on podium) (people applauding)