>>live from Stanford University. It's the queue covering Stanford women in data science 2020. Brought to you by Silicon Angle Media. >>Hi! And welcome to the Cube. I'm your host, Sonia, to guard. And we're live at Stanford University covering Woods Women in Data Science Conference The fifth annual one And joining us today is Daphne Koller, who is the co founder who sorry is the CEO and founder of In Citro that Daphne. Welcome to the Cube. >>Nice to be here, Sonia. Thank you for having me. So >>tell us a little bit about in Citro how you how you got founded and more about your >>role. So I've been working in the intersection of machine learning and biology and health for quite a while, and it was always a bit of an interesting journey and that the data sets were quite small and limited. We're now in a different world where there's tools that are allowing us to create massive biological data sense that I think can help us solve really significant societal problems. And one of those problems that I think is really important is drug discovery and development, where despite many important advancements, the costs just keep going up and up and up. And the question is, can we use machine learning to solve that problem >>better? And you talk about this more in your keynote, so give us a few highlights of what you talked about. So in the last, you can think of >>drug discovery development in the last 50 to 70 years as being a bit of a glass half full glass, half empty. The glass half full is the fact that there's diseases that used to be a death sentence or of sentenced, a lifelong of pain and suffering that >>are now >>addressed by some of the modern day medicines. And I think that's absolutely amazing. The >>other side of >>it is that the cost of developing new drugs has been growing exponentially and what's come to be known as the Rooms law being the inverse of Moore's law, which is the one we're all familiar with because the number of drugs approved per 1,000,000,000 U. S. Dollars just keeps going down exponentially. So the question is, can we change that curve? >>And you talked in your keynote about the interdisciplinary culture to tell us more about that? I think in >>order to address some of the critical problems that we're facing. One needs to really build a culture of people who work together at from different disciplines, each bringing their own insights and their own ideas into the mix. So and in Citro, we actually have a company. That's half life scientists, many of whom are producing data for the purpose of driving machine learning models and the other Halford machine learning people in data scientists who are working on those. But it's not a handoff where one group produces that they then the other one consumes and interpreted. But really, they start from the very beginning to understand. What are the problems that one could solve together? How do you design the experiment? How do you build the model and how do you derive insights from that that can help us make better medicines for people? >>And, um, I also wanted to ask you the you co founded coursera, so tell us a little bit more about that platform. So I found that >>coursera as a result of work that I've been doing at Stanford, working on how technology can make education better and more accessible. This was a project that I did here, number of my colleagues as well. And at some point in the fall of 2011 there was an experiment of Let's take some of the content that we've been we've been developing within within Stanford and put it out there for people to just benefit from, and we didn't know what would happen. Would it be a few 1000 people, but within a matter of weeks with minimal advertising Other than one New York Times article that went viral, we had 100,000 people in each of those courses. And that was a moment in time where, you know, we looked at it at this and said, Can we just go back to writing more papers or is there an incredible opportunity to transform access to education to people all over the world? And so I ended up taking a what was supposed to be to really absence from Stanford to go and co found coursera, and I thought I'd go back after two years, but the But at the end of that two year period, the there was just so much more to be done and so much more impact that we could bring to people all over the world, people of both genders, people of different social economic status, every single country around the world. We just felt like this was something that I couldn't not dio. >>And how did you Why did you decide to go from an educational platform to then going into machine learning and biomedicine? >>So I've been doing Corsair for about five years in 2016 and the company was on a great trajectory. But it's primarily >>a >>a content company, and around me, machine learning was transforming the world, and I wanted to come back and be part of that. And when I looked around, I saw machine learning being applied to e commerce and the natural language and to self driving cars. But there really wasn't a lot of impact being made on the life science area. I wanted to be part of making that happen, partly because I felt like coming back to your earlier comment that in order to really have that impact, you need to have someone who speaks both languages. And while there's a new generation of researchers who are bilingual in biology and machine learning, there's still a small group in there, very few of those in kind of my age cohort and I thought that I would be able to have a real impact by bullying company in the space. >>So it sounds like your background is pretty varied. What advice would you give to women who are just starting college now who may be interested in the similar field? Would you tell them they have to major in math? Or or do you think that maybe, like there's some other majors that may be influential as well? I think >>there is a lot of ways to get into data science. Math is one of them. But there's also statistics or physics. And I would say that especially for the field that I'm currently in, which is at the intersection of machine learning data science on the one hand, and biology and health on the other one can, um, get there from biology or medicine as well. But what I think is important is not to shy away from the more mathematically oriented courses in whatever major you're in, because that foundation is a really strong one. There is ah lot of people out there who are basically lightweight consumers of data science, and they don't really understand how the methods that they're deploying, how they work and that limits thumb in their ability to advance the field and come up with new methods that are better suited, perhaps, of the problems of their tackling. So I think it's totally fine. And in fact, there's a lot of value to coming into data science from fields other than now third computer science. But I think taking courses in those fields, even while you're majoring in whatever field you're interested in, is going to make you a much better person who lives at that intersection. >>And how do you think having a technology background has helped you in in founding your companies and has helped you become a successful CEO in companies >>that are very strongly R and D, focused like like in Citro and others? Having a technical co founder is absolutely essential because it's fine to have and understanding of whatever the user needs and so on and come from the business side of it. And a lot of companies have a business co founder. But not understanding what the technology can actually do is highly limiting because you end up hallucinating. Oh, if we could only do this and that would be great. But you can't and people end up often times making ridiculous promises about what's technology will or will not do because they just don't understand where the land mines sit. And, um, and where you're going to hit reels, obstacles in the path. So I think it's really important to have a strong technical foundation in these companies. >>And that being said, Where do you see in Teacher in the future? And how do you see it solving, Say, Nash, that you talked about in your keynote. >>So we hope that in Citro will be a fully integrated drug discovery and development company that is based on a completely different foundation than a traditional pharma company where they grew up. In the old approach of that is very much a bespoke scientific um, analysis of the biology of different diseases and then going after targets are ways of dealing with the disease that are driven by human intuition. Where I think we have the opportunity to go today is to build a very data driven approach that collects massive amounts of data and then let analysis of those data really reveal new hypotheses that might not be the ones that accord with people's preconceptions of what matters and what doesn't. And so hopefully we'll be able to overtime create enough data and applying machine learning to address key bottlenecks in the drug discovery development process that we can bring better drugs to people, and we can do it faster and hopefully it much lower cost. >>That's great. And you also mention in your keynote that you think the 20 twenties is like a digital biology era, so tell us more about that. So I think if >>you look, if you take a historical perspective on science and think back, you realize that there's periods in history where one discipline has made a tremendous amount of progress in relatively short amount of time because of a new technology or a new way of looking at things in the 18 seventies, that discipline was chemistry with the understanding of the periodic table, and that you actually couldn't turn lead into gold in the 19 hundreds. That was physics with understanding the connection between matter and energy in between space and time. In the 19 fifties that was computing where silicon chips were suddenly able to perform calculations that up until that point, only people have been able to >>dio. And then in 19 nineties, >>there was an interesting bifurcation. One was three era of data, which is related to computing but also involves elements, statistics and optimization of neuroscience. And the other one was quantitative biology. In which file do you move from a descriptive signs of taxonomy izing phenomenon to really probing and measuring biology in a very detailed on high throughput way, using techniques like micro arrays that measure the activity of 20,000 genes at once, or the human genome sequencing of the human genome and many others. But >>these two fields kind of >>evolved in parallel, and what I think is coming now, 30 years later, is the convergence of those two fields into one field that I like to think of a digital biology where we are able using the tools that have and continue to be developed, measure biology, an entirely new levels of detail, of fidelity of scale. We can use the techniques of machine learning and data signs to interpret what we're seeing and then use some of the technologies that are also emerging to engineer biology to do things that it otherwise wouldn't do. And that will have implications and bio materials in energy and the environment in agriculture. And I think also in human health. And it's a incredibly exciting space toe to be in right now, because just so much is happening in the opportunities to make a difference and make the world a better place or just so large. >>That sounds awesome. Stephanie. Thank you for your insight. And thanks for being on the Cube. Thank you. I'm Sonia. Taqueria. Thanks for watching. Stay tuned for more. Okay? Great. Yeah, yeah, yeah.

live from Stanford University it's the hue covering Stanford women in data science 2020 brought to you by Silicon angle media hi and welcome to the cube I'm your host Sonia - Garrett and we're live at Stanford University covering wigs women in data science conference the fifth annual one and joining us today is Daphne Koller who is the co-founder who sari is the CEO and founder of in seat row that Daphne welcome to the cube nice to be here Sonia thank you for having me so tell us a little bit about in seat row how you how it you got it founded and more about your role so I've been working in the intersection of machine learning and biology and health for quite a while and it was always a bit of a an interesting journey in that the data sets were quite small and limited we're now in a different world where there's tools that are allowing us to create massive biological data sets that I think can help us solve really significant societal problems and one of those problems that I think is really important is drug discovery development where despite many important advancements the costs just keep going up and up and up and the question is can we use machine learning to solve that problem better and you talk about this more in your keynote so give us a few highlights of what you talked about so in the last you can think of drug discovery and development in the last 50 to 70 years as being a bit of a glass half-full glass half-empty the glass half-full is the fact that there's diseases that used to be a death sentence or of the sentence still a life long of pain and suffering that are now addressed by some of the modern-day medicines and I think that's absolutely amazing the other side of it is that the cost of developing new drugs has been growing exponentially in what's come to be known as Arun was law being the inverse of Moore's Law which is the one we're all familiar with because the number of drugs approved per billion u.s. dollars just keeps going down exponentially so the question is can we change that curve and you talked in your keynote about the interdisciplinary cold to tell us more about that I think in order to address some of the critical problems that were facing one needs to really build a culture of people who work together at from different disciplines each bringing their own insights and their own ideas into the mix so and in seat row we actually have a company that's half-life scientists many of whom are producing data for the purpose of driving machine learning models and the other half are machine learning people and data scientists who are working on those but it's not a handoff where one group produces the data and the other one consumes and interpreted but really they start from the very beginning to understand what are the problems that one could solve together how do you design the experiment how do you build the model and how do you derive insights from that that can help us make better medicines for people and I also wanted to ask you you co-founded Coursera so tell us a little bit more about that platform so I founded Coursera as a result of work that I'd been doing at Stanford working on how technology can make education better and more accessible this was a project that I did here a number of my colleagues as well and at some point in the fall of 2011 there was an experiment let's take some of the content that we've been we've been developing within it's within Stanford and put it out there for people to just benefit from and we didn't know what would happen would it be a few thousand people but within a matter of weeks with minimal advertising other than one New York Times article that went viral we had a hundred thousand people in each of those courses and that was a moment in time where you know we looked at this and said can we just go back to writing more papers or is there an incredible opportunity to transform access to education to people all over the world and so I ended up taking a what was supposed to be a teary leave of absence from Stanford to go and co-found Coursera and I thought I'd go back after two years but the but at the end of that two-year period the there was just so much more to be done and so much more impact that we could bring to people all over the world people of both genders people of the different social economic status every single country around the world we I just felt like this was something that I couldn't not do and how did you why did you decide to go from an educational platform to then going into machine learning and biomedicine so I've been doing Coursera for about five years in 2016 and the company was on a great trajectory but it's primarily a Content company and around me machine learning was transforming the world and I wanted to come back and be part of that and when I looked around I saw machine learning being applied to ecommerce and the natural language and to self-driving cars but there really wasn't a lot of impact being made on the life science area and I wanted to be part of making that happen partly because I felt like coming back to our earlier comment that in order to really have that impact you need to have someone who speaks both languages and while there's a new generation of researchers who are bilingual in biology and in machine learning there's still a small group and there very few of those in kind of my age cohort and I thought that I would be able to have a real impact by building and company in the space so it sounds like your background is pretty varied what advice would you give to women who are just starting college now who may be interested in a similar field would you tell them they have to major in math or or do you think that maybe like there are some other majors that may be influential as well I think there's a lot of ways to get into data science math is one of them but there's also statistics or physics and I would say that especially for the field that I'm currently in which is at the intersection of machine learning data science on the one hand and biology and health on the other one can get there from biology or medicine as well but what I think is important is not to shy away from the more mathematically oriented courses in whatever major you're in because that found the is a really strong one there's a lot of people out there who are basically lightweight consumers of data science and they don't really understand how the methods that they're deploying how they work and that limits them in their ability to advance the field and come up with new methods that are better suited perhaps to the problems that they're tackling so I think it's totally fine and in fact there's a lot of value to coming into data science from fields other than a third computer science but I think taking courses in those fields even while you're majoring in whatever field you're interested in is going to make you a much better person who lives at that intersection and how do you think having a technology background has helped you in in founding your companies and has helped you become a successful CEO in companies that are very strongly Rd focused like like in C tro and others having a technical co-founder is absolutely essential because it's fine to have an understanding of whatever the user needs and so on and come from the business side of it and a lot of companies have a business co-founder but not understanding what the technology can actually do is highly limiting because you end up hallucinating oh if we could only do this and yet that would be great but you can't and people end up oftentimes making ridiculous promises about what technology will or will not do because they just don't understand where the land mines sit and and where you're gonna hit real obstacles and in the path so I think it's really important to have a strong technical foundation in these companies and that being said where do you see an teacher in the future and and how do you see it solving say Nash that you talked about in your keynote so we hope that in seat row we'll be a fully integrated drug discovery and development company that is based on a slightly different foundation than a traditional pharma company where they grew up in the old approach of that is very much bespoke scientific analysis of the biology of different diseases and then going after targets or our ways of dealing with the disease that are driven by human intuition where I think we have the opportunity to go today is to build a very data-driven approach that collects massive amounts of data and then let analysis of those data really reveal new hypotheses that might not be the ones that the cord with people's preconceptions of what matters and what doesn't and so hopefully we'll be able to over time create enough data and apply machine learning to address key bottlenecks in the drug discovery development process so we can bring better drugs to people and we can do it faster and hopefully at much lower cost that's great and you also mentioned in your keynote that you think that 2020s is like a digital biology era so tell us more about that so I think if you look if you take a historical perspective on science and think back you realize that there's periods in history where one discipline has made a tremendous amount of progress in a relatively short amount of time because of a new technology or a new way of looking at things in the 1870s that discipline was chemistry was the understanding of the periodic table and that you actually couldn't turn lead into gold in the 1900s that was physics with understanding the connection between matter and energy and between space and time in the 1950s that was computing where silicon chips were suddenly able to perform calculations that up until that point only people have been able to do and then in 1990s there was an interesting bifurcation one was the era of data which is related to computing but also involves elements statistics and optimization of neuroscience and the other one was quantitative biology in which biology moved from a descriptive science of techsan amaizing phenomena to really probing and measuring biology in a very detailed and a high-throughput way using techniques like microarrays that measure the activity of 20,000 genes at once Oh the human genome sequencing of the human genome and many others but these two feels kind of evolved in parallel and what I think is coming now 30 years later is the convergence of those two fields into one field that I like to think of as digital biology where we are able using the tools that have and continue to be developed measure biology in entirely new levels of detail of fidelity of scale we can use the techniques of machine learning and data science to interpret what we're seeing and then use some of the technologies that are also emerging to engineer biology to do things that it otherwise wouldn't do and that will have implications in biomaterials in energy in the environment in agriculture and I think also in human health and it's an incredibly exciting space to be in right now because just so much is happening and the opportunities to make a difference and make the world a better place are just so large that sounds awesome Daphne thank you for your insight and thank you for being on cute thank you I'm so neat agario thanks for watching stay tuned for more great

>> Reporter: Live from Stanford University, it's theCUBE, covering Stanford Women in Data Science 2020. Brought to you by SiliconANGLE media. >> Hi, and welcome to theCUBE. I'm your host, Sonia Tagare, and we're live at Stanford University covering the fifth annual WiDs, Women in Data Science conference. Joining us today is Emily Glassberg Sands, the Head of Data Science at Coursera, Emily, welcome to theCUBE. >> Thanks, so great to be on. >> So, tell us a little bit more about what you do at Coursera. >> Yeah, absolutely, so Coursera is the world's largest platform for higher education. We partner with about 160 universities and 20 industry partners and we provide top learning content from data science to child nutrition to about 50 million learners around the world. I lead the end to end data team so spanning data engineering, data science and machine learning. >> Wow, and we just had Daphne Koller on earlier this morning who is the co-founder of Coursera and she's also the one who hired you. >> Yeah. >> So tell us more about that relationship. >> Well, I love Daphne, I think the world of her, as I will talk about shortly, she actually didn't hire me from the start. The first answer I got one from Coursera was a no, that the company wasn't quite ready for someone who wasn't a full blown coder. But I eventually talked to her into bringing me on board, and she's been an inspiration ever since. I think one of my first memories of Daphne was when she was painting the vision of what's possible with online education, and she said, "think about the first movie." The first movie was literally just filming a play on stage. You'll appreciate this, given your background in film, and then fast forward to today and think about what's possible in movies that could never be possible on the brick-and-mortar stage. And the analog she was creating was the first MOOC, the first Massive Open Online Course was very simply filming a professor in a classroom. But she was thinking forward to today and tomorrow and five years from now, and what's possible in terms of how data and technology can transform, how educators teach and how learners learn. >> That's very cool. So, how has Coursera changed from when she started it to now? >> So, it's evolved a lot. So, I've been at Coursera about six years, when I joined the company, it had less than 50 people. Today we're 10 times that size, we have 500. I think there have been obviously dramatic growth in the platform over all the three main changes to our business model. The first is we've moved from partnering exclusively with universities to recognizing that actually, a lot of the most important education for folks in the labor market is being taught within companies. So, Google is super incentivized to train people in Google Cloud, Amazon and AWS. Folks need to learn Tableau and a whole host of other software's. So, we've expanded to including education that's provided not just by top institutions like Stanford, but also by top institutions that are companies like Amazon and Google. The second big change is we've recognized that while for many learners and individual course or a MOOC is sufficient, some learners need access to full degree, a diploma bearing credential. So we've moved to the degree space we now have 14 degrees live on the platform masters in computer science and data science but also in business, accounting, and so on. And the third major changes, I think just sort of as the world has evolved to recognize that folks need to be learning throughout their lives. There's also general consensus that it's not just on the individuals to learn, but also on their companies to train them and governments as well, and so we launched Coursera enterprise, which is about providing learning content through employers and through governments so we can reach a wider swath of individuals who might not be able to afford it themselves. >> And how are you able to use data science to track individual, user preferences and user behavior? >> Yeah, that's a great question so you can imagine right? 50 million learners, they're from almost every country in the world from a range of different backgrounds have a bunch of different goals, And so I think what you're getting out is that so much of creating the right learning experience for each person is about personalizing that experience. And we personalized throughout the learner journey so in discovery up-front, when you first joined the platform, we ask you, what's your career goal? What role are you in today? And then we help you find the right content to close the gap. As you're moving through courses we predict whether or not you need some additional support. Whether it's a fully automated intervention like a behavioral nudge, emphasizing growth mindset, or a pedagogical nudge like recommending the right review material and provide it to you, and then we also do the same to accelerate support staff on campus. So, we identify for each individual what type of human touch might they need, and we serve up to support staff recommendations for who they should reach out to, whether it's a counselor reaching out to degree student who hasn't logged in for a while, or a TA reaching out to a degree student who's struggling with an assignment. So, data really powers all of that, understanding someone's goals, their backgrounds, the content that's going to close the gap, as well as understanding where they need additional support and what type of help we can provide. >> And how are you able to track this data, are you using AV testing? >> Yeah, great question, so the, we call it a venting level data, which basically tracks what every learner is doing as they're moving through the platform. And then we use AV testing to understand the influence of kind of our big feature. So, say we roll out a new search ranking algorithm or a new learning experience we would AV-Test that, yes to understand how learners in the new variant compared to learners in the old variant. But for many of our machine learn systems, we're actually doing more of a multi-armed bandit approach where on the margin, we're changing a little bit the experience people have to understand what effect that has on their downstream behavior, separate from this mass hold-in or hold-out AV-Test. >> And so today, you're giving a talk about Coursera's latest data products so give us a little insight about that. >> So, I'm covering three data products that we've launched over the last couple of years. The first two are oriented around really helping learners be successful in the learning experience. So the first is predicting when learners are going to need additional nudges and intervening in fully automated ways to get them back on track. The second is about identifying learners who need human support and serving up really easily interpretable insights to support staff so they can reach out to the right learner with the right help. And then the third is a little bit different. It's about once learners are out in the labor market, how can they credibly signal what they know, so that they can be rewarded for that learning on the job. And this is a product called skill scoring, where we're actually measuring what skills each learner has up to what level so I can for example, compare that to the skills required in my target career or show it to my employer so I can be rewarded for what I know. >> That can be really helpful when people are creating resumes, by ranking how much of a skill that they have. >> Absolutely. So, it's really interesting when you talk about resumes, so many of what, so much of what's shown on resumes are traditional credentials, things like What school did you go to? what did you major in? what jobs have you had? And as you and I both know, there's unequal access to the school you go to or the early jobs you get. And so, part of the motivation behind skill scoring is to create more equitable or fair or accessible signals for the labor market. So, we're really excited about that direction. >> And do you think companies are taking that into consideration when they're hiring people who say have like a five out of five skills in computer science, but they didn't go to Stanford? >> Yeah. >> Think they're taking that >> Absolutely, I think companies are hungry to find more diverse talent and the biggest challenge is, when you look at people from diverse backgrounds, it's hard to know who has what skills. And so skill scoring provides a really valuable input, we're actually seeing it in use already by many of our enterprise customers who are using it to identify who have their internal employees is well positioned for new opportunities or new roles. For example, I may have a bunch of backend engineers, if I know who's good in math and machine learning and statistics, I can actually tap those folks to transition over to machine learning roles. And so it's used both as an external signal and external labor market, as well as an internal signal within companies. >> And just our last question here, what advice would you give to young women who are either out of college or just starting college who are interested in data science? Who maybe, don't haven't majored in a typical data science major? What advice would you give to them? >> So, I love that you asked you haven't made it, majored in a typical data science major. I'm actually an economist by training. And I think that's probably the reason why I was at first rejected from Coursera because an economist is a very strange background to go into data science. I think my primary advice to those young women would be to really not get too lost in the data science, in the math, in the algorithms and instead to remember that those are a means to an end, and the end is impact. So, think about the problems in the world that you care about. For me, it's education. For others, it's health care, or personal finance or a range of other issues. And remember that data science provides this vast set of tools that you can use to solve the problems you care about most. >> That's great, thank you so much for being on theCUBE. >> Thank you. I'm Sonia Tagare, thank you so much for watching theCUBE and stay tuned for more. (upbeat music)