(plane engine roars) (upbeat music) >> They call me Dr. Goh. I'm Senior Vice President and Chief Technology Officer of AI at Hewlett Packard Enterprise. And today I'm in Munich, Germany. Home to one and a half million people. Munich is famous for everything from BMW, to beer, to breathtaking architecture and festive markets. The Bavarian capital is the beating heart of Germany's automobile industry. Over 50,000 of its residents work in automotive engineering, and to date, Munich allocated around 30 million euros to boost electric vehicles and infrastructure for them. (upbeat music) >> Hello, everyone, my name is Dr. Jerome Baudry. I am a professor at the University of Alabama in Huntsville. Our mission is to use a computational resources to accelerate the discovery of drugs that will be useful and efficient against the COVID-19 virus. On the one hand, there is this terrible crisis. And on the other hand, there is this absolutely unique and rare global effort to fight it. And that I think is a is a very positive thing. I am working with the Cray HPE machine called Sentinel. This machine is so amazing that it can actually mimic the screening of hundreds of thousands, almost millions of chemicals a day. What we take weeks, if not months, or years, we can do in a matter of a few days. And it's really the key to accelerating the discovery of new drugs, new pharmaceuticals. We are all in this together, thank you. (upbeat music) >> Hello, everyone. I'm so pleased to be here to interview Dr. Jerome Baudry, of the University of Alabama in Huntsville. >> Hello, Dr. Goh, I'm very happy to be meeting with you here, today. I have a lot of questions for you as well. And I'm looking forward to this conversation between us. >> Yes, yes, and I've got lots of COVID-19 and computational science questions lined up for you too Jerome. Yeah, so let's interview each other, then. >> Absolutely, let's do that, let's interview each other. I've got many questions for you. And , we have a lot in common and yet a lot of things we are addressing from a different point of view. So I'm very much looking forward to your ideas and insights. >> Yeah, especially now, with COVID-19, many of us will have to pivot a lot of our research and development work, to address the most current issues. I watch your video and I've seen that you're very much focused on drug discovery using super computing. The central notebook you did, I'm very excited about that. Can you tell us a bit more about how that works, yeah? >> Yes, I'd be happy to in fact, I watch your video as well manufacturing, and it's actually quite surprisingly close, what we do with drugs, and with what other people do with planes or cars or assembly lanes. we are calculating forces, on molecules, on drug candidates, when they hit parts of the viruses. And we essentially try to identify what small molecules will hit the viruses or its components, the hardest to mess with its function in a way. And that's not very different from what you're doing. What you are describing people in the industry or in the transportation industry are doing. So that's our problem, so to speak, is to deal with a lot of small molecules. Guy creating a lot of forces. That's not a main problem, our main problem is to make intelligent choices about what calculates, what kind of data should we incorporate in our calculations? And what kind of data should we give to the people who are going to do the testing? And that's really something I would like you to do to help us understand better. How do you see artificial intelligence, helping us, putting our hands on the right data to start with, in order to produce the right data and accuracy. >> Yeah, that's that's a great question. And it is a question that we've been pondering in our strategy as a company a lot recently. Because more and more now we realize that the data is being generated at the far out edge. By edge. I mean, something that's outside of the cloud and data center, right? Like, for example, a more recent COVID-19 work, doing a lot of cryo electron microscope work, right? To try and get high resolution pictures of the virus and at different angles, so creating lots of movies under electron microscope to try and create a 3D model of the virus. And we realize that's the edge, right, because that's where the microscope is, away from the data center. And massive amounts of data is generated, terabytes and terabytes of data per day generated. And we had to develop means, a workflow means to get that data off the microscope and provide pre-processing and processing, so that they can achieve results without delay. So we learned quite a few lessons there, right, especially trying to get the edge to be more intelligent, to deal with the onslaught of data coming in, from these devices. >> That's fantastic that you're saying that and that you're using this very example of cryo-EM, because that's the kind of data that feeds our computations. And indeed, we have found that it is very, very difficult to get the right cryo-EM data to us. Now we've been working with HPE supercomputer Sentinel, as you may know, for our COVID-19 work. So we have a lot of computational power. But we will be even faster and better, frankly, if we knew what kind of cryo-EM data to focus on. In fact, most of our discussions are based on not so much how to compute the forces of the molecules, which we do quite well on an HP supercomputer. But again, what cryo-EM 3D dimensional space to look at. And it's becoming almost a bottleneck. >> Have access to that. >> And we spend a lot of time, do you envision a point where AI will be able to help us, to make this kind of code almost live or at least as close to live as possible, as that that comes from the edge? How to pack it and not triage it, but prioritize it for the best possible computations on supercomputers? >> What a visionary question and desire, right? Like exactly the vision we have, right? Of course, the ultimate vision, you aim for the best, and that will be a real time stream of processed data coming off the microscope straight, providing your need, right? We are not there. Before this, we are far from there, right? But that's the aim, the ability to push more and more intelligence forward, so that by the time the data reaches you, it is what you need, right, without any further processing. And a lot of AI is applied there, particularly in cryo-EM where they do particle picking, right, they do a lot of active pictures and movies of the virus. And then what they do is, they rotate the virus a little bit, right? And then to try and figure out in all the different images in the movies, to try and pick the particles in there. And this is very much image processing that AI is very good at. So many different stages, application is made. The key thing, is to deal with the data that is flowing at this at this speed, and to get the data to you in the right form, that in time. So yes, that's the desire, right? >> It will be a game changer, really. You'll be able to get things in a matter of weeks, instead of a matter of years to the colleague who will be doing the best day. If the AI can help me learn from a calculation that didn't exactly turn out the way we want it to be, that will be very, very helpful. I can see, I can envision AI being able to, live AI to be able to really revolutionize all the process, not only from the discovery, but all the way to the clinical, to the patient, to the hospital. >> Well, that's a great point. In fact, I caught on to your term live AI. That's actually what we are trying to achieve. Although I have not used that term before. Perhaps I'll borrow it for next time. >> Oh please, by all means. >> You see, yes, we have done, I've been doing also recent work on gene expression data. So a vaccine, clinical trial, they have the blood, they get the blood from the volunteers after the first day. And then to run very, very fast AI analytics on the gene expression data that the one, the transcription data, before translation to emit amino acid. The transcription data is enormous. We're talking 30,000, 60,000 different items, transcripts, and how to use that high dimensional data to predict on day one, whether this volunteer will get an adverse event or will have a good antibody outcome, right? For efficacy. So yes, how to do it so quickly, right? To get the blood, go through an SA, right, get the transcript, and then run the analytics and AI to produce an outcome. So that's exactly what we're trying to achieve, yeah. Yes, I always emphasize that, ultimately, the doctor makes that decision. Yeah, AI only suggests based on the data, this is the likely outcome based on all the previous data that the machine has learned from, yeah. >> Oh, I agree, we wouldn't want the machine to decide the fate of the patient, but to assist the doctor or nurse making the decision that will be invaluable? And are you aware of any kind of industry that already is using this kind of live AI? And then, is there anything in, I don't know in sport or crowd control? Or is there any kind of industry? I will be curious to see who is ahead of us in terms of making this kind of a minute based decisions using AI? Yes, in fact, this is very pertinent question. We as In fact, COVID-19, lots of effort working on it, right? But now, industries and different countries are starting to work on returning to work, right, returning to their offices, returning to the factories, returning to the manufacturing plants, but yet, the employers need to reassure the employees that things, appropriate measures are taken for safety, but yet maintain privacy, right? So our Aruba organization actually developed a solution called contact location tracing inside buildings, inside factories, right? Why they built this, and needed a lot of machine learning methods in there to do very, very well, as you say, live AI right? To offer a solution? Well, let me describe the problem. The problem is, in certain countries, and certain states, certain cities where regulations require that, if someone is ill, right, you actually have to go in and disinfect the area person has been to, is a requirement. But if you don't know precisely where the ill person has been to, you actually disinfect the whole factory. And if you have that, if you do that, it becomes impractical and cost prohibitive for the company to keep operating profitably. So what they are doing today with Aruba is, that they carry this Bluetooth Low Energy tag, which is a quarter size, right? The reason they do that is, so that they extract the tag from the person, and then the system tracks, everybody, all the employees. We have one company, there's 10,000 employees, right? Tracks everybody with the tag. And if there is a person ill, immediately a floor plan is brought up with hotspots. And then you just targeted the cleaning services there. The same thing, contact tracing is also produced automatically, you could say, anybody that is come in contact with this person within two meters, and more than 15 minutes, right? It comes up the list. And we, privacy is our focused here. There's a separation between the tech and the person, on only restricted people are allowed to see the association. And then things like washrooms and all that are not tracked here. So yes, live AI, trying to make very, very quick decisions, right, because this affects people. >> Another question I have for you, if you have a minute, actually has to be the same thing. Though, it's more a question about hardware, about computer hardware purify may. We're having, we're spending a lot of time computing on number crunching giant machines, like Sentinel, for instance, which is a dream to use, but it's very good at something but when we pulled it off, also spent a lot of time moving back and forth, so data from clouds from storage, from AI processing, to the computing cycles back and forth, back and forth, did you envision an architecture, that will kind of, combine the hardware needed for a massively parallel calculations, kind of we are doing. And also very large storage, fast IO to be more AI friendly, so to speak. You see on the horizon, some kind of, I would say you need some machine, maybe it's to be determined, to be ambitious at times but something that, when the AI ahead plan in terms of passing the vector to the massively parallel side, yeah, that makes sense? >> Makes a lot of sense. And you ask it I know, because it is a tough problem to solve, as we always say, computation, right, is growing capability enormously. But bandwidth, you have to pay for, latency you sweat for, right? >> That's a very good >> So moving data is ultimately going to be the problem. >> It is. >> Yeah, and we've move the data a lot of times, right, >> You move back and forth, so many times >> Back and forth, back and forth, from the edge that's where you try to pre-process it, before you put it in storage, yeah. But then once it arrives in storage, you move it to memory to do some work and bring it back and move it memory again, right, and then that's what HPC, and then you put it back into storage, and then the AI comes in you, you do the learning, the other way around also. So lots of back and forth, right. So tough problem to solve. But more and more, we are looking at a new architecture, right? Currently, this architecture was built for the AI side first, but we're now looking and see how we can expand that. And this is that's the reason why we announced HPE Ezmeral Data Fabric. What it does is that, it takes care of the data, all the way from the edge point of view, the minute it is ingested at the edge, it is incorporated in the global namespace. So that eventually where the data arrives, lands at geographically one, or lands at, temperature, hot data, warm data or cold data, regardless of eventually where it lands at, this Data Fabric checks everything, from in a global namespace, in a unified way. So that's the first step. So that data is not seen as in different places, different pieces, it is a unified view of all the data, the minute that it does, Just start from the edge. >> I think it's important that we communicate that AI is purposed for good, A lot of sci-fi movies, unfortunately, showcase some psychotic computers or teams of evil scientists who want to take over the world. But how can we communicate better that it's a tool for a change, a tool for good? >> So key differences are I always point out is that, at least we have still judgment relative to the machine. And part of the reason we still have judgment is because our brain, logical center is automatically connected to our emotional center. So whatever our logic say is tempered by emotion, and whatever our emotion wants to act, wants to do, right, is tempered by our logic, right? But then AI machine is, many call them, artificial specific intelligence. They are just focused on that decision making and are not connected to other more culturally sensitive or emotionally sensitive type networks. They are focus networks. Although there are people trying to build them, right. That's this power, reason why with judgment, I always use the phrase, right, what's correct, is not always the right thing to do. There is a difference, right? We need to be there to be the last Judge of what's right, right? >> Yeah. >> So that says one of the the big thing, the other one, I bring up is that humans are different from machines, generally, in a sense that, we are highly subtractive. We, filter, right? Well, machine is highly accumulative today. So an AI machine they accumulate to bring in lots of data and tune the network, but our brains a few people realize, we've been working with brain researchers in our work, right? Between three and 30 years old, our brain actually goes through a pruning process of our connections. So for those of us like me after 30 it's done right. (laughs) >> Wait till you reach my age. >> Keep the brain active, because it prunes away connections you don't use, to try and conserve energy, right? I always say, remind our engineers about this point, about prunings because of energy efficiency, right? A slice of pizza drives our brain for three hours. (laughs) That's why, sometimes when I get need to get my engineers to work longer, I just offer them pizza, three more hours, >> Pizza is universal solution to our problems, absolutely. Food Indeed, indeed. There is always a need for a human consciousness. It's not just a logic, it's not like Mr. Spock in "Star Trek," who always speaks about logic but forgets the humanity aspect of it. >> Yes, yes, The connection between the the logic centers and emotional centers, >> You said it very well. Yeah, yeah and the thing is, sleep researchers are saying that when you don't get enough REM sleep, this connection is weakened. Therefore, therefore your decision making gets affected if you don't get enough sleep. So I was thinking, people do alcohol test breathalyzer test before they are allowed to operate sensitive or make sensitive decisions. Perhaps in the future, you have to check whether you have enough REM sleep before, >> It is. This COVID-19 crisis obviously problematic, and I wish it never happened, but there is something that I never experienced before is, how people are talking to each other, people like you and me, we have a lot in common. But I hear more about the industry outside of my field. And I talk a lot to people, like cryo-EM people or gene expression people, I would have gotten the data before and process it. Now, we have a dialogue across the board in all aspects of industry, science, and society. And I think that could be something wonderful that we should keep after we finally fix this bug. >> Yes. yes, yes. >> Right? >> Yes, that's that's a great point. In fact, it's something I've been thinking about, right, for employees, things have changed, because of COVID-19. But very likely, the change will continue, yeah? >> Right. Yes, yes, because there are a few positive outcomes. COVID-19 is a tough outcome. But there positive side of things, like communicating in this way, effectively. So we were part of the consortium that developed a natural language processing system in AI system that would allow you scientists to do, I can say, with the link to that website, allows you to do a query. So say, tell me the latest on the binding energy between the Sasko B2 virus like protein and the AC receptor. And then you will, it will give you a list of 10 answers, yeah? And give you a link to the papers that say, they say those answers. If you key that in today to NLP, you see 315 points -13.7 kcal per mole, which is right, I think the general consensus answer, and see a few that are highly out of out of range, right? And then when you go further, you realize those are the earlier papers. So I think this NLP system will be useful. (both chattering) I'm sorry, I didn't mean to interrupt, but I mentioned yesterday about it, because I have used that, and it's a game changer indeed, it is amazing, indeed. Many times by using this kind of intelligent conceptual, analyzes a very direct use, that indeed you guys are developing, I have found connections between facts, between clinical or pharmaceutical aspects of COVID-19. That I wasn't really aware of. So a it's a tool for creativity as well, I find it, it builds something. It just doesn't analyze what has been done, but it creates the connections, it creates a network of knowledge and intelligence. >> That's why three to 30 years old, when it stops pruning. >> I know, I know. (laughs) But our children are amazing, in that respect, they see things that we don't see anymore. they make connections that we don't necessarily think of, because we're used to seeing a certain way. And the eyes of a child, are bringing always something new, which I think is what AI could potentially bring here. So look, this is fascinating, really. >> Yes, yes, difference between filtering subtractive and the machine being accumulative. That's why I believe, the two working together, can have a stronger outcome if used properly. >> Absolutely. And I think that's how AI will be a force for good indeed. Obviously see, seems that we would have missed that would end up being very important. Well, we are very interested in or in our quest for drug discovery against COVID-19, we have been quite successful so far. We have accelerated the process by an order of magnitude. So we're having molecules that are being tested against the virus, otherwise, it would have taken maybe three or four years to get to that point. So first thing, we have been very fast. But we are very interested in natural products, that chemicals that come from plants, essentially. We found a way to mine, I don't want to say explore it, but leverage, that knowledge of hundreds of years of people documenting in a very historical way of what plants do against what diseases in different parts of the world. So that really has been a, not only very useful in our work, but a fantastic bridge to our common human history, basically. And second, yes, plants have chemicals. And of course we love chemicals. Every living cell has chemicals. The chemicals that are in plants, have been fine tuned by evolution to actually have some biological function. They are not there just to look good. They have a role in the cell. And if we're trying to come up with a new growth from scratch, which is also something we want to do, of course, then we have to engineer a function that evolution hasn't already found a solution to, for in plants, so in a way, it's also artificial intelligence. We have natural solutions to our problems, why don't we try to find them and see their work in ourselves, we're going to, and this is certainly have to reinvent the wheel each time. >> Hundreds of millions of years of evolution, >> Hundreds of millions of years. >> Many iterations, >> Yes, ending millions of different plants with all kinds of chemical diversity. So we have a lot of that, at our disposal here. If only we find the right way to analyze them, and bring them to our supercomputers, then we will, we will really leverage this humongus amount of knowledge. Instead of having to reinvent the wheel each time we want to take a car, we'll find that there are cars whose wheels already that we should be borrowing instead of, building one each time. Most of the keys are out there, if we can find them, They' re at our disposal. >> Yeah, nature has done the work after hundreds of millions of years. >> Yes. (chattering) Is to figure out, which is it, yeah? Exactly, exactly hence the importance of biodiversity. >> Yeah, I think this is related to the Knowledge Graph, right? Where, yes, to objects and the linking parameter, right? And then you have hundreds of millions of these right? A chemical to an outcome and the link to it, right? >> Yes, that's exactly what it is, absolutely the kind of things we're pursuing very much, so absolutely. >> Not only only building the graph, but building the dynamics of the graph, In the future, if you eat too much Creme Brulee, or if you don't run enough, or if you sleep, well, then your cells, will have different connections on this graph of the ages, will interact with that molecule in a different way than if you had more sleep or didn't eat that much Creme Brulee or exercise a bit more, >> So insightful, Dr. Baudry. Your, span of knowledge, right, impressed me. And it's such fascinating talking to you. (chattering) Hopefully next time, when we get together, we'll have a bit of Creme Brulee together. >> Yes, let's find out scientifically what it does, we have to do double blind and try three times to make sure we get the right statistics. >> Three phases, three clinical trial phases, right? >> It's been a pleasure talking to you. I like we agreed, you knows this, for all that COVID-19 problems, the way that people talk to each other is, I think the things that I want to keep in this in our post COVID-19 world. I appreciate very much your insight and it's very encouraging the way you see things. So let's make it happen. >> We will work together Dr.Baudry, hope to see you soon, in person. >> Indeed in person, yes. Thank you. >> Thank you, good talking to you.

>> Voice Over: Data is at the heart of transformation, and the change every company needs to succeed. But it takes more than new technology. It's about teams, talent and cultural change. Empowering everyone on the front lines to make decisions, all at the speed of digital. The transformation starts with you, it's time to lead the way, it's time for thought leaders. (soft upbeat music) >> Welcome to Thought.Leaders a digital event brought to you by ThoughtSpot, my name is Dave Vellante. The purpose of this day is to bring industry leaders and experts together to really try and understand the important issues around digital transformation. We have an amazing lineup of speakers, and our goal is to provide you with some best practices that you can bring back and apply to your organization. Look, data is plentiful, but insights are not, ThoughtSpot is disrupting analytics, by using search and machine intelligence to simplify data analysis and really empower anyone with fast access to relevant data. But in the last 150 days, we've had more questions than answers. Creating an organization that puts data and insights at their core, requires not only modern technology but leadership, a mindset and a culture, that people often refer to as data-driven. What does that mean? How can we equip our teams with data and fast access to quality information that can turn insights into action? And today we're going to hear from experienced leaders who are transforming their organizations with data, insights, and creating digital first cultures. But before we introduce our speakers, I'm joined today by two of my co-hosts from ThoughtSpot. First, chief data strategy officer of the ThoughtSpot is Cindi Howson, Cindi is an analytics and BI expert with 20 plus years experience, and the author of Successful Business Intelligence: Unlock the Value of BI & Big Data. Cindi was previously the lead analyst at Gartner for the data and analytics Magic Quadrant. In early last year, she joined ThoughtSpot to help CEOs and their teams understand how best to leverage analytics and AI for digital transformation. Cindi great to see you, welcome to the show. >> Thank you Dave, nice to join you virtually. >> Now our second cohost and friend of theCUBE is ThoughtSpot CEO Sudheesh Nair Hello Sudheesh, how are you doing today? >> I'm well, good to talk to you again. >> That's great to see you, thanks so much for being here. Now Sudheesh, please share with us why this discussion is so important to your customers and of course to our audience, and what they're going to learn today. (upbeat music) >> Thanks Dave, I wish you were there to introduce me into every room that I walk into because you have such an amazing way of doing it. It makes me feel also good. Look, since we have all been you know, cooped up in our homes, I know that the vendors like us, we have amped up our sort of effort to reach out to you with, invites for events like this. So we are getting very more invites for events like this than ever before. So when we started planning for this, we had three clear goals that we wanted to accomplish. And our first one, that when you finish this and walk away, we want to make sure that you don't feel like it was a waste of time, we want to make sure that we value your time, then this is going to be used. Number two, we want to put you in touch with industry leaders and thought leaders, generally good people, that you want to hang around with long after this event is over. And number three, as we plan through this, you know we are living through these difficult times we want this event to be more of an uplifting and inspiring event too. Now, the challenge is how do you do that with the team being change agents, because teens and as much as we romanticize it, it is not one of those uplifting things that everyone wants to do or likes to do. The way I think of it, changes sort of like, if you've ever done bungee jumping, and it's like standing on the edges, waiting to make that one more step you know, all you have to do is take that one step and gravity will do the rest, but that is the hardest step today. Change requires a lot of courage, and when we are talking about data and analytics, which is already like such a hard topic not necessarily an uplifting and positive conversation most businesses, it is somewhat scary, change becomes all the more difficult. Ultimately change requires courage, courage to first of all, challenge the status quo. People sometimes are afraid to challenge the status quo because they are thinking that you know, maybe I don't have the power to make the change that the company needs, sometimes they feel like I don't have the skills, sometimes they may feel that I'm probably not the right person to do it. Or sometimes the lack of courage manifest itself as the inability to sort of break the silos that are formed within the organizations when it comes to data and insights that you talked about. You know, that are people in the company who are going to have the data because they know how to manage the data, how to inquire and extract, they know how to speak data, they have the skills to do that. But they are not the group of people who have sort of the knowledge, the experience of the business to ask the right questions off the data. So there is the silo of people with the answers, and there is a silo of people with the questions, and there is gap, this sort of silos are standing in the way of making that necessary change that we all know the business needs. And the last change to sort of bring an external force sometimes. It could be a tool, it could be a platform, it could be a person, it could be a process but sometimes no matter how big the company is or how small the company is you may need to bring some external stimuli to start the domino of the positive changes that are necessary. The group of people that we are brought in, the four people, including Cindi that you will hear from today are really good at practically telling you how to make that step, how to step off that edge, how to dress the rope, that you will be safe and you're going to have fun, you will have that exhilarating feeling of jumping for a bungee jump, all four of them are exceptional, but my owner is to introduce Michelle. And she's our first speaker, Michelle I am very happy after watching our presentation and reading your bio that there are no country vital worldwide competition for cool parents, because she will beat all of us. Because when her children were small, they were probably into Harry Potter and Disney and she was managing a business and leading change there. And then as her kids grew up and got to that age where they like football and NFL, guess what? She's the CIO of NFL, what a cool mom. I am extremely excited to see what she's going to talk about. I've seen this slides, a bunch of amazing pictures, I'm looking to see the context behind it, I'm very thrilled to make that client so far, Michelle, I'm looking forward to her talk next. Welcome Michelle, it's over to you. (soft upbeat music) >> I'm delighted to be with you all today to talk about thought leadership. And I'm so excited that you asked me to join you because today I get to be a quarterback. I always wanted to be one, and I thought this is about as close as I'm ever going to get. So I want to talk to you about quarterbacking our digital revolution using insights data, and of course as you said, leadership. First a little bit about myself, a little background as I said, I always wanted to play football, and this is something that I wanted to do since I was a child, but when I grew up, girls didn't get to play football. I'm so happy that that's changing and girls are now doing all kinds of things that they didn't get to do before. Just this past weekend on an NFL field, we had a female coach on two sidelines, and a female official on the field. I'm a lifelong fan and student of the game of football, I grew up in the South, you can tell from the accent and in the South is like a religion and you pick sides. I chose Auburn University working in the Athletic Department, so I'm testament to you can start the journey can be long it took me many, many years to make it into professional sports. I graduated in 1987 and my little brother, well, not actually not so little, he played offensive line for the Alabama Crimson Tide. And for those of you who know SEC football you know, this is a really big rivalry. And when you choose sides, your family is divided, so it's kind of fun for me to always tell the story that my dad knew his kid would make it to the NFL he just bet on the wrong one. My career has been about bringing people together for memorable moments at some of America's most iconic brands. Delivering memories and amazing experiences that delight from Universal Studios, Disney to my current position as CIO of the NFL. In this job I'm very privileged to have the opportunity to work with the team, that gets to bring America's game to millions of people around the world. Often I'm asked to talk about how to create amazing experiences for fans, guests, or customers. But today I really wanted to focus on something different and talk to you about being behind the scenes and backstage. Because behind every event every game, every awesome moment is execution, precise repeatable execution. And most of my career has been behind the scenes, doing just that, assembling teams to execute these plans, and the key way that companies operate at these exceptional levels, is making good decisions, the right decisions at the right time and based upon data, so that you can translate the data into intelligence and be a data-driven culture. Using data and intelligence is an important way that world-class companies do differentiate themselves. And it's the lifeblood of collaboration and innovation. Teams that are working on delivering these kinds of world-class experiences are often seeking out and leveraging next generation technologies and finding new ways to work. I've been fortunate to work across three decades of emerging experiences, which each required emerging technologies to execute. A little bit first about Disney, in the 90s I was at Disney, leading a project called destination Disney, which it's a data project, it was a data project, but it was CRM before CRM was even cool. And then certainly before anything like a data-driven culture was ever brought up. But way back then we were creating a digital backbone that enabled many technologies for the things that you see today, like the magic band, just these magical express. My career at Disney began in finance, but Disney was very good about rotating you around, and it was during one of these rotations that I became very passionate about data. I kind of became a pain in the butt to the IT team, asking for data more and more data. And I learned that all of that valuable data was locked up in our systems, all of our point of sales systems, our reservation systems, our operation systems, and so I became a shadow IT person in marketing, ultimately leading to moving into IT, and I haven't looked back since. In the early 2000s I was at Universal Studios Theme Park as their CIO, preparing for and launching the wizarding world of Harry Potter. Bringing one of history's most memorable characters to life required many new technologies and a lot of data. Our data and technologies were embedded into the rides and attractions. I mean, how do you really think a wand selects you at a wine shop. As today at the NFL, I am constantly challenged to do leading edge technologies using things like sensors, AI, machine learning, and all new communication strategies, and using data to drive everything from player performance, contracts to where we build new stadiums and hold events. With this year being the most challenging, yet rewarding year in my career at the NFL. In the middle of a global pandemic, the way we are executing on our season is leveraging data from contract tracing devices joined with testing data. Talk about data, actually enabling your business without it we wouldn't be having a season right now. I'm also on the board of directors of two public companies, where data and collaboration are paramount. First RingCentral, it's a cloud based unified communications platform, and collaboration with video message and phone, all in one solution in the cloud. And Quotient Technologies, whose product is actually data. The tagline at quotient is the result in knowing. I think that's really important, because not all of us are data companies, where your product is actually data. But we should operate more like your product is data. I'd also like to talk to you about four areas of things to think about, as thought leaders in your companies. First just hit on it is change, how to be a champion and a driver of change. Second, how to use data to drive performance for your company, and measure performance of your company. Third, how companies now require intense collaboration to operate, and finally, how much of this is accomplished through solid data-driven decisions. First let's hit on change. I mean, it's evident today more than ever, that we are in an environment of extreme change. I mean, we've all been at this for years and as technologists we've known it, believed it, lived it, and thankfully for the most part knock on wood we were prepared for it. But this year everyone's cheese was moved, all the people in the back rooms, IT, data architects and others, were suddenly called to the forefront. Because a global pandemic has turned out to be the thing that is driving intense change in how people work and analyze their business. On March 13th, we closed our office at the NFL in the middle of preparing for one of our biggest events, our kickoff event, the 2020 Draft. We went from planning, a large event in Las Vegas under the bright lights red carpet stage to smaller events in club facilities. And then ultimately to one where everyone coaches, GMs, prospects and even our commissioner were at home in their basements. And we only had a few weeks to figure it out. I found myself for the first time being in the live broadcast event space, talking about bungee dress jumping, this is really what it felt like. It was one in which no one felt comfortable, because it had not been done before. But leading through this, I stepped up, but it was very scary, it was certainly very risky but it ended up being Oh, so rewarding when we did it. And as a result of this, some things will change forever. Second, managing performance. I mean, data should inform how you're doing and how to get your company to perform at this level, highest level. As an example, the NFL has always measured performance obviously, and it is one of the purest examples of how performance directly impacts outcome. I mean, you can see performance on the field, you can see points being scored and stats, and you immediately know that impact, those with the best stats, usually win the games. The NFL has always recorded stats, since the beginning of time, here at the NFL a little this year as our 100 and first year and athletes ultimate success as a player has also always been greatly impacted by his stats. But what has changed for us, is both how much more we can measure, and the immediacy with which it can be measured. And I'm sure in your business, it's the same, the amount of data you must have has got to have quadrupled recently and how fast you need it and how quickly you need to analyze it, is so important. And it's very important to break the silos between the keys to the data and the use of the data. Our next generation stats platform is taking data to a next level, it's powered by Amazon Web Services, and we gathered this data real time from sensors that are on players' bodies. We gather it in real time, analyze it, display it online and on broadcast, and of course it's used to prepare week to week in addition to what is a normal coaching plan would be. We can now analyze, visualize, route patterns speed, matchups, et cetera, so much faster than ever before. We're continuing to roll out sensors too, that we'll gather more and more information about player's performance as it relates to their health and safety. The third trend is really I think it's a big part of what we're feeling today and that is intense collaboration. And just for sort of historical purposes it's important to think about for those of you that are IT professionals and developers, you know more than 10 years ago, agile practices began sweeping companies or small teams would work together rapidly in a very flexible, adaptive and innovative way, and it proved to be transformational. However today, of course, that is no longer just small teams the next big wave of change, and we've seen it through this pandemic is that it's the whole enterprise that must collaborate and be agile. If I look back on my career when I was at Disney, we owned everything 100%, we made a decision, we implemented it, we were a collaborative culture but it was much easier to push change because you own the whole decision. If there was buy in from the top down, you got the people from the bottom up to do it, and you executed. At Universal, we were a joint venture, our attractions and entertainment was licensed, our hotels were owned and managed by other third parties. So influence and collaboration and how to share across companies became very important. And now here I am at the NFL and even the bigger ecosystem. We have 32 clubs that are all separate businesses 31 different stadiums that are owned by a variety of people. We have licensees, we have sponsors, we have broadcast partners. So it seems that as my career has evolved centralized control has gotten less and less and has been replaced by intense collaboration not only within your own company, but across companies. The ability to work in a collaborative way across businesses and even other companies that has been a big key to my success in my career. I believe this whole vertical integration and big top down decision making is going by the wayside in favor of ecosystems that require cooperation, yet competition to coexist. I mean the NFL is a great example of what we call coopertition, which is cooperation and competition. When in competition with each other, but we cooperate to make the company the best it can be. And at the heart of these items really are data-driven decisions and culture. Data on its own isn't good enough, you must be able to turn it to insights, partnerships between technology teams who usually hold the keys to the raw data, and business units who have the knowledge to build the right decision models is key. If you're not already involved in this linkage, you should be, data mining isn't new for sure. The availability of data is quadrupling and it's everywhere. How do you know what to even look at? How do you know where to begin? How do you know what questions to ask? It's by using the tools that are available for visualization and analytics and knitting together strategies of the company. So it begins with first of all making sure you do understand the strategy of the company. So in closing, just to wrap up a bit, many of you joined today looking for thought leadership on how to be a change agent, a change champion, and how to lead through transformation. Some final thoughts are be brave, and drive, don't do the ride along program, it's very important to drive, driving can be high risk but it's also high reward. Embracing the uncertainty of what will happen, is how you become brave, get more and more comfortable with uncertainty be calm and let data be your map on your journey, thanks. >> Michelle, thank you so much. So you and I share a love of data, and a love of football. You said you want to be the quarterback, I'm more an old wine person. (Michelle laughing) >> Well, then I can do my job without you. >> Great, and I'm getting the feeling now you know, Sudheesh is talking about bungee jumping. My boat is when we're past this pandemic, we both take them to the Delaware Water Gap and we do the cliff jumping. >> That sounds good, I'll watch. >> You'll watch, okay, so Michelle, you have so many stakeholders when you're trying to prioritize the different voices, you have the players, you have the owners you have the league, as you mentioned to the broadcasters your, your partners here and football mamas like myself. How do you prioritize when there's so many different stakeholders that you need to satisfy? I think balancing across stakeholders starts with aligning on a mission. And if you spend a lot of time understanding where everyone's coming from, and you can find the common thread ties them all together you sort of do get them to naturally prioritize their work, and I think that's very important. So for us at the NFL, and even at Disney, it was our core values and our core purpose is so well known, and when anything challenges that we're able to sort of lay that out. But as a change agent, you have to be very empathetic, and I would say empathy is probably your strongest skill if you're a change agent. And that means listening to every single stakeholder even when they're yelling at you, even when they're telling you your technology doesn't work and you know that it's user error, or even when someone is just emotional about what's happening to them and that they're not comfortable with it. So I think being empathetic and having a mission and understanding it, is sort of how I prioritize and balance. >> Yeah, empathy, a very popular word this year. I can imagine those coaches and owners yelling. So I thank you for your metership here. So Michelle, I look forward to discussing this more with our other customers and disruptors joining us in a little bit. (soft upbeat music) >> So we're going to take a hard pivot now and go from football to Chernobyl, Chernobyl, what went wrong? 1986, as the reactors were melting down they had the data to say, this is going to be catastrophic and yet the culture said, "No, we're perfect, hide it. Don't dare tell anyone," which meant they went ahead and had celebrations in Kiev. Even though that increased the exposure the additional thousands getting cancer, and 20,000 years before the ground around there and even be inhabited again, This is how powerful and detrimental a negative culture, a culture that is unable to confront the brutal facts that hides data. This is what we have to contend with, and this is why I want you to focus on having fostering a data-driven culture. I don't want you to be a laggard, I want you to be a leader in using data to drive your digital transformation. So I'll talk about culture and technology, isn't really two sides of the same coin, real-world impacts and then some best practices you can use to disrupt and innovate your culture. Now, oftentimes I would talk about culture and I talk about technology, and recently a CDO said to me, "You know Cindi, I actually think this is two sides of the same coin. One reflects the other, what do you think?" Let me walk you through this, so let's take a laggard. What is the technology look like? Is it based on 1990s BI and reporting largely parameterized reports on-premises data warehouses, or not even that operational reports, at best one enterprise data warehouse very slow moving and collaboration is only email. What does that culture tell you? Maybe there's a lack of leadership to change, to do the hard work that Sudheesh referred to. Or is there also a culture of fear, afraid of failure, resistance to change complacency and sometimes that complacency it's not because people are lazy, it's because they've been so beaten down every time a new idea is presented. It's like, no we're measured on least cost to serve. So politics and distrust, whether it's between business and IT or individual stakeholders is the norm. So data is hoarded, let's contrast that with a leader, a data and analytics leader, what is their technology look like? Augmented analytics, search and AI-driven insights not on-premises, but in the cloud and maybe multiple clouds. And the data is not in one place, but it's in a data lake, and in a data warehouse, a logical data warehouse. The collaboration is being a newer methods whether it's Slack or teams allowing for that real time decisioning or investigating a particular data point. So what is the culture in the leaders? It's transparent and trust, there is a trust that data will not be used to punish, that there is an ability to confront the bad news. It's innovation, valuing innovation in pursuit of the company goals, whether it's the best fan experience and player safety in the NFL or best serving your customers. It's innovative and collaborative. There's none of this, oh, well, I didn't invent that, I'm not going to look at that. There's still pride of ownership, but it's collaborating to get to a better place faster. And people feel empowered to present new ideas to fail fast, and they're energized, knowing that they're using the best technology and innovating at the pace that business requires. So data is democratized and democratized, not just for power users or analysts, but really at the point of impact what we like to call the new decision makers. Or really the frontline workers. So Harvard business review partnered with us to develop this study to say, just how important is this? They've been working at BI and analytics as an industry for more than 20 years. Why is it not at the front lines? Whether it's a doctor, a nurse, a coach, a supply chain manager a warehouse manager, a financial services advisor. 87% said they would be more successful if frontline workers were empowered with data-driven insights, but they recognize they need new technology to be able to do that. It's not about learning hard tools, the sad reality only 20% of organizations are actually doing this, these are the data-driven leaders. So this is the culture and technology, how did we get here? It's because state of the art keeps changing. So the first generation BI and analytics platforms were deployed on-premises, on small datasets really just taking data out of ERP systems that were also on-premises, and state of the art was maybe getting a management report, an operational report. Over time visual based data discovery vendors, disrupted these traditional BI vendors, empowering now analysts to create visualizations with the flexibility on a desktop, sometimes larger data sometimes coming from a data warehouse, the current state of the art though, Gartner calls it augmented analytics, at ThoughtSpot, we call it search and AI-driven analytics. And this was pioneered for large scale data sets, whether it's on-premises or leveraging the cloud data warehouses, and I think this is an important point. Oftentimes you, the data and analytics leaders, will look at these two components separately, but you have to look at the BI and analytics tier in lockstep with your data architectures to really get to the granular insights, and to leverage the capabilities of AI. Now, if you've never seen ThoughtSpot I'll just show you what this looks like, instead of somebody's hard coding a report, it's typing in search keywords and very robust keywords contains rank, top, bottom getting to a visualization that then can be pinned to an existing Pinboard that might also contain insights generated by an AI engine. So it's easy enough for that new decision maker, the business user, the non analyst to create themselves. Modernizing the data and analytics portfolio is hard, because the pace of change has accelerated. You used to be able to create an investment, place a bet for maybe 10 years. A few years ago, that time horizon was five years, now it's maybe three years, and the time to maturity has also accelerated. So you have these different components the search and AI tier, the data science tier, data preparation and virtualization. But I would also say equally important is the cloud data warehouse. And pay attention to how well these analytics tools can unlock the value in these cloud data warehouses. So ThoughtSpot was the first to market with search and AI-driven insights. Competitors have followed suit, but be careful if you look at products like Power BI or SAP Analytics Cloud, they might demo well, but do they let you get to all the data without moving it in products like Snowflake, Amazon Redshift or Azure Synapse or Google BigQuery, they do not. They require you to move it into a smaller in memory engine. So it's important how well these new products inter operate. The pace of change, it's acceleration, Gartner recently predicted that by 2022, 65% of analytical queries will be generated using search or NLP or even AI, and that is roughly three times the prediction they had just a couple years ago. So let's talk about the real world impact of culture. And if you've read any of my books or used any of the maturity models out there whether the Gartner IT score that I worked on, or the data warehousing institute also has a maturity model. We talk about these five pillars to really become data-driven, as Michelle spoke about, it's focusing on the business outcomes, leveraging all the data, including new data sources. It's the talent, the people, the technology, and also the processes, and often when I would talk about the people in the talent, I would lump the culture as part of that. But in the last year, as I've traveled the world and done these digital events for thought leaders you have told me now culture is absolutely so important. And so we've pulled it out as a separate pillar, and in fact, in polls that we've done in these events, look at how much more important culture is, as a barrier to becoming data-driven. It's three times as important as any of these other pillars. That's how critical it is, and let's take an example of where you can have great data but if you don't have the right culture there's devastating impacts. And I will say, I have been a loyal customer of Wells Fargo for more than 20 years, but look at what happened in the face of negative news with data, that said, "Hey, we're not doing good cross selling, customers do not have both a checking account and a credit card and a savings account and a mortgage." They opened fake accounts, facing billions in fines, change in leadership, that even the CEO attributed to a toxic sales culture, and they're trying to fix this. But even recently there's been additional employee backlash saying that culture has not changed. Let's contrast that with some positive examples, Medtronic a worldwide company in 150 countries around the world, they may not be a household name to you, but if you have a loved one or yourself, you have a pacemaker, spinal implant, diabetes you know, this brand. And at the start of COVID when they knew their business would be slowing down, because hospitals would only be able to take care of COVID patients, they took the bold move of making their IP for ventilators publicly available, that is the power of a positive culture. Or Verizon, a major telecom organization, looking at late payments of their customers, and even though the US federal government said "Well, you can't turn them off." They said, "We'll extend that even beyond the mandated guidelines," and facing a slow down in the business because of the tough economy, he said, "You know what? We will spend the time upskilling our people giving them the time to learn more about the future of work, the skills and data and analytics," for 20,000 of their employees, rather than furloughing them. That is the power of a positive culture. So how can you transform your culture to the best in class? I'll give you three suggestions, bring in a change agent identify the relevance, or I like to call it WIIFM, and organize for collaboration. So the CDO whatever your title is, chief analytics officer chief digital officer, you are the most important change agent. And this is where you will hear, that oftentimes a change agent has to come from outside the organization. So this is where, for example in Europe, you have the CDO of Just Eat takeout food delivery organization, coming from the airline industry or in Australia, National Australian Bank, taking a CDO within the same sector from TD Bank going to NAB. So these change agents come in disrupt, it's a hard job. As one of you said to me, it often feels like Sisyphus, I make one step forward and I get knocked down again, I get pushed back. It is not for the faint of heart, but it's the most important part of your job. The other thing I'll talk about is WIIFM, what is in it for me? And this is really about understanding the motivation, the relevance that data has for everyone on the frontline as well as those analysts, as well as the executives. So if we're talking about players in the NFL they want to perform better, and they want to stay safe. That is why data matters to them. If we're talking about financial services this may be a wealth management advisor, okay, we could say commissions, but it's really helping people have their dreams come true whether it's putting their children through college, or being able to retire without having to work multiple jobs still into your 70s or 80s. For the teachers, teachers, you asked them about data, they'll say, "We don't need that, I care about the student." So if you can use data to help a student perform better that is WIIFM. And sometimes we spend so much time talking the technology, we forget what is the value we're trying to deliver with it. And we forget the impact on the people that it does require change. In fact, the Harvard Business Review Study, found that 44% said lack of change management is the biggest barrier to leveraging both new technology but also being empowered to act on those data-driven insights. The third point, organize for collaboration. This does require diversity of thought, but also bringing the technology, the data and the business people together. Now there's not a single one size fits all model for data and analytics. At one point in time, even having a BICC, a BI Competency Center was considered state of the art. Now for the biggest impact, what I recommend is that you have a federated model, centralized for economies of scale, that could be the common data, but then in bed, these evangelists, these analysts of the future, within every business unit, every functional domain, and as you see this top bar, all models are possible but the hybrid model has the most impact, the most leaders. So as we look ahead to the months ahead, to the year ahead, an exciting time, because data is helping organizations better navigate a tough economy lock in the customer loyalty, and I look forward to seeing how you foster that culture that's collaborative with empathy and bring the best of technology, leveraging the cloud, all your data. So thank you for joining us at thought leaders, and next I'm pleased to introduce our first change agent Thomas Mazzaferro, chief data officer of Western Union, and before joining Western Union, Tom made his mark at HSBC and JP Morgan Chase spearheading digital innovation in technology operations, risk compliance, and retail banking. Tom, thank you so much for joining us today. (soft upbeat music) >> Very happy to be here and looking forward to talking to all of you today. So as we look to move organizations to a data-driven capability into the future, there is a lot that needs to be done on the data side, but also how does data connect and enable, different business teams and technology teams into the future. As we look across our data ecosystems and our platforms and how we modernize that to the cloud in the future, it all needs to basically work together, right? To really be able to drive over the shift from a data standpoint, into the future. That includes being able to have the right information with the right quality of data at the right time to drive informed business decisions, to drive the business forward. As part of that, we actually have partnered with ThoughtSpot to actually bring in the technology to help us drive that, as part of that partnership, and it's how we've looked to integrated into our overall business as a whole. We've looked at how do we make sure that our business and our professional lives, right? Are enabled in the same ways as our personal lives. So for example, in your personal lives, when you want to go and find something out, what do you do? You go on to google.com or you go on to Bing, or go to Yahoo and you search for what you want, search to find an answer. ThoughtSpot for us as the same thing, but in the business world. So using ThoughtSpot and other AI capability is allowed us to actually enable our overall business teams in our company, to actually have our information at our fingertips. So rather than having to go and talk to someone or an engineer to go pull information or pull data, we actually can have the end users or the business executives, right? Search for what they need, what they want, at the exact time that action needed, to go and drive the business forward. This is truly one of those transformational things that we've put in place. On top of that, we are on the journey to modernize our larger ecosystem as a whole. That includes modernizing our underlying data warehouses, our technology or our (indistinct) environments, and as we move that we've actually picked to our cloud providers going to AWS and GCP. We've also adopted Snowflake to really drive into organize our information and our data, then drive these new solutions and capabilities forward. So big portion of us though is culture, so how do we engage with the business teams and bring the IT teams together to really drive these holistic end to end solutions and capabilities, to really support the actual business into the future. That's one of the keys here, as we look to modernize and to really enhance our organizations to become data-driven, this is the key. If you can really start to provide answers to business questions before they're even being asked, and to predict based upon different economic trends or different trends in your business, what does is be made and actually provide those answers to the business teams before they're even asking for it. That is really becoming a data-driven organization. And as part of that, it's really then enables the business to act quickly and take advantage of opportunities as they come in based upon industries, based upon markets, based upon products, solutions, or partnerships into the future. These are really some of the keys that become crucial as you move forward right into this new age, especially with COVID, with COVID now taking place across the world, right? Many of these markets, many of these digital transformations are celebrating, and are changing rapidly to accommodate and to support customers in these very difficult times. As part of that, you need to make sure you have the right underlying foundation, ecosystems and solutions to really drive those capabilities, and those solutions forward. As we go through this journey, both of my career but also each of your careers into the future, right? It also needs to evolve, right? Technology has changed so drastically in the last 10 years, and that change is only a celebrating. So as part of that, you have to make sure that you stay up to speed, up to date with new technology changes both on the platform standpoint, tools, but also what our customers want, what do our customers need, and how do we then surface them with our information, with our data, with our platform, with our products and our services, to meet those needs and to really support and service those customers into the future. This is all around becoming a more data-driven organization such as how do you use your data to support the current business lines. But how do you actually use your information your data, to actually better support your customers better support your business, better support your employees, your operations teams and so forth, and really creating that full integration in that ecosystem is really when you start to get large dividends from these investments into the future. With that being said I hope you enjoyed the segment on how to become and how to drive a data-driven organization, and looking forward to talking to you again soon, thank you. >> Tom, that was great, thanks so much. Now I'm going to have to brag on you for a second, as a change agent you've come in disrupted, and how long have you been at Western Union? >> Only nine months, I just started this year, but there'd be some great opportunities and big changes, and we have a lot more to go, but we're really driving things forward in partnership with our business teams, and our colleagues to support those customers forward. >> Tom, thank you so much that was wonderful. And now I'm excited to introduce you to Gustavo Canton, a change agent that I've had the pleasure of working with meeting in Europe, and he is a serial change agent. Most recently with Schneider Electric, but even going back to Sam's Club, Gustavo welcome. (soft upbeat music) >> So hi everyone my name is Gustavo Canton and thank you so much Cindi for the intro. As you mentioned, doing transformations is a you know, high effort, high reward situation. I have empowerment in transformation and I have led many transformations. And what I can tell you is that it's really hard to predict the future, but if you have a North Star and you know where you're going, the one thing that I want you to take away from this discussion today, is that you need to be bold to evolve. And so in today, I'm going to be talking about culture and data, and I'm going to break this down in four areas. How do we get started barriers or opportunities as I see it, the value of AI, and also how do you communicate, especially now in the workforce of today with so many different generations, you need to make sure that you are communicating in ways that are nontraditional sometimes. And so how do we get started? So I think the answer to that is, you have to start for you, yourself as a leader and stay tuned. And by that, I mean you need to understand not only what is happening in your function or your field, but you have to be very into what is happening in society, socioeconomically speaking, wellbeing, you know, the common example is a great example. And for me personally, it's an opportunity because the number one core value that I have is wellbeing. I believe that for human potential, for customers and communities to grow, wellbeing should be at the center of every decision. And as somebody mentioned, it's great to be you know, stay in tune and have the skillset and the courage. But for me personally, to be honest to have this courage is not about not being afraid. You're always afraid when you're making big changes and your swimming upstream. But what gives me the courage is the empathy part, like I think empathy is a huge component because every time I go into an organization or a function, I try to listen very attentively to the needs of the business, and what the leaders are trying to do, what I do it thinking about the mission of how do I make change for the bigger, you know workforce so the bigger good, despite the fact that this might have a perhaps implication, so my own self interest in my career, right? Because you have to have that courage sometimes to make choices, that are not well seeing politically speaking what are the right thing to do, and you have to push through it. So the bottom line for me is that, I don't think they're transforming fast enough. And the reality is I speak with a lot of leaders and we have seen stories in the past, and what they show is that if you look at the four main barriers, that are basically keeping us behind budget, inability to add, cultural issues, politics, and lack of alignment, those are the top four. But the interesting thing is that as Cindi has mentioned, this topic about culture is actually gaining more and more traction, and in 2018, there was a story from HBR and it was for about 45%. I believe today, it's about 55%, 60% of respondents say that this is the main area that we need to focus on. So again, for all those leaders and all the executives who understand, and are aware that we need to transform, commit to the transformation and set us deadline to say, "Hey, in two years, we're going to make this happen, what do we need to do to empower and enable these search engines to make it happen?" You need to make the tough choices. And so to me, when I speak about being bold is about making the right choices now. So I'll give you samples of some of the roadblocks that I went through, as I think the intro information most recently as Cindi mentioned in Schneider. There are three main areas, legacy mindset, and what that means is that we've been doing this in a specific way for a long time, and here is how we have been successful. We're working the past is not going to work now, the opportunity there is that there is a lot of leaders who have a digital mindset, and their up and coming leaders that are perhaps not yet fully developed. We need to mentor those leaders and take bets on some of these talents, including young talent. We cannot be thinking in the past and just wait for people you know, three to five years for them to develop, because the world is going to in a way that is super fast. The second area and this is specifically to implementation of AI is very interesting to me, because just example that I have with ThoughtSpot, right? We went to an implementation and a lot of the way the IT team functions, so the leaders look at technology, they look at it from the prism of the prior or success criteria for the traditional BIs, and that's not going to work. Again, your opportunity here is that you need to really find what success look like, in my case, I want the user experience of our workforce to be the same as your experience you have at home. It's a very simple concept, and so we need to think about how do we gain that user experience with this augmented analytics tools, and then work backwards to have the right talent, processes and technology to enable that. And finally, and obviously with COVID a lot of pressure in organizations and companies to do more with less, and the solution that most leaders I see are taking is to just minimize cost sometimes and cut budget. We have to do the opposite, we have to actually invest some growth areas, but do it by business question. Don't do it by function, if you actually invest in these kind of solutions, if you actually invest on developing your talent, your leadership, to see more digitally, if you actually invest on fixing your data platform is not just an incremental cost, it's actually this investment is going to offset all those hidden costs and inefficiencies that you have on your system, because people are doing a lot of work in working very hard but it's not efficiency, and it's not working in the way that you might want to work. So there is a lot of opportunity there, and you just to put it into some perspective, there have been some studies in the past about you know, how do we kind of measure the impact of data? And obviously this is going to vary by organization, maturity there's going to be a lot of factors. I've been in companies who have very clean, good data to work with, and I think with companies that we have to start basically from scratch. So it all depends on your maturity level, but in this study what I think is interesting is, they try to put a tagline or attack price to what is a cost of incomplete data. So in this case, it's about 10 times as much to complete a unit of work, when you have data that is flawed as opposed to have imperfect data. So let me put that just in perspective, just as an example, right? Imagine you are trying to do something and you have to do 100 things in a project, and each time you do something it's going to cost you a dollar. So if you have perfect data, the total cost of that project might be a $100. But now let's say you have any percent perfect data and 20% flow data, by using this assumption that flow data is 10 times as costly as perfect data, your total costs now becomes $280 as opposed to $100, this just for you to really think about as a CIO, CTO, you know CSRO, CEO, are we really paying attention and really closing the gaps that we have on our infrastructure? If we don't do that, it's hard sometimes to see the snowball effect or to measure the overall impact, but as you can tell, the price tag goes up very, very quickly. So now, if I were to say, how do I communicate this? Or how do I break through some of these challenges or some of these barriers, right? I think the key is I am in analytics, I know statistics obviously, and love modeling and you know, data and optimization theory and all that stuff, that's what I can do analytics, but now as a leader and as a change agent, I need to speak about value, and in this case, for example for Schneider, there was this tagline coffee of your energy. So the number one thing that they were asking from the analytics team was actually efficiency, which to me was very interesting. But once I understood that I understood what kind of language to use, how to connect it to the overall strategy and basically how to bring in the right leaders, because you need to, you know, focus on the leaders that you're going to make the most progress. You know, again, low effort, high value, you need to make sure you centralize all the data as you can, you need to bring in some kind of augmented analytics, you know, solution, and finally you need to make it super simple for the you know, in this case, I was working with the HR teams and other areas, so they can have access to one portal. They don't have to be confused and looking for 10 different places to find information. I think if you can actually have those four foundational pillars, obviously under the guise of having a data-driven culture, that's when you can actually make the impact. So in our case, it was about three years total transformation but it was two years for this component of augmented analytics. It took about two years to talk to, you know, IT, get leadership support, find the budgeting, you know, get everybody on board, make sure the success criteria was correct. And we call this initiative, the people analytics, I pulled up, it was actually launched in July of this year. And we were very excited and the audience was very excited to do this. In this case, we did our pilot in North America for many, many manufacturers, but one thing that is really important is as you bring along your audience on this, you know, you're going from Excel, you know in some cases or Tableau to other tools like you know, ThoughtSpot, you need to really explain them, what is the difference, and how these two can truly replace some of the spreadsheets or some of the views that you might have on these other kind of tools. Again, Tableau, I think it's a really good tool, there are other many tools that you might have in your toolkit. But in my case, personally I feel that you need to have one portal going back to seeing these points that really truly enable the end user. And I feel that this is the right solution for us, right? And I will show you some of the findings that we had in the pilot in the last two months. So this was a huge victory, and I will tell you why, because it took a lot of effort for us to get to these stations. Like I said it's been years for us to kind of lay the foundation, get the leadership and chasing culture, so people can understand why you truly need to invest what I meant analytics. And so what I'm showing here is an example of how do we use basically, you know a tool to capturing video, the qualitative findings that we had, plus the quantitative insights that we have. So in this case, our preliminary results based on our ambition for three main metrics, hours saved, user experience and adoption. So for hours saved, our ambition was to have 10 hours per week per employee save on average, user experience or ambition was 4.5 and adoption 80%. In just two months, two months and a half of the pilot we were able to achieve five hours, per week per employee savings. I used to experience for 4.3 out of five, and adoption of 60%. Really, really amazing work. But again, it takes a lot of collaboration for us to get to the stage from IT, legal, communications obviously the operations things and the users, in HR safety and other areas that might be basically stakeholders in this whole process. So just to summarize this kind of effort takes a lot of energy, you are a change agent, you need to have a courage to make these decision and understand that, I feel that in this day and age with all this disruption happening, we don't have a choice. We have to take the risk, right? And in this case, I feel a lot of satisfaction in how we were able to gain all these very souls for this organization, and that gave me the confidence to know that the work has been done, and we are now in a different stage for the organization. And so for me it safe to say, thank you for everybody who has believed obviously in our vision, everybody who has believed in, you know, the word that we were trying to do and to make the life for, you know workforce or customers that are in community better. As you can tell, there is a lot of effort, there is a lot of collaboration that is needed to do something like this. In the end, I feel very satisfied with the accomplishments of this transformation, and I just want to tell for you, if you are going right now in a moment that you feel that you have to swim upstream you know, what would mentors what people in this industry that can help you out and guide you on this kind of a transformation is not easy to do is high effort but is well worth it. And with that said, I hope you are well and it's been a pleasure talking to you, talk to you soon, take care. >> Thank you Gustavo, that was amazing. All right, let's go to the panel. (soft upbeat music) >> I think we can all agree how valuable it is to hear from practitioners, and I want to thank the panel for sharing their knowledge with the community, and one common challenge that I heard you all talk about was bringing your leadership and your teams along on the journey with you. We talk about this all the time, and it is critical to have support from the top, why? Because it directs the middle, and then it enables bottoms up innovation effects from the cultural transformation that you guys all talked about. It seems like another common theme we heard, is that you all prioritize database decision making in your organizations, and you combine two of your most valuable assets to do that, and create leverage, employees on the front lines, and of course the data. That was rightly pointed out, Tom, the pandemic has accelerated the need for really leaning into this. You know, the old saying, if it ain't broke, don't fix it, well COVID's broken everything. And it's great to hear from our experts, you know, how to move forward, so let's get right into it. So Gustavo let's start with you if I'm an aspiring change agent, and let's say I'm a budding data leader. What do I need to start doing? What habits do I need to create for long lasting success? >> I think curiosity is very important. You need to be, like I say, in tune to what is happening not only in your specific field, like I have a passion for analytics, I can do this for 50 years plus, but I think you need to understand wellbeing other areas across not only a specific business as you know, I come from, you know, Sam's Club Walmart retail, I mean energy management technology. So you have to try to push yourself and basically go out of your comfort zone. I mean, if you are staying in your comfort zone and you want to use lean continuous improvement that's just going to take you so far. What you have to do is and that's what I tried to do is I try to go into areas, businesses and transformations that make me, you know stretch and develop as a leader. That's what I'm looking to do, so I can help transform the functions organizations, and do these change management and decisions mindset as required for these kinds of efforts. >> Thank you for that is inspiring and Cindi, you love data, and the data is pretty clear that diversity is a good business, but I wonder if you can add your perspectives to this conversation. >> Yeah, so Michelle has a new fan here because she has found her voice, I'm still working on finding mine. And it's interesting because I was raised by my dad, a single dad, so he did teach me how to work in a predominantly male environment. But why I think diversity matters more now than ever before, and this is by gender, by race, by age, by just different ways of working and thinking is because as we automate things with AI, if we do not have diverse teams looking at the data and the models, and how they're applied, we risk having bias at scale. So this is why I think I don't care what type of minority, you are finding your voice, having a seat at the table and just believing in the impact of your work has never been more important. And as Michelle said more possible >> Great perspectives thank you, Tom, I want to go to you. I mean, I feel like everybody in our businesses in some way, shape or form become a COVID expert but what's been the impact of the pandemic on your organization's digital transformation plans? >> We've seen a massive growth actually you know, in a digital business over the last 12 months really, even in celebration, right? Once COVID hit, we really saw that in the 200 countries and territories that we operate in today and service our customers and today, that there's been a huge need, right? To send money, to support family, to support friends and loved ones across the world. And as part of that, you know, we are very honored to support those customers that we across all the centers today. But as part of that celebration, we need to make sure that we had the right architecture and the right platforms to basically scale, right? To basically support and provide the right kind of security for our customers going forward. So as part of that, we did do some pivots and we did celebrate some of our plans on digital to help support that overall growth coming in, and to support our customers going forward. Because there were these times during this pandemic, right? This is the most important time, and we need to support those that we love and those that we care about. And in doing that, it's one of those ways is actually by sending money to them, support them financially. And that's where really are part of that our services come into play that, you know, I really support those families. So it was really a great opportunity for us to really support and really bring some of our products to this level, and supporting our business going forward. >> Awesome, thank you. Now I want to come back to Gustavo, Tom, I'd love for you to chime in too. Did you guys ever think like you were pushing the envelope too much and doing things with data or the technology that was just maybe too bold, maybe you felt like at some point it was failing, or you pushing your people too hard, can you share that experience and how you got through it? >> Yeah, the way I look at it is, you know, again, whenever I go to an organization I ask the question, Hey, how fast you would like to conform?" And, you know, based on the agreements on the leadership and the vision that we want to take place, I take decisions and I collaborate in a specific way. Now, in the case of COVID, for example, right? It forces us to remove silos and collaborate in a faster way, so to me it was an opportunity to actually integrate with other areas and drive decisions faster. But make no mistake about it, when you are doing a transformation, you are obviously trying to do things faster than sometimes people are comfortable doing and you need to be okay with that. Sometimes you need to be okay with tension, or you need to be okay, you know debating points or making repetitive business cases onto people connect with the decision because you understand, and you are seeing that, hey, the CEO is making a one, two year, you know, efficiency goal, the only way for us to really do more with less is for us to continue this path. We cannot just stay with the status quo, we need to find a way to accelerate transformation... >> How about you Tom, we were talking earlier was Sudheesh had said about that bungee jumping moment, what can you share? >> Yeah you know, I think you hit upon it. Right now, the pace of change will be the slowest pace that you see for the rest of your career. So as part of that, right? That's what I tell my team is that you need to feel comfortable being uncomfortable. I mean, that we have to be able to basically scale, right? Expand and support that the ever changing needs the marketplace and industry and our customers today and that pace of change that's happening, right? And what customers are asking for, and the competition the marketplace, it's only going to accelerate. So as part of that, you know, as we look at what how you're operating today in your current business model, right? Things are only going to get faster. So you have to plan into align, to drive the actual transformation, so that you can scale even faster into the future. So as part of that, so we're putting in place here, right? Is how do we create that underlying framework and foundation that allows the organization to basically continue to scale and evolve into the future? >> We're definitely out of our comfort zones, but we're getting comfortable with it. So, Cindi, last question, you've worked with hundreds of organizations, and I got to believe that you know, some of the advice you gave when you were at Gartner, which is pre COVID, maybe sometimes clients didn't always act on it. You know, they're not on my watch for whatever variety of reasons, but it's being forced on them now, but knowing what you know now that you know, we're all in this isolation economy how would you say that advice has changed, has it changed? What's your number one action and recommendation today? >> Yeah well, first off, Tom just freaked me out. What do you mean this is the slowest ever? Even six months ago, I was saying the pace of change in data and analytics is frenetic. So, but I think you're right, Tom, the business and the technology together is forcing this change. Now, Dave, to answer your question, I would say the one bit of advice, maybe I was a little more, very aware of the power in politics and how to bring people along in a way that they are comfortable, and now I think it's, you know what? You can't get comfortable. In fact, we know that the organizations that were already in the cloud, have been able to respond and pivot faster. So if you really want to survive as Tom and Gustavo said, get used to being uncomfortable, the power and politics are going to happen. Break the rules, get used to that and be bold. Do not be afraid to tell somebody they're wrong and they're not moving fast enough. I do think you have to do that with empathy as Michelle said, and Gustavo, I think that's one of the key words today besides the bungee jumping. So I want to know where's Sudheesh going to go on bungee jumping? (all chuckling) >> That's fantastic discussion really. Thanks again to all the panelists and the guests, it was really a pleasure speaking with you today. Really virtually all of the leaders that I've spoken to in theCUBE program recently, they tell me that the pandemic is accelerating so many things, whether it's new ways to work, we heard about new security models and obviously the need for cloud. I mean, all of these things are driving true enterprise wide digital transformation, not just as I said before lip service. And sometimes we minimize the importance and the challenge of building culture and in making this transformation possible. But when it's done right, the right culture is going to deliver tremendous results. Yeah, what does that mean getting it right? Everybody's trying to get it right. My biggest takeaway today, is it means making data part of the DNA of your organization. And that means making it accessible to the people in your organization that are empowered to make decisions that can drive you revenue, cut costs, speed, access to critical care, whatever the mission is of your organization. Data can create insights and informed decisions that drive value. Okay, let's bring back Sudheesh and wrap things up. Sudheesh please bring us home. >> Thank you, thank you Dave, thank you theCUBE team, and thanks goes to all of our customers and partners who joined us, and thanks to all of you for spending the time with us. I want to do three quick things and then close it off. The first thing is I want to summarize the key takeaways that I had from all four of our distinguished speakers. First, Michelle, I was simply put it, she said it really well, that is be brave and drive. Don't go for a drive along, that is such an important point. Often times, you know that I think that you have to do to make the positive change that you want to see happen. But you wait for someone else to do it, why not you? Why don't you be the one making that change happen? That's the thing that I picked up from Michelle's talk. Cindi talked about finding the importance of finding your voice, taking that chair, whether it's available or not and making sure that your ideas, your voices are heard and if it requires some force then apply that force, make sure your ideas are good. Gustavo talked about the importance of building consensus, not going at things all alone sometimes building the importance of building the courtroom. And that is critical because if you want the changes to last, you want to make sure that the organization is fully behind it. Tom instead of a single take away, what I was inspired by is the fact that a company that is 170 years old, 170 years old, 200 companies and 200 countries they're operating in, and they were able to make the change that is necessary through this difficult time. So in a matter of months, if they could do it, anyone could. The second thing I want to do is to leave you with a takeaway that is I would like you to go to thoughtspot.com/nfl because our team has made an app for NFL on Snowflake. I think you will find this interesting now that you are inspired and excited because of Michelle's talk. And the last thing is, please go to thoughtspot.com/beyond, our global user conferences happening in this December, we would love to have you join us. It's again, virtual, you can join from anywhere, we are expecting anywhere from five to 10,000 people, and we would love to have you join and see what we would have been up to since the last year. We have a lot of amazing things in store for you, our customers, our partners, our collaborators, they will be coming and sharing, you'll be sharing things that you have been working to release something that will come out next year. And also some of the crazy ideas for engineers I've been cooking up. All of those things will be available for you at ThoughtSpot Beyond, thank you, thank you so much.

(speaks in foreign language) >> Narrator: Data is at the heart of transformation and the change every company needs to succeed, but it takes more than new technology. It's about teams, talent, and cultural change. Empowering everyone on the front lines to make decisions, all at the speed of digital. The transformation starts with you. It's time to lead the way, it's time for thought leaders. >> Welcome to Thought Leaders, a digital event brought to you by ThoughtSpot. My name is Dave Vellante. The purpose of this day is to bring industry leaders and experts together to really try and understand the important issues around digital transformation. We have an amazing lineup of speakers and our goal is to provide you with some best practices that you can bring back and apply to your organization. Look, data is plentiful, but insights are not. ThoughtSpot is disrupting analytics by using search and machine intelligence to simplify data analysis, and really empower anyone with fast access to relevant data. But in the last 150 days, we've had more questions than answers. Creating an organization that puts data and insights at their core, requires not only modern technology, but leadership, a mindset and a culture that people often refer to as data-driven. What does that mean? How can we equip our teams with data and fast access to quality information that can turn insights into action. And today, we're going to hear from experienced leaders, who are transforming their organizations with data, insights and creating digital-first cultures. But before we introduce our speakers, I'm joined today by two of my co-hosts from ThoughtSpot. First, Chief Data Strategy Officer for ThoughtSpot is Cindi Hausen. Cindi is an analytics and BI expert with 20 plus years experience and the author of Successful Business Intelligence Unlock The Value of BI and Big Data. Cindi was previously the lead analyst at Gartner for the data and analytics magic quadrant. And early last year, she joined ThoughtSpot to help CDOs and their teams understand how best to leverage analytics and AI for digital transformation. Cindi, great to see you, welcome to the show. >> Thank you, Dave. Nice to join you virtually. >> Now our second cohost and friend of theCUBE is ThoughtSpot CEO Sudheesh Nair. Hello Sudheesh, how are you doing today? >> I am well Dave, it's good to talk to you again. >> It's great to see you. Thanks so much for being here. Now Sudheesh, please share with us why this discussion is so important to your customers and of course, to our audience and what they're going to learn today? (gentle music) >> Thanks, Dave, I wish you were there to introduce me into every room that I walk into because you have such an amazing way of doing it. It makes me feel also good. Look, since we have all been cooped up in our homes, I know that the vendors like us, we have amped up our, you know, sort of effort to reach out to you with invites for events like this. So we are getting way more invites for events like this than ever before. So when we started planning for this, we had three clear goals that we wanted to accomplish. And our first one that when you finish this and walk away, we want to make sure that you don't feel like it was a waste of time. We want to make sure that we value your time, and this is going to be useful. Number two, we want to put you in touch with industry leaders and thought leaders, and generally good people that you want to hang around with long after this event is over. And number three, as we plan through this, you know, we are living through these difficult times, we want an event to be, this event to be more of an uplifting and inspiring event too. Now, the challenge is, how do you do that with the team being change agents? Because change and as much as we romanticize it, it is not one of those uplifting things that everyone wants to do or likes to do. The way I think of it, change is sort of like, if you've ever done bungee jumping. You know, it's like standing on the edges, waiting to make that one more step. You know, all you have to do is take that one step and gravity will do the rest, but that is the hardest step to take. Change requires a lot of courage and when we are talking about data and analytics, which is already like such a hard topic, not necessarily an uplifting and positive conversation, in most businesses it is somewhat scary. Change becomes all the more difficult. Ultimately change requires courage. Courage to to, first of all, challenge the status quo. People sometimes are afraid to challenge the status quo because they are thinking that, "You know, maybe I don't have the power to make the change that the company needs. Sometimes I feel like I don't have the skills." Sometimes they may feel that, I'm probably not the right person to do it. Or sometimes the lack of courage manifest itself as the inability to sort of break the silos that are formed within the organizations, when it comes to data and insights that you talked about. You know, there are people in the company, who are going to hog the data because they know how to manage the data, how to inquire and extract. They know how to speak data, they have the skills to do that, but they are not the group of people who have sort of the knowledge, the experience of the business to ask the right questions off the data. So there is this silo of people with the answers and there is a silo of people with the questions, and there is gap. These sort of silos are standing in the way of making that necessary change that we all I know the business needs, and the last change to sort of bring an external force sometimes. It could be a tool, it could be a platform, it could be a person, it could be a process, but sometimes no matter how big the company is or how small the company is. You may need to bring some external stimuli to start that domino of the positive changes that are necessary. The group of people that we have brought in, the four people, including Cindi, that you will hear from today are really good at practically telling you how to make that step, how to step off that edge, how to trust the rope that you will be safe and you're going to have fun. You will have that exhilarating feeling of jumping for a bungee jump. All four of them are exceptional, but my honor is to introduce Michelle and she's our first speaker. Michelle, I am very happy after watching her presentation and reading her bio, that there are no country vital worldwide competition for cool patents, because she will beat all of us because when her children were small, you know, they were probably into Harry Potter and Disney and she was managing a business and leading change there. And then as her kids grew up and got to that age, where they like football and NFL, guess what? She's the CIO of NFL. What a cool mom. I am extremely excited to see what she's going to talk about. I've seen the slides with a bunch of amazing pictures, I'm looking to see the context behind it. I'm very thrilled to make the acquaintance of Michelle. I'm looking forward to her talk next. Welcome Michelle. It's over to you. (gentle music) >> I'm delighted to be with you all today to talk about thought leadership. And I'm so excited that you asked me to join you because today I get to be a quarterback. I always wanted to be one. This is about as close as I'm ever going to get. So, I want to talk to you about quarterbacking our digital revolution using insights, data and of course, as you said, leadership. First, a little bit about myself, a little background. As I said, I always wanted to play football and this is something that I wanted to do since I was a child but when I grew up, girls didn't get to play football. I'm so happy that that's changing and girls are now doing all kinds of things that they didn't get to do before. Just this past weekend on an NFL field, we had a female coach on two sidelines and a female official on the field. I'm a lifelong fan and student of the game of football. I grew up in the South. You can tell from the accent and in the South football is like a religion and you pick sides. I chose Auburn University working in the athletic department, so I'm testament. Till you can start, a journey can be long. It took me many, many years to make it into professional sports. I graduated in 1987 and my little brother, well not actually not so little, he played offensive line for the Alabama Crimson Tide. And for those of you who know SEC football, you know this is a really big rivalry, and when you choose sides your family is divided. So it's kind of fun for me to always tell the story that my dad knew his kid would make it to the NFL, he just bet on the wrong one. My career has been about bringing people together for memorable moments at some of America's most iconic brands, delivering memories and amazing experiences that delight. From Universal Studios, Disney, to my current position as CIO of the NFL. In this job, I'm very privileged to have the opportunity to work with a team that gets to bring America's game to millions of people around the world. Often, I'm asked to talk about how to create amazing experiences for fans, guests or customers. But today, I really wanted to focus on something different and talk to you about being behind the scenes and backstage. Because behind every event, every game, every awesome moment, is execution. Precise, repeatable execution and most of my career has been behind the scenes doing just that. Assembling teams to execute these plans and the key way that companies operate at these exceptional levels is making good decisions, the right decisions, at the right time and based upon data. So that you can translate the data into intelligence and be a data-driven culture. Using data and intelligence is an important way that world-class companies do differentiate themselves, and it's the lifeblood of collaboration and innovation. Teams that are working on delivering these kind of world class experiences are often seeking out and leveraging next generation technologies and finding new ways to work. I've been fortunate to work across three decades of emerging experiences, which each required emerging technologies to execute. A little bit first about Disney. In '90s I was at Disney leading a project called Destination Disney, which it's a data project. It was a data project, but it was CRM before CRM was even cool and then certainly before anything like a data-driven culture was ever brought up. But way back then we were creating a digital backbone that enabled many technologies for the things that you see today. Like the MagicBand, Disney's Magical Express. My career at Disney began in finance, but Disney was very good about rotating you around. And it was during one of these rotations that I became very passionate about data. I kind of became a pain in the butt to the IT team asking for data, more and more data. And I learned that all of that valuable data was locked up in our systems. All of our point of sales systems, our reservation systems, our operation systems. And so I became a shadow IT person in marketing, ultimately, leading to moving into IT and I haven't looked back since. In the early 2000s, I was at Universal Studio's theme park as their CIO preparing for and launching the Wizarding World of Harry Potter. Bringing one of history's most memorable characters to life required many new technologies and a lot of data. Our data and technologies were embedded into the rides and attractions. I mean, how do you really think a wand selects you at a wand shop. As today at the NFL, I am constantly challenged to do leading edge technologies, using things like sensors, AI, machine learning and all new communication strategies, and using data to drive everything, from player performance, contracts, to where we build new stadiums and hold events. With this year being the most challenging, yet rewarding year in my career at the NFL. In the middle of a global pandemic, the way we are executing on our season is leveraging data from contact tracing devices joined with testing data. Talk about data actually enabling your business. Without it we wouldn't be having a season right now. I'm also on the board of directors of two public companies, where data and collaboration are paramount. First, RingCentral, it's a cloud based unified communications platform and collaboration with video message and phone, all-in-one solution in the cloud and Quotient Technologies, whose product is actually data. The tagline at Quotient is The Result in Knowing. I think that's really important because not all of us are data companies, where your product is actually data, but we should operate more like your product is data. I'd also like to talk to you about four areas of things to think about as thought leaders in your companies. First, just hit on it, is change. how to be a champion and a driver of change. Second, how to use data to drive performance for your company and measure performance of your company. Third, how companies now require intense collaboration to operate and finally, how much of this is accomplished through solid data-driven decisions. First, let's hit on change. I mean, it's evident today more than ever, that we are in an environment of extreme change. I mean, we've all been at this for years and as technologists we've known it, believed it, lived it. And thankfully, for the most part, knock on wood, we were prepared for it. But this year everyone's cheese was moved. All the people in the back rooms, IT, data architects and others were suddenly called to the forefront because a global pandemic has turned out to be the thing that is driving intense change in how people work and analyze their business. On March 13th, we closed our office at the NFL in the middle of preparing for one of our biggest events, our kickoff event, The 2020 Draft. We went from planning a large event in Las Vegas under the bright lights, red carpet stage, to smaller events in club facilities. And then ultimately, to one where everyone coaches, GMs, prospects and even our commissioner were at home in their basements and we only had a few weeks to figure it out. I found myself for the first time, being in the live broadcast event space. Talking about bungee jumping, this is really what it felt like. It was one in which no one felt comfortable because it had not been done before. But leading through this, I stepped up, but it was very scary, it was certainly very risky, but it ended up being also rewarding when we did it. And as a result of this, some things will change forever. Second, managing performance. I mean, data should inform how you're doing and how to get your company to perform at its level, highest level. As an example, the NFL has always measured performance, obviously, and it is one of the purest examples of how performance directly impacts outcome. I mean, you can see performance on the field, you can see points being scored and stats, and you immediately know that impact. Those with the best stats usually win the games. The NFL has always recorded stats. Since the beginning of time here at the NFL a little... This year is our 101st year and athlete's ultimate success as a player has also always been greatly impacted by his stats. But what has changed for us is both how much more we can measure and the immediacy with which it can be measured and I'm sure in your business it's the same. The amount of data you must have has got to have quadrupled recently. And how fast do you need it and how quickly you need to analyze it is so important. And it's very important to break the silos between the keys to the data and the use of the data. Our next generation stats platform is taking data to the next level. It's powered by Amazon Web Services and we gather this data, real-time from sensors that are on players' bodies. We gather it in real time, analyze it, display it online and on broadcast. And of course, it's used to prepare week to week in addition to what is a normal coaching plan would be. We can now analyze, visualize, route patterns, speed, match-ups, et cetera, so much faster than ever before. We're continuing to roll out sensors too, that will gather more and more information about a player's performance as it relates to their health and safety. The third trend is really, I think it's a big part of what we're feeling today and that is intense collaboration. And just for sort of historical purposes, it's important to think about, for those of you that are IT professionals and developers, you know, more than 10 years ago agile practices began sweeping companies. Where small teams would work together rapidly in a very flexible, adaptive and innovative way and it proved to be transformational. However today, of course that is no longer just small teams, the next big wave of change and we've seen it through this pandemic, is that it's the whole enterprise that must collaborate and be agile. If I look back on my career, when I was at Disney, we owned everything 100%. We made a decision, we implemented it. We were a collaborative culture but it was much easier to push change because you own the whole decision. If there was buy-in from the top down, you got the people from the bottom up to do it and you executed. At Universal, we were a joint venture. Our attractions and entertainment was licensed. Our hotels were owned and managed by other third parties, so influence and collaboration, and how to share across companies became very important. And now here I am at the NFL an even the bigger ecosystem. We have 32 clubs that are all separate businesses, 31 different stadiums that are owned by a variety of people. We have licensees, we have sponsors, we have broadcast partners. So it seems that as my career has evolved, centralized control has gotten less and less and has been replaced by intense collaboration, not only within your own company but across companies. The ability to work in a collaborative way across businesses and even other companies, that has been a big key to my success in my career. I believe this whole vertical integration and big top-down decision-making is going by the wayside in favor of ecosystems that require cooperation, yet competition to co-exist. I mean, the NFL is a great example of what we call co-oppetition, which is cooperation and competition. We're in competition with each other, but we cooperate to make the company the best it can be. And at the heart of these items really are data-driven decisions and culture. Data on its own isn't good enough. You must be able to turn it to insights. Partnerships between technology teams who usually hold the keys to the raw data and business units, who have the knowledge to build the right decision models is key. If you're not already involved in this linkage, you should be, data mining isn't new for sure. The availability of data is quadrupling and it's everywhere. How do you know what to even look at? How do you know where to begin? How do you know what questions to ask? It's by using the tools that are available for visualization and analytics and knitting together strategies of the company. So it begins with, first of all, making sure you do understand the strategy of the company. So in closing, just to wrap up a bit, many of you joined today, looking for thought leadership on how to be a change agent, a change champion, and how to lead through transformation. Some final thoughts are be brave and drive. Don't do the ride along program, it's very important to drive. Driving can be high risk, but it's also high reward. Embracing the uncertainty of what will happen is how you become brave. Get more and more comfortable with uncertainty, be calm and let data be your map on your journey. Thanks. >> Michelle, thank you so much. So you and I share a love of data and a love of football. You said you want to be the quarterback. I'm more an a line person. >> Well, then I can't do my job without you. >> Great and I'm getting the feeling now, you know, Sudheesh is talking about bungee jumping. My vote is when we're past this pandemic, we both take him to the Delaware Water Gap and we do the cliff jumping. >> Oh that sounds good, I'll watch your watch. >> Yeah, you'll watch, okay. So Michelle, you have so many stakeholders, when you're trying to prioritize the different voices you have the players, you have the owners, you have the league, as you mentioned, the broadcasters, your partners here and football mamas like myself. How do you prioritize when there are so many different stakeholders that you need to satisfy? >> I think balancing across stakeholders starts with aligning on a mission and if you spend a lot of time understanding where everyone's coming from, and you can find the common thread that ties them all together. You sort of do get them to naturally prioritize their work and I think that's very important. So for us at the NFL and even at Disney, it was our core values and our core purpose is so well known and when anything challenges that, we're able to sort of lay that out. But as a change agent, you have to be very empathetic, and I would say empathy is probably your strongest skill if you're a change agent and that means listening to every single stakeholder. Even when they're yelling at you, even when they're telling you your technology doesn't work and you know that it's user error, or even when someone is just emotional about what's happening to them and that they're not comfortable with it. So I think being empathetic, and having a mission, and understanding it is sort of how I prioritize and balance. >> Yeah, empathy, a very popular word this year. I can imagine those coaches and owners yelling, so thank you for your leadership here. So Michelle, I look forward to discussing this more with our other customers and disruptors joining us in a little bit. >> (gentle music) So we're going to take a hard pivot now and go from football to Chernobyl. Chernobyl, what went wrong? 1986, as the reactors were melting down, they had the data to say, "This is going to be catastrophic," and yet the culture said, "No, we're perfect, hide it. Don't dare tell anyone." Which meant they went ahead and had celebrations in Kiev. Even though that increased the exposure, additional thousands getting cancer and 20,000 years before the ground around there can even be inhabited again. This is how powerful and detrimental a negative culture, a culture that is unable to confront the brutal facts that hides data. This is what we have to contend with and this is why I want you to focus on having, fostering a data-driven culture. I don't want you to be a laggard. I want you to be a leader in using data to drive your digital transformation. So I'll talk about culture and technology, is it really two sides of the same coin? Real-world impacts and then some best practices you can use to disrupt and innovate your culture. Now, oftentimes I would talk about culture and I talk about technology. And recently a CDO said to me, "You know, Cindi, I actually think this is two sides of the same coin, one reflects the other." What do you think? Let me walk you through this. So let's take a laggard. What does the technology look like? Is it based on 1990s BI and reporting, largely parametrized reports, on-premises data warehouses, or not even that operational reports. At best one enterprise data warehouse, very slow moving and collaboration is only email. What does that culture tell you? Maybe there's a lack of leadership to change, to do the hard work that Sudheesh referred to, or is there also a culture of fear, afraid of failure, resistance to change, complacency. And sometimes that complacency, it's not because people are lazy. It's because they've been so beaten down every time a new idea is presented. It's like, "No, we're measured on least to serve." So politics and distrust, whether it's between business and IT or individual stakeholders is the norm, so data is hoarded. Let's contrast that with the leader, a data and analytics leader, what does their technology look like? Augmented analytics, search and AI driven insights, not on-premises but in the cloud and maybe multiple clouds. And the data is not in one place but it's in a data lake and in a data warehouse, a logical data warehouse. The collaboration is via newer methods, whether it's Slack or Teams, allowing for that real-time decisioning or investigating a particular data point. So what is the culture in the leaders? It's transparent and trust. There is a trust that data will not be used to punish, that there is an ability to confront the bad news. It's innovation, valuing innovation in pursuit of the company goals. Whether it's the best fan experience and player safety in the NFL or best serving your customers, it's innovative and collaborative. There's none of this, "Oh, well, I didn't invent that. I'm not going to look at that." There's still pride of ownership, but it's collaborating to get to a better place faster. And people feel empowered to present new ideas, to fail fast and they're energized knowing that they're using the best technology and innovating at the pace that business requires. So data is democratized and democratized, not just for power users or analysts, but really at the point of impact, what we like to call the new decision-makers or really the frontline workers. So Harvard Business Review partnered with us to develop this study to say, "Just how important is this? We've been working at BI and analytics as an industry for more than 20 years, why is it not at the front lines? Whether it's a doctor, a nurse, a coach, a supply chain manager, a warehouse manager, a financial services advisor." 87% said they would be more successful if frontline workers were empowered with data-driven insights, but they recognize they need new technology to be able to do that. It's not about learning hard tools. The sad reality only 20% of organizations are actually doing this. These are the data-driven leaders. So this is the culture and technology, how did we get here? It's because state-of-the-art keeps changing. So the first generation BI and analytics platforms were deployed on-premises, on small datasets, really just taking data out of ERP systems that were also on-premises and state-of-the-art was maybe getting a management report, an operational report. Over time, visual based data discovery vendors disrupted these traditional BI vendors, empowering now analysts to create visualizations with the flexibility on a desktop, sometimes larger data, sometimes coming from a data warehouse. The current state-of-the-art though, Gartner calls it augmented analytics. At ThoughtSpot, we call it search and AI driven analytics, and this was pioneered for large scale data sets, whether it's on-premises or leveraging the cloud data warehouses. And I think this is an important point, oftentimes you, the data and analytics leaders, will look at these two components separately. But you have to look at the BI and analytics tier in lock-step with your data architectures to really get to the granular insights and to leverage the capabilities of AI. Now, if you've never seen ThoughtSpot, I'll just show you what this looks like. Instead of somebody hard coding a report, it's typing in search keywords and very robust keywords contains rank, top, bottom, getting to a visual visualization that then can be pinned to an existing pin board that might also contain insights generated by an AI engine. So it's easy enough for that new decision maker, the business user, the non-analyst to create themselves. Modernizing the data and analytics portfolio is hard because the pace of change has accelerated. You used to be able to create an investment, place a bet for maybe 10 years. A few years ago, that time horizon was five years. Now, it's maybe three years and the time to maturity has also accelerated. So you have these different components, the search and AI tier, the data science tier, data preparation and virtualization but I would also say, equally important is the cloud data warehouse. And pay attention to how well these analytics tools can unlock the value in these cloud data warehouses. So ThoughtSpot was the first to market with search and AI driven insights. Competitors have followed suit, but be careful, if you look at products like Power BI or SAP analytics cloud, they might demo well, but do they let you get to all the data without moving it in products like Snowflake, Amazon Redshift, or Azure Synapse, or Google BigQuery, they do not. They require you to move it into a smaller in-memory engine. So it's important how well these new products inter-operate. The pace of change, its acceleration, Gartner recently predicted that by 2022, 65% of analytical queries will be generated using search or NLP or even AI and that is roughly three times the prediction they had just a couple of years ago. So let's talk about the real world impact of culture and if you've read any of my books or used any of the maturity models out there, whether the Gartner IT Score that I worked on or the Data Warehousing Institute also has a maturity model. We talk about these five pillars to really become data-driven. As Michelle spoke about, it's focusing on the business outcomes, leveraging all the data, including new data sources, it's the talent, the people, the technology and also the processes. And often when I would talk about the people in the talent, I would lump the culture as part of that. But in the last year, as I've traveled the world and done these digital events for thought leaders. You have told me now culture is absolutely so important, and so we've pulled it out as a separate pillar. And in fact, in polls that we've done in these events, look at how much more important culture is as a barrier to becoming data-driven. It's three times as important as any of these other pillars. That's how critical it is. And let's take an example of where you can have great data, but if you don't have the right culture, there's devastating impacts. And I will say I have been a loyal customer of Wells Fargo for more than 20 years, but look at what happened in the face of negative news with data. It said, "Hey, we're not doing good cross-selling, customers do not have both a checking account and a credit card and a savings account and a mortgage." They opened fake accounts facing billions in fines, change in leadership that even the CEO attributed to a toxic sales culture and they're trying to fix this, but even recently there's been additional employee backlash saying the culture has not changed. Let's contrast that with some positive examples. Medtronic, a worldwide company in 150 countries around the world. They may not be a household name to you, but if you have a loved one or yourself, you have a pacemaker, spinal implant, diabetes, you know this brand. And at the start of COVID when they knew their business would be slowing down, because hospitals would only be able to take care of COVID patients. They took the bold move of making their IP for ventilators publicly available. That is the power of a positive culture. Or Verizon, a major telecom organization looking at late payments of their customers and even though the U.S. Federal Government said, "Well, you can't turn them off." They said, "We'll extend that even beyond the mandated guidelines," and facing a slow down in the business because of the tough economy, They said, "You know what? We will spend the time upskilling our people, giving them the time to learn more about the future of work, the skills and data and analytics for 20,000 of their employees rather than furloughing them. That is the power of a positive culture. So how can you transform your culture to the best in class? I'll give you three suggestions. Bring in a change agent, identify the relevance or I like to call it WIIFM and organize for collaboration. So the CDO, whatever your title is, Chief Analytics Officer, Chief Digital Officer, you are the most important change agent. And this is where you will hear that oftentimes a change agent has to come from outside the organization. So this is where, for example, in Europe you have the CDO of Just Eat, a takeout food delivery organization coming from the airline industry or in Australia, National Australian Bank taking a CDO within the same sector from TD Bank going to NAB. So these change agents come in, disrupt. It's a hard job. As one of you said to me, it often feels like. I make one step forward and I get knocked down again, I get pushed back. It is not for the faint of heart, but it's the most important part of your job. The other thing I'll talk about is WIIFM What's In It For Me? And this is really about understanding the motivation, the relevance that data has for everyone on the frontline, as well as those analysts, as well as the executives. So, if we're talking about players in the NFL, they want to perform better and they want to stay safe. That is why data matters to them. If we're talking about financial services, this may be a wealth management advisor. Okay, we could say commissions, but it's really helping people have their dreams come true, whether it's putting their children through college or being able to retire without having to work multiple jobs still into your 70s or 80s. For the teachers, teachers you ask them about data. They'll say, "We don't need that, I care about the student." So if you can use data to help a student perform better, that is WIIFM and sometimes we spend so much time talking the technology, we forget, what is the value we're trying to deliver with this? And we forget the impact on the people that it does require change. In fact, the Harvard Business Review study found that 44% said lack of change management is the biggest barrier to leveraging both new technology, but also being empowered to act on those data-driven insights. The third point, organize for collaboration. This does require diversity of thought, but also bringing the technology, the data and the business people together. Now there's not a single one size fits all model for data and analytics. At one point in time, even having a BICC, a BI competency center was considered state of the art. Now for the biggest impact, what I recommend is that you have a federated model centralized for economies of scale. That could be the common data, but then embed these evangelists, these analysts of the future within every business unit, every functional domain. And as you see this top bar, all models are possible, but the hybrid model has the most impact, the most leaders. So as we look ahead to the months ahead, to the year ahead, an exciting time because data is helping organizations better navigate a tough economy, lock in the customer loyalty and I look forward to seeing how you foster that culture that's collaborative with empathy and bring the best of technology, leveraging the cloud, all your data. So thank you for joining us at Thought Leaders. And next, I'm pleased to introduce our first change agent, Tom Mazzaferro Chief Data Officer of Western Union and before joining Western Union, Tom made his Mark at HSBC and JP Morgan Chase spearheading digital innovation in technology, operations, risk compliance and retail banking. Tom, thank you so much for joining us today. (gentle music) >> Very happy to be here and looking forward to talking to all of you today. So as we look to move organizations to a data-driven capability into the future, there is a lot that needs to be done on the data side, but also how does data connect and enable different business teams and the technology teams into the future? As we look across our data ecosystems and our platforms, and how we modernize that to the cloud in the future, it all needs to basically work together, right? To really be able to drive an organization from a data standpoint, into the future. That includes being able to have the right information with the right quality of data, at the right time to drive informed business decisions, to drive the business forward. As part of that, we actually have partnered with ThoughtSpot to actually bring in the technology to help us drive that. As part of that partnership and it's how we've looked to integrate it into our overall business as a whole. We've looked at, how do we make sure that our business and our professional lives, right? Are enabled in the same ways as our personal lives. So for example, in your personal lives, when you want to go and find something out, what do you do? You go onto google.com or you go onto Bing or you go onto Yahoo and you search for what you want, search to find an answer. ThoughtSpot for us is the same thing, but in the business world. So using ThoughtSpot and other AI capability is it's allowed us to actually enable our overall business teams in our company to actually have our information at our fingertips. So rather than having to go and talk to someone, or an engineer to go pull information or pull data. We actually can have the end users or the business executives, right. Search for what they need, what they want, at the exact time that they actually need it, to go and drive the business forward. This is truly one of those transformational things that we've put in place. On top of that, we are on a journey to modernize our larger ecosystem as a whole. That includes modernizing our underlying data warehouses, our technology, our... The local environments and as we move that, we've actually picked two of our cloud providers going to AWS and to GCP. We've also adopted Snowflake to really drive and to organize our information and our data, then drive these new solutions and capabilities forward. So a big portion of it though is culture. So how do we engage with the business teams and bring the IT teams together, to really help to drive these holistic end-to-end solutions and capabilities, to really support the actual business into the future. That's one of the keys here, as we look to modernize and to really enhance our organizations to become data-driven. This is the key. If you can really start to provide answers to business questions before they're even being asked and to predict based upon different economic trends or different trends in your business, what decisions need to be made and actually provide those answers to the business teams before they're even asking for it. That is really becoming a data-driven organization and as part of that, it really then enables the business to act quickly and take advantage of opportunities as they come in based upon industries, based upon markets, based upon products, solutions or partnerships into the future. These are really some of the keys that become crucial as you move forward, right, into this new age, Especially with COVID. With COVID now taking place across the world, right? Many of these markets, many of these digital transformations are celebrating and are changing rapidly to accommodate and to support customers in these very difficult times. As part of that, you need to make sure you have the right underlying foundation, ecosystems and solutions to really drive those capabilities and those solutions forward. As we go through this journey, both in my career but also each of your careers into the future, right? It also needs to evolve, right? Technology has changed so drastically in the last 10 years, and that change is only accelerating. So as part of that, you have to make sure that you stay up to speed, up to date with new technology changes, both on the platform standpoint, tools, but also what do our customers want, what do our customers need and how do we then service them with our information, with our data, with our platform, and with our products and our services to meet those needs and to really support and service those customers into the future. This is all around becoming a more data-driven organization, such as how do you use your data to support your current business lines, but how do you actually use your information and your data to actually better support your customers, better support your business, better support your employees, your operations teams and so forth. And really creating that full integration in that ecosystem is really when you start to get large dividends from these investments into the future. With that being said, I hope you enjoyed the segment on how to become and how to drive a data-driven organization, and looking forward to talking to you again soon. Thank you. >> Tom, that was great. Thanks so much and now going to have to drag on you for a second. As a change agent you've come in, disrupted and how long have you been at Western Union? >> Only nine months, so just started this year, but there have been some great opportunities to integrate changes and we have a lot more to go, but we're really driving things forward in partnership with our business teams and our colleagues to support those customers going forward. >> Tom, thank you so much. That was wonderful. And now, I'm excited to introduce you to Gustavo Canton, a change agent that I've had the pleasure of working with meeting in Europe and he is a serial change agent. Most recently with Schneider Electric but even going back to Sam's Clubs. Gustavo, welcome. (gentle music) >> So, hey everyone, my name is Gustavo Canton and thank you so much, Cindi, for the intro. As you mentioned, doing transformations is, you know, a high reward situation. I have been part of many transformations and I have led many transformations. And, what I can tell you is that it's really hard to predict the future, but if you have a North Star and you know where you're going, the one thing that I want you to take away from this discussion today is that you need to be bold to evolve. And so, in today, I'm going to be talking about culture and data, and I'm going to break this down in four areas. How do we get started, barriers or opportunities as I see it, the value of AI and also, how you communicate. Especially now in the workforce of today with so many different generations, you need to make sure that you are communicating in ways that are non-traditional sometimes. And so, how do we get started? So, I think the answer to that is you have to start for you yourself as a leader and stay tuned. And by that, I mean, you need to understand, not only what is happening in your function or your field, but you have to be very in tune what is happening in society socioeconomically speaking, wellbeing. You know, the common example is a great example and for me personally, it's an opportunity because the number one core value that I have is wellbeing. I believe that for human potential for customers and communities to grow, wellbeing should be at the center of every decision. And as somebody mentioned, it's great to be, you know, stay in tune and have the skillset and the courage. But for me personally, to be honest, to have this courage is not about not being afraid. You're always afraid when you're making big changes and you're swimming upstream, but what gives me the courage is the empathy part. Like I think empathy is a huge component because every time I go into an organization or a function, I try to listen very attentively to the needs of the business and what the leaders are trying to do. But I do it thinking about the mission of, how do I make change for the bigger workforce or the bigger good despite the fact that this might have perhaps implication for my own self interest in my career. Right? Because you have to have that courage sometimes to make choices that are not well seen, politically speaking, but are the right thing to do and you have to push through it. So the bottom line for me is that, I don't think we're they're transforming fast enough. And the reality is, I speak with a lot of leaders and we have seen stories in the past and what they show is that, if you look at the four main barriers that are basically keeping us behind budget, inability to act, cultural issues, politics and lack of alignment, those are the top four. But the interesting thing is that as Cindi has mentioned, these topic about culture is actually gaining more and more traction. And in 2018, there was a story from HBR and it was about 45%. I believe today, it's about 55%, 60% of respondents say that this is the main area that we need to focus on. So again, for all those leaders and all the executives who understand and are aware that we need to transform, commit to the transformation and set a deadline to say, "Hey, in two years we're going to make this happen. What do we need to do, to empower and enable these change agents to make it happen? You need to make the tough choices. And so to me, when I speak about being bold is about making the right choices now. So, I'll give you examples of some of the roadblocks that I went through as I've been doing transformations, most recently, as Cindi mentioned in Schneider. There are three main areas, legacy mindset and what that means is that, we've been doing this in a specific way for a long time and here is how we have been successful. What worked in the past is not going to work now. The opportunity there is that there is a lot of leaders, who have a digital mindset and they're up and coming leaders that are perhaps not yet fully developed. We need to mentor those leaders and take bets on some of these talents, including young talent. We cannot be thinking in the past and just wait for people, you know, three to five years for them to develop because the world is going in a way that is super-fast. The second area and this is specifically to implementation of AI. It's very interesting to me because just the example that I have with ThoughtSpot, right? We went on implementation and a lot of the way the IT team functions or the leaders look at technology, they look at it from the prism of the prior or success criteria for the traditional BIs, and that's not going to work. Again, the opportunity here is that you need to redefine what success look like. In my case, I want the user experience of our workforce to be the same user experience you have at home. It's a very simple concept and so we need to think about, how do we gain that user experience with these augmented analytics tools and then work backwards to have the right talent, processes, and technology to enable that. And finally and obviously with COVID, a lot of pressure in organizations and companies to do more with less. And the solution that most leaders I see are taking is to just minimize costs sometimes and cut budget. We have to do the opposite. We have to actually invest on growth areas, but do it by business question. Don't do it by function. If you actually invest in these kind of solutions, if you actually invest on developing your talent and your leadership to see more digitally, if you actually invest on fixing your data platform, it's not just an incremental cost. It's actually this investment is going to offset all those hidden costs and inefficiencies that you have on your system, because people are doing a lot of work and working very hard but it's not efficient and it's not working in the way that you might want to work. So there is a lot of opportunity there and just to put in terms of perspective, there have been some studies in the past about, you know, how do we kind of measure the impact of data? And obviously, this is going to vary by organization maturity, there's going to be a lot of factors. I've been in companies who have very clean, good data to work with and I've been with companies that we have to start basically from scratch. So it all depends on your maturity level. But in this study, what I think is interesting is they try to put a tagline or a tag price to what is the cost of incomplete data. So in this case, it's about 10 times as much to complete a unit of work when you have data that is flawed as opposed to having perfect data. So let me put that just in perspective, just as an example, right? Imagine you are trying to do something and you have to do 100 things in a project, and each time you do something, it's going to cost you a dollar. So if you have perfect data, the total cost of that project might be $100. But now let's say you have 80% perfect data and 20% flawed data. By using this assumption that flawed data is 10 times as costly as perfect data, your total costs now becomes $280 as opposed to $100. This just for you to really think about as a CIO, CTO, you know CHRO, CEO, "Are we really paying attention and really closing the gaps that we have on our data infrastructure?" If we don't do that, it's hard sometimes to see the snowball effect or to measure the overall impact, but as you can tell, the price tag goes up very, very quickly. So now, if I were to say, how do I communicate this or how do I break through some of these challenges or some of these barriers, right? I think the key is, I am in analytics, I know statistics obviously and love modeling, and, you know, data and optimization theory, and all that stuff. That's what I came to analytics, but now as a leader and as a change agent, I need to speak about value and in this case, for example, for Schneider. There was this tagline, make the most of your energy. So the number one thing that they were asking from the analytics team was actually efficiency, which to me was very interesting. But once I understood that, I understood what kind of language to use, how to connect it to the overall strategy and basically, how to bring in the right leaders because you need to, you know, focus on the leaders that you're going to make the most progress, you know. Again, low effort, high value. You need to make sure you centralize all the data as you can, you need to bring in some kind of augmented analytics, you know, solution. And finally, you need to make it super-simple for the, you know, in this case, I was working with the HR teams and other areas, so they can have access to one portal. They don't have to be confused and looking for 10 different places to find information. I think if you can actually have those four foundational pillars, obviously under the guise of having a data-driven culture, that's when you can actually make the impact. So in our case, it was about three years total transformation, but it was two years for this component of augmented analytics. It took about two years to talk to, you know, IT, get leadership support, find the budgeting, you know, get everybody on board, make sure the success criteria was correct. And we call this initiative, the people analytics portal. It was actually launched in July of this year and we were very excited and the audience was very excited to do this. In this case, we did our pilot in North America for many, many, many factors but one thing that is really important is as you bring along your audience on this, you know. You're going from Excel, you know, in some cases or Tableu to other tools like, you know, ThoughtSpot. You need to really explain them what is the difference and how this tool can truly replace some of the spreadsheets or some of the views that you might have on these other kinds of tools. Again, Tableau, I think it's a really good tool. There are other many tools that you might have in your toolkit but in my case, personally, I feel that you need to have one portal. Going back to Cindi's points, that really truly enable the end user. And I feel that this is the right solution for us, right? And I will show you some of the findings that we had in the pilot in the last two months. So this was a huge victory and I will tell you why, because it took a lot of effort for us to get to this stage and like I said, it's been years for us to kind of lay the foundation, get the leadership, initiating culture so people can understand, why you truly need to invest on augmented analytics. And so, what I'm showing here is an example of how do we use basically, you know, a tool to capturing video, the qualitative findings that we had, plus the quantitative insights that we have. So in this case, our preliminary results based on our ambition for three main metrics. Hours saved, user experience and adoption. So for hours saved, our ambition was to have 10 hours per week for employee to save on average. User experience, our ambition was 4.5 and adoption 80%. In just two months, two months and a half of the pilot, we were able to achieve five hours per week per employee savings, a user experience for 4.3 out of five and adoption of 60%. Really, really amazing work. But again, it takes a lot of collaboration for us to get to the stage from IT, legal, communications, obviously the operations things and the users. In HR safety and other areas that might be basically stakeholders in this whole process. So just to summarize, this kind of effort takes a lot of energy. You are a change agent, you need to have courage to make this decision and understand that, I feel that in this day and age with all this disruption happening, we don't have a choice. We have to take the risk, right? And in this case, I feel a lot of satisfaction in how we were able to gain all these great resource for this organization and that give me the confident to know that the work has been done and we are now in a different stage for the organization. And so for me, it's just to say, thank you for everybody who has belief, obviously in our vision, everybody who has belief in, you know, the work that we were trying to do and to make the life of our, you know, workforce or customers and community better. As you can tell, there is a lot of effort, there is a lot of collaboration that is needed to do something like this. In the end, I feel very satisfied with the accomplishments of this transformation and I just want to tell for you, if you are going right now in a moment that you feel that you have to swim upstream, you know, work with mentors, work with people in the industry that can help you out and guide you on this kind of transformation. It's not easy to do, it's high effort, but it's well worth it. And with that said, I hope you are well and it's been a pleasure talking to you. Talk to you soon. Take care. >> Thank you, Gustavo. That was amazing. All right, let's go to the panel. (light music) Now I think we can all agree how valuable it is to hear from practitioners and I want to thank the panel for sharing their knowledge with the community. Now one common challenge that I heard you all talk about was bringing your leadership and your teams along on the journey with you. We talk about this all the time and it is critical to have support from the top. Why? Because it directs the middle and then it enables bottoms up innovation effects from the cultural transformation that you guys all talked about. It seems like another common theme we heard is that you all prioritize database decision making in your organizations. And you combine two of your most valuable assets to do that and create leverage, employees on the front lines, and of course the data. Now as as you rightly pointed out, Tom, the pandemic has accelerated the need for really leaning into this. You know, the old saying, if it ain't broke, don't fix it, well COVID has broken everything and it's great to hear from our experts, you know, how to move forward, so let's get right into it. So Gustavo, let's start with you. If I'm an aspiring change agent and let's say I'm a budding data leader, what do I need to start doing? What habits do I need to create for long-lasting success? >> I think curiosity is very important. You need to be, like I said, in tune to what is happening, not only in your specific field, like I have a passion for analytics, I've been doing it for 50 years plus, but I think you need to understand wellbeing of the areas across not only a specific business. As you know, I come from, you know, Sam's Club, Walmart retail. I've been in energy management, technology. So you have to try to push yourself and basically go out of your comfort zone. I mean, if you are staying in your comfort zone and you want to just continuous improvement, that's just going to take you so far. What you have to do is, and that's what I try to do, is I try to go into areas, businesses and transformations, that make me, you know, stretch and develop as a leader. That's what I'm looking to do, so I can help transform the functions, organizations, and do the change management, the essential mindset that's required for this kind of effort. >> Well, thank you for that. That is inspiring and Cindi you love data and the data is pretty clear that diversity is a good business, but I wonder if you can, you know, add your perspectives to this conversation? >> Yeah, so Michelle has a new fan here because she has found her voice. I'm still working on finding mine and it's interesting because I was raised by my dad, a single dad, so he did teach me how to work in a predominantly male environment, but why I think diversity matters more now than ever before and this is by gender, by race, by age, by just different ways of working and thinking, is because as we automate things with AI, if we do not have diverse teams looking at the data, and the models, and how they're applied, we risk having bias at scale. So this is why I think I don't care what type of minority you are, finding your voice, having a seat at the table and just believing in the impact of your work has never been more important and as Michelle said, more possible. >> Great perspectives, thank you. Tom, I want to go to you. So, I mean, I feel like everybody in our businesses is in some way, shape, or form become a COVID expert, but what's been the impact of the pandemic on your organization's digital transformation plans? >> We've seen a massive growth, actually, in our digital business over the last 12 months really, even acceleration, right, once COVID hit. We really saw that in the 200 countries and territories that we operate in today and service our customers in today, that there's been a huge need, right, to send money to support family, to support friends, and to support loved ones across the world. And as part of that we are very honored to be able to support those customers that, across all the centers today, but as part of the acceleration, we need to make sure that we have the right architecture and the right platforms to basically scale, right? To basically support and provide the right kind of security for our customers going forward. So as part of that, we did do some pivots and we did accelerate some of our plans on digital to help support that overall growth coming in and to support our customers going forward, because during these times, during this pandemic, right, this is the most important time and we need to support those that we love and those that we care about. And doing that some of those ways is actually by sending money to them, support them financially. And that's where really our products and our services come into play that, you know, and really support those families. So, it was really a great opportunity for us to really support and really bring some of our products to the next level and supporting our business going forward. >> Awesome, thank you. Now, I want to come back to Gustavo. Tom, I'd love for you to chime in too. Did you guys ever think like you were pushing the envelope too much in doing things with data or the technology that it was just maybe too bold, maybe you felt like at some point it was failing, or you're pushing your people too hard? Can you share that experience and how you got through it? >> Yeah, the way I look at it is, you know, again, whenever I go to an organization, I ask the question, "Hey, how fast you would like to conform?" And, you know, based on the agreements on the leadership and the vision that we want to take place, I take decisions and I collaborate in a specific way. Now, in the case of COVID, for example, right, it forces us to remove silos and collaborate in a faster way. So to me, it was an opportunity to actually integrate with other areas and drive decisions faster, but make no mistake about it, when you are doing a transformation, you are obviously trying to do things faster than sometimes people are comfortable doing, and you need to be okay with that. Sometimes you need to be okay with tension or you need to be okay, you know, debating points or making repetitive business cases until people connect with the decision because you understand and you are seeing that, "Hey, the CEO is making a one, two year, you know, efficiency goal. The only way for us to really do more with less is for us to continue this path. We can not just stay with the status quo, we need to find a way to accelerate the transformation." That's the way I see it. >> How about Utah, we were talking earlier with Sudheesh and Cindi about that bungee jumping moment. What can you share? >> Yeah, you know, I think you hit upon it. Right now, the pace of change will be the slowest pace that you see for the rest of your career. So as part of that, right, this is what I tell my team, is that you need to be, you need to feel comfortable being uncomfortable. Meaning that we have to be able to basically scale, right? Expand and support the ever changing needs in the marketplace and industry and our customers today, and that pace of change that's happening, right? And what customers are asking for and the competition in the marketplace, it's only going to accelerate. So as part of that, you know, as you look at how you're operating today in your current business model, right? Things are only going to get faster. So you have to plan and to align and to drive the actual transformation, so that you can scale even faster into the future. So it's part of that, that's what we're putting in place here, right? It's how do we create that underlying framework and foundation that allows the organization to basically continue to scale and evolve into the future? >> Yeah, we're definitely out of our comfort zones, but we're getting comfortable with it. So Cindi, last question, you've worked with hundreds of organizations and I got to believe that, you know, some of the advice you gave when you were at Gartner, which was pre-COVID, maybe sometimes clients didn't always act on it. You know, not my watch or for whatever, variety of reasons, but it's being forced on them now. But knowing what you know now that, you know, we're all in this isolation economy, how would you say that advice has changed? Has it changed? What's your number one action and recommendation today? >> Yeah, well first off, Tom, just freaked me out. What do you mean, this is the slowest ever? Even six months ago I was saying the pace of change in data and analytics is frenetic. So, but I think you're right, Tom, the business and the technology together is forcing this change. Now, Dave, to answer your question, I would say the one bit of advice, maybe I was a little more very aware of the power in politics and how to bring people along in a way that they are comfortable and now I think it's, you know what, you can't get comfortable. In fact, we know that the organizations that were already in the cloud have been able to respond and pivot faster. So, if you really want to survive, as Tom and Gustavo said, get used to being uncomfortable. The power and politics are going to happen, break the rules, get used to that and be bold. Do not be afraid to tell somebody they're wrong and they're not moving fast enough. I do think you have to do that with empathy, as Michelle said and Gustavo, I think that's one of the key words today besides the bungee jumping. So I want to know where Sudheesh is going to go bungee jumping. (all chuckling) >> Guys, fantastic discussion, really. Thanks again to all the panelists and the guests, it was really a pleasure speaking with you today. Really, virtually all of the leaders that I've spoken to in theCUBE program recently, they tell me that the pandemic is accelerating so many things. Whether it's new ways to work, we heard about new security models and obviously the need for cloud. I mean, all of these things are driving true enterprise-wide digital transformation, not just as I said before, lip service. You know, sometimes we minimize the importance and the challenge of building culture and in making this transformation possible. But when it's done right, the right culture is going to deliver tournament results. You know, what does that mean? Getting it right. Everybody's trying to get it right. My biggest takeaway today is it means making data part of the DNA of your organization. And that means making it accessible to the people in your organization that are empowered to make decisions, decisions that can drive new revenue, cut costs, speed access to critical care, whatever the mission is of your organization, data can create insights and informed decisions that drive value. Okay, let's bring back Sudheesh and wrap things up. Sudheesh, please bring us home. >> Thank you, thank you, Dave. Thank you, theCUBE team, and thanks goes to all of our customers and partners who joined us, and thanks to all of you for spending the time with us. I want to do three quick things and then close it off. The first thing is I want to summarize the key takeaways that I heard from all four of our distinguished speakers. First, Michelle, I will simply put it, she said it really well. That is be brave and drive, don't go for a drive alone. That is such an important point. Often times, you know the right thing that you have to do to make the positive change that you want to see happen, but you wait for someone else to do it, not just, why not you? Why don't you be the one making that change happen? That's the thing that I picked up from Michelle's talk. Cindi talked about finding, the importance of finding your voice. Taking that chair, whether it's available or not, and making sure that your ideas, your voice is heard and if it requires some force, then apply that force. Make sure your ideas are heard. Gustavo talked about the importance of building consensus, not going at things all alone sometimes. The importance of building the quorum, and that is critical because if you want the changes to last, you want to make sure that the organization is fully behind it. Tom, instead of a single takeaway, what I was inspired by is the fact that a company that is 170 years old, 170 years old, 200 companies and 200 countries they're operating in and they were able to make the change that is necessary through this difficult time in a matter of months. If they could do it, anyone could. The second thing I want to do is to leave you with a takeaway, that is I would like you to go to ThoughtSpot.com/nfl because our team has made an app for NFL on Snowflake. I think you will find this interesting now that you are inspired and excited because of Michelle's talk. And the last thing is, please go to ThoughtSpot.com/beyond. Our global user conference is happening in this December. We would love to have you join us, it's, again, virtual, you can join from anywhere. We are expecting anywhere from five to 10,000 people and we would love to have you join and see what we've been up to since last year. We have a lot of amazing things in store for you, our customers, our partners, our collaborators, they will be coming and sharing. We'll be sharing things that we have been working to release, something that will come out next year. And also some of the crazy ideas our engineers have been cooking up. All of those things will be available for you at ThoughtSpot Beyond. Thank you, thank you so much.

>> Data is at the heart of transformation and the change every company needs to succeed, but it takes more than new technology. It's about teams, talent and cultural change. Empowering everyone on the front lines to make decisions all at the speed of digital. The transformation starts with you. It's time to lead the way it's time for Thought leaders. >> Welcome to "Thought Leaders" a digital event brought to you by ThoughtSpot. My name is Dave Vellante. The purpose of this day is to bring industry leaders and experts together to really try and understand the important issues around digital transformation. We have an amazing lineup of speakers and our goal is to provide you with some best practices that you can bring back and apply to your organization. Look, data is plentiful, but insights are not. ThoughtSpot is disrupting analytics by using search and machine intelligence to simplify data analysis and really empower anyone with fast access to relevant data. But in the last 150 days, we've had more questions than answers. Creating an organization that puts data and insights at their core requires not only modern technology, but leadership, a mindset and a culture that people often refer to as data-driven. What does that mean? How can we equip our teams with data and fast access to quality information that can turn insights into action. And today we're going to hear from experienced leaders who are transforming their organizations with data, insights and creating digital first cultures. But before we introduce our speakers, I'm joined today by two of my co-hosts from ThoughtSpot first chief data strategy officer at the ThoughtSpot is Cindi Howson. Cindi is an analytics and BI expert with 20 plus years experience and the author of "Successful Business Intelligence "Unlock the Value of BI & Big Data." Cindi was previously the lead analyst at Gartner for the data and analytics magic quadrant. And early last year, she joined ThoughtSpot to help CDOs and their teams understand how best to leverage analytics and AI for digital transformation. Cindi, great to see you welcome to the show. >> Thank you, Dave. Nice to join you virtually. >> Now our second cohost and friend of the cube is ThoughtSpot CEO Sudheesh Nair Hello, Sudheesh how are you doing today? >> I'm well Dave, it's good to talk to you again. >> It's great to see you thanks so much for being here. Now Sudheesh please share with us why this discussion is so important to your customers and of course, to our audience and what they're going to learn today. (upbeat music) >> Thanks, Dave. I wish you were there to introduce me into every room and that I walk into because you have such an amazing way of doing it. Makes me feel all so good. Look, since we have all been cooped up in our homes, I know that the vendors like us, we have amped up our sort of effort to reach out to you with invites for events like this. So we are getting very more invites for events like this than ever before. So when we started planning for this, we had three clear goals that we wanted to accomplish. And our first one that when you finish this and walk away, we want to make sure that you don't feel like it was a waste of time. We want to make sure that we value your time and this is going to be useful. Number two, we want to put you in touch with industry leaders and thought leaders, generally good people that you want to hang around with long after this event is over. And number three, as we plan through this, we are living through these difficult times. We want an event to be this event, to be more of an uplifting and inspiring event too. Now, the challenge is how do you do that with the team being change agents because change and as much as we romanticize it, it is not one of those uplifting things that everyone wants to do, or like to do. The way I think of it sort of like a, if you've ever done bungee jumping and it's like standing on the edges waiting to make that one more step, all you have to do is take that one step and gravity will do the rest, but that is the hardest step to take. Change requires a lot of courage. And when we are talking about data and analytics, which is already like such a hard topic, not necessarily an uplifting and positive conversation in most businesses, it is somewhat scary. Change becomes all the more difficult. Ultimately change requires courage. Courage to first of all challenge the status quo. People sometimes are afraid to challenge the status quo because they are thinking that maybe I don't have the power to make the change that the company needs. Sometimes they feel like I don't have the skills. Sometimes they may feel that I'm probably not the right person do it. Or sometimes the lack of courage manifest itself as the inability to sort of break the silos that are formed within the organizations, when it comes to data and insights that you talked about. There are people in the company who are going to hog the data because they know how to manage the data, how to inquire and extract. They know how to speak data. They have the skills to do that. But they are not the group of people who have sort of the knowledge, the experience of the business to ask the right questions off the data. So there is the silo of people with the answers, and there is a silo of people with the questions. And there is gap. This sort of silos are standing in the way of making that necessary change that we all know the business needs. And the last change to sort of bring an external force sometimes. It could be a tool. It could be a platform, it could be a person, it could be a process, but sometimes no matter how big the company is or how small the company is, you may need to bring some external stimuli to start the domino of the positive changes that are necessary. The group of people that we are brought in, the four people, including Cindi, that you will hear from today are really good at practically telling you how to make that step, how to step off that edge, how to dress the rope, that you will be safe and you're going to have fun. You will have that exhilarating feeling of jumping, for a bungee jump. All four of them are exceptional, but my honor is to introduce Michelle and she's our first speaker. Michelle, I am very happy after watching her presentation and reading our bio, that there are no country vital worldwide competition for cool patterns, because she will beat all of us because when her children were small, they were probably into Harry Potter and Disney. She was managing a business and leading change there. And then as her kids grew up and got to that age where they like football and NFL, guess what? She's the CIO of NFL. What a cool mom? I am extremely excited to see what she's going to talk about. I've seen the slides, tons of amazing pictures. I'm looking to see the context behind it. I'm very thrilled to make the acquaintance of Michelle and looking forward to her talk next. Welcome Michelle, it's over to you. (upbeat music) >> I'm delighted to be with you all today to talk about thought leadership. And I'm so excited that you asked me to join you because today I get to be a quarterback. I always wanted to be one. And I thought this is about as close as I'm ever going to get. So I want to talk to you about quarterbacking, our digital revolution using insights data. And of course, as you said, leadership, first a little bit about myself, a little background, as I said, I always wanted to play football. And this is something that I wanted to do since I was a child. But when I grew up, girls didn't get to play football. I'm so happy that that's changing and girls are now doing all kinds of things that they didn't get to do before. Just this past weekend on an NFL field, we had a female coach on two sidelines and a female official on the field. I'm a lifelong fan and student of the game of football. I grew up in the South. You can tell from the accent. And in the South football is like a religion and you pick sides. I chose Auburn university working in the athletic department. So I'm Testament to you can start the journey can be long. It took me many, many years to make it into professional sports. I graduated in 1987 and my little brother, well, not actually not so little. He played offensive line for the Alabama Crimson Tide. And for those of you who know SCC football, you know this is a really big rivalry. And when you choose sides, your family is divided. So it's kind of fun for me to always tell the story that my dad knew his kid would make it to the NFL. He just bet on the wrong one. My career has been about bringing people together for memorable moments at some of America's most iconic brands, delivering memories and amazing experiences that delight from Universal Studios, Disney to my current position as CIO of the NFL. In this job I'm very privileged to have the opportunity to work with the team that gets to bring America's game to millions of people around the world. Often I'm asked to talk about how to create amazing experiences for fans, guests, or customers. But today I really wanted to focus on something different and talk to you about being behind the scenes and backstage because behind every event, every game, every awesome moment is execution, precise, repeatable execution. And most of my career has been behind the scenes doing just that assembling teams to execute these plans. And the key way that companies operate at these exceptional levels is making good decisions, the right decisions at the right time and based upon data so that you can translate the data into intelligence and be a data-driven culture. Using data and intelligence is an important way that world-class companies do differentiate themselves. And it's the lifeblood of collaboration and innovation. Teams that are working on delivering these kinds of world casts experiences are often seeking out and leveraging next-generation technologies and finding new ways to work. I've been fortunate to work across three decades of emerging experiences, which each required emerging technologies to execute a little bit first about Disney in the 90s, I was at Disney leading a project called destination Disney, which it's a data project. It was a data project, but it was CRM before CRM was even cool. And then certainly before anything like a data-driven culture was ever brought up, but way back then we were creating a digital backbone that enabled many technologies for the things that you see today, like the magic band, Disney's magical express. My career at Disney began in finance, but Disney was very good about rotating you around. And it was during one of these rotations that I became very passionate about data. I kind of became a pain in the butt to the IT team asking for data more and more data. And I learned that all of that valuable data was locked up in our systems. All of our point of sales systems, our reservation systems, our operation systems. And so I became a shadow IT person in marketing, ultimately leading to moving into IT. And I haven't looked back since. In the early two thousands, I was at universal studios theme park as their CIO preparing for and launching "The Wizarding World of Harry Potter" bringing one of history's most memorable characters to life required many new technologies and a lot of data. Our data and technologies were embedded into the rides and attractions. I mean, how do you really think a wan selects you at a wan shop. As today at the NFL? I am constantly challenged to do leading edge technologies, using things like sensors, AI, machine learning, and all new communication strategies and using data to drive everything from player performance, contracts, to where we build new stadiums and hold events with this year being the most challenging yet rewarding year in my career at the NFL. In the middle of a global pandemic, the way we are executing on our season is leveraging data from contract tracing devices joined with testing data, talk about data, actually enabling your business without it w wouldn't be having a season right now. I'm also on the board of directors of two public companies where data and collaboration are paramount. First RingCentral, it's a cloud based unified communications platform and collaboration with video message and phone all in one solution in the cloud and Quotient technologies whose product is actually data. The tagline at Quotient is the result in knowing I think that's really important because not all of us are data companies where your product is actually data, but we should operate more like your product is data. I'd also like to talk to you about four areas of things to think about as thought leaders in your companies. First just hit on it is change how to be a champion and a driver of change. Second, how do you use data to drive performance for your company and measure performance of your company? Third, how companies now require intense collaboration to operate. And finally, how much of this is accomplished through solid data driven decisions. First let's hit on change. I mean, it's evident today more than ever, that we are in an environment of extreme change. I mean, we've all been at this for years and as technologists we've known it, believed it, lived it and thankfully for the most part, knock on what we were prepared for it. But this year everyone's cheese was moved. All the people in the back rooms, IT, data architects and others were suddenly called to the forefront because a global pandemic has turned out to be the thing that is driving intense change in how people work and analyze their business. On March 13th, we closed our office at the NFL in the middle of preparing for one of our biggest events, our kickoff event, the 2020 draft. We went from planning a large event in Las Vegas under the bright lights, red carpet stage to smaller events in club facilities. And then ultimately to one where everyone coaches GM's prospects and even our commissioner were at home in their basements. And we only had a few weeks to figure it out. I found myself for the first time being in the live broadcast event space, talking about bungee jumping. This is really what it felt like. It was one in which no one felt comfortable because it had not been done before. But leading through this, I stepped up, but it was very scary. It was certainly very risky, but it ended up being all so rewarding when we did it. And as a result of this, some things will change forever. Second, managing performance. I mean, data should inform how you're doing and how to get your company to perform at it's level. Highest level. As an example, the NFL has always measured performance, obviously, and it is one of the purest examples of how performance directly impacts outcome. I mean, you can see performance on the field. You can see points being scored in stats, and you immediately know that impact those with the best stats usually when the games. The NFL has always recorded stats since the beginning of time here at the NFL a little this year is our 101 year and athletes ultimate success as a player has also always been greatly impacted by his stats. But what has changed for us is both how much more we can measure and the immediacy with which it can be measured. And I'm sure in your business it's the same. The amount of data you must have has got to have quadrupled and how fast you need it and how quickly you need to analyze it is so important. And it's very important to break the silos between the keys, to the data and the use of the data. Our next generation stats platform is taking data to a next level. It's powered by Amazon web services. And we gathered this data real-time from sensors that are on players' bodies. We gather it in real time, analyze it, display it online and on broadcast. And of course it's used to prepare week to week in addition to what is a normal coaching plan would be. We can now analyze, visualize route patterns, speed match-ups, et cetera. So much faster than ever before. We're continuing to roll out sensors too that will gather more and more information about a player's performance as it relates to their health and safety. The third trend is really, I think it's a big part of what we're feeling today and that is intense collaboration. And just for sort of historical purposes, it's important to think about for those of you that are IT professionals and developers, more than 10 years ago, agile practices began sweeping companies where small teams would work together rapidly in a very flexible, adaptive, and innovative way. And it proved to be transformational. However, today, of course, that is no longer just small teams, the next big wave of change. And we've seen it through this pandemic is that it's the whole enterprise that must collaborate and be agile. If I look back on my career, when I was at Disney, we owned everything 100%. We made a decision, we implemented it. We were a collaborative culture, but it was much easier to push change because you own the whole decision. If there was buy-in from the top down, you've got the people from the bottom up to do it and you executed. At Universal we were a joint venture. Our attractions and entertainment was licensed. Our hotels were owned and managed by other third parties. So influence and collaboration and how to share across companies became very important. And now here I am at the NFL and even the bigger ecosystem, we have 32 clubs that are all separate businesses. 31 different stadiums that are owned by a variety of people. We have licensees, we have sponsors, we have broadcast partners. So it seems that as my career has evolved, centralized control has gotten less and less and has been replaced by intense collaboration, not only within your own company, but across companies. The ability to work in a collaborative way across businesses and even other companies that has been a big key to my success in my career. I believe this whole vertical integration and big top-down decision-making is going by the wayside in favor of ecosystems that require cooperation yet competition to co-exist. I mean, the NFL is a great example of what we call co-op petition, which is cooperation and competition. We're in competition with each other, but we cooperate to make the company the best it can be. And at the heart of these items really are data driven decisions and culture. Data on its own isn't good enough. You must be able to turn it to insights. Partnerships between technology teams who usually hold the keys to the raw data and business units who have the knowledge to build the right decision models is key. If you're not already involved in this linkage, you should be. Data mining isn't new for sure. The availability of data is quadrupling and it's everywhere. How do you know what to even look at? How do you know where to begin? How do you know what questions to ask it's by using the tools that are available for visualization and analytics and knitting together strategies of the company. So it begins with first of all, making sure you do understand the strategy of the company. So in closing, just to wrap up a bit, many of you joined today, looking for thought leadership on how to be a change agent, a change champion, and how to lead through transformation. Some final thoughts are be brave and drive. Don't do the ride along program. It's very important to drive. Driving can be high risk, but it's also high reward. Embracing the uncertainty of what will happen is how you become brave. Get more and more comfortable with uncertainty, be calm and let data be your map on your journey. Thanks. >> Michelle, tank you so much. So you and I share a love of data and a love of football. You said you want to be the quarterback. I'm more an old line person. (Michelle and Cindi laughing) >> Well, then I can do my job without you. >> Great. And I'm getting the feeling now, Sudheesh is talking about bungee jumping. My vote is when we're past this pandemic, we both take them to the Delaware water gap and we do the cliff jumping. >> That sounds good, I'll watch. >> Yeah, you'll watch, okay. So Michelle, you have so many stakeholders when you're trying to prioritize the different voices. You have the players, you have the owners, you have the league, as you mentioned, the broadcasters, your partners here and football mamas like myself. How do you prioritize when there's so many different stakeholders that you need to satisfy? >> I think balancing across stakeholders starts with, aligning on a mission. And if you spend a lot of time understanding where everyone's coming from, and you can find the common thread that ties them all together, you sort of do get them to naturally prioritize their work. And I think that's very important. So for us, at the NFL and even at Disney, it was our core values and our core purpose, is so well known and when anything challenges that we're able to sort of lay that out. But as a change agent, you have to be very empathetic. And I would say empathy is probably your strongest skill if you're a change agent. And that means listening to every single stakeholder, even when they're yelling at you, even when they're telling you your technology doesn't work and you know that it's user error, or even when someone is just emotional about what's happening to them and that they're not comfortable with it. So I think being empathetic and having a mission and understanding it is sort of how I prioritize and balance. >> Yeah, empathy, a very popular word this year. I can imagine those coaches and owners yelling. So, thank you for your leadership here. So Michelle, I look forward to discussing this more with our other customers and disruptors joining us in a little bit. (upbeat music) So we're going to take a hard pivot now and go from football to Chernobyl. Chernobyl what went wrong? 1986, as the reactors were melting down, they had the data to say, this is going to be catastrophic. And yet the culture said, "no, we're perfect, hide it. "Don't dare tell anyone." Which meant they went ahead and had celebrations in Kiev. Even though that increased the exposure, the additional thousands getting cancer and 20,000 years before the ground around there can even be inhabited again, this is how powerful and detrimental a negative culture, a culture that is unable to confront the brutal facts that hides data. This is what we have to contend with. And this is why I want you to focus on having, fostering a data-driven culture. I don't want you to be a laggard. I want you to be a leader in using data to drive your digital transformation. So I'll talk about culture and technology. Is it really two sides of the same coin, real-world impacts and then some best practices you can use to and innovate your culture. Now, oftentimes I would talk about culture and I talk about technology. And recently a CDO said to me, "Cindi, I actually think this is two sides "of the same coin. "One reflects the other." What do you think? Let me walk you through this. So let's take a laggard. What does the technology look like? Is it based on 1990s BI and reporting largely parametrized reports, on premises data, warehouses, or not even that operational reports at best one enterprise data warehouse, very slow moving and collaboration is only email. What does that culture tell you? Maybe there's a lack of leadership to change, to do the hard work that Sudheesh referred to, or is there also a culture of fear, afraid of failure, resistance to change complacency. And sometimes that complacency it's not because people are lazy. It's because they've been so beaten down every time a new idea is presented. It's like, no we're measured on least cost to serve. So politics and distrust, whether it's between business and IT or individual stakeholders is the norm. So data is hoarded. Let's contrast that with a leader, a data and analytics leader, what is their technology look like? Augmented analytics search and AI driven insights, not on premises, but in the cloud and maybe multiple clouds. And the data is not in one place, but it's in a data Lake and in a data warehouse, a logical data warehouse. The collaboration is being a newer methods, whether it's Slack or teams allowing for that real time decisioning or investigating a particular data point. So what is the culture in the leaders? It's transparent and trust. There is a trust that data will not be used to punish that there is an ability to confront the bad news. It's innovation, valuing innovation in pursuit of the company goals, whether it's the best fan experience and player safety in the NFL or best serving your customers. It's innovative and collaborative. There's none of this. Oh, well, I didn't invent that. I'm not going to look at that. There's still pride of ownership, but it's collaborating to get to a better place faster. And people feel empowered to present new ideas to fail fast, and they're energized knowing that they're using the best technology and innovating at the pace that business requires. So data is democratized. And democratized, not just for power users or analysts, but really at the point of impact what we like to call the new decision-makers or really the frontline workers. So Harvard business review partnered with us to develop this study to say, just how important is this? We've been working at BI and analytics as an industry for more than 20 years. Why is it not at the front lines? Whether it's a doctor, a nurse, a coach, a supply chain manager, a warehouse manager, a financial services advisor. Everyone said that if our 87% said, they would be more successful if frontline workers were empowered with data driven insights, but they recognize they need new technology to be able to do that. It's not about learning hard tools. The sad reality, only 20% of organizations are actually doing this. These are the data-driven leaders. So this is the culture in technology. How did we get here? It's because state-of-the-art keeps changing. So the first-generation BI and analytics platforms were deployed on premises on small datasets, really just taking data out of ERP systems that were also on premises. And state-of-the-art was maybe getting a management report, an operational report. Over time visual-based data discovery vendors disrupted these traditional BI vendors, empowering now analysts to create visualizations with the flexibility on a desktop, sometimes larger data, sometimes coming from a data warehouse. The current state of the art though, Gartner calls it augmented analytics at ThoughtSpot, we call it search and AI driven analytics. And this was pioneered for large scale datasets, whether it's on premises or leveraging the cloud data warehouses. And I think this is an important point. Oftentimes you, the data and analytics leaders will look at these two components separately, but you have to look at the BI and analytics tier in lockstep with your data architectures to really get to the granular insights and to leverage the capabilities of AI. Now, if you've never seen ThoughtSpot, I'll just show you what this looks like. Instead of somebody hard coding, a report it's typing in search keywords and very robust keywords contains rank top bottom, getting to a visual visualization that then can be pinned to an existing Pin board that might also contain insights generated by an AI engine. So it's easy enough for that new decision maker, the business user, the non analyst to create themselves. Modernizing the data and analytics portfolio is hard because the pace of change has accelerated. You use to be able to create an investment place a bet for maybe 10 years, a few years ago, that time horizon was five years, now it's maybe three years and the time to maturity has also accelerated. So you have these different components, the search and AI tier, the data science tier, data preparation and virtualization. But I would also say equally important is the cloud data warehouse and pay attention to how well these analytics tools can unlock the value in these cloud data warehouses. So ThoughtSpot was the first to market with search and AI driven insights. Competitors have followed suit, but be careful if you look at products like power BI or SAP analytics cloud, they might demo well, but do they let you get to all the data without moving it in products like Snowflake, Amazon Redshift, or Azure synapse or Google big query, they do not. They require you to move it into a smaller in memory engine. So it's important how well these new products inter operate. the pace of change, its acceleration Gartner recently predicted that by 2022, 65% of analytical queries will be generated using search or NLP or even AI. And that is roughly three times the prediction they had just a couple years ago. So let's talk about the real world impact of culture. And if you read any of my books or used any of the maturity models out there, whether the Gartner IT score that I worked on, or the data warehousing Institute also has the money surety model. We talk about these five pillars to really become data-driven. As Michelle, I spoke about it's focusing on the business outcomes, leveraging all the data, including new data sources, it's the talent, the people, the technology, and also the processes. And often when I would talk about the people and the talent, I would lump the culture as part of that. But in the last year, as I've traveled the world and done these digital events for Thought leaders, you have told me now culture is absolutely so important. And so we've pulled it out as a separate pillar. And in fact, in polls that we've done in these events, look at how much more important culture is as a barrier to becoming data-driven it's three times as important as any of these other pillars. That's how critical it is. And let's take an example of where you can have great data, but if you don't have the right culture, there's devastating impacts. And I will say, I have been a loyal customer of Wells Fargo for more than 20 years. But look at what happened in the face of negative news with data, it said, "hey, we're not doing good cross selling, "customers do not have both a checking account "and a credit card and a savings account and a mortgage." They opened fake accounts facing billions in fines, change in leadership that even the CEO attributed to a toxic sales culture, and they're trying to fix this. But even recently there's been additional employee backlash saying the culture has not changed. Let's contrast that with some positive examples, Medtronic, a worldwide company in 150 countries around the world. They may not be a household name to you, but if you have a loved one or yourself, you have a pacemaker, spinal implant diabetes, you know this brand. And at the start of COVID when they knew their business would be slowing down, because hospitals would only be able to take care of COVID patients. They took the bold move of making their IP for ventilators publicly available. That is the power of a positive culture. Or Verizon, a major telecom organization looking at late payments of their customers. And even though the U.S federal government said, "well, you can't turn them off. They said, "we'll extend that even beyond "the mandated guidelines." And facing a slow down in the business because of the tough economy, they said, you know what? "We will spend the time up skilling our people, "giving them the time to learn more "about the future of work, the skills and data "and analytics," for 20,000 of their employees, rather than furloughing them. That is the power of a positive culture. So how can you transform your culture to the best in class? I'll give you three suggestions, bring in a change agent, identify the relevance, or I like to call it WIFM and organize for collaboration. So the CDO, whatever your title is, chief analytics officer, chief digital officer, you are the most important change agent. And this is where you will hear that oftentimes a change agent has to come from outside the organization. So this is where, for example, in Europe, you have the CDO of Just Eat a takeout food delivery organization coming from the airline industry or in Australia, National Australian bank, taking a CDO within the same sector from TD bank going to NAB. So these change agents come in disrupt. It's a hard job. As one of you said to me, it often feels like Sisyphus. I make one step forward and I get knocked down again. I get pushed back. It is not for the faint of heart, but it's the most important part of your job. The other thing I'll talk about is WIFM. What is in it for me? And this is really about understanding the motivation, the relevance that data has for everyone on the frontline, as well as those analysts, as well as the executives. So if we're talking about players in the NFL, they want to perform better and they want to stay safe. That is why data matters to them. If we're talking about financial services, this may be a wealth management advisor. Okay we could say commissions, but it's really helping people have their dreams come true, whether it's putting their children through college or being able to retire without having to work multiple jobs still into your 70s or 80s for the teachers, teachers, you ask them about data. They'll say we don't, we don't need that. I care about the student. So if you can use data to help a student perform better, that is WIFM. And sometimes we spend so much time talking the technology, we forget what is the value we're trying to deliver with it. And we forget the impact on the people that it does require change. In fact, the Harvard business review study found that 44% said lack of change management is the biggest barrier to leveraging both new technology, but also being empowered to act on those data-driven insights. The third point organize for collaboration. This does require diversity of thought, but also bringing the technology, the data and the business people together. Now there's not a single one size fits all model for data and analytics. At one point in time, even having a BICC, a BI competency center was considered state-of-the-art. Now for the biggest impact what I recommend is that you have a federated model centralized for economies of scale. That could be the common data, but then in bed, these evangelists, these analysts of the future within every business unit, every functional domain. And as you see this top bar, all models are possible, but the hybrid model has the most impact, the most leaders. So as we look ahead to the months ahead, to the year ahead an exciting time, because data is helping organizations better navigate a tough economy, lock in the customer loyalty. And I look forward to seeing how you foster that culture that's collaborative with empathy and bring the best of technology, leveraging the cloud, all your data. So thank you for joining us at Thought Leaders. And next I'm pleased to introduce our first change agent, Tom Mazzaferro chief data officer of Western union. And before joining Western union, Tom made his Mark at HSBC and JPMorgan Chase spearheading digital innovation in technology, operations, risk compliance, and retail banking. Tom, thank you so much for joining us today. (upbeat music) >> Very happy to be here and looking forward to talking to all of you today. So as we look to move organizations to a data-driven, capability into the future, there is a lot that needs to be done on the data side, but also how does data connect and enable different business teams and technology teams into the future. As you look across, our data ecosystems and our platforms and how we modernize that to the cloud in the future, it all needs to basically work together, right? To really be able to drive and over the shift from a data standpoint, into the future, that includes being able to have the right information with the right quality of data, at the right time to drive informed business decisions, to drive the business forward. As part of that, we actually have partnered with ThoughtSpot, to actually bring in the technology to help us drive that as part of that partnership. And it's how we've looked to integrate it into our overall business as a whole we've looked at how do we make sure that our business and our professional lives right, are enabled in the same ways as our personal lives. So for example, in your personal lives, when you want to go and find something out, what do you do? You go onto google.com or you go on to Bing we go onto Yahoo and you search for what you want search to find and answer. ThoughtSpot for us as the same thing, but in the business world. So using ThoughtSpot and other AI capability it's allowed us to actually, enable our overall business teams in our company to actually have our information at our fingertips. So rather than having to go and talk to someone or an engineer to go pull information or pull data, we actually can have the end-users or the business executives, right. Search for what they need, what they want at the exact time that action need it to go and drive the business forward. This is truly one of those transformational things that we've put in place. On top of that, we are on the journey to modernize our larger ecosystem as a whole. That includes modernizing our underlying data warehouses, our technology, or our Eloqua environments. And as we move that, we've actually picked two of our cloud providers going to AWS and GCP. We've also adopted Snowflake to really drive and to organize our information and our data then drive these new solutions and capabilities forward. So they portion of us though is culture. So how do we engage with the business teams and bring the IT teams together to really drive these holistic end to end solutions and capabilities to really support the actual business into the future? That's one of the keys here, as we look to modernize and to really enhance our organizations to become data-driven, this is the key. If you can really start to provide answers to business questions before they're even being asked and to predict based upon different economic trends or different trends in your business, what does this is maybe be made and actually provide those answers to the business teams before they're even asking for it, that is really becoming a data-driven organization. And as part of that, it's really then enables the business to act quickly and take advantage of opportunities as they come in based upon, industries based upon markets, based upon products, solutions, or partnerships into the future. These are really some of the keys that become crucial as you move forward, right, into this new age, especially with COVID. With COVID now taking place across the world, right? Many of these markets, many of these digital transformations are accelerating and are changing rapidly to accommodate and to support customers in these very difficult times, as part of that, you need to make sure you have the right underlying foundation ecosystems and solutions to really drive those capabilities and those solutions forward. As we go through this journey, both of my career, but also each of your careers into the future, right? It also needs to evolve, right? Technology has changed so drastically in the last 10 years, and that change is only accelerating. So as part of that, you have to make sure that you stay up to speed, up to date with new technology changes both on the platform standpoint tools, but also what do our customers want? What do our customers need and how do we then service them with our information, with our data, with our platform and with our products and our services to meet those needs and to really support and service those customers into the future. This is all around becoming a more data organization such as how do you use your data to support the current business lines, but how do you actually use your information, your data to actually put a better support your customers, better support your business, better support your employees, your operations teams, and so forth, and really creating that full integration in that ecosystem is really when you start to get large dividends from this investments into the future. But that being said, hope you enjoy the segment on how to become and how to drive it data driven organization. And, looking forward to talking to you again soon. Thank you. >> Tom that was great thanks so much. Now I'm going to have to brag on you for a second as a change agent you've come in disrupted and how long have you been at Western union? >> Only nine months, so just started this year, but, doing some great opportunities and great changes. And we have a lot more to go, but, we're really driving things forward in partnership with our business teams and our colleagues to support those customers going forward. >> Tom, thank you so much. That was wonderful. And now I'm excited to introduce you to Gustavo Canton, a change agent that I've had the pleasure of working with meeting in Europe, and he is a serial change agent, most recently with Schneider electric, but even going back to Sam's clubs, Gustavo welcome. (upbeat music) >> So, hey everyone, my name is Gustavo Canton and thank you so much, Cindi, for the intro, as you mentioned, doing transformations is high effort, high reward situation. I have empowered many transformations and I have led many transformations. And what I can tell you is that it's really hard to predict the future, but if you have a North star and where you're going, the one thing that I want you to take away from this discussion today is that you need to be bold to evolve. And so in today, I'm going to be talking about culture and data, and I'm going to break this down in four areas. How do we get started barriers or opportunities as I see it, the value of AI, and also, how do you communicate, especially now in the workforce of today with so many different generations, you need to make sure that you are communicating in ways that are non-traditional sometimes. And so how do we get started? So I think the answer to that is you have to start for you yourself as a leader and stay tuned. And by that, I mean, you need to understand not only what is happening in your function or your field, but you have to be varying into what is happening in society, socioeconomically speaking wellbeing. The common example is a great example. And for me personally, it's an opportunity because the one core value that I have is well-being, I believe that for human potential, for customers and communities to grow wellbeing should be at the center of every decision. And as somebody mentioned is great to be, stay in tune and have the skillset and the courage. But for me personally, to be honest, to have this courage is not about not being afraid. You're always afraid when you're making big changes when you're swimming upstream, but what gives me the courage is the empathy part. Like I think empathy is a huge component because every time I go into an organization or a function, I try to listen very attentively to the needs of the business and what the leaders are trying to do. What I do it thinking about the mission of how do I make change for the bigger, workforce? for the bigger good. Despite this fact that this might have a perhaps implication on my own self-interest in my career, right? Because you have to have that courage sometimes to make choices that I know we'll see in politically speaking, what are the right thing to do? And you have to push through it. And you have to push through it. So the bottom line for me is that I don't think they're transforming fast enough. And the reality is I speak with a lot of leaders and we have seen stories in the past. And what they show is that if you look at the four main barriers that are basically keeping us behind budget, inability to act cultural issues, politics, and lack of alignment, those are the top four. But the interesting thing is that as Cindi has mentioned, these topics culture is actually gaining, gaining more and more traction. And in 2018, there was a story from HBR and it was about 45%. I believe today it's about 55%, 60% of respondents say that this is the main area that we need to focus on. So again, for all those leaders and all the executives who understand and are aware that we need to transform, commit to the transformation and set a state, deadline to say, "hey, in two years, we're going to make this happen. "What do we need to do to empower and enable "this change engines to make it happen?" You need to make the tough choices. And so to me, when I speak about being bold is about making the right choices now. So I'll give you samples of some of the roadblocks that I went through as I think transformation most recently, as Cindi mentioned in Schneider. There are three main areas, legacy mindset. And what that means is that we've been doing this in a specific way for a long time and here is how we have been successful what was working the past is not going to work now. The opportunity there is that there is a lot of leaders who have a digital mindset and there're up and coming leaders that are not yet fully developed. We need to mentor those leaders and take bets on some of these talent, including young talent. We cannot be thinking in the past and just wait for people, three to five years for them to develop because the world is going to in a way that is super fast. The second area, and this is specifically to implementation of AI is very interesting to me because just example that I have with ThoughtSpot, right, we went to implementation and a lot of the way is the IT team function of the leaders look at technology, they look at it from the prism of the prior all success criteria for the traditional Bi's. And that's not going to work. Again the opportunity here is that you need to really find what successful look like. In my case, I want the user experience of our workforce to be the same as user experience you have at home is a very simple concept. And so we need to think about how do we gain the user experience with this augmented analytics tools and then work backwards to have the right talent processes and technology to enable that. And finally, with COVID a lot of pressuring organizations, and companies to do more with less. And the solution that most leaders I see are taking is to just minimize costs, sometimes in cut budget, we have to do the opposite. We have to actually invest some growth areas, but do it by business question. Don't do it by function. If you actually invest in these kind of solutions, if you actually invest on developing your talent, your leadership to see more digitally, if you actually invest on fixing your data platform, it's not just an incremental cost. It's actually this investment is going to offset all those hidden costs and inefficiencies that you have on your system, because people are doing a lot of work and working very hard, but it's not efficiency, and it's not working in the way that you might want to work. So there is a lot of opportunity there. And you just to put into some perspective, there have studies in the past about, how do we kind of measure the impact of data. And obviously this is going to vary by your organization maturity, is going to, there's going to be a lot of factors. I've been in companies who have very clean, good data to work with. And I think with companies that we have to start basically from scratch. So it all depends on your maturity level, but in this study, what I think is interesting is they try to put attack line or attack price to what is the cost of incomplete data. So in this case, it's about 10 times as much to complete a unit of work when you have data that is flawed as opposed to have perfect data. So let me put that just in perspective, just as an example, right? Imagine you are trying to do something and you have to do 100 things in a project, and each time you do something, it's going to cost you a dollar. So if you have perfect data, the total cost of that project might be $100. But now let's say you have any percent perfect data and 20% flawed data by using this assumption that flawed data is 10 times as costly as perfect data. Your total costs now becomes $280 as opposed to $100. This is just for you to really think about as a CIO CTO, CHRO CEO, are we really paying attention and really closing the gaps that we have on our data infrastructure. If we don't do that, it's hard sometimes to see the snowball effect or to measure the overall impact. But as you can tell the price that goes up very, very quickly. So now, if I were to say, how do I communicate this? Or how do I break through some of these challenges or some of these various, right. I think the key is I am in analytics. I know statistics obviously, and love modeling and data and optimization theory and all that stuff. That's what I came to analytics. But now as a leader and as a change agent, I need to speak about value. And in this case, for example, for Schneider, there was this tagline called free up your energy. So the number one thing that they were asking from the analytics team was actually efficiency, which to me was very interesting. But once I understood that I understood what kind of language to use, how to connect it to the overall strategy and basically how to bring in the, the right leaders, because you need to focus on the leaders that you're going to make the most progress. Again, low effort, high value. You need to make sure you centralize all the data as you can. You need to bring in some kind of augmented analytics solution. And finally you need to make it super simple for the, in this case, I was working with the HR teams in other areas, so they can have access to one portal. They don't have to be confused in looking for 10 different places to find information. I think if you can actually have those four foundational pillars, obviously under the guise of having a data-driven culture, that's when you can actually make the impact. So in our case, it was about three years total transformation, but it was two years for this component of augmented analytics. It took about two years to talk to IT get leadership support, find the budgeting, get everybody on board, make sure the safe criteria was correct. And we call this initiative, the people analytics portal, it was actually launched in July of this year. And we were very excited and the audience was very excited to do this. In this case, we did our pilot in North America for many, many manufacturers. But one thing that is really important is as you bring along your audience on this, you're going from Excel, in some cases or Tableau to other tools like, ThoughtSpot, you need to really explain them what is the difference and how these tools can truly replace, some of the spreadsheets or some of the views that you might have on these other kind of tools. Again, Tableau, I think it's a really good tool. There are other many tools that you might have in your toolkit. But in my case, personally, I feel that you need to have one portal going back to Cindi's point. I really truly enable the end user. And I feel that this is the right solution for us, right? And I will show you some of the findings that we had in the pilot in the last two months. So this was a huge victory, and I will tell you why, because it took a lot of effort for us to get to the station. Like I said, it's been years for us to kind of lay the foundation, get the leadership, and shaping culture so people can understand why you truly need to invest on (indistinct) analytics. And so what I'm showing here is an example of how do we use basically, a tool to capture in video the qualitative findings that we had, plus the quantitative insights that we have. So in this case, our preliminary results based on our ambition for three main metrics, hours saved user experience and adoption. So for hours saved or a mission was to have 10 hours per week per employee save on average user experience, or ambition was 4.5. And adoption, 80%. In just two months, two months and a half of the pilot, we were able to achieve five hours per week per employee savings. Our user experience for 4.3 out of five and adoption of 60%. Really, really amazing work. But again, it takes a lot of collaboration for us to get to the stage from IT, legal, communications, obviously the operations teams and the users in HR safety and other areas that might be, basically stakeholders in this whole process. So just to summarize this kind of effort takes a lot of energy. You are a change agent. You need to have a courage to make the decision and understand that I feel that in this day and age, with all this disruption happening, we don't have a choice. We have to take the risk, right? And in this case, I feel a lot of satisfaction in how we were able to gain all these very source for this organization. And that gave me the confidence to know that the work has been done and we are now in a different stage for the organization. And so for me, it to say, thank you for everybody who has believed, obviously in our vision, everybody who has believe in the word that we were trying to do and to make the life of four workforce or customers or in community better. As you can tell, there is a lot of effort. There is a lot of collaboration that is needed to do something like this. In the end, I feel very satisfied. With the accomplishments of this transformation, and I just want to tell for you, if you are going right now in a moment that you feel that you have to swim upstream what would mentors, what would people in this industry that can help you out and guide you on this kind of a transformation is not easy to do is high effort, but is well worth it. And with that said, I hope you are well, and it's been a pleasure talking to you. Talk to you soon, take care. >> Thank you, Gustavo, that was amazing. All right, let's go to the panel. (air whooshing) >> Okay, now we're going to go into the panel and bring Cindi, Michelle, Tom, and Gustavo back and have an open discussion. And I think we can all agree how valuable it is to hear from practitioners. And I want to thank the panel for sharing their knowledge with the community. And one common challenge that I heard you all talk about was bringing your leadership and your teams along on the journey with you. We talk about this all the time, and it is critical to have support from the top. Why? Because it directs the middle and then it enables bottoms up innovation effects from the cultural transformation that you guys all talked about. It seems like another common theme we heard is that you all prioritize database decision-making in your organizations and you combine two of your most valuable assets to do that and create leverage, employees on the front lines. And of course the data. And as you rightly pointed out, Tom, the pandemic has accelerated the need for really leaning into this. The old saying, if it ain't broke don't fix it. Well COVID is broken everything. And it's great to hear from our experts, how to move forward. So let's get right into it. So Gustavo, let's start with you if I'm an aspiring change agent and let's say I'm a budding data leader. What do I need to start doing? What habits do I need to create for long lasting success? >> I think curiosity is very important. You need to be, like I say, in tune to what is happening, not only in your specific field, like I have a passion for analytics, I can do this for 50 years plus, but I think you need to understand wellbeing other areas across not only a specific business, as you know I come from, Sam's club Walmart, retail, I mean energy management technology. So you have to try to push yourself and basically go out of your comfort zone. I mean, if you are staying in your comfort zone and you want to use lean continuous improvement, that's just going to take you so far. What you have to do is, and that's what I try to do is I try to go into areas, businesses, and transformation that make me stretch and develop as a leader. That's what I'm looking to do so I can help transform the functions organizations and do the change management, change of mindset required for these kinds of efforts. >> Michelle, you're at the intersection of tech and sports and what a great combination, but they're both typically male oriented fields. I mean, we've talked a little bit about how that's changing, but two questions. Tell us how you found your voice and talk about why diversity matters so much more than ever now. >> No, I found my voice really as a young girl, and I think I had such amazing support from men in my life. And I think the support and sponsorship as well as sort of mentorship along the way, I've had amazing male mentors who have helped me understand that my voice is just as important as anyone else's. I mean, I have often heard, and I think it's been written about that a woman has to believe they'll 100% master topic before they'll talk about it where a man can feel much less mastery and go on and on. So I was that way as well. And I learned just by watching and being open, to have my voice. And honestly at times demand a seat at the table, which can be very uncomfortable. And you really do need those types of, support networks within an organization. And diversity of course is important and it has always been. But I think if anything, we're seeing in this country right now is that diversity among all types of categories is front and center. And we're realizing that we don't all think alike. We've always known this, but we're now talking about things that we never really talked about before. And we can't let this moment go unchecked and on, and not change how we operate. So having diverse voices within your company and in the field of tech and sports, I am often the first and only I'm was the first, CIO at the NFL, the first female senior executive. It was fun to be the first, but it's also, very challenging. And my responsibility is to just make sure that, I don't leave anyone behind and make sure that I leave it good for the next generation. >> Well, thank you for that. That is inspiring. And Cindi, you love data and the data's pretty clear that diversity is a good business, but I wonder if you can add your perspectives to this conversation? >> Yeah, so Michelle has a new fan here because she has found her voice. I'm still working on finding mine. And it's interesting because I was raised by my dad, a single dad. So he did teach me how to work in a predominantly male environment, but why I think diversity matters more now than ever before. And this is by gender, by race, by age, by just different ways of working in thinking is because as we automate things with AI, if we do not have diverse teams looking at the data and the models and how they're applied, we risk having bias at scale. So this is why I think I don't care what type of minority you are finding your voice, having a seat at the table and just believing in the impact of your work has never been more important. And as Michelle said more possible. >> Great perspectives, thank you. Tom I want to go to you. I mean, I feel like everybody in our businesses in some way, shape or form become a COVID expert, but what's been the impact of the pandemic on your organization's digital transformation plans? >> We've seen a massive growth actually in a digital business over the last, 12 months, really, even in celebration, right? Once COVID hit, we really saw that in the 200 countries and territories that we operate in today and service our customers, today, that there's been a huge need, right? To send money, to support family, to support, friends and support loved ones across the world. And as part of that we are very, honored to get to support those customers that we, across all the centers today. But as part of that acceleration we need to make sure that we had the right architecture and the right platforms to basically scale, right, to basically support and provide the right kind of security for our customers going forward. So as part of that, we did do some pivots and we did accelerate some of our plans on digital to help support that overall growth coming in and to support our customers going forward, because there were these times during this pandemic, right? This is the most important time. And we need to support those that we love and those that we care about and doing that it's one of those ways is actually by sending money to them, support them financially. And that's where, really our part of that our services come into play that we really support those families. So it was really a great opportunity for us to really support and really bring some of our products to this level and supporting our business going forward. >> Awesome, thank you. Now I want to come back to Gustavo, Tom I'd love for you to chime in too. Did you guys ever think like you were, you were pushing the envelope too much in doing things with data or the technology that was just maybe too bold, maybe you felt like at some point it was failing or you're pushing your people too hard. Can you share that experience and how you got through it? >> Yeah, the way I look at it is, again, whenever I go to an organization, I ask the question, hey, how fast you would like transform. And, based on the agreements from the leadership and the vision that we want to take place, I take decisions. And I collaborate in a specific way now, in the case of COVID, for example, right. It forces us to remove silos and collaborate in a faster way. So to me, it was an opportunity to actually integrate with other areas and drive decisions faster, but make no mistake about it. When you are doing a transformation, you are obviously trying to do things faster than sometimes people are comfortable doing, and you need to be okay with that. Sometimes you need to be okay with tension, or you need to be okay debating points or making repetitive business cases until people connect with the decision because you understand, and you are seeing that, "hey, the CEO is making a one two year, efficiency goal. "The only way for us to really do more with less "is for us to continue this path. "We cannot just stay with the status quo. "We need to find a way to accelerate the transformation." That's the way I see it. >> How about you Tom, we were talking earlier with Sudheesh and Cindi, about that bungee jumping moment. What could you share? >> Yeah, I think you hit upon it, right now, the pace of change with the slowest pace that you see for the rest of your career. So as part of that, right, that's what I tell my team is that you need to be, you need to feel comfortable being uncomfortable. I mean, that we have to be able to basically scale, right, expand and support that the ever-changing needs in the marketplace and industry our customers today, and that pace of change that's happening, right. And what customers are asking for and the competition in the marketplace, it's only going to accelerate. So as part of that, as you look at what, how you're operating today in your current business model, right. Things are only going to get faster. So you have to plan into a line into drive the agile transformation so that you can scale even faster in the future. So as part of that, that's what we're putting in place here, right, is how do we create that underlying framework and foundation that allows the organization to basically continue to scale and evolve into the future? >> Yeah, we're definitely out of our comfort zones, but we're getting comfortable with it. So, Cindi, last question, you've worked with hundreds of organizations, and I got to believe that, some of the advice you gave when you were at Gartner, which is pre COVID, maybe sometimes clients didn't always act on it. They're not on my watch for whatever variety of reasons, but it's being forced on them now. But knowing what you know now that we're all in this isolation economy, how would you say that advice has changed? Has it changed? What's your number one action and recommendation today? >> Yeah, well, first off, Tom just freaked me out. What do you mean? This is the slowest ever even six months ago I was saying the pace of change in data and analytics is frenetic. So, but I think you're right, Tom, the business and the technology together is forcing this change. Now, Dave, to answer your question, I would say the one bit of advice, maybe I was a little more, very aware of the power and politics and how to bring people along in a way that they are comfortable. And now I think it's, you know what you can't get comfortable. In fact, we know that the organizations that were already in the cloud have been able to respond and pivot faster. So if you really want to survive as Tom and Gustavo said, get used to being uncomfortable, the power and politics are going to happen. Break the rules, get used to that and be bold. Do not be afraid to tell somebody they're wrong and they're not moving fast enough. I do think you have to do that with empathy, as Michelle said, and Gustavo, I think that's one of the key words today besides the bungee jumping. So I want to know where's the dish going to go bungee jumping. >> Guys fantastic discussion, really. Thanks again to all the panelists and the guests. It was really a pleasure speaking with you today. Really virtually all of the leaders that I've spoken to in the Cube program. Recently, they tell me that the pandemic is accelerating so many things, whether it's new ways to work, we heard about new security models and obviously the need for cloud. I mean, all of these things are driving true enterprise wide digital transformation, not just, as I said before, lip service. Sometimes we minimize the importance and the challenge of building culture and in making this transformation possible. But when it's done, right, the right culture is going to deliver tremendous results. Yeah, what does that mean getting it right? Everybody's trying to get it right. My biggest takeaway today is it means making data part of the DNA of your organization. And that means making it accessible to the people in your organization that are empowered to make decisions, decisions that can drive new revenue, cut costs, speed access to critical care, whatever the mission is of your organization. Data can create insights and informed decisions that drive value. Okay. Let's bring back Sudheesh and wrap things up. Sudheesh, please bring us home. >> Thank you. Thank you, Dave. Thank you, the Cube team, and thank goes to all of our customers and partners who joined us and thanks to all of you for spending the time with us. I want to do three quick things and then close it off. The first thing is I want to summarize the key takeaways that I had from all four of our distinguished speakers. First, Michelle, I will simply put it. She said it really well. That is be brave and drive. Don't go for a drive along. That is such an important point. Oftentimes, you know that I think that you have to do to make the positive change that you want to see happen but you wait for someone else to do it, not just, why not you? Why don't you be the one making that change happen? That's the thing that I've picked up from Michelle's talk. Cindi talked about finding the importance of finding your voice. Taking that chair, whether it's available or not, and making sure that your ideas, your voices are heard, and if it requires some force, then apply that force. Make sure your ideas are heard. Gustavo talked about the importance of building consensus, not going at things all alone sometimes building the importance of building the quorum. And that is critical because if you want the changes to last, you want to make sure that the organization is fully behind it. Tom, instead of a single takeaway, what I was inspired by is the fact that a company that is 170 years old, 170 years old, 200 companies and 200 countries they're operating in. And they were able to make the change that is necessary through this difficult time. So in a matter of months, if they could do it, anyone could. The second thing I want to do is to leave you with a takeaway that is I would like you to go to topspot.com/nfl because our team has made an app for NFL on Snowflake. I think you will find this interesting now that you are inspired and excited because of Michelle's talk. And the last thing is please go to thoughtspot.com/beyond our global user conference is happening in this December. We would love to have you join us. It's again, virtual, you can join from anywhere. We are expecting anywhere from five to 10,000 people, and we would love to have you join and see what we've been up to since last year. We have a lot of amazing things in store for you, our customers, our partners, our collaborators, they will be coming and sharing. We'll be sharing things that we've have been working to release something that will come out next year. And also some of the crazy ideas our engineers have been cooking up. All of those things will be available for you at the Thought Spot Beyond. Thank you. Thank you so much.

>>from Las Vegas. It's the Q covering. Next work. 2019 America's Do You buy Juniper Networks? Come back already. Jeffrey here with the Cube were in Las Vegas at Caesar's at the Juniper. Next work event. About 1000 people kind of going over a lot of new cool things. 400 gigs. Who knew that was coming out of new information for me? But that's not what we're here today. We're here for the fourth installment of around the Cube unpacking. I were happy to have all the winners of the three previous rounds here at the same place. We don't have to do it over the phone s so we're happy to have him. Let's jump into it. So winner of Round one was Bob Friday. He is the VP and CTO at Missed the Juniper Company. Bob, Great to see you. Good to be back. Absolutely. All the way from Seattle. Sharna Parky. She's a VP applied scientist at Tech CEO could see Sharna and, uh, from Google. We know a lot of a I happen to Google. Rajan's chef. He is the V p ay ay >>product management on Google. Welcome. Thank you, Christy. Here >>All right, so let's jump into it. So just warm everybody up and we'll start with you. Bob, What are some When you're talking to someone at a cocktail party Friday night talking to your mom And they say, What is a I What >>do you >>give him? A Zen examples of where a eyes of packing our lives today? >>Well, I think we all know the examples of the south driving car, you know? Aye, aye. Starting to help our health care industry being diagnosed cancer for me. Personally, I had kind of a weird experience last week at a retail technology event where basically had these new digital mirrors doing facial recognition. Right? And basically, you start to have little mirrors were gonna be a skeevy start guessing. Hey, you have a beard, you have some glasses, and they start calling >>me old. So this is kind >>of very personal. I have a something for >>you, Camille, but eh? I go walking >>down a mall with a bunch of mirrors, calling me old. >>That's a little Illinois. Did it bring you out like a cane or a walker? You know, you start getting some advertising's >>that were like Okay, you guys, this is a little bit over the top. >>Alright, Charlotte, what about you? What's your favorite example? Share with people? >>Yeah, E think one of my favorite examples of a I is, um, kind of accessible in on your phone where the photos you take on an iPhone. The photos you put in Google photos, they're automatically detecting the faces and their labeling them for you. They're like, Here's selfies. Here's your family. Here's your Children. And you know, that's the most successful one of the ones that I think people don't really think about a lot or things like getting loan applications right. We actually have a I deciding whether or not we get loans. And that one is is probably the most interesting one to be right now. >>Roger. So I think the father's example is probably my favorite as well. And what's interesting to me is that really a I is actually not about the Yeah, it's about the user experience that you can create as a result of a I. What's cool about Google photos is that and my entire family uses Google photos and they don't even know actually that the underlying in some of the most powerful a I in the world. But what they know is they confined every picture of our kids on the beach whenever they whenever they want to. Or, you know, we had a great example where we were with our kids. Every time they like something in the store, we take a picture of it, Um, and we can look up toy and actually find everything that they've taken picture. >>It's interesting because I think most people don't even know the power that they have. Because if you search for beach in your Google photos or you search for, uh, I was looking for an old bug picture from my high school there it came right up until you kind of explore. You know, it's pretty tricky, Raja, you know, I think a lot of conversation about A They always focus the general purpose general purpose, general purpose machines and robots and computers. But people don't really talk about the applied A that's happening all around. Why do you think that? >>So it's a good question. There's there's a lot more talk about kind of general purpose, but the reality of where this has an impact right now is, though, are those specific use cases. And so, for example, things like personalizing customer interaction or, ah, spotting trends that did that you wouldn't have spotted for turning unstructured data like documents into structure data. That's where a eyes actually having an impact right now. And I think it really boils down to getting to the right use cases where a I right? >>Sharon, I want ask you. You know, there's a lot of conversation. Always has A I replace people or is it an augmentation for people? And we had Gary Kasparov on a couple years ago, and he talked about, you know, it was the combination if he plus the computer made the best chess player, but that quickly went away. Now the computer is actually better than Garry Kasparov. Plus the computer. How should people think about a I as an augmentation tool versus a replacement tool? And is it just gonna be specific to the application? And how do you kind of think about those? >>Yeah, I would say >>that any application where you're making life and death decisions where you're making financial decisions that disadvantage people anything where you know you've got u A. V s and you're deciding whether or not to actually dropped the bomb like you need a human in the loop. If you're trying to change the words that you are using to get a different group of people to apply for jobs, you need a human in the loop because it turns out that for the example of beach, you type sheep into your phone and you might get just a field, a green field and a I doesn't know that, uh, you know, if it's always seen sheep in a field that when the sheep aren't there, that that isn't a sheep like it doesn't have that kind of recognition to it. So anything were we making decisions about parole or financial? Anything like that needs to have human in the loop because those types of decisions are changing fundamentally the way we live. >>Great. So shift gears. The team are Jeff Saunders. Okay, team, your mind may have been the liquid on my bell, so I'll be more active on the bell. Sorry about that. Everyone's even. We're starting a zero again, so I want to shift gears and talk about data sets. Um Bob, you're up on stage. Demo ing some some of your technology, the Miss Technology and really, you know, it's interesting combination of data sets A I and its current form needs a lot of data again. Kind of the classic Chihuahua on blue buried and photos. You got to run a lot of them through. How do you think about data sets? In terms of having the right data in a complete data set to drive an algorithm >>E. I think we all know data sets with one The tipping points for a I to become more real right along with cloud computing storage. But data is really one of the key points of making a I really write my example on stage was wine, right? Great wine starts a great grape street. Aye, aye. Starts a great data for us personally. L s t M is an example in our networking space where we have data for the last three months from our customers and rule using the last 30 days really trained these l s t m algorithms to really get that tsunami detection the point where we don't have false positives. >>How much of the training is done. Once you once you've gone through the data a couple times in a just versus when you first started, you're not really sure how it's gonna shake out in the algorithm. >>Yeah. So in our case right now, right, training happens every night. So every night, we're basically retraining those models, basically, to be able to predict if there's gonna be an anomaly or network, you know? And this is really an example. Where you looking all these other cat image thinks this is where these neural networks there really were one of the transformational things that really moved a I into the reality calling. And it's starting to impact all our different energy. Whether it's text imaging in the networking world is an example where even a I and deep learnings ruling starting to impact our networking customers. >>Sure, I want to go to you. What do you do if you don't have a big data set? You don't have a lot of pictures of chihuahuas and blackberries, and I want to apply some machine intelligence to the problem. >>I mean, so you need to have the right data set. You know, Big is a relative term on, and it depends on what you're using it for, right? So you can have a massive amount of data that represents solar flares, and then you're trying to detect some anomaly, right? If you train and I what normal is based upon a massive amount of data and you don't have enough examples of that anomaly you're trying to detect, then it's never going to say there's an anomaly there, so you actually need to over sample. You have to create a population of data that allows you to detect images you can't say, Um oh, >>I'm going to reflect in my data set the percentage of black women >>in Seattle, which is something below 6% and say it's fair. It's not right. You have to be able thio over sample things that you need, and in some ways you can get this through surveys. You can get it through, um, actually going to different sources. But you have to boot, strap it in some way, and then you have to refresh it, because if you leave that data set static like Bob mentioned like you, people are changing the way they do attacks and networks all the time, and so you may have been able to find the one yesterday. But today it's a completely different ball game >>project to you, which comes first, the chicken or the egg. You start with the data, and I say this is a ripe opportunity to apply some. Aye, aye. Or do you have some May I objectives that you want to achieve? And I got to go out and find the >>data. So I actually think what starts where it starts is the business problem you're trying to solve. And then from there, you need to have the right data. What's interesting about this is that you can actually have starting points. And so, for example, there's techniques around transfer, learning where you're able to take an an algorithm that's already been trained on a bunch of data and training a little bit further with with your data on DSO, we've seen that such that people that may have, for example, only 100 images of something, but they could use a model that's trained on millions of images and only use those 100 thio create something that's actually quite accurate. >>So that's a great segue. Wait, give me a ring on now. And it's a great Segway into talking about applying on one algorithm that was built around one data set and then applying it to a different data set. Is that appropriate? Is that correct? Is air you risking all kinds of interesting problems by taking that and applying it here, especially in light of when people are gonna go to outweigh the marketplace, is because I've got a date. A scientist. I couldn't go get one in the marketplace and apply to my data. How should people be careful not to make >>a bad decision based on that? So I think it really depends. And it depends on the type of machine learning that you're doing and what type of data you're talking about. So, for example, with images, they're they're they're well known techniques to be able to do this, but with other things, there aren't really and so it really depends. But then the other inter, the other really important thing is that no matter what at the end, you need to test and generate based on your based on your data sets and on based on sample data to see if it's accurate or not, and then that's gonna guide everything. Ultimately, >>Sharon has got to go to you. You brought up something in the preliminary rounds and about open A I and kind of this. We can't have this black box where stuff goes into the algorithm. That stuff comes out and we're not sure what the result was. Sounds really important. Is that Is that even plausible? Is it feasible? This is crazy statistics, Crazy math. You talked about the business objective that someone's trying to achieve. I go to the data scientist. Here's my data. You're telling this is the output. How kind of where's the line between the Lehman and the business person and the hard core data science to bring together the knowledge of Here's what's making the algorithm say this. >>Yeah, there's a lot of names for this, whether it's explainable. Aye, aye. Or interpret a belay. I are opening the black box. Things like that. Um, the algorithms that you use determine whether or not they're inspect herbal. Um, and the deeper your neural network gets, the harder it is to inspect, actually. Right. So, to your point, every time you take an aye aye and you use it in a different scenario than what it was built for. For example, um, there is a police precinct in New York that had a facial recognition software, and, uh, victim said, Oh, it looked like this actor. This person looked like Bill Cosby or something like that, and you were never supposed to take an image of an actor and put it in there to find people that look like them. But that's how people were using it. So the Russians point yes, like it. You can transfer learning to other a eyes, but it's actually the humans that are using it in ways that are unintended that we have to be more careful about, right? Um, even if you're a, I is explainable, and somebody tries to use it in a way that it was never intended to be used. The risk is much higher >>now. I think maybe I had, You know, if you look at Marvis kind of what we're building for the networking community Ah, good examples. When Marvis tries to do estimate your throughput right, your Internet throughput. That's what we usually call decision tree algorithm. And that's a very interpretive algorithm. and we predict low throughput. We know how we got to that answer, right? We know what features God, is there? No. But when we're doing something like a NAMI detection, that's a neural network. That black box it tells us yes, there's a problem. There's some anomaly, but that doesn't know what caused the anomaly. But that's a case where we actually used neural networks, actually find the anomie, and then we're using something else to find the root cause, eh? So it really depends on the use case and where the night you're going to use an interpreter of model or a neural network which is more of a black box model. T tell her you've got a cat or you've got a problem >>somewhere. So, Bob, that's really interested. So can you not unpacking? Neural network is just the nature of the way that the communication and the data flows and the inferences are made that you can't go in and unpack it, that you have to have the >>separate kind of process too. Get to the root cause. >>Yeah, assigned is always hard to say. Never. But inherently s neural networks are very complicated. Saito set of weights, right? It's basically usually a supervised training model, and we're feeding a bunch of data and trying to train it to detect a certain features, sir, an output. But that is where they're powerful, right? And that's why they basically doing such good, Because they are mimicking the brain, right? That neural network is a very complex thing. Can't like your brain, right? We really don't understand how your brain works right now when you have a problem, it's really trialling there. We try to figure out >>right going right. So I want to stay with you, bought for a minute. So what about when you change what you're optimizing? Four? So you just said you're optimizing for throughput of the network. You're looking for problems. Now, let's just say it's, uh, into the end of the quarter. Some other reason we're not. You're changing your changing what you're optimizing for, Can you? You have to write separate algorithm. Can you have dynamic movement inside that algorithm? How do you approach a problem? Because you're not always optimizing for the same things, depending on the market conditions. >>Yeah, I mean, I think a good example, you know, again, with Marvis is really with what we call reinforcement. Learning right in reinforcement. Learning is a model we use for, like, radio resource management. And there were really trying to optimize for the user experience in trying to balance the reward, the models trying to reward whether or not we have a good balance between the network and the user. Right, that reward could be changed. So that algorithm is basically reinforcement. You can finally change hell that Algren works by changing the reward you give the algorithm >>great. Um, Rajan back to you. A couple of huge things that have come into into play in the marketplace and get your take one is open source, you know, kind of. What's the impact of open source generally on the availability, desire and more applications and then to cloud and soon to be edge? You know, the current next stop. How do you guys incorporate that opportunity? How does it change what you can do? How does it open up the lens of >>a I Yeah, I think open source is really important because I think one thing that's interesting about a I is that it's a very nascent field and the more that there's open source, the more that people could build on top of each other and be able to utilize what what others others have done. And it's similar to how we've seen open source impact operating systems, the Internet, things like things like that with Cloud. I think one of the big things with cloud is now you have the processing power and the ability to access lots of data to be able to t create these thes networks. And so the capacity for data and the capacity for compute is much higher. Edge is gonna be a very important thing, especially going into next few years. You're seeing Maur things incorporated on the edge and one exciting development is around Federated learning where you can train on the edge and then combine some of those aspects into a cloud side model. And so that I think will actually make EJ even more powerful. >>But it's got to be so dynamic, right? Because the fundamental problem used to always be the move, the computer, the data or the date of the computer. Well, now you've got on these edge devices. You've got Tanya data right sensor data all kinds of machining data. You've got potentially nasty hostile conditions. You're not in a nice, pristine data center where the environmental conditions are in the connective ity issues. So when you think about that problem yet, there's still great information. There you got latent issues. Some I might have to be processed close to home. How do you incorporate that age old thing of the speed of light to still break the break up? The problem to give you a step up? Well, we see a lot >>of customers do is they do a lot of training on the cloud, but then inference on the on the edge. And so that way they're able to create the model that they want. But then they get fast response time by moving the model to the edge. The other thing is that, like you said, lots of data is coming into the edge. So one way to do it is to efficiently move that to the cloud. But the other way to do is filter. And to try to figure out what data you want to send to the clouds that you can create the next days. >>Shawna, back to you let's shift gears into ethics. This pesky, pesky issue that's not not a technological issue at all, but right. We see it often, especially in tech. Just cause you should just cause you can doesn't mean that you should. Um so and this is not a stem issue, right? There's a lot of different things that happened. So how should people be thinking about ethics? How should they incorporate ethics? Um, how should they make sure that they've got kind of a, you know, a standard kind of overlooking kind of what they're doing? The decisions are being made. >>Yeah, One of the more approachable ways that I have found to explain this is with behavioral science methodologies. So ethics is a massive field of study, and not everyone shares the same ethics. However, if you try and bring it closer to behavior change because every product that we're building is seeking to change of behavior. We need to ask questions like, What is the gap between the person's intention and the goal we have for them? Would they choose that goal for themselves or not? If they wouldn't, then you have an ethical problem, right? And this this can be true of the intention, goal gap or the intention action up. We can see when we regulated for cigarettes. What? We can't just make it look cool without telling them what the cigarettes are doing to them, right so we can apply the same principles moving forward. And they're pretty accessible without having to know. Oh, this philosopher and that philosopher in this ethicist said these things, it can be pretty human. The challenge with this is that most people building these algorithms are not. They're not trained in this way of thinking, and especially when you're working at a start up right, you don't have access to massive teams of people to guide you down this journey, so you need to build it in from the beginning, and you need to be open and based upon principles. Um, and it's going to touch every component. It should touch your data, your algorithm, the people that you're using to build the product. If you only have white men building the product, you have a problem you need to pull in other people. Otherwise, there are just blind spots that you are not going to think of in order to still that product for a wider audience, but it seems like >>they were on such a razor sharp edge. Right with Coca Cola wants you to buy Coca Cola and they show ads for Coca Cola, and they appeal to your let's all sing together on the hillside and be one right. But it feels like with a I that that is now you can cheat. Right now you can use behavioral biases that are hardwired into my brain is a biological creature against me. And so where is where is the fine line between just trying to get you to buy Coke? Which somewhat argues Probably Justus Bad is Jule cause you get diabetes and all these other issues, but that's acceptable. But cigarettes are not. And now we're seeing this stuff on Facebook with, you know, they're coming out. So >>we know that this is that and Coke isn't just selling Coke anymore. They're also selling vitamin water so they're they're play isn't to have a single product that you can purchase, but it is to have a suite of products that if you weren't that coke, you can buy it. But if you want that vitamin water you can have that >>shouldn't get vitamin water and a smile that only comes with the coat. Five. You want to jump in? >>I think we're going to see ethics really break into two different discussions, right? I mean, ethics is already, like human behavior that you're already doing right, doing bad behavior, like discriminatory hiring, training, that behavior. And today I is gonna be wrong. It's wrong in the human world is gonna be wrong in the eye world. I think the other component to this ethics discussion is really round privacy and data. It's like that mirror example, right? No. Who gave that mirror the right to basically tell me I'm old and actually do something with that data right now. Is that my data? Or is that the mirrors data that basically recognized me and basically did something with it? Right. You know, that's the Facebook. For example. When I get the email, tell me, look at that picture and someone's take me in the pictures Like, where was that? Where did that come from? Right? >>What? I'm curious about to fall upon that as social norms change. We talked about it a little bit for we turn the cameras on, right? It used to be okay. Toe have no black people drinking out of a fountain or coming in the side door of a restaurant. Not that long ago, right in the 60. So if someone had built an algorithm, then that would have incorporated probably that social norm. But social norms change. So how should we, you know, kind of try to stay ahead of that or at least go back reflectively after the fact and say kind of back to the black box, That's no longer acceptable. We need to tweak this. I >>would have said in that example, that was wrong. 50 years ago. >>Okay, it was wrong. But if you ask somebody in Alabama, you know, at the University of Alabama, Matt Department who have been born Red born, bred in that culture as well, they probably would have not necessarily agreed. But so generally, though, again, assuming things change, how should we make sure to go back and make sure that we're not again carrying four things that are no longer the right thing to do? >>Well, I think I mean, as I said, I think you know what? What we know is wrong, you know is gonna be wrong in the eye world. I think the more subtle thing is when we start relying on these Aye. Aye. To make decisions like no shit in my car, hit the pedestrian or save my life. You know, those are tough decisions to let a machine take off or your balls decision. Right when we start letting the machines Or is it okay for Marvis to give this D I ps preference over other people, right? You know, those type of decisions are kind of the ethical decision, you know, whether right or wrong, the human world, I think the same thing will apply in the eye world. I do think it will start to see more regulation. Just like we see regulation happen in our hiring. No, that regulation is going to be applied into our A I >>right solutions. We're gonna come back to regulation a minute. But, Roger, I want to follow up with you in your earlier session. You you made an interesting comment. You said, you know, 10% is clearly, you know, good. 10% is clearly bad, but it's a soft, squishy middle at 80% that aren't necessarily super clear, good or bad. So how should people, you know, kind of make judgments in this this big gray area in the middle? >>Yeah, and I think that is the toughest part. And so the approach that we've taken is to set us set out a set of AI ai principles on DDE. What we did is actually wrote down seven things that we will that we think I should do and four things that we should not do that we will not do. And we now have to actually look at everything that we're doing against those Aye aye principles. And so part of that is coming up with that governance process because ultimately it boils down to doing this over and over, seeing lots of cases and figuring out what what you should do and so that governments process is something we're doing. But I think it's something that every company is going to need to do. >>Sharon, I want to come back to you, so we'll shift gears to talk a little bit about about law. We've all seen Zuckerberg, unfortunately for him has been, you know, stuck in these congressional hearings over and over and over again. A little bit of a deer in a headlight. You made an interesting comment on your prior show that he's almost like he's asking for regulation. You know, he stumbled into some really big Harry nasty areas that were never necessarily intended when they launched Facebook out of his dorm room many, many moons ago. So what is the role of the law? Because the other thing that we've seen, unfortunately, a lot of those hearings is a lot of our elected officials are way, way, way behind there, still printing their e mails, right? So what is the role of the law? How should we think about it? What shall we What should we invite from fromthe law to help sort some of this stuff out? >>I think as an individual, right, I would like for each company not to make up their own set of principles. I would like to have a shared set of principles that were following the challenge. Right, is that with between governments, that's impossible. China is never gonna come up with same regulations that we will. They have a different privacy standards than we D'oh. Um, but we are seeing locally like the state of Washington has created a future of work task force. And they're coming into the private sector and asking companies like text you and like Google and Microsoft to actually advise them on what should we be regulating? We don't know. We're not the technologists, but they know how to regulate. And they know how to move policies through the government. What will find us if we don't advise regulators on what we should be regulating? They're going to regulate it in some way, just like they regulated the tobacco industry. Just like they regulated. Sort of, um, monopolies that tech is big enough. Now there is enough money in it now that it will be regularly. So we need to start advising them on what we should regulate because just like Mark, he said. While everyone else was doing it, my competitors were doing it. So if you >>don't want me to do it, make us all stop. What >>can I do? A negative bell and that would not for you, but for Mark's responsibly. That's crazy. So So bob old man at the mall. It's actually a little bit more codified right, There's GDP are which came through May of last year and now the newness to California Extra Gatorade, California Consumer Protection Act, which goes into effect January 1. And you know it's interesting is that the hardest part of the implementation of that I think I haven't implemented it is the right to be for gotten because, as we all know, computers, air, really good recording information and cloud. It's recorded everywhere. There's no there there. So when these types of regulations, how does that impact? Aye, aye, because if I've got an algorithm built on a data set in in person, you know, item number 472 decides they want to be forgotten How that too I deal with that. >>Well, I mean, I think with Facebook, I can see that as I think. I suspect Mark knows what's right and wrong. He's just kicking ball down tires like >>I want you guys. >>It's your problem, you know. Please tell me what to do. I see a ice kind of like any other new technology, you know, it could be abused and used in the wrong waste. I think legally we have a constitution that protects our rights. And I think we're going to see the lawyers treat a I just like any other constitutional things and people who are building products using a I just like me build medical products or other products and actually harmful people. You're gonna have to make sure that you're a I product does not harm people. You're a product does not include no promote discriminatory results. So I >>think we're going >>to see our constitutional thing is going applied A I just like we've seen other technologies work. >>And it's gonna create jobs because of that, right? Because >>it will be a whole new set of lawyers >>the holdings of lawyers and testers, even because otherwise of an individual company is saying. But we tested. It >>works. Trust us. Like, how are you gonna get the independent third party verification of that? So we're gonna start to see a whole terrorist proliferation of that type of fields that never had to exist before. >>Yeah, one of my favorite doctor room. A child. Grief from a center. If you don't follow her on Twitter Follower. She's fantastic and a great lady. So I want to stick with you for a minute, Bob, because the next topic is autonomous. And Rahman up on the keynote this morning, talked about missed and and really, this kind of shifting workload of fixing things into an autonomous set up where the system now is, is finding problems, diagnosing problems, fixing problems up to, I think, he said, even generating return authorizations for broken gear, which is amazing. But autonomy opens up all kinds of crazy, scary things. Robert Gates, we interviewed said, You know, the only guns that are that are autonomous in the entire U. S. Military are the ones on the border of North Korea. Every single other one has to run through a person when you think about autonomy and when you can actually grant this this a I the autonomy of the agency toe act. What are some of the things to think about in the word of the things to keep from just doing something bad, really, really fast and efficiently? >>Yeah. I mean, I think that what we discussed, right? I mean, I think Pakal purposes we're far, you know, there is a tipping point. I think eventually we will get to the CP 30 Terminator day where we actually build something is on par with the human. But for the purposes right now, we're really looking at tools that we're going to help businesses, doctors, self driving cars and those tools are gonna be used by our customers to basically allow them to do more productive things with their time. You know, whether it's doctor that's using a tool to actually use a I to predict help bank better predictions. They're still gonna be a human involved, you know, And what Romney talked about this morning and networking is really allowing our I T customers focus more on their business problems where they don't have to spend their time finding bad hard were bad software and making better experiences for the people. They're actually trying to serve >>right, trying to get your take on on autonomy because because it's a different level of trust that we're giving to the machine when we actually let it do things based on its own. But >>there's there's a lot that goes into this decision of whether or not to allow autonomy. There's an example I read. There's a book that just came out. Oh, what's the title? You look like a thing. And I love you. It was a book named by an A I, um if you want to learn a lot about a I, um and you don't know much about it, Get it? It's really funny. Um, so in there there is in China. Ah, factory where the Aye Aye. Is optimizing um, output of cockroaches now they just They want more cockroaches now. Why do they want that? They want to grind them up and put them in a lotion. It's one of their secret ingredients now. It depends on what parameters you allow that I to change, right? If you decide Thio let the way I flood the container, and then the cockroaches get out through the vents and then they get to the kitchen to get food, and then they reproduce the parameters in which you let them be autonomous. Over is the challenge. So when we're working with very narrow Ai ai, when use hell the Aye. Aye. You can change these three things and you can't just change anything. Then it's a lot easier to make that autonomous decision. Um and then the last part of it is that you want to know what is the results of a negative outcome, right? There was the result of a positive outcome. And are those results something that we can take actually? >>Right, Right. Roger, don't give you the last word on the time. Because kind of the next order of step is where that machines actually write their own algorithms, right? They start to write their own code, so they kind of take this next order of thought and agency, if you will. How do you guys think about that? You guys are way out ahead in the space, you have huge data set. You got great technology. Got tensorflow. When will the machines start writing their own A their own out rhythms? Well, and actually >>it's already starting there that, you know, for example, we have we have a product called Google Cloud. Ottawa. Mel Village basically takes in a data set, and then we find the best model to be able to match that data set. And so things like that that that are there already, but it's still very nascent. There's a lot more than that that can happen. And I think ultimately with with how it's used I think part of it is you have to start. Always look at the downside of automation. And what is what is the downside of a bad decision, whether it's the wrong algorithm that you create or a bad decision in that model? And so if the downside is really big, that's where you need to start to apply Human in the loop. And so, for example, in medicine. Hey, I could do amazing things to detect diseases, but you would want a doctor in the loop to be able to actually diagnose. And so you need tohave have that place in many situations to make sure that it's being applied well. >>But is that just today? Or is that tomorrow? Because, you know, with with exponential growth and and as fast as these things are growing, will there be a day where you don't necessarily need maybe need the doctor to communicate the news? Maybe there's some second order impacts in terms of how you deal with the family and, you know, kind of pros and cons of treatment options that are more emotional than necessarily mechanical, because it seems like eventually that the doctor has a role. But it isn't necessarily in accurately diagnosing a problem. >>I think >>I think for some things, absolutely over time the algorithms will get better and better, and you can rely on them and trust them more and more. But again, I think you have to look at the downside consequence that if there's a bad decision, what happens and how is that compared to what happens today? And so that's really where, where that is. So, for example, self driving cars, we will get to the point where cars are driving by themselves. There will be accidents, but the accident rate is gonna be much lower than what's there with humans today, and so that will get there. But it will take time. >>And there was a day when will be illegal for you to drive. You have manslaughter, right? >>I I believe absolutely there will be in and and I don't think it's that far off. Actually, >>wait for the day when I have my car take me up to Northern California with me. Sleepy. I've only lived that long. >>That's right. And work while you're while you're sleeping, right? Well, I want to thank everybody Aton for being on this panel. This has been super fun and these air really big issues. So I want to give you the final word will just give everyone kind of a final say and I just want to throw out their Mars law. People talk about Moore's law all the time. But tomorrow's law, which Gardner stolen made into the hype cycle, you know, is that we tend to overestimate in the short term, which is why you get the hype cycle and we turn. Tend to underestimate, in the long term the impacts of technology. So I just want it is you look forward in the future won't put a year number on it, you know, kind of. How do you see this rolling out? What do you excited about? What are you scared about? What should we be thinking about? We'll start with you, Bob. >>Yeah, you know, for me and, you know, the day of the terminus Heathrow. I don't know if it's 100 years or 1000 years. That day is coming. We will eventually build something that's in part of the human. I think the mission about the book, you know, you look like a thing and I love >>you. >>Type of thing that was written by someone who tried to train a I to basically pick up lines. Right? Cheesy pickup lines. Yeah, I'm not for sure. I'm gonna trust a I to help me in my pickup lines yet. You know I love you. Look at your thing. I love you. I don't know if they work. >>Yeah, but who would? Who would have guessed online dating is is what it is if you had asked, you know, 15 years ago. But I >>think yes, I think overall, yes, we will see the Terminator Cp through It was probably not in our lifetime, but it is in the future somewhere. A. I is definitely gonna be on par with the Internet cell phone, radio. It's gonna be a technology that's gonna be accelerating if you look where technology's been over last. Is this amazing to watch how fast things have changed in our lifetime alone, right? Yeah, we're just on this curve of technology accelerations. This in the >>exponential curves China. >>Yeah, I think the thing I'm most excited about for a I right now is the addition of creativity to a lot of our jobs. So ah, lot of we build an augmented writing product. And what we do is we look at the words that have happened in the world and their outcomes. And we tell you what words have impacted people in the past. Now, with that information, when you augment humans in that way, they get to be more creative. They get to use language that have never been used before. To communicate an idea. You can do this with any field you can do with composition of music. You can if you can have access as an individual, thio the data of a bunch of cultures the way that we evolved can change. So I'm most excited about that. I think I'm most concerned currently about the products that we're building Thio Give a I to people that don't understand how to use it or how to make sure they're making an ethical decision. So it is extremely easy right now to go on the Internet to build a model on a data set. And I'm not a specialist in data, right? And so I have no idea if I'm adding bias in or not, um and so it's It's an interesting time because we're in that middle area. Um, and >>it's getting loud, all right, Roger will throw with you before we have to cut out, or we're not gonna be able to hear anything. So I actually start every presentation out with a picture of the Mosaic browser, because what's interesting is I think that's where >>a eyes today compared to kind of weather when the Internet was around 1994 >>were just starting to see how a I can actually impact the average person. As a result, there's a lot of hype, but what I'm actually finding is that 70% of the company's I talked to the first question is, Why should I be using this? And what benefit does it give me? Why 70% ask you why? Yeah, and and what's interesting with that is that I think people are still trying to figure out what is this stuff good for? But to your point about the long >>run, and we underestimate the longer I think that every company out there and every product will be fundamentally transformed by eye over the course of the next decade, and it's actually gonna have a bigger impact on the Internet itself. And so that's really what we have to look forward to. >>All right again. Thank you everybody for participating. There was a ton of fun. Hope you had fun. And I look at the score sheet here. We've got Bob coming in and the bronze at 15 points. Rajan, it's 17 in our gold medal winner for the silver Bell. Is Sharna at 20 points. Again. Thank you. Uh, thank you so much and look forward to our next conversation. Thank Jeffrey Ake signing out from Caesar's Juniper. Next word unpacking. I Thanks for watching.