>>Mhm Hello and welcome to the cubes coverage of AWS amazon web services, Global public Sector partner awards program. I'm john for your host of the cube here we're gonna talk about the best covid solution to great guests. Benham or with healthcare and life sciences lead at palantir Ben welcome to the cube SAm Michaels, Director of automation and compound management and Cats. National Center for advancing translational sciences and Cats. Part of the NIH National sort of health Gentlemen, thank you for coming on and and congratulations on the best covid solution. >>Thank you so much john >>so I gotta, I gotta ask you the best solution is when can I get the vaccine? How fast how long it's gonna last but I really appreciate you guys coming on. I >>hope you're vaccinated. I would say john that's outside of our hands. I would say if you've not got vaccinated, go get vaccinated right now, have someone stab you in the arm, you know, do not wait and and go for it. That's not on us. But you got that >>opportunity that we have that done. I got to get on a plane and all kinds of hoops to jump through. We need a better solution anyway. You guys have a great technical so I wanna I wanna dig in all seriousness aside getting inside. Um you guys have put together a killer solution that really requires a lot of data can let's step back and and talk about first. What was the solution that won the award? You guys have a quick second set the table for what we're talking about. Then we'll start with you. >>So the national covered cohort collaborative is a secure data enclave putting together the HR records from more than 60 different academic medical centers across the country and they're making it available to researchers to, you know, ask many and varied questions to try and understand this disease better. >>See and take us through the challenges here. What was going on? What was the hard problem? I'll see everyone had a situation with Covid where people broke through and cloud as he drove it amazon is part of the awards, but you guys are solving something. What was the problem statement that you guys are going after? What happened? >>I I think the problem statement is essentially that, you know, the nation has the electronic health records, but it's very fragmented, right. You know, it's been is highlighted is there's there's multiple systems around the country, you know, thousands of folks that have E H. R. S. But there is no way from a research perspective to actually have access in any unified location. And so really what we were looking for is how can we essentially provide a centralized location to study electronic health records. But in a Federated sense because we recognize that the data exist in other locations and so we had to figure out for a vast quantity of data, how can we get data from those 60 sites, 60 plus that Ben is referencing from their respective locations and then into one central repository, but also in a common format. Because that's another huge aspect of the technical challenge was there's multiple formats for electronic health records, there's different standards, there's different versions. And how do you actually have all of this data harmonised into something which is usable again for research? >>Just so many things that are jumping in my head right now, I want to unpack one at the time Covid hit the scramble and the imperative for getting answers quickly was huge. So it's a data problem at a massive scale public health impact. Again, we were talking before we came on camera, public health records are dirty, they're not clean. A lot of things are weird. I mean, just just massive amount of weird problems. How did you guys pull together take me through how this gets done? What what happened? Take us through the the steps He just got together and said, let's do this. How does it all happen? >>Yeah, it's a great and so john, I would say so. Part of this started actually several years ago. I explain this when people talk about in three C is that and Cats has actually established what we like to call, We support a program which is called the Clinical translation Science Award program is the largest single grant program in all of NIH. And it constitutes the bulk of the Cats budget. So this is extra metal grants which goes all over the country. And we wanted this group to essentially have a common research environment. So we try to create what we call the secure scientific collaborative platforms. Another example of this is when we call the rare disease clinical research network, which again is a consortium of 20 different sites around the nation. And so really we started working this several years ago that if we want to Build an environment that's collaborative for researchers around the country around the world, the natural place to do that is really with a cloud first strategy and we recognize this as and cats were about 600 people now. But if you look at the size of our actual research community with our grantees were in the thousands. And so from the perspective that we took several years ago was we have to really take a step back. And if we want to have a comprehensive and cohesive package or solution to treat this is really a mid sized business, you know, and so that means we have to treat this as a cloud based enterprise. And so in cats several years ago had really gone on this strategy to bring in different commercial partners, of which one of them is Palin tear. It actually started with our intramural research program and obviously very heavy cloud use with AWS. We use your we use google workspace, essentially use different cloud tools to enable our collaborative researchers. The next step is we also had a project. If we want to have an environment, we have to have access. And this is something that we took early steps on years prior that there is no good building environment if people can't get in the front door. So we invested heavily and create an application which we call our Federated authentication system. We call it unified and cats off. So we call it, you know, for short and and this is the open source in house project that we built it and cats. And we wanted to actually use this for all sorts of implementation, acting as the front door to this collaborative environment being one of them. And then also by by really this this this interest in electronic health records that had existed prior to the Covid pandemic. And so we've done some prior work via mixture of internal investments in grants with collaborative partners to really look at what it would take to harmonize this data at scale. And so like you mentioned, Covid hit it. Hit really hard. Everyone was scrambling for answers. And I think we had a bit of these pieces um, in play. And then that's I think when we turned to ban and the team at volunteer and we said we have these components, we have these pieces what we really need. Something independent that we can stand up quickly to really address some of these problems. One of the biggest one being that data ingestion and the harmonization step. And so I can let Ben really speak to that one. >>Yeah. Ben Library because you're solving a lot of collaboration problems, not just the technical problem but ingestion and harmonization ingestion. Most people can understand is that the data warehousing or in the database know that what that means? Take us through harmonization because not to put a little bit of shade on this, but most people think about, you know, these kinds of research or non profits as a slow moving, you know, standing stuff up sandwich saying it takes time you break it down. By the time you you didn't think things are over. This was agile. So take us through what made it an agile because that's not normal. I mean that's not what you see normally. It's like, hey we'll see you next year. We stand that up. Yeah. At the data center. >>Yeah, I mean so as as Sam described this sort of the question of data on interoperability is a really essential problem for working with this kind of data. And I think, you know, we have data coming from more than 60 different sites and one of the reasons were able to move quickly was because rather than saying oh well you have to provide the data in a certain format, a certain standard. Um and three C. was able to say actually just give us the data how you have it in whatever format is easiest for you and we will take care of that process of actually transforming it into a single standard data model, converting all of the medical vocabularies, doing all of the data quality assessment that's needed to ensure that data is actually ready for research and that was very much a collaborative endeavor. It was run out of a team based at johns Hopkins University, but in collaboration with a broad range of researchers who are all adding their expertise and what we were able to do was to provide the sort of the technical infrastructure for taking the transformation pipelines that are being developed, that the actual logic and the code and developing these very robust kind of centralist templates for that. Um, that could be deployed just like software is deployed, have changed management, have upgrades and downgrades and version control and change logs so that we can roll that out across a large number of sites in a very robust way very quickly. So that's sort of that, that that's one aspect of it. And then there was a bunch of really interesting challenges along the way that again, a very broad collaborative team of researchers worked on and an example of that would be unit harmonization and inference. So really simple things like when a lab result arrives, we talked about data quality, um, you were expected to have a unit right? Like if you're reporting somebody's weight, you probably want to know if it's in kilograms or pounds, but we found that a very significant proportion of the time the unit was actually missing in the HR record. And so unless you can actually get that back, that becomes useless. And so an approach was developed because we had data across 60 or more different sites, you have a large number of lab tests that do have the correct units and you can look at the data distributions and decide how likely is it that this missing unit is actually kilograms or pounds and save a huge portion of these labs. So that's just an example of something that has enabled research to happen that would not otherwise have been able >>just not to dig in and rat hole on that one point. But what time saving do you think that saves? I mean, I can imagine it's on the data cleaning side. That's just a massive time savings just in for Okay. Based on the data sampling, this is kilograms or pounds. >>Exactly. So we're talking there's more than 3.5 billion lab records in this data base now. So if you were trying to do this manually, I mean, it would take, it would take to thousands of years, you know, it just wouldn't be a black, it would >>be a black hole in the dataset, essentially because there's no way it would get done. Ok. Ok. Sam take me through like from a research standpoint, this normalization, harmonization the process. What does that enable for the, for the research and who decides what's the standard format? So, because again, I'm just in my mind thinking how hard this is. And then what was the, what was decided? Was it just on the base records what standards were happening? What's the impact of researchers >>now? It's a great quite well, a couple things I'll say. And Ben has touched on this is the other real core piece of N three C is the community, right? You know, And so I think there's a couple of things you mentioned with this, johN is the way we execute this is, it was very nimble, it was very agile and there's something to be said on that piece from a procurement perspective, the government had many covid authorities that were granted to make very fast decisions to get things procured quickly. And we were able to turn this around with our acquisition shop, which we would otherwise, you know, be dead in the water like you said, wait a year ago through a normal acquisition process, which can take time, but that's only one half the other half. And really, you're touching on this and Ben is touching on this is when he mentions the research as we have this entire courts entire, you know, research community numbering in the thousands from a volunteer perspective. I think it's really fascinating. This is a really a great example to me of this public private partnership between the companies we use, but also the academic participants that are actually make up the community. Um again, who the amount of time they have dedicated on this is just incredible. So, so really, what's also been established with this is core governance. And so, you know, you think from assistance perspective is, you know, the Palin tear this environment, the N three C environment belongs to the government, but the N 33 the entire actually, you know, program, I would say, belongs to the community. We have co governance on this. So who decides really is just a mixture between the folks on End Cats, but not just end cast as folks at End Cats, folks that, you know, and I proper, but also folks and other government agencies, but also the, the academic communities and entire these mixed governance teams that actually set the stage for all of this. And again, you know, who's gonna decide the standard, We decide we're gonna do this in Oman 5.3 point one um is the standard we're going to utilize. And then once the data is there, this is what gets exciting is then they have the different domain teams where they can ask different research questions depending upon what has interest scientifically to them. Um and so really, you know, we viewed this from the government's perspective is how do we build again the secure platform where we can enable the research, but we don't really want to dictate the research. I mean, the one criteria we did put your research has to be covid focused because very clearly in response to covid, so you have to have a Covid focus and then we have data use agreements, data use request. You know, we have entire governance committees that decide is this research in scope, but we don't want to dictate the research types that the domain teams are bringing to the table. >>And I think the National Institutes of Health, you think about just that their mission is to serve the public health. And I think this is a great example of when you enable data to be surfaced and available that you can really allow people to be empowered and not to use the cliche citizen analysts. But in a way this is what the community is doing. You're doing research and allowing people from volunteers to academics to students to just be part of it. That is citizen analysis that you got citizen journalism. You've got citizen and uh, research, you've got a lot of democratization happening here. Is that part of it was a result of >>this? Uh, it's both. It's a great question. I think it's both. And it's it's really by design because again, we want to enable and there's a couple of things that I really, you know, we we clamor with at end cats. I think NIH is going with this direction to is we believe firmly in open science, we believe firmly in open standards and how we can actually enable these standards to promote this open science because it's actually nontrivial. We've had, you know, the citizen scientists actually on the tricky problem from a governance perspective or we have the case where we actually had to have students that wanted access to the environment. Well, we actually had to have someone because, you know, they have to have an institution that they come in with, but we've actually across some of those bridges to actually get students and researchers into this environment very much by design, but also the spirit which was held enabled by the community, which, again, so I think they go they go hand in hand. I planned for >>open science as a huge wave, I'm a big fan, I think that's got a lot of headroom because open source, what that's done to software, the software industry, it's amazing. And I think your Federated idea comes in here and Ben if you guys can just talk through the Federated, because I think that might enable and remove some of the structural blockers that might be out there in terms of, oh, you gotta be affiliate with this or that our friends got to invite you, but then you got privacy access and this Federated ID not an easy thing, it's easy to say. But how do you tie that together? Because you want to enable frictionless ability to come in and contribute same time you want to have some policies around who's in and who's not. >>Yes, totally, I mean so Sam sort of already described the the UNa system which is the authentication system that encounters has developed. And obviously you know from our perspective, you know we integrate with that is using all of the standard kind of authentication protocols and it's very easy to integrate that into the family platform um and make it so that we can authenticate people correctly. But then if you go beyond authentication you also then to actually you need to have the access controls in place to say yes I know who this person is, but now what should they actually be able to see? Um And I think one of the really great things in Free C has done is to be very rigorous about that. They have their governance rules that says you should be using the data for a certain purpose. You must go through a procedure so that the access committee approves that purpose. And then we need to make sure that you're actually doing the work that you said you were going to. And so before you can get your data back out of the system where your results out, you actually have to prove that those results are in line with the original stated purpose and the infrastructure around that and having the access controls and the governance processes, all working together in a seamless way so that it doesn't, as you say, increase the friction on the researcher and they can get access to the data for that appropriate purpose. That was a big component of what we've been building out with them three C. Absolutely. >>And really in line john with what NIH is doing with the research, all service, they call this raz. And I think things that we believe in their standards that were starting to follow and work with them closely. Multifactor authentication because of the point Ben is making and you raised as well, you know, one you need to authenticate, okay. This you are who you say you are. And and we're recognizing that and you're, you know, the author and peace within the authors. E what do you authorized to see? What do you have authorization to? And they go hand in hand and again, non trivial problems. And especially, you know, when we basis typically a lot of what we're using is is we'll do direct integrations with our package. We using commons for Federated access were also even using login dot gov. Um, you know, again because we need to make sure that people had a means, you know, and login dot gov is essentially a runoff right? If they don't have, you know an organization which we have in common or a Federated access to generate a login dot gov account but they still are whole, you know beholden to the multi factor authentication step and then they still have to get the same authorizations because we really do believe access to these environment seamlessly is absolutely critical, you know, who are users are but again not make it restrictive and not make it this this friction filled process. That's very that's very >>different. I mean you think about nontrivial, totally agree with you and if you think about like if you were in a classic enterprise, I thought about an I. T. Problem like bring your own device to work and that's basically what the whole world does these days. So like you're thinking about access, you don't know who's coming in, you don't know where they're coming in from, um when the churn is so high, you don't know, I mean all this is happening, right? So you have to be prepared two Provisions and provide resource to a very lightweight access edge. >>That's right. And that's why it gets back to what we mentioned is we were taking a step back and thinking about this problem, you know, an M three C became the use case was this is an enterprise I. T. Problem. Right. You know, we have users from around the world that want to access this environment and again we try to hit a really difficult mark, which is secure but collaborative, Right? That's that's not easy, you know? But but again, the only place this environment could take place isn't a cloud based environment, right? Let's be real. You know, 10 years ago. Forget it. You know, Again, maybe it would have been difficult, but now it's just incredible how much they advanced that these real virtual research organizations can start to exist and they become the real partnerships. >>Well, I want to Well, that's a great point. I want to highlight and call out because I've done a lot of these interviews with awards programs over the years and certainly in public sector and open source over many, many years. One of the things open source allows us the code re use and also when you start getting in these situations where, okay, you have a crisis covid other things happen, nonprofits go, that's the same thing. They, they lose their funding and all the code disappears. Saying with these covid when it becomes over, you don't want to lose the momentum. So this whole idea of re use this platform is aged deplatforming of and re factoring if you will, these are two concepts with a cloud enables SAM, I'd love to get your thoughts on this because it doesn't go away when Covid's >>over, research still >>continues. So this whole idea of re platform NG and then re factoring is very much a new concept versus the old days of okay, projects over, move on to the next one. >>No, you're absolutely right. And I think what first drove us is we're taking a step back and and cats, you know, how do we ensure that sustainability? Right, Because my background is actually engineering. So I think about, you know, you want to build things to last and what you just described, johN is that, you know, that, that funding, it peaks, it goes up and then it wanes away and it goes and what you're left with essentially is nothing, you know, it's okay you did this investment in a body of work and it goes away. And really, I think what we're really building are these sustainable platforms that we will actually grow and evolve based upon the research needs over time. And I think that was really a huge investment that both, you know, again and and Cats is made. But NIH is going in a very similar direction. There's a substantial investment, um, you know, made in these, these these these really impressive environments. How do we make sure the sustainable for the long term? You know, again, we just went through this with Covid, but what's gonna come next? You know, one of the research questions that we need to answer, but also open source is an incredibly important piece of this. I think Ben can speak this in a second, all the harmonization work, all that effort, you know, essentially this massive, complex GTL process Is in the N three Seagate hub. So we believe, you know, completely and the open source model a little bit of a flavor on it too though, because, you know, again, back to the sustainability, john, I believe, you know, there's a room for this, this marriage between commercial platforms and open source software and we need both. You know, as we're strong proponents of N cats are both, but especially with sustainability, especially I think Enterprise I. T. You know, you have to have professional grade products that was part of, I would say an experiment we ran out and cast our thought was we can fund academic groups and we can have them do open source projects and you'll get some decent results. But I think the nature of it and the nature of these environments become so complex. The experiment we're taking is we're going to provide commercial grade tools For the academic community and the researchers and let them use them and see how they can be enabled and actually focus on research questions. And I think, you know, N3C, which we've been very successful with that model while still really adhering to the open source spirit and >>principles as an amazing story, congratulated, you know what? That's so awesome because that's the future. And I think you're onto something huge. Great point, Ben, you want to chime in on this whole sustainability because the public private partnership idea is the now the new model innovation formula is about open and collaborative. What's your thoughts? >>Absolutely. And I mean, we uh, volunteer have been huge proponents of reproducibility and openness, um in analyses and in science. And so everything done within the family platform is done in open source languages like python and R. And sequel, um and is exposed via open A. P. I. S and through get repository. So that as SaM says, we've we've pushed all of that E. T. L. Code that was developed within the platform out to the cats get hub. Um and the analysis code itself being written in those various different languages can also sort of easily be pulled out um and made available for other researchers in the future. And I think what we've also seen is that within the data enclave there's been an enormous amount of re use across the different research projects. And so actually having that security in place and making it secure so that people can actually start to share with each other securely as well. And and and be very clear that although I'm sharing this, it's still within the range of the government's requirements has meant that the, the research has really been accelerated because people have been able to build and stand on the shoulders of what earlier projects have done. >>Okay. Ben. Great stuff. 1000 researchers. Open source code and get a job. Where do I sign up? I want to get involved. This is amazing. Like it sounds like a great party. >>We'll send you a link if you do a search on on N three C, you know, do do a search on that and you'll actually will come up with a website hosted by the academic side and I'll show you all the information of how you can actually connect and john you're welcome to come in. Billion by all means >>billions of rows of data being solved. Great tech he's working on again. This is a great example of large scale the modern era of solving problems is here. It's out in the open, Open Science. Sam. Congratulations on your great success. Ben Award winners. You guys doing a great job. Great story. Thanks for sharing here with us in the queue. Appreciate it. >>Thank you, john. >>Thanks for having us. >>Okay. It is. Global public sector partner rewards best Covid solution palantir and and cats. Great solution. Great story. I'm john Kerry with the cube. Thanks for watching. Mm mm. >>Mhm

(upbeat music) >> Welcome to the special CUBE presentation of the AWS Global Public Sector Partner Awards Program. I'm here with the leader of the partner program, Sandy Carter, Vice President, AWS, Amazon Web Services @Sandy_Carter on Twitter, prolific on social and great leader. Sandy, great to see you again. And congratulations on this great program we're having here. In fact, thanks for coming out for this keynote. Well, thank you, John, for having me. You guys always talk about the coolest thing. So we had to be part of it. >> Well, one of the things that I've been really loving about this success of public sector we talked to us before is that as we start coming out of the pandemic, is becoming very clear that the cloud has helped a lot of people and your team has done amazing work, just want to give you props for that and say, congratulations, and what a great time to talk about the winners. Because everyone's been working really hard in public sector, because of the pandemic. The internet didn't break. And everyone stepped up with cloud scale and solve some problems. So take us through the award winners and talk about them. Give us an overview of what it is. The criteria and all the specifics. >> Yeah, you got it. So we've been doing this annually, and it's for our public sector partners overall, to really recognize the very best of the best. Now, we love all of our partners, John, as you know, but every year we'd like to really hone in on a couple who really leverage their skills and their ability to deliver a great customer solution. They demonstrate those Amazon leadership principles like working backwards from the customer, having a bias for action, they've engaged with AWS and very unique ways. And as well, they've contributed to our customer success, which is so very important to us and to our customers as well. >> That's awesome. Hey, can we put up a slide, I know we have slide on the winners, I want to look at them, with the tiles here. So here's a list of some of the winners. I see a nice little stars on there. Look at the gold star. I knows IronNet, CrowdStrike. That's General Keith Alexander's company, I mean, super relevant. Presidio, we've interviewed them before many times, got Palantir in there. And is there another one, I want to take a look at some of the other names here. >> In overall we had 21 categories. You know, we have over 1900 public sector partners today. So you'll notice that the awards we did, a big focus on mission. So things like government, education, health care, we spotlighted some of the brand new technologies like Containers, Artificial Intelligence, Amazon Connect. And we also this year added in awards for innovative use of our programs, like think big for small business and PTP as well. >> Yeah, well, great roundup, they're looking forward to hearing more about those companies. I have to ask you, because this always comes up, we're seeing more and more ecosystem discussions when we talk about the future of cloud. And obviously, we're going to, you know, be at Mobile World Congress, theCUBE, back in physical form, again, (indistinct) will continue to go on. The notion of ecosystem is becoming a key competitive advantage for companies and missions. So I have to ask you, why are partners so important to your public sector team? Talk about the importance of partners in context to your mission? >> Yeah, you know, our partners are critical. We drive most of our business and public sector through partners. They have great relationships, they've got great skills, and they have, you know, that really unique ability to meet the customer needs. If I just highlighted a couple of things, even using some of our partners who won awards, the first is, you know, migrations are so critical. Andy talked at Reinvent about still 96% of applications still sitting on premises. So anybody who can help us with the velocity of migrations is really critical. And I don't know if you knew John, but 80% of our migrations are led by partners. So for example, we gave awards to Collibra and Databricks as best lead migration for data as well as Datacom for best data lead migration as well. And that's because they increase the velocity of migrations, which increases customer satisfaction. They also bring great subject matter expertise, in particular around that mission that you're talking about. So for instance, GDIT won best Mission Solution For Federal, and they had just an amazing solution that was a secure virtual desktop that reduced a federal agencies deployment process, from months to days. And then finally, you know, our partners drive new opportunities and innovate on behalf of our customers. So we did award this year for P to P, Partnering to Partner which is a really big element of ecosystems, but it was won by four points and in quizon, and they were able to work together to implement a data, implement a data lake and an AI, ML solution, and then you just did the startup showcase, we have a best startup delivering innovation too, and that was EduTech (indistinct) Central America. And they won for implementing an amazing student registration and early warning system to alert and risks that may impact a student's educational achievement. So those are just some of the reasons why partners are important. I could go on and on. As you know, I'm so passionate about my partners, >> I know you're going to talk for an hour, we have to cut you off a little there. (indistinct) love your partners so much. You have to focus on this mission thing. It was a strong mission focus in the awards this year. Why are customers requiring much more of a mission focused? Is it because, is it a part of the criteria? I mean, we're seeing a mission being big. Why is that the case? >> Well, you know, IDC, said that IT spend for a mission or something with a purpose or line of business was five times greater than IT. We also recently did our CTO study where we surveyed thousands of CTOs. And the biggest and most changing elements today is really not around the technology. But it's around the industry, healthcare, space that we talked about earlier, or government. So those are really important. So for instance, New Reburial, they won Best Emission for Healthcare. And they did that because of their new smart diagnostic system. And then we had a partner when PA consulting for Best Amazon Connect solution around a mission for providing support for those most at risk, the elderly population, those who already had pre existing conditions, and really making sure they were doing what they called risk shielding during COVID. Really exciting and big, strong focus on mission. >> Yeah, and it's also, you know, we've been covering a lot on this, people want to work for a company that has purpose, and that has missions. I think that's going to be part of the table stakes going forward. I got to ask you on the secrets of success when this came up, I love asking this question, because, you know, we're starting to see the playbooks of what I call post COVID and cloud scale 2.0, whatever you want to call it, as you're starting to see this new modern era of success formulas, obviously, large scale value creation mission. These are points we're hearing and keep conversations across the board. What do you see as the secret of success for these parties? I mean, obviously, it's indirect for Amazon, I get that, but they're also have their customers, they're your customers, customers. That's been around for a while. But there's a new model emerging. What are the secrets from your standpoint of success? you know, it's so interesting, John, that you asked me this, because this is the number one question that I get from partners too. I would say the first secret is being able to work backwards from your customer, not just technology. So take one of our award winners Cognizant. They won for their digital tolling solution. And they work backwards from the customer and how to modernize that, or Pariveda, who is one of our best energy solution winners. And again, they looked at some of these major capital projects that oil companies were doing, working backwards from what the customer needed. I think that's number one, working backwards from the customer. Two, is having that mission expertise. So given that you have to have technology, but you also got to have that expertise in the area. We see that as a big secret of our public sector partners. So education cloud, (indistinct) one for education, effectual one for government and not for profit, Accenture won, really leveraging and showcasing their global expansion around public safety and disaster response. Very important as well. And then I would say the last secret of success is building repeatable solutions using those strong skills. So Deloitte, they have a great solution for migration, including mainframes. And then you mentioned early on, CloudStrike and IronNet, just think about the skill sets that they have there for repeatable solutions around security. So I think it's really around working backwards from the customer, having that mission expertise, and then building a repeatable solution, leveraging your skill sets. >> That's a great formula for success. I got you mentioned IronNet, and cybersecurity. One of things that's coming up is, in addition to having those best practices, there's also like real problems to solve, like, ransomware is now becoming a government and commercial problem, right. So (indistinct) seeing that happen a lot in DC, that's a front burner. That's a societal impact issue. That's like a cybersecurity kind of national security defense issue, but also, it's a technical one. And also public sector, through my interviews, I can tell you the past year and a half, there's been a lot of creativity of new solutions, new problems or new opportunities that are not yet identified as problems and I'd love to get your thoughts on my concern is with Jeff Bar yesterday from AWS, who's been blogging all the the news and he is a leader in the community. He was saying that he sees like 5G in the edge as new opportunities where it's creative. It's like he compared to the going to the home improvement store where he just goes to buy one thing. He does other things. And so there's a builder culture. And I think this is something that's coming out of your group more, because the pandemic forced these problems, and they forced new opportunities to be creative, and to build. What's your thoughts? >> Yeah, so I see that too. So if you think about builders, you know, we had a partner, Executive Council yesterday, we had 900, executives sign up from all of our partners. And we asked some survey questions like, what are you building with today? And the number one thing was artificial intelligence and machine learning. And I think that's such a new builders tool today, John, and, you know, one of our partners who won an award for the most innovative AI&ML was Kablamo And what they did was they use AI&ML to do a risk assessment on bushfires or wildfires in Australia. But I think it goes beyond that. I think it's building for that need. And this goes back to, we always talk about #techforgood. Presidio, I love this award that they won for best nonprofit, the Cherokee Nation, which is one of our, you know, Native American heritage, they were worried about their language going out, like completely out like no one being able to speak yet. And so they came to Presidio, and they asked how could we have a virtual classroom platform for the Cherokee Nation? And they created this game that's available on your phone, so innovative, so much of a builder's culture to capture that young generation, so they don't you lose their language. So I do agree. I mean, we're seeing builders everywhere, we're seeing them use artificial intelligence, Container, security. And we're even starting with quantum, so it is pretty powerful of what you can do as a public sector partner. >> I think the partner equation is just so wide open, because it's always been based on value, adding value, right? So adding value is just what they do. And by the way, you make money doing it if you do a good job of adding value. And, again, I just love riffing on this, because Dave and I talked about this on theCUBE all the time, and it comes up all the time in cloud conversations. The lock in isn't proprietary technology anymore, its value, and scale. So you starting to see builders thrive in that environment. So really good points. Great best practice. And I think I'm very bullish on the partner ecosystems in general, and people do it right, flat upside. I got to ask you, though, going forward, because this is the big post COVID kind of conversation. And last time we talked on theCUBE about this, you know, people want to have a growth strategy coming out of COVID. They want to be, they want to have a tail win, they want to be on the right side of history. No one wants to be in the losing end of all this. So last year in 2021 your goals were very clear, mission, migrations, modernization. What's the focus for the partners beyond 2021? What are you guys thinking to enable them, 21 is going to be a nice on ramp to this post COVID growth strategy? What's the focus beyond 2021 for you and your partners? >> Yeah, it's really interesting, we're going to actually continue to focus on those three M's mission, migration and modernization. But we'll bring in different elements of it. So for example, on mission, we see a couple of new areas that are really rising to the top, Smart Cities now that everybody's going back to work and (indistinct) down, operations and maintenance and global defense and using gaming and simulation. I mean, think about that digital twin strategy and how you're doing that. For migration, one of the big ones we see emerging today is data-lead migration. You know, we have been focused on applications and mainframes, but data has gravity. And so we are seeing so many partners and our customers demanding to get their data from on premises to the cloud so that now they can make real time business decisions. And then on modernization. You know, we talked a lot about artificial intelligence and machine learning. Containers are wicked hot right now, provides you portability and performance. I was with a startup last night that just moved everything they're doing to ECS our Container strategy. And then we're also seeing, you know, crippin, quantum blockchain, no code, low code. So the same big focus, mission migration, modernization, but the underpinnings are going to shift a little bit beyond 2021. >> That's great stuff. And you know, you have first of all people don't might not know that your group partners and Amazon Web Services public sector, has a big surface area. You talking about government, health care, space. So I have to ask you, you guys announced in March the space accelerator and you recently announced that you selected 10 companies to participate in the accelerated program. So, I mean, this is this is a space centric, you know, targeting, you know, low earth orbiting satellites to exploring the surface of the Moon and Mars, which people love. And because the space is cool, let's say the tech and space, they kind of go together, right? So take us through, what's this all about? How's that going? What's the selection, give us a quick update, while you're here on this space accelerated selection, because (indistinct) will have had a big blog post that went out (indistinct). >> Yeah, I would be thrilled to do that. So I don't know if you know this. But when I was young, I wanted to be an astronaut. We just helped through (indistinct), one of our partners reach Mars. So Clint, who is a retired general and myself got together, and we decided we needed to do something to help startups accelerate in their space mission. And so we decided to announce a competition for 10 startups to get extra help both from us, as well as a partner Sarafem on space. And so we announced it, everybody expected the companies to come from the US, John, they came from 44 different countries. We had hundreds of startups enter, and we took them through this six week, classroom education. So we had our General Clint, you know, helping and teaching them in space, which he's done his whole life, we provided them with AWS credits, they had mentoring by our partner, Sarafem. And we just down selected to 10 startups, that was what Vernors blog post was. If you haven't read it, you should look at some of the amazing things that they're going to do, from, you know, farming asteroids to, you know, helping with some of the, you know, using small vehicles to connect to larger vehicles, when we all get to space. It's very exciting. Very exciting, indeed, >> You have so much good content areas and partners, exploring, it's a very wide vertical or sector that you're managing. Is there any pattern? Well, I want to get your thoughts on post COVID success again, is there any patterns that you're seeing in terms of the partner ecosystem? You know, whether its business model, or team makeup, or more mindset, or just how they're organizing that that's been successful? Is there like a, do you see a trend? Is there a certain thing, then I've got the working backwards thing, I get that. But like, is there any other observations? Because I think people really want to know, am I doing it right? Am I being a good manager, when you know, people are going to be working remotely more? We're seeing more of that. And there's going to be now virtual events, hybrid events, physical events, the world's coming back to normal, but it's never going to be the same. Do you see any patterns? >> Yeah, you know, we're seeing a lot of small partners that are making an entrance and solving some really difficult problems. And because they're so focused on a niche, it's really having an impact. So I really believe that that's going to be one of the things that we see, I focus on individual creators and companies who are really tightly aligned and not trying to do everything, if you will. I think that's one of the big trends. I think the second we talked about it a little bit, John, I think you're going to see a lot of focus on mission. Because of that purpose. You know, we've talked about #techforgood, with everything going on in the world. As people have been working from home, they've been reevaluating who they are, and what do they stand for, and people want to work for a company that cares about people. I just posted my human footer on LinkedIn. And I got my first over a million hits on LinkedIn, just by posting this human footer, saying, you know what, reply to me at a time that's convenient for you, not necessarily for me. So I think we're going to see a lot of this purpose driven mission, that's going to come out as well. >> Yeah, and I also noticed that, and I was on LinkedIn, I got a similar reaction when I started trying to create more of a community model, not so much have people attend our events, and we need butts in the seats. It was much more personal, like we wanted you to join us, not attend and be like a number. You know, people want to be part of something. This seem to be the new mission. >> Yeah, I completely agree with that. I think that, you know, people do want to be part of something and they want, they want to be part of the meaning of something too, right. Not just be part of something overall, but to have an impact themselves, personally and individually, not just as a company. And I think, you know, one of the other trends that we saw coming up too, was the focus on technology. And I think low code, no code is giving a lot of people entry into doing things I never thought they could do. So I do think that technology, artificial intelligence Containers, low code, no code blockchain, those are going to enable us to even do greater mission-based solutions. >> Low code, no code reduces the friction to create more value, again, back to the value proposition. Adding value is the key to success, your partners are doing it. And of course, being part of something great, like the Global Public Sector Partner Awards list is a good one. And that's what we're talking about here. Sandy, great to see you. Thank you for coming on and sharing your insights and an update and talking more about the 2021, Global Public Sector partner Awards. Thanks for coming on. >> Thank you, John, always a pleasure. >> Okay, the Global Leaders here presented on theCUBE, again, award winners doing great work in mission, modernization, again, adding value. That's what it's all about. That's the new competitive advantage. This is theCUBE. I'm John Furrier, your host, thanks for watching. (upbeat music)

>> From theCUBE studios in Palo Alto and Boston, bringing you data-driven insights from theCUBE and ETR, this is Breaking Analysis with Dave Vellante. >> In our 2020 predictions post, we said that organizations would begin to operationalize their digital transformation experiments and POCs. We also said that based on spending data that cybersecurity companies like CrowdStrike and Okta were poised to rise above the rest in 2020, and we even said the S&P 500 would surpass 3,700 this year. Little did we know that we'd have a pandemic that would make these predictions a virtual lock, and, of course, COVID did blow us out of the water in some other areas, like our prediction that IT spending would increase plus 4% in 2020, when in reality, we have a dropping by 4%. We made a number of other calls that did pretty well, but I'll let you review last year's predictions at your leisure to see how we did. Hello, everyone. This is Dave Vellante and welcome to this week's Wikibon CUBE Insights powered by ETR. Erik Bradley of ETR is joining me again for this Breaking Analysis, and we're going to lay out our top picks for 2021. Erik, great to see you. Welcome back. Happy to have you on theCUBE, my friend. >> Always great to see you too, Dave. I'm excited about these picks this year. >> Well, let's get right into it. Let's bring up the first prediction here. Tech spending will rebound in 2021. We expect a 4% midpoint increase next year in spending. Erik, there are a number of factors that really support this prediction, which of course is based on ETR's most recent survey work, and we've listed a number of them here in this slide. I wonder if we can talk about that a little bit, the pace of the vaccine rollout. I've called this a forced march to COVID, but I can see people doubling down on things that are working. Productivity improvements are going to go back into the business. People are going to come back to the headquarters and that maybe is going to spur infrastructure on some pent-up demand, and work from home, we're going to talk about that. What are your thoughts on this prediction? >> Well, first of all, you weren't wrong last year. You were just, (laughs) you were just delayed. Just delayed a little bit, that's all. No, very much so. Early on, just three months ago, we were not seeing this optimism. The most recent survey, however, is capturing 4%. I truly believe that still might be a little bit mild. I think it can go even higher, and that's going to be driven by some of the things you've said about. This is a year where a lot of spending was paused on machine learning, on automation, on some of these projects that had to be stopped because of what we all went through. Right now, that is not a nice to have, it's a must have, and that spending is going quickly. There's a rapid pace on that spending, so I do think that's going to push it and, of course, security. We're going to get to this later on so I don't want to bury the lede, but with what's happening right now, every CISO I speak to is not panicked, but they are concerned and there will definitely be increased security spending that might push this 4% even higher. >> Yeah, and as we've reported as well, the survey data shows that there's less freezing of IT, there are fewer layoffs, there's more hiring, we're accelerating IT deployments, so that, I think, 34% last survey, 34% of organizations are accelerating IT deployments over the next three months, so that's great news. >> And also your point too about hiring. I was remiss in not bringing that up because we had layoffs and we had freezes on hiring. Both of that is stopping. As you know, as more head count comes in, whether that be from home or whether that be in your headquarters, both of those require support and require spending. >> All right, let's bring up the next prediction. Remote worker trends are going to become fossilized, settling in at an average of 34% by year-end 2021. Now, I love this chart, you guys. It's been amazingly consistent to me, Erik. We're showing data here from ETR's latest COVID survey. So it shows that prior to the pandemic, about 15 to 16% of employees on average worked remotely. That jumped to where we are today and well into the 70s, and we're going to stay close to that, according to the ETR data, in the first half of 2021, but by the end of the year, it's going to settle in at around 34%. Erik, that's double the pre-pandemic numbers and that's been consistent in your surveys over the past six month, and even within the sub-samples. >> Yeah, super surprised by the consistency, Dave. You're right about that. We were expecting the most recent data to kind of come down, right? We see the vaccines being rolled out. We kind of thought that that number would shift, but it hasn't, it has been dead consistent, and that's just from the data perspective. What we're hearing from the interviews and the feedback is that's not going to change, it really isn't, and there's a main reason for that. Productivity is up, and we'll talk about that in a second, but if you have productivity up and you have employees happy, they're not commuting, they're working more, they're working effectively, there is no reason to rush. And now imagine if you're a company that's trying to hire the best talent and attract the best talent but you're also the only company telling them where they have to live. I mean, good luck with that, right? So even if a few of them decide to make this permanent, that's something where you're going to really have to follow suit to attract talent. >> Yeah, so let's talk about that. Productivity leads us to our next prediction. We can bring that up. Number three is productivity increases are going to lead organizations to double down on the successes of 2020 and productivity apps are going to benefit. Now, of course, I'm always careful to cautious to interpret when you ask somebody by how much did productivity increase. It's a very hard thing to estimate depending on how you measure it. Is it revenue per employee? Is it profit? But nonetheless, the vast majority of people that we talk to are seeing productivity is going up. The productivity apps are really the winners here. Who do you see, Erik, as really benefiting from this trend? This year we saw Zoom, Teams, even Webex benefit, but how do you see this playing out in 2021? >> Well, first of all, the real beneficiaries are the companies themselves because they are getting more productivity, and our data is not only showing more productivity, but that's continuing to increase over time, so that's number one. But you're 100% right that the reason that's happening is because of the support of the applications and what would have been put in place. Now, what we do expect to see here, early on it was a rising tide lifted all boats, even Citrix got pulled up, but over time you realize Citrix is really just about legacy applications. Maybe that's not really the virtualization platform we need or maybe we just don't want to go that route at all. So the ones that we think are going to win longer term are part of this paradigm shift. The easiest one to put out as example is DocuSign. Nobody is going to travel and sit in an office to sign a paper ever again. It's not happening. I don't care if you go back to the office or you go back to headquarters. This is a paradigm shift that is not temporary. It is permanent. Another one that we're seeing is Smartsheet. Early on it started in. I was a little concerned about it 'cause it was a shadow IT type of a company where it was just spreading and spreading and spreading. It's turned out that this, the data on Smartsheet is continuing to be strong. It's an effective tool for project management when you're remotely working, so that's another one I don't see changing anytime. The other one I would call out would be Twilio. Slightly different, yes. It's more about the customer experience, but when you look at how many brick and mortar or how many in-person transactions have moved online and will stay there, companies like Twilio that support that customer experience, I'll throw out a Qualtrics out there as well, not a name we hear about a lot, but that customer experience software is a name that needs to be watched going forward. >> What do you think's going to happen to Zoom and Teams? Certainly Zoom just escalated this year, a huge ascendancy, and Teams I look at a little differently 'cause it's not just video conferencing, and both have done really, really well. How do you interpret the data that you're seeing there? >> There's no way around it, our data is decelerating quickly, really quickly. We were kind of bullish when Zoom first came out on the IPO prospects. It did very well. Obviously what happened in this remote shift turned them into an absolute overnight huge success. I don't see that continuing going forward, and there's a reason. What we're seeing and hearing from our feedback interviews is that now that people recognize this isn't temporary and they're not scrambling and they need to set up for permanency, they're going to consolidate their spend. They don't need to have Teams and Zoom. It's not necessary. They will consolidate where they can. There's always going to be the players that are going to choose Slack and Zoom 'cause they don't want to be on Microsoft architecture. That's fine, but you and I both know that the majority of large enterprises have Microsoft already. It's bundled in in pricing. I just don't see it happening. There's going to be M&A out there, which we can talk about again soon, so maybe Zoom, just like Slack, gets to a point where somebody thinks it's worthwhile, but there's a lot of other video conferencing out there. They're trying to push their telephony. They're trying to push their mobile solutions. There's a lot of companies out there doing it, so we'll see, but the current market cap does not seem to make sense in a permanent remote work situation. >> I think I'm inferring Teams is a little different because it's Microsoft. They've got this huge software estate they can leverage. They can bundle. Now, it's going to be interesting to see how and if Zoom can then expand its TAM, use its recent largesse to really enter potentially new markets. >> It will be, but listen, just the other day there was another headline that one of Zoom's executives out in China was actually blocking content as per directed by the Chinese government. Those are the kind of headlines that just really just get a little bit difficult when you're running a true enterprise size. Zoom is wonderful in the consumer space, but what I do is I research enterprise technology, and it's going to be really, really difficult to make inroads there with Microsoft. >> Yep. I agree. Okay, let's bring up number four, prediction number four. Permanent shifts in CISO strategies lead to measurable share shifts in network security. So the remote work sort of hyper-pivot, we'll call it, it's definitely exposed us. We've seen recent breaches that underscore the need for change. They've been well-publicized. We've talked a lot about identity access management, cloud security, endpoint security, and so as a result, we've seen the upstarts, and just a couple that we called, CrowdStrike, Okta, Zscaler has really benefited and we expect them to continue to show consistent growth, some well over 50% revenue growth. Erik, you really follow this space closely. You've been focused on microsegmentation and other, some of the big players. What are your thoughts here? >> Yeah, first of all, security, number one in spending overall when we started looking and asking people what their priority is going to be. That's not changing, and that was before the SolarWinds breach. I just had a great interview today with a CISO of a global hospitality enterprise to really talk about the implications of this. It is real. Him and his peers are not panicking but pretty close, is the way he put it, so there is spend happening. So first of all, to your point, continued on Okta, continued on identity access. See no reason why that changes. CrowdStrike, continue. What this is going to do is bring in some new areas, like we just mentioned, in network segmentation. Illumio is a pure play in that name that doesn't have a lot of citations, but I have watched over the last week their net spending score go from about 30 to 60%, so I am watching in real time, as this data comes in in the later part of our survey, that it's really happening Forescout is another one that's in there. We're seeing some of the zero trust names really picking up in the last week. Now, to talk about some of the more established names, yeah, Cisco plays in this space and we can talk about Cisco and what they're doing in security forever. They're really reinventing themselves and doing a great job. Palo Alto was in this space as well, but I do believe that network and microsegmentation is going to be something that's going to continue. The other one I'm going to throw out that I'm hearing a lot about lately is user behavior analytics. People need to be able to watch the trends, compare them to past trends, and catch something sooner. Varonis is a name in that space that we're seeing get a lot of adoptions right now. It's early trend, but based on our data, Varonis is a name to watch in that area as well. >> Yeah, and you mentioned Cisco transitioning, reinventing themselves toward a SaaS player. Their subscription, Cisco's security business is a real bright spot for them. Palo Alto, every time I sit in on a VENN, which is ETR's proprietary roundtable, the CISOs, they love Palo Alto. They want to work, many of them, anyway, want to work with Palo Alto. They see them as a thought leader. They seem to be getting their cloud act together. Fortinet has been doing a pretty good job there and especially for mid-market. So we're going to see this equilibrium, best of breed versus the big portfolio companies, and I think 2021 sets up as a really interesting battle for those guys with momentum and those guys with big portfolios. >> I completely agree and you nailed it again. Palo Alto has this perception that they're really thought leaders in the space and people want to work with them, but let's not rule Cisco out. They have a much, much bigger market cap. They are really good at acquisitions. In the past, they maybe didn't integrate them as well, but it seems like they're getting their act together on that. And they're pushing now what they call SecureX, which is sort of like their own full-on platform in the cloud, and they're starting to market that, I'm starting to hear more about it, and I do think Cisco is really changing people's perception of them. We shall see going forward because in the last year, you're 100% right, Palo Alto definitely got a little bit more of the sentiment, of positive sentiment. Now, let's also realize, and we'll talk about this again in a bit, there's a lot of players out there. There will probably be continued consolidation in the security space, that we'll see what happens, but it's an area where spending is increasing, there is a lot of vendors out there to play with, and I do believe we'll see consolidation in that space. >> Yes. No question. A highly fragmented business. A lack of skills is a real challenge. Automation is a big watch word and so I would expect, which brings us, Erik, to prediction number five. Can be hard to do prediction posts without talking about M&A. We see the trend toward increased tech spending driving more IPOs, SPACs and M&A. We've seen some pretty amazing liquidity events this year. Snowflake, obviously a big one. Airbnb, DoorDash, outside of our enterprise tech but still notable. Palantir, JFrog, number of others. UiPath just filed confidentially and their CEO said, "Over the next 12 to 18 months, I would think Automation Anywhere is going to follow suit at some point." Hashicorp was a company we called out in our 2020 predictions as one to watch along with Snowflake and some others, and, Erik, we've seen some real shifts in observability. The ELK Stack gaining prominence with Elastic, ChaosSearch just raised 40 million, and everybody's going after 5G. Lots of M&A opportunities. What are your thoughts? >> I think if we're going to make this a prediction show, I'm going to say that was a great year, but we're going to even have a better year next year. There is a lot of cash on the balance sheet. There are low interest rates. There is a lot of spending momentum in enterprise IT. The three of those set up for a perfect storm of more liquidity events, whether it be continued IPOs, whether it could be M&A, I do expect that to continue. You mentioned a lot of the names. I think you're 100% right. Another one I would throw out there in that observability space, is it's Grafana along with the ELK Stack is really making changes to some of the pure plays in that area. I've been pretty vocal about how I thought Splunk was having some problems. They've already made three acquisitions. They are trying really hard to get back up and keep that growth trajectory and be the great company they always have been, so I think the observability area is certainly one. We have a lot of names in that space that could be taken out. The other one that wasn't mentioned, however, that I'd like to mention is more in the CDN area. Akamai being the grandfather there, and we'll get into it a little bit too, but CloudFlare has a huge market cap, Fastly running a little bit behind that, and then there's Limelight, and there's a few startups in that space and the CDN is really changing. It's not about content delivery as much as it is about edge compute these days, and they would be a real easy takeout for one of these large market cap names that need to get into that spot. >> That's a great call. All right, let's bring up number six, and this is one that's near and dear to my heart. It's more of a longer-term prediction and that prediction is in the 2020s, 75% of large organizations are going to re-architect their big data platforms, and the premise here is we're seeing a rapid shift to cloud database and cross-cloud data sharing and automated governance. And the prediction is that because big data platforms are fundamentally flawed and are not going to be corrected by incremental improvements in data lakes and data warehouses and data hubs, we're going to see a shift toward a domain-centric ownership of the data pipeline where data teams are going to be organized around data product or data service builders and embedded into lines of business. And in this scenario, the technology details and complexity will become abstracted. You've got hyper-specialized data teams today. They serve multiple business owners. There's no domain context. Different data agendas. Those, we think, are going to be subsumed within the business lines, and in the future, the primary metric is going to shift from the cost and the quality of the big data platform outputs to the time it takes to go from idea to revenue generation, and this change is going to take four to five years to coalesce, but it's going to begin in earnest in 2021. Erik, anything you'd add to this? >> I'm going to let you kind of own that one 'cause I completely agree, and for all the listeners out there, that was Dave's original thought and I think it's fantastic and I want to get behind it. One of the things I will say to support that is big data analytics, which is what people are calling it because they got over the hype of machine learning, they're sick of vendors saying machine learning, and I'm hearing more and more people just talk about it as we need big data analytics, we need 'em at the edge, we need 'em faster, we need 'em in real time. That's happening, and what we're seeing more is this is happening with vendor-agnostic tools. This isn't just AWS-aligned. This isn't just GCP-aligned or Azure-aligned. The winners are the Snowflakes. The winners are the Databricks. The winners are the ones that are allowing this interoperability, the portability, which fully supports what you're saying. And then the only other comment I would make, which I really like about your prediction, is about the lines of business owning it 'cause I think this is even bigger. Right now, we track IT spending through the CIO, through the CTO, through IT in general. IT spending is actually becoming more diversified. IT spending is coming under the purview of marketing, it's coming under the purview of sales, so we're seeing more and more IT spending, but it's happening with the business user or the business lines and obviously data first, so I think you're 100% right. >> Yeah, and if you think about it, we've contextualized our operational systems, whether it's the CRM or the supply chain, the logistics, the business lines own their respective data. It's not true for the analytics systems, and we talked about Snowflake and Databricks. I actually see these two companies who were sort of birds of a feather in the early days together, applying Databricks machine learning on top of Snowflake, I actually see them going in diverging places. I see Databricks trying to improve on the data lake. I see Snowflake trying to reinvent the concept of data warehouse to this global mesh, and it's going to be really interesting to see how that shakes out. The data behind Snowflake, obviously very, very exciting. >> Yeah, it's just, real quickly to add on that if we have time, Dave. >> Yeah, sure. >> We all know the valuation of Snowflake, one of the most incredible IPOs I've seen in a long time. The data still supports it. It still supports that growth. Unfortunately for Databricks, their IPO has been a little bit more volatile. If you look at their stock chart every time they report, it's got a little bit of a roller coaster ride going on, and our most recent data for Databricks is actually decelerating, so again, I'm going to use the caveat that we only have about 950 survey responses in. We'll probably get that up to 1,300 or so, so it's not done yet, but right now we are putting Databricks into a category where we're seeing it decelerate a little bit, which is surprising for a company that's just right out of the gate. >> Well, it's interesting because I do see Databricks as more incremental on data lakes and I see Snowflake as more transformative, so at least from a vision standpoint, we'll see if they can execute on that. All right, number seven, let's bring up number seven. This is talking about the cloud, hybrid cloud, multi-cloud. The battle to define hybrid and multi-cloud is going to escalate in 2021. It's already started and it's going to create bifurcated CIO strategies. And, Erik, spending data clearly shows that cloud is continuing its steady margin share gains relative to on-prem, but the definitions of the cloud, they're shifting. Just a couple of years ago, AWS, they never talk about hybrid, just like they don't talk about multi-cloud today, yet AWS continues now to push into on-prem. They treat on-prem as just another node at the edge and they continue to win in the marketplace despite their slower growth rates. Still, they're so large now. 45 billion or so this year. The data is mixed. This ETR data shows that just under 50% of buyers are consolidating workloads, and then a similar, in the cloud workloads, and a similar percentage of customers are spreading evenly across clouds, so really interesting dynamic there. Erik, how do you see it shaking out? >> Yeah, the data is interesting here, and I would actually state that overall spend on the cloud is actually flat from last year, so we're not seeing a huge increase in spend, and coupled with that, we're seeing that the overall market share, which means the amount of responses within our survey, is increasing, certainly increasing. So cloud usage is increasing, but it's happening over an even spectrum. There's no clear winner of that market share increase. So they really, according to our data, the multi-cloud approach is happening and not one particular winner over another. That's just from the data perspective that various do point on AWS. Let's be honest, when they first started, they wanted all the data. They just want to take it from on-prem, put it in their data center. They wanted all of it. They never were interested in actually having interoperability. Then you look at an approach like Google. Google was always about the technology, but not necessarily about the enterprise customer. They come out with Anthos which is allowing you to have interoperability in more cloud. They're not nearly as big, but their growth rate is much higher. Law of numbers, of course. But it really is interesting to see how these cloud players are going to approach this because multi-cloud is happening whether they like it or not. >> Well, I'm glad you brought up multi-cloud in a context of what the data's showing 'cause I would agree we're, and particularly two areas that I would call out in ETR data, VMware Cloud on AWS as well as VM Cloud Foundation are showing real momentum and also OpenStack from Red Hat is showing real progress here and they're making moves. They're putting great solutions inside of AWS, doing some stuff on bare metal, and it's interesting to see. VMware, basically it's the VMware stack. They want to put that everywhere. Whereas Red Hat, similarly, but Red Hat has the developer angle. They're trying to infuse Red Hat in throughout everybody's stack, and so I think Red Hat is going to be really interesting to, especially to the extent that IBM keeps them, sort of lets them do their own thing and doesn't kind of pollute them. So, so far so good there. >> Yeah, I agree with that. I think you brought up the good point about it being developer-friendly. It's a real option as people start kicking a little bit more of new, different developer ways and containers are growing, growing more. They're not testing anymore, but they're real workloads. It is a stack that you could really use. Now, what I would say to caveat that though is I'm not seeing any net new business go to IBM Red Hat. If you were already aligned with that, then yes, you got to love these new tools they're giving you to play with, but I don't see anyone moving to them that wasn't already net new there and I would say the same thing with VMware. Listen, they have a great entrenched base. The longer they can kick that can down the road, that's fantastic, but I don't see net new customers coming onto VMware because of their alignment with AWS. >> Great, thank you for that. That's a good nuance. Number eight, cloud, containers, AI and ML and automation are going to lead 2021 spending velocity, so really is those are the kind of the big four, cloud, containers, AI, automation, And, Erik, this next one's a bit nuanced and it supports our first prediction of a rebound in tech spending next year. We're seeing cloud, containers, AI and automation, in the form of RPA especially, as the areas with the highest net scores or spending momentum, but we put an asterisk around the cloud because you can see in this inserted graphic, which again is preliminary 'cause the survey's still out in the field and it's just a little tidbit here, but cloud is not only above that 40% line of net score, but it has one of the higher sector market shares. Now, as you said, earlier you made a comment that you're not necessarily seeing the kind of growth that you saw before, but it's from a very, very large base. Virtually every sector in the ETR dataset with the exception of outsourcing and IT consulting is seeing meaningful upward spending momentum, and even those two, we're seeing some positive signs. So again, with what we talked about before, with the freezing of the IT projects starting to thaw, things are looking much, much better for 2021. >> I'd agree with that. I'm going to make two quick comments on that, one on the machine learning automation. Without a doubt, that's where we're seeing a lot of the increase right now, and I've had a multiple number of people reach out or in my interviews say to me, "This is very simple. These projects were slated to happen in 2020 and they got paused. It's as simple as that. The business needs to have more machine learning, big data analytics, and it needs to have more automation. This has just been paused and now it's coming back and it's coming back rapidly." Another comment, I'm actually going to post an article on LinkedIn as soon as we're done here. I did an interview with the lead technology director, automation director from Disney, and this guy obviously has a big budget and he was basically saying UiPath and Automation Anywhere dominate RPA, and that on top of it, the COVID crisis greatly accelerated automation, greatly accelerated it because it had to happen, we needed to find a way to get rid of these mundane tasks, we had to put them into real workloads. And another aspect you don't think about, a lot of times with automation, there's people, employees that really have friction. They don't want to adopt it. That went away. So COVID really pushed automation, so we're going to see that happening in machine learning and automation without a doubt. And now for a fun prediction real quick. You brought up the IT outsourcing and consulting. This might be a little bit more out there, the dark horse, but based on our data and what we're seeing and the COVID information about, you said about new projects being unwrapped, new hiring happening, we really do believe that this might be the bottom on IT outsourcing and consulting. >> Great, thank you for that, and then that brings us to number nine here. The automation mandate is accelerating and it will continue to accelerate in 2021. Now, you may say, "Okay, well, this is a lay-up," but not necessarily. UiPath and Automation Anywhere go public and Microsoft remains a threat. Look, UiPath, I've said UiPath and Automation Anywhere, if they were ready to go public, they probably would have already this year, so I think they're still trying to get their proverbial act together, so this is not necessarily a lay-up for them from an operational standpoint. They probably got some things to still clean up, but I think they're going to really try to go for it. If the markets stay positive and tech spending continues to go forward, I think we can see that. And I would say this, automation is going mainstream. The benefits of taking simple RPA tools to automate mundane tasks with software bots, it's both awakened organizations to the possibilities of automation, and combined with COVID, it's caused them to get serious about automation. And we think 2021, we're going to see organizations go beyond implementing point tools, they're going to use the pandemic to restructure their entire business. Erik, how do you see it, and what are the big players like Microsoft that have entered the market? What kind of impact do you see them having? >> Yeah, completely agree with you. This is a year where we go from small workloads into real deployment, and those two are the leader. In our data, UiPath by far the clear leader. We are seeing a lot of adoptions on Automation Anywhere, so they're getting some market sentiment. People are realizing, starting to actually adopt them. And by far, the number one is Microsoft Power Automate. Now, again, we have to be careful because we know Microsoft is entrenched everywhere. We know that they are good at bundling, so if I'm in charge of automation for my enterprise and I'm already a Microsoft customer, I'm going to use it. That doesn't mean it's the best tool to use for the right job. From what I've heard from people, each of these have a certain area where they are better. Some can get more in depth and do heavier lifting. Some are better at doing a lot of projects at once but not in depth, so we're going to see this play out. Right now, according to our data, UiPath is still number one, Automation Anywhere is number two, and Microsoft just by default of being entrenched in all of these enterprises has a lot of market share or mind share. >> And I also want to do a shout out to, or a call out, not really a shout out, but a call out to Pegasystems. We put them in the RPA category. They're covered in the ETR taxonomy. I don't consider them an RPA vendor. They're a business process vendor. They've been around for a long, long time. They've had a great year, done very, very well. The stock has done well. Their spending momentum, the early signs in the latest survey are just becoming, starting to moderate a little bit, but I like what they've done. They're not trying to take UiPath and Automation Anywhere head-on, and so I think there's some possibilities there. You've also got IBM who went to the market, SAP, Infor, and everybody's going to hop on the bandwagon here who's a software player. >> I completely agree, but I do think there's a very strong line in the sand between RPA and business process. I don't know if they're going to be able to make that transition. Now, business process also tends to be extremely costly. RPA came into this with trying to be, prove their ROI, trying to say, "Yeah, we're going to cost a little bit of money, but we're going to make it back." Business process has always been, at least the legacies, the ones you're mentioning, the Pega, the IBMs, really expensive. So again, I'm going to allude to that article I'm about to post. This particular person who's a lead tech automation for a very large company said, "Not only are UiPath and AA dominating RPA, but they're likely going to evolve to take over the business process space as well." So if they are proving what they can do, he's saying there's no real reason they can't turn around and take what Appian's doing, what IBM's doing and what Pega's doing. That's just one man's opinion. Our data is not actually tracking it in that space, so we can't back that, but I did think it was an interesting comment for and an interesting opportunity for UiPath and Automation Anywhere. >> Yeah, it's always great to hear directly from the mouths of the practitioners. All right, brings us to number 10 here. 5G rollouts are going to push new edge IoT workloads and necessitate new system architectures. AI and real-time inferencing, we think, require new thinking, particularly around processor and system design, and the focus is increasingly going to be on efficiency and at much, much lower costs versus what we've known for decades as general purpose workloads accommodating a lot of different use cases. You're seeing alternative processors like Nvidia, certainly the ARM acquisition. You've got companies hitting the market like Fungible with DPAs, and they're dominating these new workloads in the coming decade, we think, and they continue to demonstrate superior price performance metrics. And over the next five years they're going to find their way, we think, into mainstream enterprise workloads and put continued pressure on Intel general purpose microprocessors. Erik, look, we've seen cloud players. They're diversifying their processor suppliers. They're developing their own in-house silicon. This is a multi-year trend that's going to show meaningful progress next year, certainly if you measure it in terms of innovations, announcements and new use cases and funding and M&A activity. Your thoughts? >> Yeah, there's a lot there and I think you're right. It's a big trend that's going to have a wide implication, but right now, it's there's no doubt that the supply and demand is out of whack. You and I might be the only people around who still remember the great chip famine in 1999, but it seems to be happening again and some of that is due to just overwhelming demand, like you mentioned. Things like IoT. Things like 5G. Just the increased power of handheld devices. The remote from work home. All of this is creating a perfect storm, but it also has to do with some of the chip makers themselves kind of misfired, and you probably know the space better than me, so I'll leave you for that on that one. But I also want to talk a little bit, just another aspect of this 5G rollout, in my opinion, is we have to get closer to the edge, we have to get closer to the end consumer, and I do believe the CDN players have an area to play in this. And maybe we can leave that as there and we could do this some other time, but I do believe the CDN players are no longer about content delivery and they're really about edge compute. So as we see IoT and 5G roll out, it's going to have huge implications on the chip supply. No doubt. It's also could have really huge implications for the CDN network. >> All right, there you have it, folks. Erik, it's great working with you. It's been awesome this year. I hope we can do more in 2021. Really been a pleasure. >> Always. Have a great holiday, everybody. Stay safe. >> Yeah, you too. Okay, so look, that's our prediction for 2021 and the coming decade. Remember, all these episodes are available as podcasts. All you got to do is search Breaking Analysis podcast. You'll find it. We publish each week on wikibon.com and siliconangle.com, and you got to check out etr.plus. It's where all the survey action is. Definitely subscribe to their services if you haven't already. You can DM me @dvellante or email me at david.vellante@siliconangle.com. This is Dave Vellante for Erik Bradley for theCUBE Insights powered by ETR. Thanks for watching, everyone. Be well and we'll see you next time. (relaxing music)

>> Advertiser: From theCUBE Studios in Palo Alto, in Boston, connecting with thought leaders all around the world, this is theCUBE Conversation. >> Hi, everybody, this is Dave Vellante and welcome to our ongoing CXO series, Charlie Giancarlo season, chief executive officer of Pure Storage. Charlie, always a pleasure. Thanks so much for taking the time. >> Thanks, Dave. And like you said, always a pleasure, thank you. >> Well, I got to start asking you, the last time we talked, you were recovering from COVID. How are you doing? >> Yeah, I'm doing great actually. I seem to have fully recovered. I've been on 17 mile hikes at 10,000 feet. I've been doing a lot of biking, so it looks like other than my wife telling me that maybe I'm not all there, but she did that before COVID. So I'm used to it. >> Well, that's awesome to hear. Well, of course, just yesterday, you guys announced your quarter. I want to start there. You beat expectations, although revenue growth was a little less robust than we're used to from Pure, but you clearly had some activity regarding COVID in the US. International, very strong, but again, we'll talk about this US customers kind of reevaluating was your other key point. I got a lot of takeaways from the call that I want to ask you about. But the big thing was you had set a very confident tone on the Earnings Call. So I kind of want to start there. Well, give us your summary. >> Yeah, no, thank you for that. So first of all, we feel like we're operating really with all of our cylinders going. We have operational discipline. We've been adding to our R&D capabilities. We've hired people this year. and we showed a profit this quarter. So we're operating, I think very well. We've introduced a boatload of new products continuously over the last couple of quarters, including, FlashArray//C, the first and only all-flash product that competes at second Tier disc levels. We introduced our file services on FlashArray//C, which really allows us to go into the general purpose of file market. And we picked up a huge amount of share as you well know in Q1. We believe we're going to pick up significant share in Q2 as well, well above our competitors. So we feel like given everything we can control, we're doing very well. As you said, in Q2, what we saw was Europe, which came out of the crisis for the most part recover very, very nicely. The US, that's still in the crisis. Of course, we're seeing some slowness and especially among what we call the mid tier or the commercial market. They've been hurt very badly by the lockdown in the economy. And they have our sympathies, but we definitely saw some slow down there. >> Yeah, so I want to talk about the market share and maybe unpack some of that data. I mean, you guys gave a cautious outlook. It kind of gave no formal guidance, but you did informally guide flat, so you kind of gave some visibility there. So actually I appreciated it. I think some of the analysts were a little bit concerned there, but I think that's prudent. And they're really the expectations are a function of your expectations around the COVID recovery. I think you mentioned your account almost state by state and very clearly the international where you've seen comebacks have been very, very strong. >> Right, so I think our customers' data continues to grow if anything, growing faster under a lockdown environment and the move to more digital engagement with everyone, their customers, their employees, et cetera. So digital continues to grow, which generally creates more demand. However, of course, as you know, in storage customers generally always have a buffer. And what we saw on Q2 was customers starting to reconsider how they're going to spend their IT budget. And whenever you have a reconsideration, you have a slowdown. And that's what we experienced. And especially in the US where the effects of the pandemic, of the economy have been much more severe than in other parts of the world. >> Yeah, so I want to talk about some data. I often, as you know, like to share some data from our partner ETR every quarter we do the survey. So guys bring up that chart. And what it shows here, let's just set it up for the audience and Charlie for you as well. That this is essentially net score, which is a measure of spending velocity for the major primary guys. So we show Pure at the top in orange, that's just a coincidence guys. And then HPE, NetApp, Dell, and IBM. And you can see the net score, and then I've super imposed there in that table, in the upper left. And you can see Pure Storage is really the only one of these majors in the green. Everybody else is in the red, which is either the lower or high teens. And you can see a little bit of a COVID impact, last quarter, but holding strong at about a 40% net score where everybody else is, as I say, in the mid teens. And so that's a real positive. I point out, this is a forward looking survey. So we're asking people, what are you planning on spending in the second half relative to what you spent in the first half. And again, we see Pure with consistent momentum. I'll add, just if you looked at the past quarter, you guys announced plus 2% growth. IBM was plus 3% growth and we know why, they have the mainframe tailwind. HPE played a little hide, the growth ball. I don't know Charlie, how closely you looked at it, but they said 4% growth sequentially. Now, the last quarter they were down 16%. The same quarter last year, they were flat. So it looks to me like they were down this quarter. So we appreciate when you have clear guidance. >> Their storage, by the way, was down 10% year over year. >> Yeah, okay, great, thank you. I didn't pick up on that. And so, yeah, that seemed like that to me. And then NetApp happens tonight and we get Dell tomorrow. But so you were saying that you gained share, what gives you that confidence? >> Well, several, you mean for Q2? We know we gained Q1, right? We were 15 points above the industry average and maybe about 20 points ahead of our competitors. We saw a similar momentum from our partner. Remember, we're 100% partner fulfilled, right? And so in conversations with our partners, we have a general sense of how we're doing vis-a-vis competitive environments. We also know that our win rates have held very nicely and in quarters, almost every quarter, we're used to about a 20% per annum higher growth rate than our competitors. So when all of our metrics, that is our relative metrics. Things like win rates and so forth continue unabated, we generally expect to have the same outcome. >> Great, and then so let me go through some of the takeaways that I have from the quarter. I'll just run through them and we can go wherever you like. But the COVID snapback obviously is a key indicator. We saw that in international versus the US. >> Charlie: Right. >> New opportunities for growth. I want to talk about that, at some length the FlashArray//C object, the Cohesity pieces and other TAM expansion. The pipeline is very encouraging, but there's some uncertainty leading to your tepid guidance. Very strong, gross margins as usual. The subscription model is growing nicely. I want to hit on that. And the RPO, the remaining performance obligations grew to almost a billion dollars. That's a big number. New logo, solid at 20%. No real change in the competitive, but you called out, you'll see more PowerMax than PowerStore. That was really interesting. You're still hiring pretty aggressively, last quarter. And your technology investments continue. And I'll throw in the seven nines, which I think is another industry first, but where do you want to go there? >> Yeah, well, seven nines is a reliability figure for those of your audience that doesn't know. It relates to how much uptime or availability a product has or in our case, fleet of products. We have tens of thousands of arrays in the field. And last quarter we achieved what's called seven nines, which is the equivalent across the fleet of only three seconds of downtime per array per year. Which is, most other vendors had struggled to stay to five nines. And that's typically without even counting what they call scheduled downtime for upgrades. We don't even count that. We count all downtime of any type. So we're clearly, I think with no doubt, we're the most reliable product on the these days. >> So I want to come back to the TAM discussion because you, I inferred many opportunities for you guys to continue to grow. I mean, it's Flash, it's still about flash. flash is gaining share relative to spinning disk and relative to hybrid, you guys made that point a lot. FlashArray//C, you sound pretty happy with that, again, going after hybrid. And then this notion of bringing file services and object that unify play. kind of the man made great strides years ago with that capability. And then the data protection piece, the recovery with Cohesity, the faster recovery. That's another TAM expansion. So really, I identified four points of potential growth area for you over the next several years. I wonder if you could talk about that? >> Absolutely, we do feel very positive about all these areas. These areas open up a huge amount of the TAM that we didn't play in before. So FlashArray//C for example, as you say, flash was always a primary workload environment for flash 'cause it was very expensive compared to disc. Higher performance, better ecological footprint, denser, faster, cheaper, are more expensive though. So it only went after primary workload, but the vast majority of data storage is secondary workload. Things that don't require the high performance and therefore customers want it less expensive. And of course there were even more bits there. But FlashArray//C now competes very well with low cost disc, which is amazing. And of course it's 10 times lower footprint and 10 times more reliable. So this is the first and literally today only product that has all-flash in that secondary workload market. So just opens up a huge amount for us. And then, yes, I love talking about data protection for the following reason, customers actually don't want to do a backup, right? If you think about it, what they really want is recovery. Backup is what you have to do in order to get recovery. And these backup systems have been very good at backup, but usually can take 24 or 48 or even more hours to be able to recover from a failure. And now with ransomware, you don't want your website to be down for days before it comes back up. You don't want your traders not trading for days. It costs a lot of money. And with what we call rapid recovery and now flash recover, we can have companies come back within an hour or two at most, with a rapid recovery solution. And so the integrated solution that we've put together with Cohesity, allows customers to very quickly get up and running with an anti ransomware solution that allows them to get back up and operating in no time at all. >> Well, was interesting to see you choosing the partner route. I mean, you could have, if you remember EMC in the day. They bought in, data protection and it had actually worked out pretty well for them. You look at a company like NetApp, they've chosen not to vertically integrate with backup. You're choosing the same path. What's the thinking there? Stick to your knitting and partner up and add value where you can? >> Yeah, we have strong partnerships actually with all of the data backup players, Veritas Veeam, with Rubrik and others. In many cases, customers have already made their decision who their backup player is. Also, backup is actually a very relatively fragmented market. There's backup for different types of applications and different vendors have strengths and weaknesses in each one of those. And so our partnership across the backup board is very important to us. We did see however customers wanting an integrated solution, which we have, let's say initiated with Cohesity. But we believe it's the first of what will be multiple pure validated designs. Not all of which will be OEM, but all of which will be available as integrated systems in the market, through our channel partners. And so you can expect to see more of these as we go forward. >> So kind of the PVDs okay. I want to ask you about your subscription model. I mean, it's growing very nicely. Are there nuances there just in terms of understanding the income statement ie, product revenue was down, subscriptions growing. Are you going through that transition and having to sort of educate people on the impact on the income statement? You didn't make a big deal out of that on the Earnings Call and I thought, well, maybe I'm overstating that, but I wonder if you could talk about that dynamic? >> No, no, you're absolutely correct. And there is some of that going on on the earning statement. The bigger part, though, of let's say the lower growth this quarter was due, and the forecast was due to the pandemic. No doubt and especially in the US, especially hard hit in the US. But simultaneously we are going through the transition that many companies have had to go through in the past where a larger proportion over time of our sales are going to be what we call Pure as-a-Service and our unified subscription. So moving to subscription from CapEx. And whenever you do that, it takes a while, even though your sales, as in bookings, can stay in the growth path. The revenue takes a while to catch up as your subscription bookings grow. So there is some of that going on on our P and L as well. >> Yeah, well, it's the nirvana to the extent you can get that model. And of course your RPO is a good indication of you got a nice backlog that's yielding, that's certainty in revenue. >> That's correct. And the RPO is very nice and it reflects the fact that we have multi-year contracts going in with customers who are choosing Pure as-a-Service in Evergreen. And of course, the billing only reflects what we've actually built them for. >> I was struck by your comments regarding your main competitor, which is Dell, Dell EMC. Now, of course, in the early days of Pure, I've always said you guys drove a truck through the old VNX and symmetrics base. You said you're seeing PowerMax more than you're seeing PowerStore. That was interesting and somewhat surprising to me. >> Yeah, well, a standard play of Dell is to offer VMAX because it's less expensive versus our FlashArray. And then when the customer clearly says, well, it's just not performance enough or it just can't do the work that we need, then they'll offer PowerMax at a supposedly a deep discount to be able to compete with a FlashArray. So that's been a favorite tactic of theirs for quite some time. We maintain our win rates against that. PowerStore on the other hand, remember, it's a forklift upgrade with a new product on four different Dell existing products, right? And two things. One, is customers are just reluctant right now to try new things, right? They don't have the time to be able to test them properly. But I also think there's some reluctance even on Dell's part to put those properties up for grabs right now, when customers are more risk adverse. So, we continue, as I said, we are not seeing it as much as we had thought we might going into this. >> Yeah, we'll definitely find out more tomorrow. And I would expect that, to the extent that you're having more and more success in file, you're going to obviously run into NetApp more. >> Yeah, and that's what we're expecting. The file services on FlashArray//C really allow us to start to penetrate the general purpose file market. Clearly not on the very small, and we're not going after the very small market. We're going after the data center file share market on this and the Tier 2 workloads. >> Well, what's the early returns there? I mean, you saw the NetApp did the SolidFire acquisition to shore up NetApp kind of missed flash, and then bought SolidFire but that is obviously a good play. Do you feel like it's a tougher road than perhaps the old EMC install base or what are you seeing early on? >> Well, there's a lot of maturity obviously in files. And it will take us a while to be able to get up to full levels of maturity in files. But what customers love about us is our simplicity. And our file services on FlashArray is just as simple as our block services on FlashArray. And I think what customers are going to find is a very performant product that requires very little maintenance, very little tuning to meet their needs. And I think they're just going to appreciate the fact that it's a true fully capable block product with a fully capable set of file services. And that they'll be able to consolidate more and more of their use cases onto smaller and smaller footprint. So I think that's what they're going to appreciate about what we do. >> That's ironic, outsimplifying NetApp, which of course made its name, taken on guys like ASPEX for those of you remember that or even even the early day. So that's good. And I'd be remiss if I didn't ask you about cloud. Thinking on cloud, I know it's early days and I know most of your subscriptions of course are still with on-prem, but you made an interesting announcement last year to accelerate with Cloud Block Store running on AWS. How's the uptake been there? What can you tell us about that? >> Yeah, we're seeing a good uptake there. I'd say more of it is in the DevOps environment than in the actual NDR, disaster recovery, more than it is in transition of primary workloads into the cloud. And we're just seeing a bit less of that than one would expect given all the press around it. I don't think it's us. I think customers are just taking a while. They're focusing their new activities in the cloud and much less about transitioning existing environments. But we are seeing work done there. What we are seeing is a huge uptake in what we call our unified subscription, which is a Pure as-a-Service on-prem where we deliver to our customers, basically cloud, the equivalent from their point of view of cloud storage on-prem, where we manage the entire environment plus the unified subscription is that plus Cloud Block Store. So regardless of where our customers want to place their data, either on-prem or in the cloud, it's the same price and the same contract, same interface, same management to them. So we've seen a huge, I mean, literally an incredible spike in uptake in that. >> Great, thank you for that. And then I got to end with, I asked you last time about networking. You have a, a very wide observation space and a lot of expertise in a lot of different areas. So I want to ask you about, we've seen the spate of IPOs this week. Snowflake came , Palantir, UniFi, JFrog, number of others. Very interesting to see that in the Valley, you're in the Valley. Of course you shot in the Valley like everybody else these days, but what do you make of that? Is it kind of everybody trying to get in before the election? Or is it just a really good time? What's your take on that? >> I think a lot of it is getting in before the election, but a lot of stock market movements as you well know, has to do with cash flows more than it has to do with the prospects of individual companies and just given the amount of stimulus that's taking place, not just in US but worldwide. There's a lot of money floating around, which is boiling stock market prices. And so it's a great, an old colleague of mine had a saying, "When Monday's on sale, take it." And that seems to be the case right now, at least as far as the stock market is concerned. And I've stood there for a good time for IPOs. >> Well, the Palantir IPO took a swipe at Silicon Valley broadly, really targeting, I think Facebook and Google. It really doesn't have anything to do with your business, but I mean, I think as an executive in Silicon Valley, you see the innovation and the software development that's going into so many good things. I was struck by that though. I thought it was a little bit of a cheap shot at Silicon Valley. It really was aimed at Google and Facebook because there's so many companies from you guys, Cisco, Palo Alto Networks, it'll work on and on and on. They are just doing some great software work. And we're seeing that with COVID, where would we be without Big Tech? >> Well, thank you, Dave. I think the press tends to focus on the consumer companies. And we all have maybe our own individual opinions about the way they operate, but you're correct. I mean, I think the good foundational work that many companies in Silicon Valley are doing to make our lives easier every day, just continues to really impress. >> Well, Charles Giancarlo it's always a pleasure. Thanks so much. You're generous with your time. I really appreciate you coming on theCUBE. >> Thank you, Dave. Again, as you said, always a pleasure to speak with you and look forward to doing it next quarter. >> All right, us as well. And thank you for watching everybody. This is Dave Vellante for theCUBE. We'll see you next time, we're out. (bright upbeat music)

>> Announcer: From theCUBE studios in Palo Alto in Boston, connecting with thought leaders all around the world, this is theCUBE conversation. >> Hi, everyone. Welcome to theCUBE Studios here in Palo Alto, California. I'm John Furrier, host of theCUBE. We're here for coverage of AWS Public Sector Summit. This is theCUBE Virtual with our quarantine crew going out and covering the latest posts of the Virtual Summit where our next guest is Matthew Cornelius, Executive Director for the Alliance for Digital Innovation. Matthew, thanks for joining me today for part of AWS virtual Public Sector Summit. >> That's great, thanks, John. Appreciate you having me. >> I know that John Wood and I have been talking about this organization and some of the ambition and the relevance of it. So I think it's a super important story. I want to get your thoughts on this in an unpack kind of the mission but for starters, tell us what is the Alliance for Digital Innovation? When were you formed? What's the mission? What do you do? >> Sure. Yeah, so ADI was formed about two years ago, to create a new advocacy group that could focus explicitly on getting cloud forward, commercial, highly innovative companies into the public sector. So the government technology space has traditionally been dominated by a lot of legacy vendors, folks that are very happy with vendor lock-in, folks that have an outdated business model that would not suffice in the commercial sector. So why does it have to be that way for government and ADI started with about eight members has since grown. We're approaching two dozen now. So we've had a lot of growth and I think a lot of the response that you've seen in the public sector, especially to the COVID crisis, and the response and relief efforts have made this organization and our mission more relevant now than ever. There's no way that you can go back to the previous way of doing business, so adopting all these commercials technologies, changing your business model, changing your operating model, and really use an emerging technology to deliver all these missions services is critical. >> You know, one of the things that I've been reporting on for many, many years is this idea of modernization. Certainly on the commercial side with cloud, it's been really important and Amazon has done extremely well, from a business standpoint. We all know that where that's going. The issue that's happening now is the modernization is kicking in. So the government has started to move down this track, we've seen the procurement start to get more modernized. Move from buying manuals to actually having the modern stuff and in comes COVID-19. You couldn't have accelerated, you couldn't have pulled the future forward fast enough to an already struggling federal government, in my opinion, and I've talked to many people in DC and the young crowd saying, "Hey, old government get modern", and then this comes. It's almost like throwing the rock on your back and you're sinking. This is a problem. What's your take on this? Because you're trying to solve a problem with modernizing, but now you got COVID-19 coming in, it compounds the complexity and the challenge. What's your chosen reaction to that? >> Yeah, so it there's a multifaceted response to this. So part of it is what I like to say is the government's done more in the past four months than it's done in the past 14 years when it comes to modernization and adopting commercial capabilities. I think with individual agencies, you've seen those those agencies, I will name a couple like the Small Business Administration, the General Services Administration, where I used to work, folks that were already heavily invested in cloud, heavily invested in modern digital tools and modern digital processes, they were able to weather this storm and to deal especially in SPS case, with a dramatic increase in their mission. I mean, running the paycheck Protection Program is something unlike an organization that size has ever seen. And from a technology standpoint, they have a lot of good stories that are worth telling and I think it's because they were so cloud forward. I think one of the other interesting points that as really come to light over the past four months is so many of the issues around modernization were cultural. Now, of course, there are some that are legal, there's acquisition, there's the way agencies are appropriated and financed and the way they can spend their money, but by and large, all of these agencies had to move to maximum telework, they had to get rid of all of these outdated on premise processes, these paper based processes that they had. And although surely there were some bumps in the road, and that was not easy, especially for these folks working around the clock to keep their agencies operational to make sure citizens are getting the services, they need, especially during this crisis, I think there's a lot of great success stories that you see there and because of this, no one even if they're allowed to go back into the office or when they're allowed to go back in the office, people are going to understand how much more productive they are, how much more technologically capable they are. And that's not just CIO officers that's people on programs in the front lines delivering services that mission response. We've really seen it powerful word over the last four months. >> You know, Matthew, I've been very vocal given that I'm kind of the old guy, get off my lawn kind of commentary. (Matthew laughs) I've seen that the waves and I remember coming in when I was in my late 20s and 30s old school enterprises, the commercial business wouldn't do business with startups, you had to be approved or you were in entrenched vendors supporting those things and then in comes the web, in comes the 90s, and then the web came there's more agile, you had startups that were more open and working with commercial vendors. It seems like we're seeing that movie play out in public sector where you have the entrenched incumbents, they got the town wired, who knows what's going on. It's been called the Beltway bandits for years and Tris and Curson and I talk about that all the time, but now the government can be agile, and startups need to be product to these new solutions, like whether it's video conferencing or virtual events, things like we do. New solutions are coming that need to come in, it's hard. Can you share how a company whether it's a startup or a new solution can come in and work with the government? Because the perception is, it's impossible. >> Yeah, and part of why ADI exist is to break that down. One to recruit more members to join us to really help drive commercial innovation in the government. And we have some very large companies like AWS and others that do an awful lot of work with the government. And we have a lot of smaller startups that are interested in dipping their toe in there. And so we try to help them demystify how it is that you go about working with the government. I think there have been again, some good success stories on this one. I think that there are lots of places like the Department of Defense, a lot of the folks in the intelligence community, some other agencies, they have authorities, they have partnership programs that make it easier for folks to adopt commercial innovation. They have unique authorities like other transaction authorities or commercial solutions offerings that really lowers the barrier for new technologies to be piloted and potentially scaled inside government. But that's not the case across lots of agencies, and that's why we advocate broadly for getting the acquisition process to move at the speed of technology. If there are good authorities that work in some agencies, let's get into everybody, let's have everybody try it because the people in the agencies, the acquisition professionals, the technical professionals, they have to be committed to working with industry, so the industry is committed to working with them. And as a former federal employee, myself, I worked at the Office of Management and Budget and the General Service Administration, I always was upset at the fact that the government is very good at speaking to industry, but not very good at working with industry and listening, and so we see a lot more of that now and I think part of that is a response to COVID, but it's also the recognition that you can't do things the way you used to do it, the traditional butts in seats contracting business model where everybody in between a federal employee and that outsourced service provider. You don't need all those people there, you can do it yourself and be just as effective and get all the real outcomes you're looking for with commercial innovation. >> It sounds like ADI your priorities is to make things go fast and be modernized. So I have to ask you, the question that's on my mind, probably on everyone's mind is, what are the key conversations or messages you provide to the agencies, heads or members of Congress to get them excited about this, to take action to support what you're doing? Because let's face it, most of these guys up on the Hill are girls now, most of them have a law backgrounds, they don't have a tech background. So that's a complaint that I've heard in the hallways in DC is, the guy making all the decisions doesn't know jack about tech. >> No, it's it's a great point. When we advocate up on the Hill there's a law that I don't think a lot of folks pay in awful lot of attention to. Everybody likes the nice new things that are coming from Capitol Hill but there's a great piece of legislation from 1994 for the Federal Acquisition Streamlining Act. We actually did some tremendous original research at ADI, about a year ago and released an interesting report that got a lot of uptick here. And most people don't even understand that the law requires you to do market research and see if there's a commercial product or service that meets your need before you go down building any sort of specific requirements or building out some sort of long procurement process. And so a lot of what we're doing is educating folks, not just on what the law says, but on why these can lead to better outcomes for agencies. I mean, I truly believe that most of the folks in government whether they're technical folks or not want to do the best thing, but if you're a company trying to do business with the government, you have to go through what is often a five or six or sometimes 10 person human supply chain. There's someone in government who wants your solution because it addresses a particular problem, and between them, and you the company, there's all sorts of additional bureaucratic overlays and folks that are not technical, that have other incentives and other priorities that don't always lead to the most optable procurement outcome. So there's an educational component, there's a cultural component. We need more champions inside government. We need not just better technology that's wanting to work with the government but we also need smarter, better people inside that understand the technology and can get to it the way they need to get to it so that they can deliver mission. >> As someone like me who's in the technology business, who loves entrepreneurship, loves business, loves the impact of technology, I'm not a public servant, and I'm not at that up to speed on all the government kind of inside baseball, so I kind of look at it a little bit differently. I've always been a big proponent of public private partnerships that's been kicked around in the past. It's kind of like digital transformation, kind of cliche, but there's been some pockets of success there, but look at the future. The role of influence and the commercial impact just China, for instance, just riffing the other day with someone around China doesn't actually go through government channels for how they deal with the United States. There's a little commercial, they have intellectual property issues going on, people saying they're stealing, they're investing in the United States. So there's a commercial influence. So as the government has to look at these commercial influences, they then have to modernize their workforce, their workloads, their applications, their workplaces. The work is not just workloads, it's workplace, workforce. So if you had your way, how would you like to see the landscape of the federal technology piece of this look like in five years? Because there's now new influence vectors coming in that are outside the channels of federal purview. >> No, it's a great question, and I appreciate you bringing up the other complexities around nation state actors in China and everything else. Obviously, supply chain security and being able to deal with legitimate security threat is critical when you're inside government. I mean, your first sort of purpose is to do no harm and to make sure that you're keeping citizen data, whether it's classified or unclassified secure. We think at ADI that there's a great balance to be heard there and part of that is if you're working with American companies, and you're adopting the best and most agile and most innovative commercial technology that America has to offer, that's going to make our industry more competitive and position it better in the commercial market and it's also going to make government agencies more effective. They're going to be able to meet their mission faster, they're going to be able to lower costs, they're going to be able to shift what are going to be tighter and tighter budgets over the next four or five or 10 years to other areas because they're not wasting so much money on these old systems and this old business processes, this old way of doing business. So you that is one of the balances that we have to take from an advocacy standpoint. We have to understand that supply chain security, cybersecurity are real issues, but security can also be an enabler to innovation and not an impediment and if a lot of the commercial capabilities that are coming out now and a lot of these companies like the ones ADI represents, want to do business with the government, and their commercial products can inherently be more secure than a lot of these old bespoke systems or old business practices. That's good for not just federal agencies, that's good for citizens and that's good for our national defense and our economy. >> You know, I look at our landscape and being an American born here, looking at other emerging countries, certainly China's one example of becoming very world digital native, even other areas where 5G and then telecom has made great internet access, you're seeing digital native countries, so as we modernize, and our lawmakers have more tech savvy and things become digital native, the commercial enabling piece is a huge thing, having that enabling technology, because it creates wealth and jobs and other things so you got three things, digital native country, enabling technologies to promote good and wealth and engine of economic value, and then societal impact. What's your take on those three kind of pillars? Because we're kind of as a country coming into this world order and look at the younger generation, they're all screaming for it, we're digital native, and all kinds of arbitrage there, fake news, misinformation, then you got enabling technology with the cloud, and then you get societal benefits, future of elections and everything else. So what's your thoughts? 'Cause it sounds like you're thinking about these things in your Digital Innovation Alliance. >> Yeah, absolutely. The one thing I will say and as someone that was a former federal employee, the one thing we need more of whether you're on the executive branch or in Congress, we need more people that like you said, are digital natives that understand technology that also want to be inside government either running programs or dealing with policy issues. We need as many good new ideas and folks with real, legitimate, necessary and current skills in there. Because if you don't understand the technology, you don't understand, like you said the societal impacts, you don't understand the business impacts of government decision making and the government can drive markets. I mean, especially in the middle of Coronavirus, we're spending trillions of dollars to keep folks afloat and we're using technology primarily as a way to make that happen. So the first thing I would say is, we need, we continue, need to continue, sorry, we need to continue to recruit and retain and train the best and the brightest to go into government service because it is a joy and a privilege to serve government and we've got to have better smarter technical people in there or we're going to keep getting these same outcomes, like you've mentioned over the past 30 plus years. >> I think we're in a JFK moment where John F. Kennedy said, "Ask not what your country can do for you, "what you can do for your country". Moment in the modern era and that was the 60s, that we saw the revolution of that happen there, we're kind of having a digital version of that now where it's an opportunity for people to get involved, younger generations and make change rather than arguing about it. So I feel fairly strongly about this so I think this is an opportunity. Your reaction to that? >> No, that's a fantastic point. I hadn't really thought about the JFK resemblance. From an industry standpoint, I think that is what is happening with these emerging technology companies and even some of the large companies. They understand that this is their way to contribute to the country whose R&D dollars and these public private partnerships helped a lot of these folks to grow and become the companies they are now. At least started them down that road. And so for us at the Alliance for Digital Innovation and the companies that are a part of us that is sort of purposeful to who we are. We do what we do and we want the government to build stronger relationships and to use this technology, because it does serve mission. I mean, we exclusively focus on the public sector. Focus of these companies and it's tremendously valuable when you see a federal agency who spent five or 10 years and hundreds of millions of dollars and still not solving a problem and then they can pick up the commercial off the shelf technology from a company that we represent, and can solve that problem for $5 million and do it in six months. I mean, that's truly rewarding and whether you're inside government or out, we should all celebrate that and we should find ways to make that the norm and not the exception. >> And take all that hate and violence and challenge it towards voting and getting involved. I'm a big proponent of that. Matthew, thank you so much for taking the time. I'll give you the last word. Take a minute to put a plug in for the Alliance for Digital Innovation. Who are the charter members, who's involved? I know John Wood from Telos is a charter member. Who's involved, how did it all start? >> Yeah. >> Give it taste of the culture and who's involved. >> Yeah, thanks, John. So, yeah, like you mentioned, we have tremendous members, AWS is obviously a great partner. We have a lot of big companies that are involved, Google Cloud, Salesforce, Palantir, Palo Alto Networks. We also have great midsize and small companies. You think of Telos, you think of SAP NS2 and Iron Net, you think of Saildrone. We've got companies that whose technology product and service offerings run the range for government needs. We all come together because we understand that the government can and should and must do better to buy and leverage commercial technology to meet mission outcomes. So that is what we focus on. And, frankly, we have seen tremendous growth since COVID started. I mean, we are 24 members now we were at 18, just four months ago, but I like to say that ADI is an organization whose mission is more important and more resonant now, not just in the technology, parts of government, but at the secretary level at the Chief Acquisition Officer level, in Congress. We are folks that are trying to paint the future, we're doing a positive vision for change for what government can and should be. And for all of those other technology companies that want to be a part of that, that understand that the government can do better, and that has ideas for making it work better and for getting commercial innovation into government faster, to solve mission outcomes and to increase that trust between citizens and government, we want you. So if folks are interested in joining you got people that are watching out there, you can go to alliance4digitalinnovation.org. We're always accepting interested applicants and we look forward to continuing this message, showing some real outcomes and helping the government for the next year, five years, 10 years, really mature and modernize faster and more effectively than it has before. >> Great mission, love what you're doing. I think the future democracy depends on these new models to be explored, candidly and out in the open, and it's a great mission, we support that. Thanks for taking the time, Matthew. Appreciate it. >> Thanks, John. Have a great Public Sector Summit. >> Okay, this is theCUBE coverage of AWS Public Sector Virtual Summit. I'm John Furrier here in theCUBE Virtual. Thanks for watching and stay tuned for more coverage. (gentle music)

>> Announcer: Live from Washington, DC it's theCUBE. Covering .conf2017. Brought to you by Splunk. >> Welcome back here on theCUBE we continue our coverage of .conf2017 here at the Splunk event with about seven thousand plus Splunkers. Along with Dave Vellante, John Walls. I like that Splunkers. >> You a Splunker? >> Not sure I'd be qualified. >> I'm learning how. >> I'm not qualified. >> to be come one. >> I don't think. >> I think we're kind of in the cheap seats of Splukism right now. Certainly there's a definitely vibe and I think that there's this whole feeling of positivity amongst our community right, that is to get a sense of that here. >> Dave: Hot company, data centers booming. >> It's all happenin', so we are in the Walter Washington Convention Center day two of the convention. We're joined now by of Stephen Hunt who is the CIO of an organization called Team Rubicon. Stephen thanks for joining us here on theCUBE. Good to have you Sir. >> Thank you for having me. >> And CTO too correct? >> And CTO. >> So first off let's talk about Team Rubicon. Veterans based organization, you team up with disaster emergency responders, first responders, to come in a crisis management times of disasters I'm sure extremely busy right now. Gave birth to this organization back in 2010 after the Haiti earthquakes. So tell us a little bit more about your mission and what you're doing now I assume you're up to your ears and all kinds of work, unfortunately. >> Yeah so our, just speaking to our mission, our purpose is to leverage the skills a military vets and first responders in disaster. The capacity and skills that vets bring after active duty in the in the services, is remarkable resource that we've learned to tap to help people in need around the world. This is one of our or this is our busiest time right now. You know we're responding in the greater Houston area in Florida, the Florida Keys, British Virgin Islands, Puerto Rico, Mexico, Turks and Caicos. And it's just it's incredible what we're able to do and in aiding people from the point of search and rescue to recovery and resilience, there's a broad spectrum of activities that are our people engage in to make that all happen and across a diversity of locations. It's been truly remarkable and challenging in ways that we never imagined right now. >> And I should add that you're a veteran yourself. Paratrooper, 82nd Airborne, a reservist, but also have an engineering background MIT Lincoln Laboratories for 20 some plus years. So you've got this interesting combination of experiences that have brought you into a company that is also a beneficiary of the Splunk for Good Program part of the Splunk pledge Program. So are you bring a pretty interesting portfolio to the job here Stephen. >> It's a bit unusual I do understand how a lot of the world works, not because I'm the smartest person in the room, I have a bit of a head start there's a lot of experience there and so bringing my engineering skills to the field, as well as to the business office and how we operate. And working with companies like Splunk, you know I can see, pretty quickly, what's hard, what's easy. I understand that Splunk needs our requirements in order to deliver product that's meaningful to us and our mission. So tying that all together it is a bit unusual for an NGO to have someone like me around. I got involved simply to help people. When they told me at some point are that we're going to build a business to help people, I said I don't come here to build a business. And it took me a little while to get oriented around the fact that as we expand the brand as we bring it around the globe, it takes a strong business model and a strong technical model in how we project humanitarian aid in austere settings. >> In order to scale right. >> So Tell us more about the organization how large is the organization, you know, where do you get the resources, how is it funded. >> So we're almost a 100% privately funded. So corporations, foundations, individual donors from across the country and across the world. We have about sixty thousand members and these are volunteers in and globally, so how in the world do you do that? Well, it turns out we grew up at about the same time the cloud industry grew up, we've been around seven years. And I would like to say that I'm some kind of genius and I said well we should follow the cloud, it was a judgment call and it was what we could manage. Today we have about thirty five to forty cloud software products that drive everything from donor management, volunteer management, how we deal with our beneficiaries, as well as our employees. And and it's not just about product in mission it's about protection and seeing through what's happening at the company at scale. We have about anywhere from eight hundred to 15 hundred people sign up to join, to become a part of Team Rubicon every week. >> Dave: Every week? >> And we couldn't do that without scale, without cloud technology it's been truly remarkable. >> And the volunteers or or all veterans, is that right? >> About 80, 75 to 80% military vets, first responders and others. >> Okay, so they just they make time to take time off from work, or whatever it is and go volunteer. They'll get permission from whom ever. Their employers, their wives and husbands. >> The payment that we provide is a renewed sense of purpose. When you know you take off the uniform there is a certain part of your identity that goes on the hanger and people don't see in you that's missing and we get that back. Through service and being around like minded individuals it's just amazing when we bring all of our people together and they align to work to this common mission. >> So in the in the take a recent examples in Florida and Houston are they predominantly people that are proximate to those areas? Are you are you having to fly people in, how does that all work? We literally have people coming in from all over the world. Generally, with the way we run operations to keep them cost effective as we look first within 450 miles of an affected area, and and bring in people in close proximity. If there is need greater than that, then we expand the scope of the distance if you will. Logistically, where we bring folks in. we're all the way now to bring in people from Australia, Norway, Canada, as well as the UK and working alongside each other seamlessly and that's really due to our standards and training. You can imagine when we scale it's not just the technology but it's how you use it, in the field, and in the business environment in the office. >> Are they responsible for figuring out where they sleep, where they eat, I mean how does that all work. >> Yeah, we set that up, in the early days we kind of took care of it ourselves, you know we reach into our own pockets and the small groups run around the planet and help people. It was kind of a club, now it's a whole different story. When we're bringing in 500 people a day, we need to know how they're fed, is this safety, security and protection, not just physically, but also emotionally. You want to make sure that we're really looking after people before, during and after they deploy and help people. So we put them up, and typically it's not the Ritz, you know might be a cot in a warehouse somewhere. But I've stayed at hotels with Team Rubicon members and maybe sometimes eight in the room. My old job Wasn't like that, all these guys are fighting to see who's going to sleep on the floor. I mean it's it's a really interesting you know. >> You have very different dynamic I'm sure. So you talk about these global operations expanding what four or five countries you mentioned with thoughts of one larger. I know communications are huge part of that you have a partnership now with a a prominent satellite firm you know in Inmarsat and how is that coming to benefit your operations and does Splunk come in the play with that global communications opportunity? >> Inmarsat and Splunk have been truly remarkable impacting and working toward greater impact in how we deliver aid around the globe. And make a couple of very clear points and deliver a metric here. We're running maybe 15 simultaneous operations distributed across all those areas I just discussed earlier. And historically, in all the time that I've been with Team Rubicon we've always had outages when it comes to communicating with our staff in these austere settings. You know we have to life safety is everything. That's the most important thing on my list, is the welfare of the people I'm looking after, and our employees, volunteers and our beneficiaries. When we can't communicate if something goes wrong it's a problem Inmarsat has set us up with communications gear in such a way that even though running all these operations at our most challenging time, I haven't had one complaint. About not being able to communicate. And what's Splunk is doing, is integrating with the Inmarsat backend to provide us the status of all of that equipment and and so from a perspective where are they all located, what is the status of the you know the data usage to make sure that somebody doesn't get arbitrarily shut off, you know that strategic view of what's happening across the globe. And this was something that we've negotiated or Inmarsat asked us to do, and Splunk is stepping up to take care of that for us so that we can ensure life safety and coordination happen seamlessly. Just one more point about this, if you could communicate with everyone everyday you're planning team isn't sitting idle wondering what it needs to do next. So this tertiary effect, is really driven our planning team to perform in a way that guides material and resources that I didn't really think about, But it's quite remarkable. >> So, you please, I thought you finished, I apologize. >> No, it's OK. >> I'm excited. >> It's fantastic. >> So the tech let's get into the tech side of this. You got SaaS apps, you got logistics, you got comms, you got analytics stuff, you got planning, you got collaboration and probably a hundred other things that I haven't mentioned. Maybe talk about you put your CTO hat on. >> Oh no, absolutely, so one of the things I say to our people, you know the technology is important but people are more important. And and so how we work with technology, its adoption as a CIO is critical. I need to say that when we're provided quality top tier software technologies to support education and training, as I mentioned, volunteer management, information management and security. And they were adopted naturally and they take off like a fire on a dry day, it means Splunk and other companies produced a great product. And we've seen this time and again with our ecosystem. So it's a general statement about the cloud technologies. Many companies have just done an exceptional job at building products that our people can work with. So I don't really complain too much about adoption across the board or struggle with it, I should say. So Google, Microsoft, Splunk, Cornerstone OnDemand, Salamander, Everbridge, Palantir. >> Be careful it's like naming the kids you're going to leave somebody out. So many of these great benefactors. >> Yeah, they're used to it but we work with all and our new COO came in, I apologize, I was CIO/CTO of Team Rubicon USA for about three years and I just moved over to Team Rubicon global to help orchestrate our global footprint. And we've set up licensing and a model for where instances of software are located to meet the legal regulatory framework for doing business internationally. And but the the COO of USA, and I'm so proud of what USA is doing right now, it's just blowing up. I mean what they're accomplishing as the largest Team Rubicon entity. But he looked at me, he said, Steve we got to get rid of some of these software products, and I said well, tell me what you don't want to do and I'll delete it, happy to. And instead the numbers gone up by 10 you know since that conversation. So there's some great challenges with and great opportunities, but as you know when your capacity increases, working with data and information your risk also goes up. So we work hard it impacting the behaviors of all of our people, it doesn't happen in a month or two months it takes years. So that everyone is security minded and making good decisions about how we work with information and data, you know whether it's a collective view provided by a product like Splunk which gives us this global view of information. You know if we have people working in a in a dangerous area and all of a sudden we know where all of our people are we just don't post that up on the open internet right. That's a bad idea just to give you a simple example. Down to the PII of our members and employees. And we're becoming very good at that. And for an NGO that's unusual and we're going to be driving an independent security audit fairly soon, to push it even further with the Board of Directors and executives, and so the business team can make decisions about how what we do technically based on you know liability in business model, right for how we work, but for me, the highest priority's protection of everyone. >> Well, it is a wonderful organization and we sincerely Dave and I both thank you for your service, present and future tense, for your service absolutely. Team Rubicon they will accept contributions, both time and treasure so visit the website Team Rubicon and see what you might be able to do to lend help to the cause, great cause that it is. Thank you Stephen. Back with more from .conf2017 here in DC, right after this.

(upbeat music) >> Announcer: Live from San Francisco, it's theCUBE, covering Spark Summit 2017, brought to you by Databricks. >> Welcome back to theCUBE, it's day two at the Spark Summit 2017. I'm David Goad and here with George Gilbert from Wikibon, George. >> George: Good to be here. >> Alright and the guest of honor of course, is Ash Munshi, who is the CEO of Pepperdata. Ash, welcome to the show. >> Thank you very much, thank you. >> Well you have an interesting background, I want you to just tell us real quick here, not give the whole bio, but you got a great background in machine learning, you were an early user of Spark, tell us a little bit about your experience. >> So I'm actually a mathematician originally, a theoretician who worked for IBM Research, and then subsequently Larry Ellison at Oracle, and a number of other places. But most recently I was CTO at Yahoo, and then subsequent to that I did a bunch of startups, that involved different types of machine learning, and also just in general, sort of a lot of big data infrastructure stuff. >> And go back to 2012 with Spark right? You had an interesting development. Right, so 2011, 2012, when Spark was still early, we were actually building a recommendation system, based on user-generated reviews. That was a project that was done with Nando de Freitas, who is now at DeepMind, and Peter Cnudde, who's one of the key guys that runs infrastructure at Yahoo. We started that company, and we were one of the early users of Spark, and what we found was, that we were analyzing all the reviews at Amazon. So Amazon allows you to crawl all of their reviews, and we basically had natural language processing, that would allow us to analyze all those reviews. When we were doing sort of MapReduce stuff, it was taking us a huge number of nodes, and 24 hours to actually go do analysis. And then we had this little project called Spark, out of AMPlab, and we decided spin it up, and see what we could do. It had lots of issues at that time, but we were able to actually spin it up on to, I think it was in the order of 100,000 nodes, and we were able take our times for running our algorithms from you know, sort of tens of hours, down to sort of an hour or two, so it was a significant improvement in performance. And that's when we realized that, you know, this is going to be something that's going to be really important once this set of issues, where it, once it was going to get mature enough to make happen, and I'm glad to see that that it's actually happened now, and it's actually taken over the world. >> Yeah that little project became a big deal, didn't it? >> It became a big deal, and now everybody's taking advantage of the same thing. >> Well bring us to the present here. We'll talk about Pepperdata and what you do, and then George is going to ask a little bit more about some of the solutions that you have. >> Perfect, so Pepperdata was a company founded by two gentlemen, Sean Suchter and Chad Carson. Sean used to run Yahoo Search, and one of the first guys who actually helped develop Hadoop next to Eric14 and that team. And then Chad was one of the first guys who actually figured out how to monetize clicks, and was the data science guy around the whole thing. So those are the two guys that actually started the company. I joined the company last July as CEO, and you know, what we've done recently, is we've sort of expanded our focus of the company to addressing DevOps for big data. And the reason why DevOps for big data is important, is because what's happened in the last few years, is people have gone from experimenting with big data, to taking big data into production, and now they're actually starting to figure out how to actually make it so that it actually runs properly, and scales, and does all the other kinds of things that are there, right? So, it's that transition that's actually happened, so, "Hey, we ran it in production, "and it didn't quite work the way we wanted to, "now we actually have to make it work correctly." That's where we sort of fit in, and that's where DevOps comes in, right? DevOps comes in when you're actually trying to make production systems that are going to perform in the right way. And the reason for DevOps is it shortens the cycle between developers and operators, right? So the tighter the loop, the faster you can get solutions out, because business users are actually wanting that to happen. That's where we're squarely focused, is how do we make that work? How do we make that work correctly for big data? And the difference between, sort of classic DevOps and DevOps for big data, is that you're now dealing with not just, you know, a set of computers solving an isolated sort of problem. You're dealing with thousands of machines that are solving one problem, and the amount of data is significantly larger. So the classical methodologies that you have, while, you know, agile and all that still works, the tools don't work to actually figure out what you can do with DevOps, and that's where we come in. We've got a set of tools that are focused on performance effectively, 'cause that's the big difference between distributed systems performance I should say, that's the big difference between that, and sort of classic even scaled out computing, right? So if you've got web servers, yes performance is important, and you need data for those, but that can actually be sharded nicely. This is one system working on one problem, right? Or a set of systems working on one problem. That's much harder, it's a different set of problems, and we help solve those problems. >> Yeah, and George you look like you're itching to dig into this, feel free. (exclaims loudly) >> Well so, it was, so one of the big announcements at the show, and the sort of the headline announcement today, was Spark server lists, like so it's not just someone running Spark in the cloud sort of as a manage service, it's up there as a, you know, sort of SaaS application. And you could call it platform of the service, but it's basically a service where, you know, the infrastructure is invisible. Now, for all those customers who are running their own clusters, which is pretty much everyone I would imagine at this point, how far can you take them in hiding much of the overhead of running those clusters? And by the overhead I mean, you know, the primarily performance and maximizing, you know, sort of maximizing resource efficiency. >> So, you have to actually sort of double-click on to the kind of resources that we're talking about here, right? So there's the number of nodes that you're going to need to actually do the computation. There is, you know, the amount of disc storage and stuff that you're going to need, what type of CPUs you're going to need. All of that stuff is sort of part of the costing if you will, of running an infrastructure. If somebody hides all that stuff, and makes it so that it's economical, then you know, that's a great thing, right? And if it can actually be made so that it's works for huge installations, and hides it appropriately so I don't pay too much of a tax, that's a wonderful thing to do. But we have, our customers are enterprises, typically Fortune 200 enterprises, and they have both a mixture of cloud-based stuff, where they actually want to control everything about what's going on, and then they have infrastructure internally, which by definition they control everything that's going on, and for them we're very, very applicable. I don't know how we'd applicable in this, sort of new world as a service that grows and shrinks. I can certainly imagine that whoever provides that service would embed us, to be able to use the stuff more efficiently. >> No, you answered my question, which is, for the people who aren't getting the turnkey you know, sort of SaaS solution, and they need help managing, you know, what's a fairly involved stack, they would turn to you? >> Ash: Yes. >> Okay. >> Can I ask you about the specific products? >> George: Oh yes. >> I saw you at the booth, and I saw you were announcing a couple of things. Well what is new-- >> Ash: Correct. >> With the show? >> Correct, so at the show we announced Code Analyzer for Apache Spark, and what that allows people to do, is really understand where performance issues are actually happening in their code. So, one of the wonderful things about Spark, compared to MapReduce, is that it abstracts the paradigm that you actually write against, right? So that's a wonderful thing, 'cause it makes it easier to write code. The problem when we abstract, is what does that abstraction do down in the hardware, and where am I losing performance? And being able to give that information back to the user. So you know, in Spark, you have jobs that can run in parallel. So an apps consists of jobs, jobs can run in parallel, and each one of these things can consume resources, CPU, memory, and you see that through sort of garbage collection, or a disc or a network, and what you want to find out, is which one these parallel tasks was dominating the CPU? Why was it dominating the CPU? Which one actually caused the garbage collector actually go crazy at some point? While the Spark UI provides some of that information, what it doesn't do, is gives you a time series view of what's going on. So it's sort of a blow-by-blow view of what's going on. By imposing the time series view on sort of an enhanced version of the Spark UI, you now have much better visibility about which offending stages are causing the issue. And the nice thing about that is, once you know that, you know exactly which piece of code that you actually want to go and look at. So classic example would be, you might have two stages that are running in parallel. The Spark UI will tell you that it's stage three that's causing the problem, but if you look at the time series, you'll find out that stage two actually runs longer, and that's the one that's pegging the CPU. And you can see that because we have the time series, but you couldn't see that any other way. >> So you have a code analyzer and also the app profiler. >> So the app profiler is the other product that we announced a few months ago. We announced that I guess about three months ago or so. And the app profiler, what it does, is it actually looks after the run is done, it actually looks at all the data that the run produces, so the Spark history server produces, and then it actually goes back and analyzes that and says, "Well you know what? "You're executors here, are not working as efficiently, "these are the executors "that aren't working as efficiently." It might be using too much memory or whatever, and then it allows the developer to basically be able to click on it and say, "Explain to me why that's happening?" And then it gives you a little, you know, a little fix-it if you will. It's like, if this is happening, you probably want to do these things, in order to improve performance. So, what's happening with our customers, is our customers are asking developers to run the application profiler first, before they actually put stuff on production. Because if the application profiler comes back and says, "Everything is green." That there's no critical issues there. Then they're saying, "Okay fine, put it on my cluster, "on the production cluster, "but don't do it ahead of time." The application profiler, to be clear, is actually based on some work that, on open source project called Dr. Elephant, which comes out of LinkedIn. And now we're working very closely together to make sure that we actually can advance the set of heuristics that we have, that will allow developers to understand and diagnose more and more complex problems. >> The Spark community has the best code names ever. Dr. Elephant, I've never heard of that one before. (laughter) >> Well Dr. Elephant, actually, is not just the Spark community, it's actually also part of the MapReduce community, right? >> David: Ah, okay. >> So yeah, I mean remember Hadoop? >> David: Yes. >> The elephant thing, so Dr. Elephant, and you know. >> Well let's talk about where things are going next, George? >> So, you know, one of the things we hear all the time from customers and vendors, is, "How are we going to deal with this new era "of distributed computing?" You know, where we've got the cloud, on-prem, edge, and like so, for the first question, let's leave out the edge and say, you've got your Fortune 200 client, they have, you know, production clusters or even if it's just one on-prem, but they also want to work in the cloud, whether it's for elastics stuff, or just for, they're gathering a lot of data there. How can you help them manage both, you know, environments? >> Right, so I think there's a bunch of times still, before we get into most customers actually facing that problem. What we see today is, that a lot of the Fortune 200, or our customers, I shouldn't say a lot of the Fortune 200, a lot of our customers have significant, you know, deployments internally on-prem. They do experimentation on the cloud, right? The current infrastructure for managing all these, and sort of orchestrating all this stuff, is typically YARN. What we're seeing, is that more than likely they're going to wind up, or at least our intelligence tells us that it's going to wind up being Kubernetes that's actually going to wind up managing that. So, what will happen is-- >> George: Both on-prem and-- >> Well let me get to that, alright? >> George: Okay. >> So, I think YARN will be replaced certainly on-prem with Kupernetes, because then you can do multi data center, and things of that sort. The nice thing about Kupernetes, is it in fact can span the cloud as well. So, Kupernetes as an infrastructure, is certainly capable of being able to both handle a multi data center deployment on-prem, along with whatever actually happens on the cloud. There is infrastructure available to do that. It's very immature, most of the customers aren't anywhere close to being able to do that, and I would say even before Kupernetes gets accepted within the environment, it's probably 18 months, and there's probably another 18 months to two years, before we start facing this hybrid cloud, on-prem kind of problem. So we're a few years out I think. >> So, would, for those of us including our viewers, you know, who know the acronym, and know that it's a, you know, scheduler slash cluster manager, resource manager, would that give you enough of a control plane and knowledge of sort of the resources out there, for you to be able to either instrument or deploy an instrument to all the clusters (mumbles). >> So we are actually leading the effort right now for big data on Kupernetes. So there is a group of, there's a small group working. It's Google, us, Red Hat, Palantir, Bloomberg now has joined the group as well. We are actually today talking about our effort on getting HDFS working on Kupernetes, so we see the writing on the wall. We clearly are positioning ourselves to be a player in that particular space, so we think we'll be ready and able to take that challenge on. >> Ash this is great stuff, we've just got about a minute before the break, so I wanted to ask you just a final question. You've been in the Spark community for a while, so what of their open source tools should we be keeping our eyes out for? >> Kupernetes. >> David: That's the one? >> To me that is the killer that's coming next. >> David: Alright. >> I think that's going to make life, it's going to unify the microservices architecture, plus the sort of multi data center and everything else. I think it's really, really good. Board works, it's been working for a long time. >> David: Alright, and I want to thank you for that little Pepper pen that I got over at your booth, as the coolest-- >> Come and get more. >> Gadget here. >> We also have Pepper sauce. >> Oh, of course. (laughter) Well there sir-- >> It's our sauce. >> There's the hot news from-- >> Ash: There you go. >> Pepperdata Ash Munshi. Thank you so much for being on the show, we appreciate it. >> Ash: My pleasure, thank you very much. >> And thank you for watching theCUBE. We're going to be back with more guests, including Ali Ghodsi, CEO of Databricks, coming up next. (upbeat music) (ocean roaring)