(soft music) >> Good morning from Detroit, Michigan. theCUBE is live on our second day of coverage of KubeCon + CloudNativeCon North America 2022. Lisa Martin here with John Furrier. John, great to be back with you. The buzz is here, no doubt. We've been talking a lot about the developers. And one of the biggest bottlenecks that they face in software delivery, is when they're stuck waiting for access to environments. >> Yeah, this next segment's going to be very interesting. It's a company that's making DevOps more productive, but recognizing the reality of how people are working remotely, but also company to company developers. People are collaborating in all kinds of forms, so this is really going to be a great segment. >> Exactly. Two new guests to theCUBE who know theCUBE, but are first time on theCUBE from Release Hub, Tommy McClung, it's CEO and Matt Carter, it's CMO. Guys, great to have you on the program. >> Thank you. >> Thanks for having us here. >> So we want to dig into Release Hub, so the audience really gets an understanding. But Tommy, I want to get an understanding of your background. >> Sure. >> You've been at Release Hub for what, three years? >> Yep, I'm the co-founder. >> Before that you were at TrueCar? >> I was, yeah, I was the CTO at TrueCar. And prior to that, I've been a software engineer my entire career. I've started a couple of companies before this. Software engineer at heart. I've been working on systems management and making developers productive since 2000, long time. So it's fun to be working on developer productivity stuff. And this is our home and this is where I feel the most comfortable. >> Lisa: Yeah. And Matt, you're brand new to the company as it's chief marketing officer. >> Matt: Yeah, so I just joined earlier this month, so really excited to be here. I came over from Docker, so it's great to be able to keep working with developers and helping them, not only get their jobs done better and faster, but just get more delight out of what they do every day, that's a super important privilege to me and it's exciting to go and work on this at Release here. >> Well, they're lucky to have you. And we work together, Matt, at Docker, in the past. Developer productivity's always been a key, but communities are now more important. We've been seeing on theCUBE that developers are going to decide the standards, they're going to vote with their axes and their code. And what they decide to work on, it has to be the best. And that's going to be the new defacto standard. You guys have a great solution that I like. And I love the roots from the software engineering background because that's the hardest thing right now, is how do you scale the software, making things simpler and easier. And when things happen, you don't want to disrupt the tool chains, you want to make sure the code is right, you guys have a unique solution. Can you take a minute to explain what it is and why it's so important? >> Tommy: Yeah, I'll use a little bit of my experience to explain it. I was the CTO of a company that had 300 engineers, and sharing a handful of environments, really slowed everybody down, you bottleneck there. So in order to unlock the productivity of that team, developers need environments for development, they need it for testing, they need it for staging, you run your environments in production. So the environment is the key building block in every software development process. And like my last company, there were very few of them, one or two, everybody sharing them. And so the idea at Release is to make environments available on demand, so if a developer needs one for anything, they can spin one up. So if they want to write their code in a environment based in the cloud, they can do that, if they want to test on a poll request, an environment will automatically spin up. And the environments are full stack, include all the services, data, settings, configuration that runs the app. So developers literally get an isolated copy of the application, so they can develop knowing they're not stepping on other developers' toes. >> John: Can you give an example of what that looks like? Do they have to pre-configure the environment, or how does that work? Can you give an example? >> Yeah, sure. You have to, just like infrastructure is code, we call this environments is code. So you need to define your environment, which we have a lot of tools that help you do that. Analyze your repositories, help you define that environment. Now that you have the template for that, you can easily use that template to derive multiple environments out of it. A key part of this is everybody wants to make sure their development and data is secure. It runs within the AWS account of our customer. So we're the control plane that orchestrates it and the data and applications run within the context of their AWS account, so it's- >> John: What's the benefit? >> Tommy: Well, bottlenecking, increased developer productivity, developer happiness is a big one. Matt talks about this all the time, keeping developers in flow, so that they're focused on the job and not being distracted with, "Hey DevOps team, I need you to go spin up an environment." And a lot of times in larger organizations, not just the environments, but the process to get access to resources is a big issue. And so DevOps was designed to let developers take control of their own development process, but were still bottlenecking, waiting for environments, waiting for resources from the DevOps team, so this allows that self-service capability to really be there for the developer. >> Lisa: Matt, talk about... Target audience is the developer, talk about though... Distill that down into the business value. What am I, if I'm a financial services organization, or a hospital, or a retailer in e-commerce, what is my business value going to be with using technology like this and delighting those developers? >> Matt: I think there's three things that really matter to the developers and to the financial leader in the organization, A, developers are super expensive and they have a lot of opportunities. So if a developer's not happy and finding joy and productivity in what they're doing, they're going to look elsewhere. So that's the first thing, the second thing is that when you're running a business, productivity is one measure, but also, are you shipping something confidently the first time, or do you have to go back and fix things? And by having the environment spun up with all of your name space established, your tendencies are managed, all of your data being brought in, you're testing against a very high fidelity version of your application when you check in code. And so by doing that, you're testing things more quickly, and they talk a lot about shifting left, but it's making that environment as fully functional and featured as possible. So you're looking at something as it will appear in production, not a subset of that. And then the last thing, and this is one where the value of Figma is very important, a lot of times, you'll spin up an environment on AWS and you may forget about it and might just keep running and chewing up resources. Knowing that when you're done it goes away, means that you're not spending money on things just sitting there on your AWS instance, which is very important for competitors. >> Lisa: So I hear retention of developers, you're learning that developers, obviously business impact their speed to value as well. >> Tommy: Yep. >> And trust, you're enabling your customers to instill trust in their developers with them. >> Tommy: That's right, yeah. >> Matt: And trust and delight, they can be across purposes, a developer wants to move fast and they're rewarded for being creative, whereas your IT team, they're rewarded for predictability and consistency, and those can be opposing forces. And by giving developers a way to move quickly and the artifact that they're creating is something that the IT team understands and works within their processes, allows you to let both teams do what they care about and not create a friction there. >> John: What about the environment as a service? I love that 'cause it makes it sound like it's scaling in the cloud, which you have mentioned you do that. Is it for companies that are working together? So I don't want to spin up an environment, say we're a businesses, "Hey, let's do a deal. "I'm going to integrate my solution into yours. "I got to get my developers to maybe test it out, "so I'm spinning up an environment with you guys," then what do I do? >> Tommy: Well as far as if you're a customer of ours, is that the way you're asking? Well, a lot of times, it's being used a lot in internal development. So that's the first use case, is I'm a developer, you have cross collaboration amongst teams, so a developer tools. And what you're talking about is more, I'm using an environment for a demo environment, or I'm creating a new feature that I want to share with a customer, That's also possible. So if I'm a developer and I'm building a feature and it's for a specific customer of mine, I can build that feature and preview it with the customer before it actually goes into production. So it's a sandbox product development area for the developers to be actually integrating with their customers very, very quickly before it actually makes its way to all of the end users. >> A demo? >> It could be a demo. >> It's like a collaboration feature? >> Sandbox environment. We have customers- >> Kind of like we're seeing more of this collaboration with developers. This becomes a well- >> Tommy: And it's not even just collaboration with internal teams, it's now you're collaborating with your customer while you're building your software, which is actually really difficult to do if you only have one environment, you can't have- >> John: Yeah, I think that's a killer right there, that's the killer app right there. >> Matt: Instead of sending a Figma to a customer, this is what's going to look like, it's two dimensions, this is the app. That is a massive, powerful difference. >> Absolutely. In terms of customer delay, customer retention, employee engagement, those are all inextricably linked. Can you share, Matt, the voice of the customer? I just saw the release with TripActions, I've been a TripActions user myself, but give us this sense, I know that you're brand new, but the voice of the customer, what is it? What is it reflecting? How is it reinforcing your value prop? >> Matt: I think the voice that comes through consistently is instead of spending time building the system that is hard to do and complicated and takes our engineering cycles, our engineers can focus on whether it's platform engineering, new features and whatnot, it's more valuable to the company to build features, it's more exciting for a developer to build features and to not have to keep going back and doing things manually, which you're doing a... This is what we do all day long. To do it as a sideline is hard. And the customers are excited 'cause they get to move onto higher value activities with their time. >> Lisa: And everybody wants that, everybody wants to be able to contribute high value projects, programs for their organization rather than doing the boring stuff. >> Tommy: Yeah. I think with TripActions specifically, a lot of platform engineering teams are trying to build something like this in house, and it's a lot of toil, it's work that isn't value added, it enables developers to get their job done, but it's not really helping the business deliver a feature to the user. And so this whole movement of platform engineering, this is what those groups are doing and we're a big enabler to those teams, to get that to market faster. >> John: You're targeting businesses, enterprises, developers. >> That's right. >> Mainly, right, developers? >> Yeah. >> What's the business model? How are you guys making money? What's the strategy there? >> Yeah, I mean we really like to align with the value that we deliver. So if a user creates an environment, we get paid when that happens. So it's an on-demand, if you use the environment, you pay us, if you don't, you don't. >> John: Typical cloud-based pricing. >> Yeah. >> Pay as you go. >> Tommy: Usage based pricing. >> Is there a trigger on certain of how it gets cost? Is it more of the environment size, or what's the- >> Yeah, I mean there's a different tier for if you have really large, complicated environments. And that's the trend, that distributed applications aren't simple anymore, so if you have a small little rails app, it's going to be cheaper than if you have a massive distributed system. But manageable, the idea here is that this should help you save money over investing deeply into a deep platform engineering team. So it's got to be cost effective and we're really cognizant of that. >> So you got a simple approach, which is great. Talk about the alternative. What does it look like for a customer that you want to target? What's their environment? What does it look like, so that if I'm a customer, I would know I need to call you guys at Relief Hub. Is it sprawl? Is it multiple tool chains? Chaos, mayhem? What does it look like? >> Tommy: Yeah, let's have Matty, Matt could do this one. >> When you look at the systems right now, I think complexity is the word that keeps coming up, which is that, whether you're talking about multi-cloud or actually doing it, that's a huge thing. Microservices proliferation are happening over and over again, different languages. What I'm excited about with Release, is not dissimilar from what we saw in the Docker movement, which is that there's all this great stuff out there, but there's that common interface there, so you can actually run it locally on your machine, do your dev and test, and know that it's going to operate with, am I using Couchbase or Postgres or whatever, I don't care, it's going to work this way. Similar with Release, people are having to build a lot of these bespoke solutions that are purpose built for one thing and they're not designed to the platform. And the platform for platform engineering gives us a way to take that complexity out the equation, so you're not limited to what you can do, or, "Oh crud, I want to move to something else, "I have to start over again," that process is going to be consistent no matter what you're doing. So you're not worried about evolution and success and growth, you know that you've got a foundation that's going to grow. Doing it on your own, you have to build things in that very bespoke, specific manner, and that just creates a lot more toil than you'd want to get if you were using a platform and focusing on the value after your company. >> Matt Klein was just on here. He was with Lyft, he was the one who open source Envoy, which became very popular. We asked him what he thought about the future and he's like, it's too hard to work with all this stuff. He was mentioning Yamo code, but he got triggered a little bit, but his point was there's a lot to pull together. And it sounds like you guys have this solution, back in the old days, spin up some EC2, compute, similar way, right? "Hey, I don't want to person a server, I person a server, rack and stack, top of rack switch, I'm going to go to the cloud, use EC2. >> Tommy: Yeah, I mean just think about if- >> You're an environment version of that. Why wait for it to be built? >> Yeah. >> Is that what I'm getting- >> Yeah, I mean, and an application today isn't just the EC2 instances, it's all of your data, it's your configuration. Building it one time is actually complicated to get your app to work it, doing it lots of times to make your developers productive with copies of that, is incredibly difficult. >> John: So you saw the problem of developers waiting around for someone to provision an environment. >> Tommy: That's right. >> So they can do whatever they want to do. >> Tommy: That's right. >> Test, ship, do, play around, test the customer. Whatever that project scope is, they're waiting around versus spinning up an environment. >> Yeah, absolutely, 100%. >> And that's the service. >> That's what it is. >> Take time, reduce the steps it takes, make it more productive. >> And build an amazing developer experience that you know your developers are going to love. If you're at Facebook or Google, they have thousands of DevOps people building platforms. If you're a company that doesn't have that resource, you have a choice of go build this yourself, which is a distraction, or invest in something like us and focus on your core. >> John: You got Matt on board, got a new CMO, you got enterprise class features and I saw the press release. Talk about the origination story, why you developed it, and then take a minute to give a plug for the company, on what you're looking for, I'm sure you're hiring, what's going on? >> Tommy: Yeah, I've been an entrepreneur for 20 years. My last experience at TrueCar, I saw this problem firsthand. And as the CTO of that company, I looked into the market for a solution to this, 'cause we had this problem of 300 developers, environments needed for everything. So we ended up building it ourselves and it costs multiple millions of dollars to build it. And so as the buyer at the time, I was like, man, I would've spent to solve this, and I just couldn't. So as a software engineer at heart, having seen this problem my entire career, it was just a natural thing to go work on. So yeah, I mean, for anybody that wants to create unlimited environments for their team, just go to releasehub.com. It's pretty self-explanatory, how to give it a shot and try it out. >> Environments is a service, from someone who had the problem, fixed it, built it- >> That's right. >> For other people. What are you guys hiring, looking for some people? >> Yeah, we have engineering hires, sales hires, Matt's got a few marketing hires coming, >> Matt: I was going to say, got some marketing coming. >> Selfishly he has that. (John laughs) The team's growing and it's a really great place to work. We're 100% remote. Part of this helps that, we build this product and we use it every day, so you get to work on what you build and dog food, it's pretty cool. >> Great solution. >> We love remote development environments. Being here and watching that process where building a product and a feature for the team to work better, wow, we should share this with customers. And the agility to deliver that was really impressive, and definitely reinforced how excited I am to be here 'cause we're building stuff for ourselves, which is- >> Matt: Well we're psyched that you're here in theCUBE. Matt, what's your vision for marketing? You got a hiring plan, you got a vision, I'm sure you got some things to do. What's your goals? What's your objective? >> My goal is... The statement people say, you can't market to developers. And I don't want to market to developers, I want to make sure developers are made aware of how they can learn new things in a really efficient way, so their capabilities grow. If we get people more and more successful with what they're doing, give them joy, reduce their toil and create that flow, we help them do things that make you excited, more creative. And that's to me, the reward of this. You teach people how to do that. And wow, these customers, they're building the greatest innovations in the world, I get to be part of that, which is awesome. >> Lisa: Yeah. Delighted developers has so many positive business outcomes that I'm sure organizations in any industry are going to be able to achieve. So exciting stuff, guys. Thank you so much for joining John and me on the program. Good luck with the growth and congrats on what you've enabled so far in just a few short years. >> Thank you, appreciate it. >> Thanks you so much. >> Thank you for having us on. >> Appreciate it. >> Pleasure. >> Thank you. >> For our guests and for John Furrier, I'm Lisa Martin. You're watching theCUBE, live in Detroit, at KubeCon + CloudNativeCon '22. We're back after a short break. (soft music)

The Cube Presents UI Path Forward five. Brought to you by UI Path. >>I Ready, Dave Ante with David Nicholson. We're back at UI Path forward. Five. We're getting ready for the big guns to come in, the two co CEOs, but we have a really special analyst panel now. We're excited to have Daniel Newman here. He's the Principal analyst at Future and Research. And Andy Dai, who's the Vice president and Principal Analyst at Constellation Research. Guys, good to see you. Thanks for making some time to come on the queue. >>Glad to be here. Always >>Good. So, >>Andy, you're deep into ai. You and I have been talking about having you come to our maor office. I'm, I'm really excited that we're able to meet here. What have you seen at the show so far? What are your big takeaways? You know, day one and a half? >>Yeah, well, so first of all, I'm d AI because my last name has AI and I >>Already talk about, >>So, but, but all jokes aside, there are a lot of good things I heard from the conference, right? I mean, one is the last two years because of the pandemic, the growth has been phenomenal for, for a lot of those robotic automation intelligent automation companies, right? So because the low hanging through position making processes have been already taken care of where they going to find the next growth spot, right? That was the question I was looking answers to. And they have some inverse, one good acquisition. They had intelligent document processing, but more importantly they're trying to move from detrimental rules based RPA automation into AI based, more probabilistic subjective decision making areas. That's a huge market, tons of money involved in it, but it's going to be a harder problem to solve. Love to see the execut. >>Well, it's also a big pivot for the, for the company. It started out as sort of a a point product and now is moving to, to platform. But to end of the macro is not in UI pass favor. It's not really in any, you know, tech company's favor, but especially, you know, a company that's going into a transition transitioning to go to market cetera. What are you seeing, what's your take on the macro? I mean, I know you follow the financial markets very closely. There's a lot of negative sentiment right now. Are you as negative as the sentiment? >>Well, the, the broad sentiment comes with some pretty good historical data, right? We've had probably one of the worst market years in multiple decades. And of course we're coming into a situation where all the, the factors are really not in our favor. You've got in interest rates climbing, you've got wildly high inflation, you've had a, you know, helicopters dumping money on the economy for a period of time. And we're, we're gonna get into this great reset is what I keep talking about. But, you know, I had the opportunity to talk to Bill McDermott recently on one of my shows and Bill's CEO of ServiceNow, in case anybody there doesn't know, but >>Former, >>Yeah, really well spoken guy. But you know, him and I kind of went back and forth and we came up with this kind of concept that we were gonna have to tech our way out of what's about to come. You can almost be certain recession is gonna come. But for companies like UiPath, I actually think there's a tremendous opportunity because the bottom line is companies are gonna be looking at their bottom line. A year ago it was all about growth a deal, like the Adobe Figma deal would've been, been lauded, people would've been excited. Now everybody's looking at going, how are they paying that price? Everybody's discounting the future growth. They're looking at the situation, say, what's gonna happen next? Well, bottom line is now they're looking at that. How profitable are we? Are you making money? Are you growing that bottom line? Are you creating earnings? We're >>Gonna come in >>Era, we're gonna come into an era where companies are gonna say, you know what? People are expensive. The inflationary cost of hiring is expensive. You know, what's less expensive? Investing in the cloud, investing in ai, investing in workflow and automation and things that actually enable businesses to expand, keep costs somewhat contained fixed costs, and scale their businesses and get themselves in a good position for when the economy turns to return to >>Grow. So since prior to the pandemic cloud containers, m l and RPA slash automation have been the big four that from a spending data standpoint have been above the line above all kind of the rest in terms of spending momentum up until last quarter, AI and RPA slash automation declined. So my question is, are those two areas discretionary or more discretionary than other technology investments you heard? >>Well, I, I think we're in a, a period where companies are, I won't say they've stopped spending, but you listened to Mark Benioff, you talked about the elongated sales cycle, right? I think companies right now are being very reflective and they're doing a lot of introspection. They're looking at their business and saying, We hired a lot of people. We hired really fast. Do we need to cut? Do we need to freeze? We've made investments in technology, are we getting a return on 'em? We all know that the analytics, whether it's you know, digital adoption platforms or just analytics in the business, say, What is all this money we've been spending doing for us and how productive are we? But I will tell you universally, the companies are looking at workflow automations that enable things. Whether that's onboarding customers, whether that's delivering experiences, whether that's, you know, full, you know, price to quote technologies, automate, automate, automate. By doing that, they're gonna bring down the cost, they're gonna control themselves as best as possible in a tough macro. And then when they come out of it, these processes are gonna be beneficiary in a, in a growth environment even more so, >>Andy UiPath rocketed to a leadership position, largely due to the, the product and the simplicity of the product relative to the competition. And then as you well know, they expanded into, you know, platform. So how do you see the competitive environment? A UI path is again focusing on that platform play Automation Anywhere couldn't get to public market. They had turnover at the go to market level. Chris Riley joined a lot of, lot of hope left Microsoft joined into the fray, obviously is having an impact that you're certainly seeing spending momentum around Microsoft. Then SAP service Now Salesforce, every software company the planet thinks they should get every dollar spent on software. You know, they, they see UI pass momentum and they say, Hey, we can, we can take some of that off the table. How do you see the competitive environment right now? >>So first of all, in in my mind, UI path is slightly better because of a couple of reasons. One, as you said, it's ease of use. >>They're able to customize it variable to what they want. So that's a real easy development advantage. And then the, when you develop the bots and equal, it takes on an average anywhere between two to maybe six weeks, generally speaking, in some industries regulated government might take more so that it's faster, quicker, easier than others in a sense. So people love using that. The second advantage of what they have in my mind is that not only they are available as a managed SA solution on, on cloud, on Azure Cloud, but also they have this version that you can install, maintain, manage any way you want, whether it's a public cloud or, or your own data center and so on so forth. That's not available with almost, not all of them have it, Few have it, but not all of the competitors have it. So they have an advantage there as well. Where it could become useful would be one of the areas that they haven't even expanded is the government. >>Government is the what, >>Sorry? The government. Yeah, related solutions, right? Defense, government, all of those areas when you go, which haven't even started for various reasons. For example, they're worried about laying off people, worried about cost, worried about automating things. There's a lot of hurdles to overcome. But once you overcome that, if you want to go there, nobody's going to use, or most of them will be very of using something on the cloud. So they have a solution for version variation of that. So they are set up to come to that next level. I mean, I don't know if you guys were at the keynote, the CEO talked about how their plans to go from 1 billion to 5 billion in ar. So they're set up to capture the market. But again, as you said, every big software company saw their momentum, they want to get into it, they want to compete with them. So >>Well, to get to 5 billion, they've gotta accelerate growth. I mean, if you do 20% cer over the next, you know, through the end of the decade, they don't quite get there. So they're gonna have to, you know, they lowered their forecast out of the high 20 or mid twenties to 18%. They're gonna have to accelerate that. And we've seen that before. We see it in cloud where cloud, you know, accelerates growth even though you got the lower large numbers. Go ahead Dave. >>Yeah, so Daniel, then how do we, how do we think of this market? How do we measure the TAM for total addressable market for automation? I mean, you know, what's that? What's that metric that shows how unautomated are we, how inefficient are we? Is there a, is there a 5% efficiency that can be gained? Is there a 40% efficiency that can be gained? Because if you're talking about, you know, how much much of the market can UI path capture, first of all, how big is the market? And then is UI path poised to take advantage of that compared to the actual purveyors of the software that people are interacting with? I'm interacting with an E R p, an ER P system that has built into it the ability to automate processes. Then why do I need 'EM UI path? So first, how do you evaluate TAM? Second, how do you evaluate whether UI Path is gonna have a chance in this market where RPAs built into the applications that we actually use? Yeah, >>I think that TAM is evolving, and I don't have it in front of me right now, but what I'll tell you about the TAM is there's sort of the legacy RPA tam and then there's what I would sort of evolve to call the IPA and workflow automation tam that is being addressed by many of these software companies that you asked in the competitive equation. In the, in the, in the question, what we're seeing is a world where companies are gonna say, if we can automate it, we will automate it. That's, it's actually non-negotiable. Now, the process in the ability to a arrive at automation at scale has long been a battle front within the nor every organization. We've been able to automate things for a long time. Why has it more been done? It's the same thing with analytics. There's been numerous studies in analytics that have basically shown companies that have been able to embrace, adopt, and implement analytics, have significantly better performances, better performances on revenue growth, better performances and operational cost management, better performances with customer experience. >>Guess what? Not everybody, every company can get to this. Now there's a couple of things behind this and I'm gonna, I'm gonna try to close my answer out cause I'm getting a little long winded here. But the first thing is automation is a cultural challenge in most organizations. We've done endless research on companies digitally transforming and automating their business. And what we've found is largely the technology are somewhat comparable. Meaning, you know, I, I've heard what he is saying about some of the advantages of partnership with Microsoft, very compelling. But you know what, all these companies that have automation offerings, whether it's you know, through a Salesforce, Microsoft, whether it's a specialized rpa like an Automation Anywhere or a UI path, their solutions can be deployed and successful. The company's ability to take the investment, implement it successfully and get buy in across the organization tends to always be the hurdle. An old CIO stat, 50% of IT projects fail. That stat is still almost accurate today. It's not 50% of technology is bad, but those failures are because the culture doesn't get behind it. And automation's a tricky one because there's a lot of people that feel on the outside rather than the inside of an automation transformation. >>So, Andy, so how do you think about the, to Dave's question, the SAPs the service nows trying to, you know, at least take some red crumbs off the table. They, they're gonna, they're gonna create these automation stove pipes, but in Automation Anywhere or, or UI path is a horizontal play, are they not? And so how do you think about that progression? Well, so >>First of all, all of this other companies, when they, they, whether it's a build, acquire, what have you, these guys already have what, five, seven years on them. So it's gonna be difficult for them to catch up with the Center of Excellence knowledge on the use cases, what they got to catch up with them. That's gonna be a lot of catch up. Just to give you an idea, Microsoft Power Automate has been there for a while, right? They're supposedly doing well as well, but they still choose to partner with the UiPath as well to get them to the next level. So there's going to be competition coming from all areas, but it's, it's about, you know, highlights. >>So, so who is the competition? Is it Microsoft chipping away an individual productivity? Is it a service now? Who's got a platform play? Is it themselves just being able to execute >>All plus also, but I think the, the most, I wouldn't say competition, but it's more people are not aware of what areas need to be automated, right? For example, one of the things I was talking about with a couple of customers is, so they have a automation hub where you can put the, the process and and task that need to be automated and then you prioritize and start working on it. And, and almost all of them that I speak to, they keep saying that most of the process and task identification that they need to do for automation, it's manual right now. So, which means it's limited, you have to go and execute it. When people find out and tell you that's what need to be fixed, you try to go and fix that. But imagine if there is a way, I mean the have solutions they're showcasing now if it becomes popular, if you're able to identify tasks that are very inefficient or or process that's very inefficient, automatically score them up saying that, you know what, this is what is going to be ROI and you execute on it. That's going to be huge. So >>I think ts right, there's no shortage of, of a market. I would, I would agree with you Rob Sland this morning talked about the progression. He sort of compared it to e R P of the early days. I sort of have a love hate with E R P cuz of the complexity of the implementation and the, and the cost. However, first of all, a couple points and I love to get your thoughts for you. If you went back, I know 25 years, you, you wouldn't have been able to pick SAP out of a lineup and say that's gonna be the leader in E R P and they ended up, you know, doing really, really well. But the more interesting angle is if you could have figured out the customers that were implementing e r p in, in a really high quality fashion, those are the companies that really did well. You buy their stocks, they really took off cuz they were killing their other industry competitors. So, fast forward to automation. Will automation live up to its hype and your opinion, will it be as transformative and will the, the practitioners of automation see the same type of uplift in their markets, in their market caps, in their competitiveness as did sort of the early adopters and the excellent adopters of brp? What are your thoughts? Well, >>I think it's an interesting comparison. Maybe answer it slightly different way. I think the future is that automation is a non-negotiable in every enterprise organization. I think if you're a large organization, we have absolutely filled our, our organizations with waste too much overhead, too much expense, too much technical debt and automation is an answer. This is the way we want to interact, right? We want a chat bot that actually gives us good answers that can answer on a Tuesday at 11:00 PM at night when we want to know if the right dog food, you know, and I'm saying that, you know, that's what we want. That's the outcome we want. And businesses have to be driven by the outcome. Here's what I'm not sure about, Dave, is we have an era where over the last three to five years, a lot of products have become companies and a lot of 'EM products became companies ended up in public markets. >>And so the RPA space is one of those areas that got this explosive amount of growth. And you look at it and there's two ways. Is this horizontally a business rpa or is this going to be something that's gonna be a target of those Microsofts and those SAPs and say, Look, we need hyper automation to be deeply integrated at the E R P crm, hcm SCM level. We're gonna build by this or we're gonna build this. And you're already hearing it in the partnerships, but this is how I think the story ends. I I think either the companies like UiPath get much bigger, they get much more rounded in their, in their offerings. Or you're gonna have a large company like a Microsoft come in and say, you know what? Buy it rather >>Than build can they can, they can, can this company, maybe not so much here, but can a company like Automation Anywhere stay acquisition? Well, >>I use the, I use the Service now as an, as a parallel because they're a company that I thought would always end up inside of a bigger company and now you're like, I think they're too big. I think they've they've dropped >>That, that chart. Yeah, they're acquisition proof. I would agree. But these guys aren't yet Nora's automation. They work for >>A while and it's not necessarily a bad thing. Sometimes getting bit bought is good, but what I mean is it's gonna be core and these big companies know it cuz they're all talking >>About, but as independent analysts, we want to see independent companies. >>I wanna see the right thing. >>It just makes it fun. >>The right thing >>Customers. Yeah, but you know, okay, Oracle buy more customers, more >>Customers. >>I'm kidding. Yeah, I guess it's the right thing. It just makes it more fun when you have really good independent competitors that >>We >>Absolutely so, and, and spend way more on r and d than these big companies who spend a lot more on stock buyback. But I know you gotta go. Thanks so much for spending some time, making time for Cube Andy. Great to see you. Good to see as well. All right, we are wrapping up day one, Dave Blan and Dave Nicholson live. You can hear the action behind us, forward in five on the Cube, right back.

>>Hello. And welcome back to the cubes live coverage here in Seattle for the cubes coverage of AWS marketplace seller conference. Now part of really big move and news, Amazon partner network combines with AWS marketplace to form one organization, the Amazon partner organization, APO where the efficiencies, the next iteration, as they say in Amazon language, where they make things better, simpler, faster, and, and for customers is happening. We're here with Chris Cruz, who's the general manager, worldwide leader of ISV alliances and marketplace, which includes all the channel partners and the buyer and seller relationships all now under one partner organization, bringing together years of work. Yes. If you work with AWS and are a partner and, or sell with them, all kind of coming together, kind of in a new way for the next generation, Chris, congratulations on the new role and the reor. >>Thank you. Yeah, it's very exciting. We're we think it invent, simplifies the process on how we work with our partners and we're really optimistic so far. The feedback's been great. And I think it's just gonna get even better as we kind of work out the final details. >>This is huge news because one, we've been very close to the partner that we've been working with and we talking to, we cover them. We cover the news, the startups from startups, channel partners, big ISVs, big and small from the dorm room to the board room. You guys have great relationships. So check marketplace, the future of procurement, how software will be bought, implemented and deployed is also changed. So you've got the confluence of two worlds coming together, growth in the ecosystem. Yep. NextGen cloud on the horizon for AWS and the customers as digital transformation goes from lift and shift to refactoring businesses. Yep. This is really a seminal moment. Can you share what you talked about on the keynote stage here, around why this is happening now? Yeah. What's the guiding principle. What's the north star where, why what's what's the big news. >>Yeah. And so, you know, a lot of reasons on why we kind of, we pulled the two teams together, but you know, a lot of it kind gets centered around co-sell. And so if you take a look at marketplace where we started off, where it was really a machine image business, and it was a great self-service model and we were working with ISVs that wanted to have this new delivery mechanism on how to bring in at the time was Amazon machine images and you fast forward, we started adding more product types like SAS and containers. And the experience that we saw was that customers would use marketplace for kind of up to a certain limit on a self-service perspective. But then invariably, they wanted by a quantity discount, they wanted to get an enterprise discount and we couldn't do that through marketplace. And so they would exit us and go do a direct deal with a, an ISV. >>And, and so to remedy that we launched private offers, you know, four years ago. And private offers now allowed ISVs to do these larger deals, but do 'em all through marketplace. And so they could start off doing self-service business. And then as a customer graduated up to buying for a full department or an organization, they can now use private offers to execute that larger agreement. And it, we started to do more and more private offers, really kind of coincided with a lot of the initiatives that were going on within Amazon partner network at the time around co-sell. And, and so we started to launch programs like ISV accelerate that really kind of focused on our co-sell relationship with ISVs. And what we found was that marketplace private offers became this awesome way to automate how we co-sell with ISV. And so we kinda had these two organizations that were parallel. We said, you know what, this is gonna be better together. If we put together, it's gonna invent simplify and we can use marketplace private offers as part of that co-sell experience and really feed that automation layer for all of our ISVs as they interacted with native >>Discussions. Well, I gotta give you props, you and Mona work on stage. You guys did a great job and it reminds me of the humble nature of AWS and Amazon. I used to talk to Andy jazzy about this all the time. That reminds me of 2013 here right now, because you're in that mode where Amazon reinvent was in 2013. Yeah. Where you knew it was breaking out. Yeah. Everyone's it was kind of small, but we haven't made it yet. Yeah. But you guys are doing billions of vows in transactions. Yeah. But this event is really, I think the beginning of what we're seeing as the change over from securing and deploying applications in the cloud, because there's a lot of nuanced things I want to get your reaction on one. I heard making your part product as an ISV, more native to AWS's stack. That was one major call out. I heard the other one was, Hey, if you're a channel partner, you can play too. And by the way, there's more choice. There's a lot going on here. That's about to kind of explode in a good way for customers. Yeah. Buyers get more access to assemble their solutions. Yeah. And you got all kinds of like business logic, compensation, integration, and scale. Yeah. This is like unprecedented. >>Yeah. It's, it's exciting to see what's going on. I mean, I think we kind of saw the tipping point probably about two years ago, which, you know, prior to that, you know, we would be working with ISVs and customers and it was really much more of an evangelism role where we were just getting people to try it. Just, just list a product. We think this is gonna be a good idea. And if you're a buyer, it's like just try out a private offer, try out a self, you know, service subscription. And, and what's happened now is there's no longer a lot of that convincing that needs to happen. It's really become accepted. And so a lot of the conversations I have now with ISVs, it's not about, should I do marketplace it's how do I do it better? And how do I really leverage marketplace as part of my co-sell initiatives as, as part of my go to market strategy. >>And so you've, you've really kind of passed this tipping point where marketplaces are now becoming very accepted ways to buy third party software. And so that's really exciting. And, and we see that we, you know, we can really enhance that experience, you know, and what we saw on the machine image side is we had this awesome integrated experience where you would buy it. It was tied right into the EC two control plane. And you could go from buying to deploying in one single motion. SAS is a little bit different, you know, we can do all the buying in a very simple motion, but then deploying it. There's a whole bunch of other stuff that our customers have to do. And so we see all kinds of ways that we can simplify that. You know, recently we launched the ability to put third party solutions outta marketplace, into control tower, which is how we deploy all of our landing zones for AWS. And now it's like, instead of having to go wire that up as you're adding new AWS environments, why not just use that third party solution that you've already integrated to you and have it there as you're span those landing zones through >>Control towers, again, back to humble nature, you guys have dominated the infrastructure as a service layer. You kind of mentioned it. You didn't really kind of highlight it other than saying you're doing pretty good. Yeah. On the IAS or the technology partners as you call or infrastructure as you guys call it. Okay. I can see how the, the, the pan, the control panel is great for those customers. But outside that, when you get into like CRM, you mentioned E R P these business apps, these horizontal and verticals have data they're gonna have SageMaker, they're gonna have edge. They might have, you know, other services that are coming online from Amazon. How do I, as an ISV, get my stuff in there. Yeah. And how do I succeed? And what are you doing to make that better? Cause I know it's kind of new, but not new. Yeah, >>No, it's not. I mean, that's one of the things that we've really invested on is how do we make it really easy to list marketplace? And, you know, again, when we first start started, it was a big, huge spreadsheet that you had to fill out. It was very cumbersome and we've really automated all those aspects. So now we've exposed an API as an example. So you can go straight out of your own build process and you might have your own C I CD pipeline. And then you have a build step at the end. And now you can have that execute marketplace update from your build script, right across that API all the way over to AWS marketplace. So it's taking that effectively, a C CD pipeline from an ISV and extending it all the way to AWS and then eventually to a customer, because now it's just an automated supply chain for that software coming into their environment. And we see that being super powerful. There's nowhere manual steps >>Along. Yeah. I wanna dig into that because you made a comment and I want you to clarify it here in the cube. Some have said, even us on the cube. Oh, marketplace. Just the website's a catalog. Yeah. Feels old school. Yeah. Feels like 1995 database. I'm kind of just, you know, saying no offense sake. And now you're saying, you're now looking at this and, and implementing more of a API based. Why is that relevant? I'm I know the answer. You already set up with APIs, but explain the transition from the mindset of it's a website. Yeah. Buy stuff on a catalog to full blown API layer. Yeah. Services. >>Absolutely. Well, when you look at all AWS services, you know, our customers will interface, you know, they'll interface them through a console initially, but when they're using them in production, they're, it's all about APIs and marketplace, as you mentioned, did start off as a website. And so we've kind of taken the opposite approach. We've got this great website experience, which is great for demand gen and, you know, highlighting those listings. But what we want to do is really have this API service layer that you're interfacing with so that an ISV effectively is not even in our marketplace. They interfacing over APIs to do a variety of their high, you know, value functions, whether it's listing soy, private offers. We don't have that all available through APIs and the same thing on the buyer side. So it's integrating directly into their AWS environment and then they can view all their third party spend within things like our cost management suites. They can look at things like cost Explorer, see third party software, right next to first party software, and have that all integrated this nice as seamless >>For the customer. That's a nice cloud native kind of native experience. I think that's a huge advantage. I'm gonna track that closer. We're we're gonna follow that. I think that's gonna be the killer killer feature. All right. Now let's get to the killer feature and the business logic. Okay. Yeah. All partners all wanna know what's in it for me. Yeah. How do I make more cash? Yeah. How do I compensate my sales people? Yeah. What do you guys don't compete with me? Give me leads. Yeah. Can I get MDF market development funds? Yeah. So take me through the, how you're thinking about supporting the partners that are leaning in that, you know, the parachute will open when they jump outta the plane. Yeah. It's gonna be, they're gonna land safely with you. Yeah. MDF marketing to leads. What are you doing to support the partners to help them serve their >>Customers? It's interesting. Market marketplace has become much more of an accepted way to buy, you know, our customers are, are really defaulting to that as the way to go get that third party software. So we've had some industry analysts do some studies and in what they found, they interviewed a whole cohort of ISVs across various categories within marketplace, whether it was security or network or even line of business software. And what they've found is that on average, our ISVs will see a 24% increased close rate by using marketplace. Right. So when I go talk to a CRO and say, do you want to close, you know, more deals? Yes. Right. And we've got data to show that we're also finding that customers on average, when an ISV sales marketplace, they're seeing an 80% uplift in the actual deal size. And so if your ASP is a hundred K 180 K has a heck of a lot better, right? >>So we're seeing increased deal sizes by going through marketplace. And then the third thing that we've seen, that's a value prop for ISVs is speed of closure. And so on average, what we're finding is that our ISVs are closing deals 40% faster by using marketplace. So if you've got a 10 month sales cycle, shaving four months off of a sales cycle means you're bringing deals in, in an earlier calendar year, earlier quarter. And for ISVs getting that cash flow early is very important. So those are great metrics that we're seeing. And, and, you know, we think that they're only >>Gonna improve and from startups who also want, they don't have a lot of cash ISVs that are rich and doing well. Yeah. They have good, good, good, good, good to market funding. Yeah. You got the range of partners and you know, the next startup could be the next Figma could be in that batch startups. Exactly. Yeah. You don't know the game is changing. Yeah. The next brand could be one of those batch of startups. Yeah. What's the message to the startup community. Yeah. >>I mean, marketplace in a lot of ways becomes a level in effect, right. Because, you know, if, if you look at pre marketplace, if you were a startup, you were having to go generate sales, have a sales force, go compete, you know, kind of hand to hand with these largest ISVs marketplace is really kind of leveling that because now you can both list in marketplace. You have the same advantage of putting that directly in the AWS bill, taking advantage of all the management go features that we offer all the automation that we bring to the table. And so >>A lot of us joint selling >>And joint selling, right? When it goes through marketplace, you know, it's gonna feed into a number of our APN programs like ISV accelerate, our sales teams are gonna get recognized for those deals. And so, you know, it brings nice co-sell behavior to how we work with our, our field sales teams together. It brings nice automation that, you know, pre marketplaces, they would have to go build all that. And that was a heavy lift that really now becomes just kind of table stakes for any kind of ISV selling to an, any of >>Customer. Well, you know, I'm a big fan of the marketplace. I've always have been, even from the early days, I saw this as a procurement game changer. It makes total sense. It's so obvious. Yeah. Not obvious to everyone, but there's a lot of moving parts behind the scenes behind the curtain. So to speak that you're handling. Yeah. What's your message to the audience out there, both the buyers and the sellers. Yeah. About what your mission is, what you're you wake up every day thinking about. Yeah. And what's your promise to them and what you're gonna work on. Cause it's not easy. You're building a, an operating model. That's not a website. It's a full on cloud service. Yeah. What's your promise. And what's >>Your goals. No. And like, you know, ultimately we're trying to do from an Aus market perspective is, is provide that selection experience to the ABUS customer, right? There's the infamous flywheel that Jeff put together that had the concepts of why Amazon is successful. And one are the concepts he points to is the concept of selection. And, and what we mean by that is if you come to Amazon it's is effectively that everything stored. And when you come across, AWS marketplace becomes that selection experience. And so that's what we're trying to do is provide whatever our AWS customers wanna buy, whatever form factor, whatever software type, whatever data type it's gonna be available in AWS marketplace for consumption. And that ultimately helps our customers because now they can get whatever technologies that they need to use alongside Avis. >>And I want, wanna give you props too. You answered the hard question on stage. I've asked Andy EY this on the cube when he was the CEO, Adam Celski last year, I asked him the same question and the answer has been consistent. We have some solutions that people want a AWS end to end, but your ecosystem, you want people to compete yes. And build a product and mostly point to things like snowflake, new Relic. Yeah. Other people that compete with Amazon services. Yeah. You guys want that. You encourage that. Yeah. You're ratifying that same statement. >>Absolutely. Right. Again, it feeds into that selection experience. Right. If a customer wants something, we wanna make sure it's gonna be a great experience. Right. And so a lot of these ISVs are building on top of AWS. We wanna make sure that they're successful. And, you know, while we have a number of our first party services, we have a variety of third party technologies that run very well in a AWS. And ultimately the customer's gonna make their decision. We're customer obsessed. And if they want to go with a third party product, we're absolutely gonna support them in every way shape we can and make sure that's a successful experience for our customers. >>I, I know you referenced two studies check out the website's got buyer and seller surveys on there for Boer. Yeah. I don't want to get into that. I want to just end on one. Yeah. Kind of final note, you got a lot of successful buyers and a lot of successful sellers. The word billions, yes. With an S was and the slide. Can you say the number, how much, how many billions are sold yeah. Through the marketplace. Yeah. And the buyer experience future what's those two things. >>Yeah. So we went on record at reinvent last year, so it's approaching it birthday, but it was the first year that we've in our 10 year history announced how much was actually being sold to the marketplace. And, you know, we are now selling billions of dollars to our marketplace and that's with an S so you can assume, at least it's two, but it's, it's a, it's a large number and it's going >>Very quickly. Yeah. Can't disclose, you know, >>But it's a, it's been a very healthy part of our business. And you know, we look at this, the experience that we >>Saw, there's a lot of headroom. I mean, oh yeah, you have infrastructure nailed down. That's long, you get better, but you have basically growth up upside with these categor other categories. What's the hot categories. You >>Know, we, we started off with infrastructure related products and we've kind of hit critical mass there. Right? We've, there's very few ISVs left that are in that infrastructure related space that are not in our marketplace. And what's happened now is our customers are saying, well, I've been buying infrastructure products for years. I'm gonna buy everything. I wanna buy my line of business software. I wanna buy my vertical solutions. I wanna buy my data and I wanna buy all my services alongside of that. And so there's tons of upside. We're seeing all of these either horizontal business applications coming to our marketplace or vertical specific solutions. Yeah. Which, you know, when we first designed our marketplace, we weren't sure if that would ever happen. We're starting to see that actually really accelerate because customers are now just defaulting to buying everything through their marketplace. >>Chris, thanks for coming on the queue. I know we went a little extra long. There wanted to get that clarification on the new role. Yeah. New organization. Great, great reorg. It makes a lot of sense. Next level NextGen. Thanks for coming on the cube. Okay. >>Thank you for the opportunity. >>All right here, covering the new big news here of AWS marketplace and the AWS partner network coming together under one coherent organization, serving fires and sellers, billions sold the future of how people are gonna be buying software, deploying it, managing it, operating it. It's all happening in the marketplace. This is the big trend. It's the cue here in Seattle with more coverage here at Davis marketplace sellers conference. After the short break.

>> From The Cube Studios in Palo Alto and Boston, bringing you data driven insights from The Cube at ETR. This is "Breaking Analysis" with Dave Vellante. >> The reverse momentum in tech stocks caused by rising interest rates, less attractive discounted cash flow models, and more tepid forward guidance, can be easily measured by public market valuations. And while there's lots of discussion about the impact on private companies and cash runway and 409A valuations, measuring the performance of non-public companies isn't as easy. IPOs have dried up and public statements by private companies, of course, they accentuate the good and they kind of hide the bad. Real data, unless you're an insider, is hard to find. Hello and welcome to this week's "Wikibon Cube Insights" powered by ETR. In this "Breaking Analysis", we unlock some of the secrets that non-public, emerging tech companies may or may not be sharing. And we do this by introducing you to a capability from ETR that we've not exposed you to over the past couple of years, it's called the Emerging Technologies Survey, and it is packed with sentiment data and performance data based on surveys of more than a thousand CIOs and IT buyers covering more than 400 companies. And we've invited back our colleague, Erik Bradley of ETR to help explain the survey and the data that we're going to cover today. Erik, this survey is something that I've not personally spent much time on, but I'm blown away at the data. It's really unique and detailed. First of all, welcome. Good to see you again. >> Great to see you too, Dave, and I'm really happy to be talking about the ETS or the Emerging Technology Survey. Even our own clients of constituents probably don't spend as much time in here as they should. >> Yeah, because there's so much in the mainstream, but let's pull up a slide to bring out the survey composition. Tell us about the study. How often do you run it? What's the background and the methodology? >> Yeah, you were just spot on the way you were talking about the private tech companies out there. So what we did is we decided to take all the vendors that we track that are not yet public and move 'em over to the ETS. And there isn't a lot of information out there. If you're not in Silicon (indistinct), you're not going to get this stuff. So PitchBook and Tech Crunch are two out there that gives some data on these guys. But what we really wanted to do was go out to our community. We have 6,000, ITDMs in our community. We wanted to ask them, "Are you aware of these companies? And if so, are you allocating any resources to them? Are you planning to evaluate them," and really just kind of figure out what we can do. So this particular survey, as you can see, 1000 plus responses, over 450 vendors that we track. And essentially what we're trying to do here is talk about your evaluation and awareness of these companies and also your utilization. And also if you're not utilizing 'em, then we can also figure out your sales conversion or churn. So this is interesting, not only for the ITDMs themselves to figure out what their peers are evaluating and what they should put in POCs against the big guys when contracts come up. But it's also really interesting for the tech vendors themselves to see how they're performing. >> And you can see 2/3 of the respondents are director level of above. You got 28% is C-suite. There is of course a North America bias, 70, 75% is North America. But these smaller companies, you know, that's when they start doing business. So, okay. We're going to do a couple of things here today. First, we're going to give you the big picture across the sectors that ETR covers within the ETS survey. And then we're going to look at the high and low sentiment for the larger private companies. And then we're going to do the same for the smaller private companies, the ones that don't have as much mindshare. And then I'm going to put those two groups together and we're going to look at two dimensions, actually three dimensions, which companies are being evaluated the most. Second, companies are getting the most usage and adoption of their offerings. And then third, which companies are seeing the highest churn rates, which of course is a silent killer of companies. And then finally, we're going to look at the sentiment and mindshare for two key areas that we like to cover often here on "Breaking Analysis", security and data. And data comprises database, including data warehousing, and then big data analytics is the second part of data. And then machine learning and AI is the third section within data that we're going to look at. Now, one other thing before we get into it, ETR very often will include open source offerings in the mix, even though they're not companies like TensorFlow or Kubernetes, for example. And we'll call that out during this discussion. The reason this is done is for context, because everyone is using open source. It is the heart of innovation and many business models are super glued to an open source offering, like take MariaDB, for example. There's the foundation and then there's with the open source code and then there, of course, the company that sells services around the offering. Okay, so let's first look at the highest and lowest sentiment among these private firms, the ones that have the highest mindshare. So they're naturally going to be somewhat larger. And we do this on two dimensions, sentiment on the vertical axis and mindshare on the horizontal axis and note the open source tool, see Kubernetes, Postgres, Kafka, TensorFlow, Jenkins, Grafana, et cetera. So Erik, please explain what we're looking at here, how it's derived and what the data tells us. >> Certainly, so there is a lot here, so we're going to break it down first of all by explaining just what mindshare and net sentiment is. You explain the axis. We have so many evaluation metrics, but we need to aggregate them into one so that way we can rank against each other. Net sentiment is really the aggregation of all the positive and subtracting out the negative. So the net sentiment is a very quick way of looking at where these companies stand versus their peers in their sectors and sub sectors. Mindshare is basically the awareness of them, which is good for very early stage companies. And you'll see some names on here that are obviously been around for a very long time. And they're clearly be the bigger on the axis on the outside. Kubernetes, for instance, as you mentioned, is open source. This de facto standard for all container orchestration, and it should be that far up into the right, because that's what everyone's using. In fact, the open source leaders are so prevalent in the emerging technology survey that we break them out later in our analysis, 'cause it's really not fair to include them and compare them to the actual companies that are providing the support and the security around that open source technology. But no survey, no analysis, no research would be complete without including these open source tech. So what we're looking at here, if I can just get away from the open source names, we see other things like Databricks and OneTrust . They're repeating as top net sentiment performers here. And then also the design vendors. People don't spend a lot of time on 'em, but Miro and Figma. This is their third survey in a row where they're just dominating that sentiment overall. And Adobe should probably take note of that because they're really coming after them. But Databricks, we all know probably would've been a public company by now if the market hadn't turned, but you can see just how dominant they are in a survey of nothing but private companies. And we'll see that again when we talk about the database later. >> And I'll just add, so you see automation anywhere on there, the big UiPath competitor company that was not able to get to the public markets. They've been trying. Snyk, Peter McKay's company, they've raised a bunch of money, big security player. They're doing some really interesting things in developer security, helping developers secure the data flow, H2O.ai, Dataiku AI company. We saw them at the Snowflake Summit. Redis Labs, Netskope and security. So a lot of names that we know that ultimately we think are probably going to be hitting the public market. Okay, here's the same view for private companies with less mindshare, Erik. Take us through this one. >> On the previous slide too real quickly, I wanted to pull that security scorecard and we'll get back into it. But this is a newcomer, that I couldn't believe how strong their data was, but we'll bring that up in a second. Now, when we go to the ones of lower mindshare, it's interesting to talk about open source, right? Kubernetes was all the way on the top right. Everyone uses containers. Here we see Istio up there. Not everyone is using service mesh as much. And that's why Istio is in the smaller breakout. But still when you talk about net sentiment, it's about the leader, it's the highest one there is. So really interesting to point out. Then we see other names like Collibra in the data side really performing well. And again, as always security, very well represented here. We have Aqua, Wiz, Armis, which is a standout in this survey this time around. They do IoT security. I hadn't even heard of them until I started digging into the data here. And I couldn't believe how well they were doing. And then of course you have AnyScale, which is doing a second best in this and the best name in the survey Hugging Face, which is a machine learning AI tool. Also doing really well on a net sentiment, but they're not as far along on that access of mindshare just yet. So these are again, emerging companies that might not be as well represented in the enterprise as they will be in a couple of years. >> Hugging Face sounds like something you do with your two year old. Like you said, you see high performers, AnyScale do machine learning and you mentioned them. They came out of Berkeley. Collibra Governance, InfluxData is on there. InfluxDB's a time series database. And yeah, of course, Alex, if you bring that back up, you get a big group of red dots, right? That's the bad zone, I guess, which Sisense does vis, Yellowbrick Data is a NPP database. How should we interpret the red dots, Erik? I mean, is it necessarily a bad thing? Could it be misinterpreted? What's your take on that? >> Sure, well, let me just explain the definition of it first from a data science perspective, right? We're a data company first. So the gray dots that you're seeing that aren't named, that's the mean that's the average. So in order for you to be on this chart, you have to be at least one standard deviation above or below that average. So that gray is where we're saying, "Hey, this is where the lump of average comes in. This is where everyone normally stands." So you either have to be an outperformer or an underperformer to even show up in this analysis. So by definition, yes, the red dots are bad. You're at least one standard deviation below the average of your peers. It's not where you want to be. And if you're on the lower left, not only are you not performing well from a utilization or an actual usage rate, but people don't even know who you are. So that's a problem, obviously. And the VCs and the PEs out there that are backing these companies, they're the ones who mostly are interested in this data. >> Yeah. Oh, that's great explanation. Thank you for that. No, nice benchmarking there and yeah, you don't want to be in the red. All right, let's get into the next segment here. Here going to look at evaluation rates, adoption and the all important churn. First new evaluations. Let's bring up that slide. And Erik, take us through this. >> So essentially I just want to explain what evaluation means is that people will cite that they either plan to evaluate the company or they're currently evaluating. So that means we're aware of 'em and we are choosing to do a POC of them. And then we'll see later how that turns into utilization, which is what a company wants to see, awareness, evaluation, and then actually utilizing them. That's sort of the life cycle for these emerging companies. So what we're seeing here, again, with very high evaluation rates. H2O, we mentioned. SecurityScorecard jumped up again. Chargebee, Snyk, Salt Security, Armis. A lot of security names are up here, Aqua, Netskope, which God has been around forever. I still can't believe it's in an Emerging Technology Survey But so many of these names fall in data and security again, which is why we decided to pick those out Dave. And on the lower side, Vena, Acton, those unfortunately took the dubious award of the lowest evaluations in our survey, but I prefer to focus on the positive. So SecurityScorecard, again, real standout in this one, they're in a security assessment space, basically. They'll come in and assess for you how your security hygiene is. And it's an area of a real interest right now amongst our ITDM community. >> Yeah, I mean, I think those, and then Arctic Wolf is up there too. They're doing managed services. You had mentioned Netskope. Yeah, okay. All right, let's look at now adoption. These are the companies whose offerings are being used the most and are above that standard deviation in the green. Take us through this, Erik. >> Sure, yet again, what we're looking at is, okay, we went from awareness, we went to evaluation. Now it's about utilization, which means a survey respondent's going to state "Yes, we evaluated and we plan to utilize it" or "It's already in our enterprise and we're actually allocating further resources to it." Not surprising, again, a lot of open source, the reason why, it's free. So it's really easy to grow your utilization on something that's free. But as you and I both know, as Red Hat proved, there's a lot of money to be made once the open source is adopted, right? You need the governance, you need the security, you need the support wrapped around it. So here we're seeing Kubernetes, Postgres, Apache Kafka, Jenkins, Grafana. These are all open source based names. But if we're looking at names that are non open source, we're going to see Databricks, Automation Anywhere, Rubrik all have the highest mindshare. So these are the names, not surprisingly, all names that probably should have been public by now. Everyone's expecting an IPO imminently. These are the names that have the highest mindshare. If we talk about the highest utilization rates, again, Miro and Figma pop up, and I know they're not household names, but they are just dominant in this survey. These are applications that are meant for design software and, again, they're going after an Autodesk or a CAD or Adobe type of thing. It is just dominant how high the utilization rates are here, which again is something Adobe should be paying attention to. And then you'll see a little bit lower, but also interesting, we see Collibra again, we see Hugging Face again. And these are names that are obviously in the data governance, ML, AI side. So we're seeing a ton of data, a ton of security and Rubrik was interesting in this one, too, high utilization and high mindshare. We know how pervasive they are in the enterprise already. >> Erik, Alex, keep that up for a second, if you would. So yeah, you mentioned Rubrik. Cohesity's not on there. They're sort of the big one. We're going to talk about them in a moment. Puppet is interesting to me because you remember the early days of that sort of space, you had Puppet and Chef and then you had Ansible. Red Hat bought Ansible and then Ansible really took off. So it's interesting to see Puppet on there as well. Okay. So now let's look at the churn because this one is where you don't want to be. It's, of course, all red 'cause churn is bad. Take us through this, Erik. >> Yeah, definitely don't want to be here and I don't love to dwell on the negative. So we won't spend as much time. But to your point, there's one thing I want to point out that think it's important. So you see Rubrik in the same spot, but Rubrik has so many citations in our survey that it actually would make sense that they're both being high utilization and churn just because they're so well represented. They have such a high overall representation in our survey. And the reason I call that out is Cohesity. Cohesity has an extremely high churn rate here about 17% and unlike Rubrik, they were not on the utilization side. So Rubrik is seeing both, Cohesity is not. It's not being utilized, but it's seeing a high churn. So that's the way you can look at this data and say, "Hm." Same thing with Puppet. You noticed that it was on the other slide. It's also on this one. So basically what it means is a lot of people are giving Puppet a shot, but it's starting to churn, which means it's not as sticky as we would like. One that was surprising on here for me was Tanium. It's kind of jumbled in there. It's hard to see in the middle, but Tanium, I was very surprised to see as high of a churn because what I do hear from our end user community is that people that use it, like it. It really kind of spreads into not only vulnerability management, but also that endpoint detection and response side. So I was surprised by that one, mostly to see Tanium in here. Mural, again, was another one of those application design softwares that's seeing a very high churn as well. >> So you're saying if you're in both... Alex, bring that back up if you would. So if you're in both like MariaDB is for example, I think, yeah, they're in both. They're both green in the previous one and red here, that's not as bad. You mentioned Rubrik is going to be in both. Cohesity is a bit of a concern. Cohesity just brought on Sanjay Poonen. So this could be a go to market issue, right? I mean, 'cause Cohesity has got a great product and they got really happy customers. So they're just maybe having to figure out, okay, what's the right ideal customer profile and Sanjay Poonen, I guarantee, is going to have that company cranking. I mean they had been doing very well on the surveys and had fallen off of a bit. The other interesting things wondering the previous survey I saw Cvent, which is an event platform. My only reason I pay attention to that is 'cause we actually have an event platform. We don't sell it separately. We bundle it as part of our offerings. And you see Hopin on here. Hopin raised a billion dollars during the pandemic. And we were like, "Wow, that's going to blow up." And so you see Hopin on the churn and you didn't see 'em in the previous chart, but that's sort of interesting. Like you said, let's not kind of dwell on the negative, but you really don't. You know, churn is a real big concern. Okay, now we're going to drill down into two sectors, security and data. Where data comprises three areas, database and data warehousing, machine learning and AI and big data analytics. So first let's take a look at the security sector. Now this is interesting because not only is it a sector drill down, but also gives an indicator of how much money the firm has raised, which is the size of that bubble. And to tell us if a company is punching above its weight and efficiently using its venture capital. Erik, take us through this slide. Explain the dots, the size of the dots. Set this up please. >> Yeah. So again, the axis is still the same, net sentiment and mindshare, but what we've done this time is we've taken publicly available information on how much capital company is raised and that'll be the size of the circle you see around the name. And then whether it's green or red is basically saying relative to the amount of money they've raised, how are they doing in our data? So when you see a Netskope, which has been around forever, raised a lot of money, that's why you're going to see them more leading towards red, 'cause it's just been around forever and kind of would expect it. Versus a name like SecurityScorecard, which is only raised a little bit of money and it's actually performing just as well, if not better than a name, like a Netskope. OneTrust doing absolutely incredible right now. BeyondTrust. We've seen the issues with Okta, right. So those are two names that play in that space that obviously are probably getting some looks about what's going on right now. Wiz, we've all heard about right? So raised a ton of money. It's doing well on net sentiment, but the mindshare isn't as well as you'd want, which is why you're going to see a little bit of that red versus a name like Aqua, which is doing container and application security. And hasn't raised as much money, but is really neck and neck with a name like Wiz. So that is why on a relative basis, you'll see that more green. As we all know, information security is never going away. But as we'll get to later in the program, Dave, I'm not sure in this current market environment, if people are as willing to do POCs and switch away from their security provider, right. There's a little bit of tepidness out there, a little trepidation. So right now we're seeing overall a slight pause, a slight cooling in overall evaluations on the security side versus historical levels a year ago. >> Now let's stay on here for a second. So a couple things I want to point out. So it's interesting. Now Snyk has raised over, I think $800 million but you can see them, they're high on the vertical and the horizontal, but now compare that to Lacework. It's hard to see, but they're kind of buried in the middle there. That's the biggest dot in this whole thing. I think I'm interpreting this correctly. They've raised over a billion dollars. It's a Mike Speiser company. He was the founding investor in Snowflake. So people watch that very closely, but that's an example of where they're not punching above their weight. They recently had a layoff and they got to fine tune things, but I'm still confident they they're going to do well. 'Cause they're approaching security as a data problem, which is probably people having trouble getting their arms around that. And then again, I see Arctic Wolf. They're not red, they're not green, but they've raised fair amount of money, but it's showing up to the right and decent level there. And a couple of the other ones that you mentioned, Netskope. Yeah, they've raised a lot of money, but they're actually performing where you want. What you don't want is where Lacework is, right. They've got some work to do to really take advantage of the money that they raised last November and prior to that. >> Yeah, if you're seeing that more neutral color, like you're calling out with an Arctic Wolf, like that means relative to their peers, this is where they should be. It's when you're seeing that red on a Lacework where we all know, wow, you raised a ton of money and your mindshare isn't where it should be. Your net sentiment is not where it should be comparatively. And then you see these great standouts, like Salt Security and SecurityScorecard and Abnormal. You know they haven't raised that much money yet, but their net sentiment's higher and their mindshare's doing well. So those basically in a nutshell, if you're a PE or a VC and you see a small green circle, then you're doing well, then it means you made a good investment. >> Some of these guys, I don't know, but you see these small green circles. Those are the ones you want to start digging into and maybe help them catch a wave. Okay, let's get into the data discussion. And again, three areas, database slash data warehousing, big data analytics and ML AI. First, we're going to look at the database sector. So Alex, thank you for bringing that up. Alright, take us through this, Erik. Actually, let me just say Postgres SQL. I got to ask you about this. It shows some funding, but that actually could be a mix of EDB, the company that commercializes Postgres and Postgres the open source database, which is a transaction system and kind of an open source Oracle. You see MariaDB is a database, but open source database. But the companies they've raised over $200 million and they filed an S-4. So Erik looks like this might be a little bit of mashup of companies and open source products. Help us understand this. >> Yeah, it's tough when you start dealing with the open source side and I'll be honest with you, there is a little bit of a mashup here. There are certain names here that are a hundred percent for profit companies. And then there are others that are obviously open source based like Redis is open source, but Redis Labs is the one trying to monetize the support around it. So you're a hundred percent accurate on this slide. I think one of the things here that's important to note though, is just how important open source is to data. If you're going to be going to any of these areas, it's going to be open source based to begin with. And Neo4j is one I want to call out here. It's not one everyone's familiar with, but it's basically geographical charting database, which is a name that we're seeing on a net sentiment side actually really, really high. When you think about it's the third overall net sentiment for a niche database play. It's not as big on the mindshare 'cause it's use cases aren't as often, but third biggest play on net sentiment. I found really interesting on this slide. >> And again, so MariaDB, as I said, they filed an S-4 I think $50 million in revenue, that might even be ARR. So they're not huge, but they're getting there. And by the way, MariaDB, if you don't know, was the company that was formed the day that Oracle bought Sun in which they got MySQL and MariaDB has done a really good job of replacing a lot of MySQL instances. Oracle has responded with MySQL HeatWave, which was kind of the Oracle version of MySQL. So there's some interesting battles going on there. If you think about the LAMP stack, the M in the LAMP stack was MySQL. And so now it's all MariaDB replacing that MySQL for a large part. And then you see again, the red, you know, you got to have some concerns about there. Aerospike's been around for a long time. SingleStore changed their name a couple years ago, last year. Yellowbrick Data, Fire Bolt was kind of going after Snowflake for a while, but yeah, you want to get out of that red zone. So they got some work to do. >> And Dave, real quick for the people that aren't aware, I just want to let them know that we can cut this data with the public company data as well. So we can cross over this with that because some of these names are competing with the larger public company names as well. So we can go ahead and cross reference like a MariaDB with a Mongo, for instance, or of something of that nature. So it's not in this slide, but at another point we can certainly explain on a relative basis how these private names are doing compared to the other ones as well. >> All right, let's take a quick look at analytics. Alex, bring that up if you would. Go ahead, Erik. >> Yeah, I mean, essentially here, I can't see it on my screen, my apologies. I just kind of went to blank on that. So gimme one second to catch up. >> So I could set it up while you're doing that. You got Grafana up and to the right. I mean, this is huge right. >> Got it thank you. I lost my screen there for a second. Yep. Again, open source name Grafana, absolutely up and to the right. But as we know, Grafana Labs is actually picking up a lot of speed based on Grafana, of course. And I think we might actually hear some noise from them coming this year. The names that are actually a little bit more disappointing than I want to call out are names like ThoughtSpot. It's been around forever. Their mindshare of course is second best here but based on the amount of time they've been around and the amount of money they've raised, it's not actually outperforming the way it should be. We're seeing Moogsoft obviously make some waves. That's very high net sentiment for that company. It's, you know, what, third, fourth position overall in this entire area, Another name like Fivetran, Matillion is doing well. Fivetran, even though it's got a high net sentiment, again, it's raised so much money that we would've expected a little bit more at this point. I know you know this space extremely well, but basically what we're looking at here and to the bottom left, you're going to see some names with a lot of red, large circles that really just aren't performing that well. InfluxData, however, second highest net sentiment. And it's really pretty early on in this stage and the feedback we're getting on this name is the use cases are great, the efficacy's great. And I think it's one to watch out for. >> InfluxData, time series database. The other interesting things I just noticed here, you got Tamer on here, which is that little small green. Those are the ones we were saying before, look for those guys. They might be some of the interesting companies out there and then observe Jeremy Burton's company. They do observability on top of Snowflake, not green, but kind of in that gray. So that's kind of cool. Monte Carlo is another one, they're sort of slightly green. They are doing some really interesting things in data and data mesh. So yeah, okay. So I can spend all day on this stuff, Erik, phenomenal data. I got to get back and really dig in. Let's end with machine learning and AI. Now this chart it's similar in its dimensions, of course, except for the money raised. We're not showing that size of the bubble, but AI is so hot. We wanted to cover that here, Erik, explain this please. Why TensorFlow is highlighted and walk us through this chart. >> Yeah, it's funny yet again, right? Another open source name, TensorFlow being up there. And I just want to explain, we do break out machine learning, AI is its own sector. A lot of this of course really is intertwined with the data side, but it is on its own area. And one of the things I think that's most important here to break out is Databricks. We started to cover Databricks in machine learning, AI. That company has grown into much, much more than that. So I do want to state to you Dave, and also the audience out there that moving forward, we're going to be moving Databricks out of only the MA/AI into other sectors. So we can kind of value them against their peers a little bit better. But in this instance, you could just see how dominant they are in this area. And one thing that's not here, but I do want to point out is that we have the ability to break this down by industry vertical, organization size. And when I break this down into Fortune 500 and Fortune 1000, both Databricks and Tensorflow are even better than you see here. So it's quite interesting to see that the names that are succeeding are also succeeding with the largest organizations in the world. And as we know, large organizations means large budgets. So this is one area that I just thought was really interesting to point out that as we break it down, the data by vertical, these two names still are the outstanding players. >> I just also want to call it H2O.ai. They're getting a lot of buzz in the marketplace and I'm seeing them a lot more. Anaconda, another one. Dataiku consistently popping up. DataRobot is also interesting because all the kerfuffle that's going on there. The Cube guy, Cube alum, Chris Lynch stepped down as executive chairman. All this stuff came out about how the executives were taking money off the table and didn't allow the employees to participate in that money raising deal. So that's pissed a lot of people off. And so they're now going through some kind of uncomfortable things, which is unfortunate because DataRobot, I noticed, we haven't covered them that much in "Breaking Analysis", but I've noticed them oftentimes, Erik, in the surveys doing really well. So you would think that company has a lot of potential. But yeah, it's an important space that we're going to continue to watch. Let me ask you Erik, can you contextualize this from a time series standpoint? I mean, how is this changed over time? >> Yeah, again, not show here, but in the data. I'm sorry, go ahead. >> No, I'm sorry. What I meant, I should have interjected. In other words, you would think in a downturn that these emerging companies would be less interesting to buyers 'cause they're more risky. What have you seen? >> Yeah, and it was interesting before we went live, you and I were having this conversation about "Is the downturn stopping people from evaluating these private companies or not," right. In a larger sense, that's really what we're doing here. How are these private companies doing when it comes down to the actual practitioners? The people with the budget, the people with the decision making. And so what I did is, we have historical data as you know, I went back to the Emerging Technology Survey we did in November of 21, right at the crest right before the market started to really fall and everything kind of started to fall apart there. And what I noticed is on the security side, very much so, we're seeing less evaluations than we were in November 21. So I broke it down. On cloud security, net sentiment went from 21% to 16% from November '21. That's a pretty big drop. And again, that sentiment is our one aggregate metric for overall positivity, meaning utilization and actual evaluation of the name. Again in database, we saw it drop a little bit from 19% to 13%. However, in analytics we actually saw it stay steady. So it's pretty interesting that yes, cloud security and security in general is always going to be important. But right now we're seeing less overall net sentiment in that space. But within analytics, we're seeing steady with growing mindshare. And also to your point earlier in machine learning, AI, we're seeing steady net sentiment and mindshare has grown a whopping 25% to 30%. So despite the downturn, we're seeing more awareness of these companies in analytics and machine learning and a steady, actual utilization of them. I can't say the same in security and database. They're actually shrinking a little bit since the end of last year. >> You know it's interesting, we were on a round table, Erik does these round tables with CISOs and CIOs, and I remember one time you had asked the question, "How do you think about some of these emerging tech companies?" And one of the executives said, "I always include somebody in the bottom left of the Gartner Magic Quadrant in my RFPs. I think he said, "That's how I found," I don't know, it was Zscaler or something like that years before anybody ever knew of them "Because they're going to help me get to the next level." So it's interesting to see Erik in these sectors, how they're holding up in many cases. >> Yeah. It's a very important part for the actual IT practitioners themselves. There's always contracts coming up and you always have to worry about your next round of negotiations. And that's one of the roles these guys play. You have to do a POC when contracts come up, but it's also their job to stay on top of the new technology. You can't fall behind. Like everyone's a software company. Now everyone's a tech company, no matter what you're doing. So these guys have to stay in on top of it. And that's what this ETS can do. You can go in here and look and say, "All right, I'm going to evaluate their technology," and it could be twofold. It might be that you're ready to upgrade your technology and they're actually pushing the envelope or it simply might be I'm using them as a negotiation ploy. So when I go back to the big guy who I have full intentions of writing that contract to, at least I have some negotiation leverage. >> Erik, we got to leave it there. I could spend all day. I'm going to definitely dig into this on my own time. Thank you for introducing this, really appreciate your time today. >> I always enjoy it, Dave and I hope everyone out there has a great holiday weekend. Enjoy the rest of the summer. And, you know, I love to talk data. So anytime you want, just point the camera on me and I'll start talking data. >> You got it. I also want to thank the team at ETR, not only Erik, but Darren Bramen who's a data scientist, really helped prepare this data, the entire team over at ETR. I cannot tell you how much additional data there is. We are just scratching the surface in this "Breaking Analysis". So great job guys. I want to thank Alex Myerson. Who's on production and he manages the podcast. Ken Shifman as well, who's just coming back from VMware Explore. Kristen Martin and Cheryl Knight help get the word out on social media and in our newsletters. And Rob Hof is our editor in chief over at SiliconANGLE. Does some great editing for us. Thank you. All of you guys. Remember these episodes, they're all available as podcast, wherever you listen. All you got to do is just search "Breaking Analysis" podcast. I publish each week on wikibon.com and siliconangle.com. Or you can email me to get in touch david.vellante@siliconangle.com. You can DM me at dvellante or comment on my LinkedIn posts and please do check out etr.ai for the best survey data in the enterprise tech business. This is Dave Vellante for Erik Bradley and The Cube Insights powered by ETR. Thanks for watching. Be well. And we'll see you next time on "Breaking Analysis". (upbeat music)