>> From The Cube Studios in Palo Alto and Boston connecting with thought-leaders all around the world, this is a Cube Conversation. >> Hello, everyone, and welcome to this Cube Conversation, I'm Dave Vellante. Now, you know I love data, and today we're going to introduce you to a new data and analytical platform, and we're going to take it to the world of cloud database and data warehouses. And with me is Sagar Kadakia who's the head of Enterprise IT (indistinct) 7Park Data. Sagar, welcome back to the Cube. Good to see you. >> Thank you so much, David. I appreciate you having me back on. >> Hey, so new gig for you, how's it going? Tell us about 7Park Data. >> Yeah. Look, things are going well. It started at about two months ago, just a, you know, busy. I had a chance last, you know a few months to kind of really dig into the dataset. We have a tremendous amount of research coming out in Q4 Q1 around kind of the public cloud database market public cloud analytics market. So, you know, really looking forward to that. >> Okay, good. Well, let's bring up the first slide. Let's talk about where this data comes from. Tell us a little bit more about the platform. Where's the insight. >> Yeah, absolutely. So I'll talk a little about 7Park and then we'd kind of jump into the data a little bit. So 7Park was founded in 2012 in terms of differentiator, you know with other alternative data firms, you know we use NLP machine learning, you know AI to really kind of, you know, structure like noisy and unstructured data sets really kind of generate insight from that. And so, because a lot of that know how we ended up being acquired by Vista back in 2018. And really like for us, you know the mandate there is to really, you know look across all their different portfolio companies and try to generate insight from all the data assets you know, that these portfolio companies have. So, you know, today we're going to be talking about you know, one of the data sets from those companies it's that cloud infrastructure data set. We get it from one of the portfolio companies that you know, helps organizations kind of manage and optimize their cloud spend. It's real time data. We essentially get this aggregated daily. So this certainly different than, you know your traditional providers maybe giving you quarterly or kind of by annual data. This is incredibly granular, real time all the way down to the invoice level. So within this cloud infrastructure dataset we're tracking several billion dollars worth of spend across AWS, Azure and GCP. Something like 350 services across like 20 plus markets. So, you know, security machine learning analytics database which we're going to talk about today. And again like the granularity of the KPIs I think is kind of really what kind of you know, differentiates this dataset you know, with just within database itself, you know we're tracking over 20 services. So, you know, lots to kind of look forward to kind of into Q4 and Q1. >> So, okay. So the main spring of your data is if I'm a customer and I there's a service out there there are many services like this that can help me optimize my spend and the way they do that is I basically connect their APIs. So they have visibility on what the transactions that I'm making my usage statistics et cetera. And then you take that and then extrapolate that and report on that. Is that right? >> Exactly. Yeah. We're seeing just on this one data set that we're going to talk about today, it's something like six 700 million rows worth of data. And so kind of what we do is, you know we kind of have the insight layer on top of that or the analytics layer on top of all that unstructured data, so that we can get a feel for, you know a whole host of different kind of KPIs spend, adoption rates, market share, you know product size, retention rates, spend, you know, net price all that type of stuff. So, yeah, that's exactly what we're doing. >> Love it, there's more transparency the better. Okay. So, so right, because this whole world of market sizing has been very opaque you know, over the years, and it's like you know, backroom conversations, whether it's IDC, Gartner who's got what don't take, you know and the estimations and it's very, very, you know it's not very transparent so I'm excited to see what you guys have. Okay. So, so you have some data on the public cloud and specifically the database market that you want to share with our audience. Let's bring up the next graphic here. What are we looking at here Sagar? What are these blue lines and red lines what's this all about? >> Yeah. So and look, we can kind of start at the kind of the 10,000 foot view kind of level here. And so what we're looking at here is our estimates for the entire kind of cloud database market, including data warehousing. If you look all the way over to the right I'll kind of explain some of these bars in a minute but just high level, you know we're forecasting for this year, $11.8 billion. Now something to kind of remember about that is that's just AWS, Azure and GCP, right? So that's not the entire cloud database market. It's just specific to those three providers. What you're looking at here is the breakout and blue and purple is SQL databases and then no SQL databases. And so, you know, to no one's surprise here and you can see, you know SQL database is obviously much larger from a revenue standpoint. And so you can see just from this time last year, you know the database market has grown 40% among these three cloud providers. And, you know, though, we're not showing it here, you know from like a PI perspective, you know database is playing a larger and larger role for all three of these providers. And so obviously this is a really hot market, which is why, you know we're kind of discussing a lot of the dynamics. You don't need to Q and Q Q4 and Q1 >> So, okay. Let's get into some of the specific firm-level data. You have numbers that you want to share on Amazon Redshift and Google BigQuery, and some comments on Snowflake let's bring up the next graphic. So tell us, it says public cloud data, warehousing growth tempered by Snowflake, what's the data showing. And let's talk about some of the implications there. >> Yeah, no problem. So yeah, this is kind of one of the markets, you know that we kind of did a deep dive in tomorrow and we'll kind of get this, you know, get to this in a few minutes, we're kind of doing a big CIO panel kind of covering data, warehousing, RDBMS documents store key value, graph all these different database markets but I thought it'd be great, you know just cause obviously what's occurring here and with snowflake to kind of talk about, you know the data warehousing market, you know, look if you look here, these are some of the KPIs that we have you know, and I'll kind of start from the left. Here are some of the orange bars, the darker orange bars. Those are our estimates for AWS Redshift. And so you can see here, you know we're projecting about 667 million in revenue for Redshift. But if you look at the lighter arm bars, you can see that the service went from representing about 2% of you know, AWS revenue to about 1.5%. And we think some of that is because of Snowflake. And if we kind of, take a look at some of these KPIs you know, below those bar charts here, you know one of the things that we've been looking at is, you know how are longer-term customer spending and how are let's just say like newer customers spending, so to speak. So kind of just like organic growth or kind of net expansion analysis. And if you look at on the bottom there, you'll see, you know customers in our dataset that we looked at, you know that were there 3Q20 as well as 3Q19 their spend on AWS Redshift is 23%. Right? And then look at the bifurcation, right? When we include essentially all the new customers that onboard it, right after 3Q19, look at how much they're bringing down the spend increase. And it's because, you know a lot of spend that was perhaps meant for Redshift is now going to Snowflake. And look, you would expect longer-term customers to spend more than newer customers. But really what we're doing is here is really highlighting the stark contrast because you have kind of back to back KPIs here, you know between organic spend versus total spend and obviously the deceleration in market share kind of coming down. So, you know, something that's interesting here and we'll kind of continue tracking that. >> Okay. So let's maybe come back to this mass Colombo questions here. So the start with the orange side. So we're talking about Snowflake being 667 million. These are your estimates extrapolated based on what we talked about earlier, 1.5% of the AWS portfolio of course you see things like, they continue to grow. Amazon made a bunch of storage announcements last week at the first week of re-invent (indistinct) I mean just name all kinds of databases. And so it's competing with a lot of other services in the portfolio and then, but it's interesting to see Google BigQuery a much larger percentage of the portfolio, which again to me, makes sense people like BigQuery. They like the data science components that are built in the machine learning components that are built in. But then if you look at Snowflake's last quarter and just on a run rate basis, it's over there over $600 million. Now, if you just multiply their last quarter by four from a revenue standpoint. So they got Redshift in their sites, you know if this is, you know to the extent this is the correct number and I know it's an estimate but I haven't seen any better numbers out there. Interesting Sagar, I mean Snowflake surpassed the value of snowflakes or past service now last Friday, it's probably just in trading today you know, on Monday it's maybe Snowflake is about a billion dollars less than the in value than IBM. So you're saying snowflake in a lot of attention, post IPO the thing is even exploded more. I mean, it's crazy. And I presume that's rippled into the customer interest areas. Now the ironic thing here of course, is that that snowflake most of its revenue comes from AWS running on AWS at the same time, AWS and or Redshift and snowflake compete. So you have this interesting dynamic going on. >> Yeah. You know, we've spoken to so many CIOs about kind of the dynamics here with Redshift and BigQuery and Snowflake, you know as it kind of pertains to, you know, Redshift and Snowflake. I think, you know, what I've heard the most is, look if you're using Redshift, you're going to keep using it. But if you're new to data warehousing kind of, so to speak you're going to move to Snowflake, or you're going to start with Snowflake, you know, that and I think, you know when it comes to data warehousing, you're seeing a lot of decisions kind of coming from, you know, bottom up now. So a lot of developers and so obviously their preference is going to be Snowflake. And then when you kind of look at BigQuery here over to the right again, like look you're seeing revenue growth, but again, as a as a percentage of total, you know, GCP revenue you're seeing it come down and look, we don't show it here. But another dynamic that we're seeing amongst BigQuery is that we are seeing adoption rates fall versus this time last year. So we think, again, that could be because of Snowflake. Now, one thing to kind of highlight here with BigQuery look it's kind of the low cost alternative, you know, so to speak, you know once Redshift gets too expensive, so to speak, you know you kind of move over to, to BigQuery and we kind of put some price KPIs down here all the way at the bottom of the chart, you know kind of for both of them, you know when you kind of think about the net price per kind of TB scan, you know, Redshift does it pro rate right? It's five bucks or whatever you, you know whatever you scan in, whereas, you know GCP and get the first terabyte for free. And then everything is prorated after that. And so you can see the net price, right? So that's the price that people actually pay. You can see it's significantly lower that than Redshift. And again, you know it's a lower cost alternative. And so when you think about, you know organizations or CIO's that want to save some money certainly BigQuery, you know, is an option. But certainly I think just overall, you know, Snowflake is is certainly having, you know, an impact here and you can see it from, you know the percentage of total revenue for both these coming down. You know, if we look at other AWS database services or you mentioned a few other services, you know we're not seeing that trend, we're seeing, you know percentage of total revenue hang in or accelerate. And so that's kind of why we want to point this out as this is something unique, you know for AWS and GCP where even though you're seeing growth, it's decelerating. And then of course you can kind of see the percentage of revenue represents coming down. >> I think it's interesting to look at these two companies and then of course Snowflake. So if you think about Snowflake and BigQuery both of those started in the cloud they were true born in the cloud databases. Whereas Redshift was a deal that Amazon did, you know with parxl back in the day, one time license fee and then they re-engineered it to be kind of cloud based. And so there is some of that historical o6n-prem baggage in there. I know that AWS did a tremendous job in rearchitecting that but nonetheless, so I'll give you a couple of examples. If you go back to last year's reinvent 2019 of course Snowflake was really the first to popularize this idea of separating compute from storage and even compute from compute, which is kind of nuance. So I won't go into that, but the idea being you can dial up or dial down compute as you need it you can even turn off compute in the world of Snowflake and just, you know, you're paying an S3 for storage charges. What Amazon did last reinvent was they announced the separation of compute and storage, but what the way they did it was they did it with a tiering architecture. So you can't ever actually fully turn off the compute, but it's great. I mean, it's customers I've talked to say, yes I'm saving a lot of money, you know, with this approach. But again, there's these little nuances. So what Snowflake announced this year was their data cloud and what the data cloud is as a whole new architecture. It's based on this global mesh. It lives across both AWS and Azure and GCP. And what Snowflake has done is they've taken they've abstracted the complexity of the clouds. So you don't even necessarily have to know what you're running on. You have to worry about it any Snowflake user inside of that data cloud if given access can share data with any other user. So it's a very powerful concept that they're doing. AWS at reinvent this year announced something called AWS glue elastic views which basically allows you to take data across their entire database portfolio. And I'm going to put, share in quotes. And I put it in quotes because it's essentially doing copying from a source pushing to a target AWS database and then doing a change data management capture and pushes that over time. So it, it feels like kind of an attempt to do their own data cloud. The advantages of AWS is that they've got way more data stores than just Snowflake cause it's one data store. So was AWS says Aurora dynamo DB Redshift on and on and on streaming databases, et cetera where Snowflake is just Snowflake. And so it's going to be interesting to see, you know these two juxtaposing philosophies but I want it to sort of lay that out because this is just it's setting up as a really interesting dynamic. Then you can bring in Azure as well with Microsoft and what they're doing. And I think this is going to be really fascinating to see how this plays out over the next decade. >> Yeah. I think some of the points you brought up maybe a little bit earlier were just around like the functional limits of a Redshift. Right. And I think that's where, you know Snowflake obviously does it does very, very well you know, you kind of have these, you know kind of to come, you know, you kind of have these, you know if you kind of think about like the market drivers right? Like, let's think about even like the prior slide that we showed, where we saw overall you know, database growth, like what's driving all of that what's driving Redshift, right. Obviously proximity application, interdependencies, right. Costs. You get all the credits or people are already working with the big three providers. And so there's so many reasons to continue spending with them, obviously, you know, COVID-19 right. Obviously all these apps being developed right in the cloud versus data centers and things of that nature. So you have all of these market drivers, you know for the cloud database services for Redshift. And so from that perspective, you know you kind of think, well why are people even to go to a third party vendor? And I think, you know, at that point it has to be the functional superiority. And so again, like a lot of times it depends on, you know, where decisions are coming from you know, top down or bottom up obviously at the engineering at the developer level they're going to want better functionality. Maybe, you know, top-down sometimes, you know it's like, look, we have a lot of credits, you know we're trying to save money, you know from a security perspective it could just be easier to spin something up you know, in AWS, so to speak. So, yeah, I think these are all the dynamics that, you know organizations have to figure out every day, but at least within the data warehousing space, you are seeing spend go towards Snowflake and it's going away to an extent as we kind of see, you know growth decelerate for both of these vendors, right. It's not that revenue's not going out there is growth which is that growth is, it's just not the same as it used to be, you know, so to speak. So yeah, this is a interesting area to kind of watch and I think across all the other markets as well, you know when you think about document store, right you have AWS document DB, right. What are the impacts there with with Mongo and some of these other kind of third party data warehousing vendors, right. Having to compete with all the, you know all the different services offered by AWS Azure like the cosmos and all that stuff. So, yeah, it's definitely kind of turning into a battle Royal, you know as we kind of head into, into 2021. And so I think having all these KPIs is really helping us kind of break down and figure out, you know which areas like data warehousing are slowing down. But then what other areas in database where they're seeing a tremendous amount of acceleration, like as we said, database revenue is driving. Like it's becoming a bigger part of their overall revenue. And so they are doing well. It just, you know, there's obviously snowflake they have to compete with here. >> Well, and I think maybe to your point I infer from your point, it's not necessarily a zero sum game. And as I was discussing before, I think Snowflake's really trying to create a new market. It's not just trying to steal share from the Terra datas and the Redshifts and the PCPs of the world, big queries and and Azure SQL server and Oracle and so forth. They're trying to create a whole new concept called the data cloud, which to me is really important because my prediction is what Snowflake is doing. And they don't even really talk a ton about this but they sort of do, if you squint through the lines I think what they're doing is first of all, simplicity is there, what they're doing. And then they're putting data in the hands of business people, business line people who have domain context, that's a whole new way of thinking about a data architecture versus the prevalent way to do a data pipeline is you got data engineers and data scientists, and you ingest data. It's goes to the beginning of the pipeline and that's kind of a traditional way to do it. And kind of how I think most of the AWS customers do it. I think over time, because of the simplicity of Snowflake you're going to see people begin to look at new ways to architect data. Anyway, we're almost out of time here but I want to bring up the next slide which is a graphic, which talks about a database discussion that you guys are having on 12/8 at 2:00 PM Eastern time with Bain and Verizon who what's this all about. >> Yeah. So, you know, one of the things we wanted to do is we kind of kick off a lot of the, you know Q4 Q1 research or putting on the database spark. It is just like kind of, we did, you know we did today, which obviously, you know we're really going to expand on tomorrow at a at 2:00 PM is discuss all the different KPIs. You know, we track something like 20 plus database services. So we're going to be going through a lot more than just kind of Redshift and BigQuery. Look at all the dynamics there, look at, you know how they're very against some of the third party vendors like the Snowflake, like a Mongo DB, as an example we got some really great, you know, thought leaders you know, Michael Delzer and Praveen from verizon they're going to kind of help, or they're going to opine on all the dynamics that we're seeing. And so it's going to be a very kind of, you know structured wise, it's going to be very quantitative but then you're going to have this beautiful qualitative discussion to kind of help support a lot of the data points that we're capturing. And so, yeah, we're really excited about the panel you know, from, you know, why you should join standpoint. Look, it's just, it's great, competitive Intel. If you're a third party, you know, database, data warehousing vendor, this is the type of information that you're going to want to know, you know, adoption rates market sizing, retention rates, you know net price reservers, on demand dynamics. You know, we're going through a lot that tomorrow. So I'm really excited about that. I'm just in general, really excited about a lot of the research that we're kind of putting out. So >> That's interesting. I mean, and we were talking earlier about AWS glue elastic views. I'd love to see your view of all the database services from Amazon. Cause that's where it's really designed to do is leverage those across those. And you know, you listen to Andrew, Jesse talk they've got a completely different philosophy than say Oracle, which says, Hey we've got one database to do all things Amazon saying we need that fine granularity. So it's going to be again. And to the extent that you're providing market context they're very excited to see that data Sagar and see how that evolves over time. Really appreciate you coming back in the cube and look forward to working with you. >> Appreciate Dave. Thank you so much. >> All right. Welcome. Thank you everybody for watching. This is Dave Vellante for the cube. We'll see you next time. (upbeat music)