>> theCube presents Dell Technologies World, brought to you by Dell. >> Hi everyone, welcome back to Dell Technologies World 2022. You're watching theCube's coverage of this, three-day coverage wall to wall. My name is David Vellante John Furrier's here, Lisa Martin, David Nicholson. Talk of the town here is data. And one of the big announcements at the show is Snowflake and Dell partnering up, building ecosystems. Snowflake reaching into on-prem, allowing customers to actually access the Snowflake Data Cloud without moving the data or if they want to move the data they can. This is really one of the hotter announcements of the show. Martin Glynn is here, he's the Senior Director of Storage Product Management at Dell Technologies. And Clark Patterson, he's the Head of Product Marketing for Snowflake. Guys, welcome. >> Thanks for having us. >> So a lot of buzz around this and, you know, Clark, you and I have talked about the need to really extend your data vision. And this really is the first step ever you've taken on-prem. Explain the motivation for this from your customer's perspective. >> Yeah. I mean, if you step back and think about Snowflake's vision and our mission of mobilizing the world's data, it's all around trying to break down silos for however customers define what a silo is, right? So we've had a lot of success breaking down silos from a workload perspective where we've expanded the platform to be data warehousing, and data engineering, and machine learning, and data science, and all the kind of compute intensive ways that people work with us. We've also had a lot of success in our sharing capabilities and how we're breaking down silos of organizations, right? So I can share data more seamlessly within my team, I can do it across totally disparate organizations, and break down silos that way. So this partnership is really like the next leg of the stool, so to speak, where we're breaking down the silos of the the data and where the data lives ultimately, right? So up until this point, Cloud, all focus there, and now we have this opportunity with Dell to expand that and into on-premises world and people can bring all those data sets together. >> And the data target for this Martin, is Dell ECS, right? Your object store, and it's got S3 compatibility. Explain that. >> Yeah, we've actually got sort of two flavors. We'll start with ECS, which is our turnkey object storage solution. Object storage offers sort of the ultimate in flexibility, you know, potential performance, ease of use, right? Which is why it fits so well with Snowflake's mission for sort of unlocking, you know, the data within the data center. So we'll offer it to begin with ECS, and then we also recently announced our software defined object scale solution. So add even more flexibility there. >> Okay. And the clock, the way it works is I can now access non-native Snowflake data using what? Materialized views, external tables, how does that work? >> Some combination of all the above. So we've had in Snowflake a capability called external tables which we refer to, it goes hand in hand with this notion of external stages. Basically through the combination of those two capabilities, it's a metadata layer on data wherever it resides. So customers have actually used this in Snowflake for data lake data outside of Snowflake in the Cloud up until this point. So it's effectively an extension of that functionality into the Dell on-premises world, so that we can tap into those things. So we use the external stages to expose all the metadata about what's in the Dell environment. And then we build external tables in Snowflake so that data looks like it is in Snowflake. And then the experience for the analyst or whomever it is, is exactly as though that data lives in the Snowflake world. >> Okay. So for a while you've allowed non-native Snowflake data but it had to be in the Cloud. >> Correct. >> It was the first time it's on-prem, >> that's correct >> that's the innovation here. Okay. And if I want to bring it into the Cloud, can I? >> Yeah, the connection here will help in a migration sense as well, right? So that's the good thing is, it's really giving the user the choice. So we are integrating together as partners to make connection as seamless as possible. And then the end user will say like, look I've got data that needs to live on-premises, for whatever reasons, data sovereignty whatever they decide. And they can keep it there and still do the analytics in another place. But if there's a need and a desire to use this as an opportunity to migrate some of that data to Cloud, that connection between our two platforms will make that easier. >> Well, Michael always says, "Hey, it's customer choice, we're flexible." So you're cool with that? That's been the mission since we kind of came together, right? Is if our customers needed to stay in their data center, if that makes more sense from a cost perspective or, you know, a data gravity perspective, then they can do that. But we also want to help them unlock the value of that data. So if they need to copy it up to the public Cloud and take advantage of it, we're going to integrate directly with Snowflake to make that really easy to do. >> So there are engineering integrations here, obviously that's required. Can you describe what that looks like? Give us the details on when it's available. >> Sure. So it's going to be sort of second half this year that you'll see, we're demoing it this week, but the availability we second half this year. And fundamentally, it's the way Clark described it, that Snowflake will reach into our S3 interface using the standard S3 interface. We're qualifying between the way they expect that S3 interface to present the data and the way our platform works, just to ensure that there's smooth interaction between the two. So that's sort of the first simplest use case. And then the second example we gave where the customer can copy some of that data up to the public Cloud. We're basically copying between two S3 buckets and making sure that Snowflake's Snowpipe is aware that data's being made available and can easily ingest it. >> And then that just goes into a virtual warehouse- >> Exactly. >> and customer does to know or care. >> Yep Exactly. >> Yeah. >> The compute happens in Snowflake the way it does in any other manner. >> And I know you got to crawl, walk, run second half of this year, but I would imagine, okay, you're going to start with AWS, correct? And then eventually you go to other Clouds. I mean, that's going to take other technical integrations, I mean, obviously. So should we assume there's a roadmap here or is this a one and done? >> I would assume that, I mean, based on our multi-Cloud approach, that's kind of our approach at least, yeah. >> Kind of makes sense, right? I mean, that would seem to be a natural progression. My other thought was, okay, I've got operational systems. They might be transaction systems running on a on a PowerMax. >> Yeah. >> Is there a way to get the data into an object store and make that available, now that opens up even more workloads. I know you're not committing to doing that, but it just, conceptually, it seems like something a customer might want to do. >> Yeah. I, a hundred percent, agree. I mean, I think when we brought our team together we started with a blank slate. It was what's the best solution we can build. We landed on this sort of first step, but we got lots of feedback from a lot of our big joint customers about you know, this system over there, this potential integration over here, and whether it's, you know, PowerMax type systems or other file workloads with native Snowflake data types. You know, I think this is just the beginning, right? We have lots of potential here. >> And I don't think you've announced pricing, right? It's premature for that. But have you thought about, and how are you thinking about the pricing model? I mean, you're a consumption based pricing, is that kind of how this is going to work? Or is it a sort of a new pricing model or haven't you figured that out yet? >> I don't know if you've got any details on that, but from a Snowflake perspective, I would assume it's consistent with how our customers engage with us today. >> Yeah. >> And we'll offer both possibilities, right? So you can either continue with the standard, you know, sort of CapEx motion, maybe that's the most optimal for you from a cost perspective, or you can take advantage through our OpEx option, right? So you can do consumption on-prem also. >> Okay. So it could be a dual model, right? Depending on what the customer wants. If they're a Snowflake customer, obviously it's going to be consumption based, however, you guys price. What's happening, Clark, in in the market? Explain why Snowflake has so much momentum and, you know, traction in the marketplace. >> So like I spent a lot of time doing analysis on why we win and lose, core part of my role. And, you know, there's a couple of, there's really three things that come up consistently as to why people people are really excited about Snowflake platform. One is the most simplest thing of all. It feels like is just ease of use and it just works, right? And I think the way that this platform was built for the Cloud from the ground up all the way back 10 years ago, really a lot allows us to deliver that seamless experience of just like instant compute when you want it, it goes away, you know, only pay for what you use. Very few knobs to turn and things like that. And so people absolutely love that factor. The other is multi-Cloud. So, you know, there's definitely a lot of organizations out there that have a multi-Cloud strategy, and, you know, what that means to them can be highly variable, but regardless, they want to be able to interact across Clouds in some capacity. And of course we are a single platform, like literally one single interface, consistent across all the three Cloud providers that we work upon. And it gives them that flexibility to mix and match Cloud infrastructure under any Snowflake however they see fit. The last piece of it is sharing. And, you know, I think it's that ability as I kind of alluded to around like breaking down organizational silos, and allow people to be able to actually connect with each other in ways that you couldn't do before. Like, if you think about how you and I would've shared data before, I'd be like, "Hey, Dave, I'm going to unload this table into a spreadsheet and I'm going to send it over in email." And there's the whole host of issues that get introduced in that and world, now it's like instantly available. I have a lot of control over it, it's governed it's all these other things. And I can create kind of walled gardens, so to speak, of how far out I want that to go. It could be in a controlled environment of organizations that I want to collaborate with, or I can put it on our marketplace and expose it to the whole world, because I think there's a value in that. And if I choose I can monetize it, right? So those, you know, the ease of use aspect of it, absolutely, it's just a fantastic platform. The multi-Cloud aspect of it and our unique differentiation around sharing in our marketplace and monetization. >> Yeah, on the sharing front. I mean, it's now discoverable. Like if you send me an email, like what'd you call that? When did you send that email? And then the same time I can forward that to somebody else's not governed. >> Yeah. >> All right. So that just be creates a nightmare for the compliance. >> Right. Yeah. You think about how you revoke access in that situation. You just don't, right? Now I can just turn it off and you go in to run your query. >> Don't get access on that data anymore. Yeah. Okay. And then the other thing I wanted to ask you, Clark is Snowflake started really as analytics platform, simplifying data warehousing, you're moving into that world of data science, you know, the whole data lake movement, bringing those two worlds together. You know, I was talking to Ben Ward about this, maybe there's a semantic layer that helps us kind of talk between those two worlds, but you don't care, right? If it's in an object store, it can play in both of those worlds, right? >> That's right. >> Yeah, it's up to you to figure it out and the customer- >> Yeah. >> from a storage standpoint. Here it is, serve it up. >> And that's the thrust of this announcement, right? Is bringing together two great companies, the Dell platform, the Snowflake platform, and allowing organizations to bring that together. And they decide like it, as we all know, customers decide how they're going to build their architecture. And so this is just another way that we're helping them leverage the capabilities of our two great platforms. >> Does this push or pull or little bit of both? I mean, where'd this come from? Or customers saying, "Hey, it would be kind of cool if we could have this." Or is it more, "Hey, what do you guys think?" You know, where are you at with that? >> It was definitely both, right? I mean, so we certainly started with, you know, a high level idea that, you know, the technologies are complimentary, right? I mean, as Clark just described, and at the same time we had customers coming to us saying, "Hey, wait a minute, I'm doing this over here, and this over here, how can I make this easier?" So that was like I said, we started with a blank sheet and lots of long customer conversations and this is what resulted. So >> So what are the sequence of events to kind of roll this out? You said it's second half, you know, when do you start getting customers involved? Do you have your already, you know, to poke at this and what's that look like? >> Yeah, sure. I can weigh in there. So, absolutely. We've had a few of our big customers that have been involved sort of in the design already who understand how they want to use it. So I think our expectation is that now that the sort of demonstrations have been in place, we have some pre functionality, we're going to see some initial testing and usage, some beta type situations with our customers. And then second half, we'll ramp from there. >> It's got to be a huge overlap between Dell customers and Snowflake customers. I mean, it's hundred billion. You can't not bump into Dell somewhere. >> Exactly. Yeah, you know. >> So where do you guys want to see this relationship go, kind of how should we measure success? Maybe you could each give your perspectives of that. >> I mean, for us, I think it's really showing the value of the Snowflake platform in this new world where there's a whole new ecosystem of data that is accessible to us, right? So seeing those organizations that are saying like, "Look, I'm doing new things with on-premises data that I didn't think that I could do before", or, "I'm driving efficiency in how I do analytics, and data engineering, and data science, in ways that I couldn't do before," 'cause they were locked out of using a Snowflake-like technology, right? So I think for me, that's going to be that real excitement. I'm really curious to see how the collaboration and the sharing component comes into this, you know, where you can think of having an on-premises data strategy and a need, right? But you can really connect to Cloud native customers and partners and suppliers that live in the Snowflake ecosystem, and that wasn't possible before. And so that is very conceivable and very possible through this relationship. So seeing how those edges get created in in our world and how people start to collaborate across data, both in the Cloud and on-prem is going to be really exciting. >> I remember I asked Frank, it was kind of early in the pandemic. I asked him, come on, tell me about how you're managing things. And he was awesome. And I asked him to at the time, you know, "You're ever going to do, you know, bring this platform on-prem?" He's like unequivocal, "No way, that's never going to happen. We're not going to do it halfway house ware Cloud only." And I kept thinking, but there's got to be a way to expand that team. There's so much data out there, and so boom, now we see the answer . Martin, from your standpoint, what does success look like? >> I think it starts with our partnership, right? So I've been doing this a long time. Probably the first time I've worked so closely with a partner like Snowflake. Joint customer conversations, joint solutioning, making sure what we're building is going to be really, truly as useful as possible to them. And I think we're going to let them guide us as we go forward here, right? You mentioned, you know, systems or record or other potential platforms. We're going to let them tell us where exactly the most value will come from the integration between the two companies. >> Yeah. Follow data. I mean, remember in the old days a hardware company like Dell would go to an ISP like Snowflake and say, "Hey, we ran some benchmarks. Your software runs really fast on our hardware, can we work together?" And you go, "Yeah, of course. Yeah, no problem." But wow! What a different dynamic it is today. >> Yeah. Yeah, absolutely. >> All right guys. Hey, thanks so much for coming to theCube. It's great to see you. We'll see you at the Snowflake Summit in June. >> Snowflake Summit in a month and a half. >> Looking forward to that. All right. Thank you again. >> Thank you Dave. >> All right. Keep it right there everybody. This is Dave Vellante, wall to wall coverage of Dell Tech World 2022. We'll be right back. (gentle music)

>> theCube presents Dell Technologies World, brought to you by Dell. >> Hi everyone, welcome back to Dell Technologies World 2022. You're watching theCube's coverage of this, three-day coverage wall to wall. My name is David Vellante John Furrier's here, Lisa Martin, David Nicholson. Talk of the town here is data. And one of the big announcements at the show is Snowflake and Dell partnering up, building ecosystems. Snowflake reaching into on-prem, allowing customers to actually access the Snowflake Data Cloud without moving the data or if they want to move the data they can. This is really one of the hotter announcements of the show. Martin Glynn is here, he's the Senior Director of Storage Product Management at Dell Technologies. And Clark Patterson, he's the Head of Product Marketing for Snowflake. Guys, welcome. >> Thanks for having us. >> So a lot of buzz around this and, you know, Clark, you and I have talked about the need to really extend your data vision. And this really is the first step ever you've taken on-prem. Explain the motivation for this from your customer's perspective. >> Yeah. I mean, if you step back and think about Snowflake's vision and our mission of mobilizing the world's data, it's all around trying to break down silos for however customers define what a silo is, right? So we've had a lot of success breaking down silos from a workload perspective where we've expanded the platform to be data warehousing, and data engineering, and machine learning, and data science, and all the kind of compute intensive ways that people work with us. We've also had a lot of success in our sharing capabilities and how we're breaking down silos of organizations, right? So I can share data more seamlessly within my team, I can do it across totally disparate organizations, and break down silos that way. So this partnership is really like the next leg of the stool, so to speak, where we're breaking down the silos of the the data and where the data lives ultimately, right? So up until this point, Cloud, all focus there, and now we have this opportunity with Dell to expand that and into on-premises world and people can bring all those data sets together. >> And the data target for this Martin, is Dell ECS, right? Your object store, and it's got S3 compatibility. Explain that. >> Yeah, we've actually got sort of two flavors. We'll start with ECS, which is our turnkey object storage solution. Object storage offers sort of the ultimate in flexibility, you know, potential performance, ease of use, right? Which is why it fits so well with Snowflake's mission for sort of unlocking, you know, the data within the data center. So we'll offer it to begin with ECS, and then we also recently announced our software defined object scale solution. So add even more flexibility there. >> Okay. And the clock, the way it works is I can now access non-native Snowflake data using what? Materialized views, external tables, how does that work? >> Some combination of all the above. So we've had in Snowflake a capability called external tables which we refer to, it goes hand in hand with this notion of external stages. Basically through the combination of those two capabilities, it's a metadata layer on data wherever it resides. So customers have actually used this in Snowflake for data lake data outside of Snowflake in the Cloud up until this point. So it's effectively an extension of that functionality into the Dell on-premises world, so that we can tap into those things. So we use the external stages to expose all the metadata about what's in the Dell environment. And then we build external tables in Snowflake so that data looks like it is in Snowflake. And then the experience for the analyst or whomever it is, is exactly as though that data lives in the Snowflake world. >> Okay. So for a while you've allowed non-native Snowflake data but it had to be in the Cloud. >> Correct. >> It was the first time it's on-prem, >> that's correct >> that's the innovation here. Okay. And if I want to bring it into the Cloud, can I? >> Yeah, the connection here will help in a migration sense as well, right? So that's the good thing is, it's really giving the user the choice. So we are integrating together as partners to make connection as seamless as possible. And then the end user will say like, look I've got data that needs to live on-premises, for whatever reasons, data sovereignty whatever they decide. And they can keep it there and still do the analytics in another place. But if there's a need and a desire to use this as an opportunity to migrate some of that data to Cloud, that connection between our two platforms will make that easier. >> Well, Michael always says, "Hey, it's customer choice, we're flexible." So you're cool with that? That's been the mission since we kind of came together, right? Is if our customers needed to stay in their data center, if that makes more sense from a cost perspective or, you know, a data gravity perspective, then they can do that. But we also want to help them unlock the value of that data. So if they need to copy it up to the public Cloud and take advantage of it, we're going to integrate directly with Snowflake to make that really easy to do. >> So there are engineering integrations here, obviously that's required. Can you describe what that looks like? Give us the details on when it's available. >> Sure. So it's going to be sort of second half this year that you'll see, we're demoing it this week, but the availability we second half this year. And fundamentally, it's the way Clark described it, that Snowflake will reach into our S3 interface using the standard S3 interface. We're qualifying between the way they expect that S3 interface to present the data and the way our platform works, just to ensure that there's smooth interaction between the two. So that's sort of the first simplest use case. And then the second example we gave where the customer can copy some of that data up to the public Cloud. We're basically copying between two S3 buckets and making sure that Snowflake's Snowpipe is aware that data's being made available and can easily ingest it. >> And then that just goes into a virtual warehouse- >> Exactly. >> and customer does to know or care. >> Yep Exactly. >> Yeah. >> The compute happens in Snowflake the way it does in any other manner. >> And I know you got to crawl, walk, run second half of this year, but I would imagine, okay, you're going to start with AWS, correct? And then eventually you go to other Clouds. I mean, that's going to take other technical integrations, I mean, obviously. So should we assume there's a roadmap here or is this a one and done? >> I would assume that, I mean, based on our multi-Cloud approach, that's kind of our approach at least, yeah. >> Kind of makes sense, right? I mean, that would seem to be a natural progression. My other thought was, okay, I've got operational systems. They might be transaction systems running on a on a PowerMax. >> Yeah. >> Is there a way to get the data into an object store and make that available, now that opens up even more workloads. I know you're not committing to doing that, but it just, conceptually, it seems like something a customer might want to do. >> Yeah. I, a hundred percent, agree. I mean, I think when we brought our team together we started with a blank slate. It was what's the best solution we can build. We landed on this sort of first step, but we got lots of feedback from a lot of our big joint customers about you know, this system over there, this potential integration over here, and whether it's, you know, PowerMax type systems or other file workloads with native Snowflake data types. You know, I think this is just the beginning, right? We have lots of potential here. >> And I don't think you've announced pricing, right? It's premature for that. But have you thought about, and how are you thinking about the pricing model? I mean, you're a consumption based pricing, is that kind of how this is going to work? Or is it a sort of a new pricing model or haven't you figured that out yet? >> I don't know if you've got any details on that, but from a Snowflake perspective, I would assume it's consistent with how our customers engage with us today. >> Yeah. >> And we'll offer both possibilities, right? So you can either continue with the standard, you know, sort of CapEx motion, maybe that's the most optimal for you from a cost perspective, or you can take advantage through our OpEx option, right? So you can do consumption on-prem also. >> Okay. So it could be a dual model, right? Depending on what the customer wants. If they're a Snowflake customer, obviously it's going to be consumption based, however, you guys price. What's happening, Clark, in in the market? Explain why Snowflake has so much momentum and, you know, traction in the marketplace. >> So like I spent a lot of time doing analysis on why we win and lose, core part of my role. And, you know, there's a couple of, there's really three things that come up consistently as to why people people are really excited about Snowflake platform. One is the most simplest thing of all. It feels like is just ease of use and it just works, right? And I think the way that this platform was built for the Cloud from the ground up all the way back 10 years ago, really a lot allows us to deliver that seamless experience of just like instant compute when you want it, it goes away, you know, only pay for what you use. Very few knobs to turn and things like that. And so people absolutely love that factor. The other is multi-Cloud. So, you know, there's definitely a lot of organizations out there that have a multi-Cloud strategy, and, you know, what that means to them can be highly variable, but regardless, they want to be able to interact across Clouds in some capacity. And of course we are a single platform, like literally one single interface, consistent across all the three Cloud providers that we work upon. And it gives them that flexibility to mix and match Cloud infrastructure under any Snowflake however they see fit. The last piece of it is sharing. And, you know, I think it's that ability as I kind of alluded to around like breaking down organizational silos, and allow people to be able to actually connect with each other in ways that you couldn't do before. Like, if you think about how you and I would've shared data before, I'd be like, "Hey, Dave, I'm going to unload this table into a spreadsheet and I'm going to send it over in email." And there's the whole host of issues that get introduced in that and world, now it's like instantly available. I have a lot of control over it, it's governed it's all these other things. And I can create kind of walled gardens, so to speak, of how far out I want that to go. It could be in a controlled environment of organizations that I want to collaborate with, or I can put it on our marketplace and expose it to the whole world, because I think there's a value in that. And if I choose I can monetize it, right? So those, you know, the ease of use aspect of it, absolutely, it's just a fantastic platform. The multi-Cloud aspect of it and our unique differentiation around sharing in our marketplace and monetization. >> Yeah, on the sharing front. I mean, it's now discoverable. Like if you send me an email, like what'd you call that? When did you send that email? And then the same time I can forward that to somebody else's not governed. >> Yeah. >> All right. So that just be creates a nightmare for the compliance. >> Right. Yeah. You think about how you revoke access in that situation. You just don't, right? Now I can just turn it off and you go in to run your query. >> Don't get access on that data anymore. Yeah. Okay. And then the other thing I wanted to ask you, Clark is Snowflake started really as analytics platform, simplifying data warehousing, you're moving into that world of data science, you know, the whole data lake movement, bringing those two worlds together. You know, I was talking to Ben Ward about this, maybe there's a semantic layer that helps us kind of talk between those two worlds, but you don't care, right? If it's in an object store, it can play in both of those worlds, right? >> That's right. >> Yeah, it's up to you to figure it out and the customer- >> Yeah. >> from a storage standpoint. Here it is, serve it up. >> And that's the thrust of this announcement, right? Is bringing together two great companies, the Dell platform, the Snowflake platform, and allowing organizations to bring that together. And they decide like it, as we all know, customers decide how they're going to build their architecture. And so this is just another way that we're helping them leverage the capabilities of our two great platforms. >> Does this push or pull or little bit of both? I mean, where'd this come from? Or customers saying, "Hey, it would be kind of cool if we could have this." Or is it more, "Hey, what do you guys think?" You know, where are you at with that? >> It was definitely both, right? I mean, so we certainly started with, you know, a high level idea that, you know, the technologies are complimentary, right? I mean, as Clark just described, and at the same time we had customers coming to us saying, "Hey, wait a minute, I'm doing this over here, and this over here, how can I make this easier?" So that was like I said, we started with a blank sheet and lots of long customer conversations and this is what resulted. So >> So what are the sequence of events to kind of roll this out? You said it's second half, you know, when do you start getting customers involved? Do you have your already, you know, to poke at this and what's that look like? >> Yeah, sure. I can weigh in there. So, absolutely. We've had a few of our big customers that have been involved sort of in the design already who understand how they want to use it. So I think our expectation is that now that the sort of demonstrations have been in place, we have some pre functionality, we're going to see some initial testing and usage, some beta type situations with our customers. And then second half, we'll ramp from there. >> It's got to be a huge overlap between Dell customers and Snowflake customers. I mean, it's hundred billion. You can't not bump into Dell somewhere. >> Exactly. Yeah, you know. >> So where do you guys want to see this relationship go, kind of how should we measure success? Maybe you could each give your perspectives of that. >> I mean, for us, I think it's really showing the value of the Snowflake platform in this new world where there's a whole new ecosystem of data that is accessible to us, right? So seeing those organizations that are saying like, "Look, I'm doing new things with on-premises data that I didn't think that I could do before", or, "I'm driving efficiency in how I do analytics, and data engineering, and data science, in ways that I couldn't do before," 'cause they were locked out of using a Snowflake-like technology, right? So I think for me, that's going to be that real excitement. I'm really curious to see how the collaboration and the sharing component comes into this, you know, where you can think of having an on-premises data strategy and a need, right? But you can really connect to Cloud native customers and partners and suppliers that live in the Snowflake ecosystem, and that wasn't possible before. And so that is very conceivable and very possible through this relationship. So seeing how those edges get created in in our world and how people start to collaborate across data, both in the Cloud and on-prem is going to be really exciting. >> I remember I asked Frank, it was kind of early in the pandemic. I asked him, come on, tell me about how you're managing things. And he was awesome. And I asked him to at the time, you know, "You're ever going to do, you know, bring this platform on-prem?" He's like unequivocal, "No way, that's never going to happen. We're not going to do it halfway house ware Cloud only." And I kept thinking, but there's got to be a way to expand that team. There's so much data out there, and so boom, now we see the answer . Martin, from your standpoint, what does success look like? >> I think it starts with our partnership, right? So I've been doing this a long time. Probably the first time I've worked so closely with a partner like Snowflake. Joint customer conversations, joint solutioning, making sure what we're building is going to be really, truly as useful as possible to them. And I think we're going to let them guide us as we go forward here, right? You mentioned, you know, systems or record or other potential platforms. We're going to let them tell us where exactly the most value will come from the integration between the two companies. >> Yeah. Follow data. I mean, remember in the old days a hardware company like Dell would go to an ISP like Snowflake and say, "Hey, we ran some benchmarks. Your software runs really fast on our hardware, can we work together?" And you go, "Yeah, of course. Yeah, no problem." But wow! What a different dynamic it is today. >> Yeah. Yeah, absolutely. >> All right guys. Hey, thanks so much for coming to theCube. It's great to see you. We'll see you at the Snowflake Summit in June. >> Snowflake Summit in a month and a half. >> Looking forward to that. All right. Thank you again. >> Thank you Dave. >> All right. Keep it right there everybody. This is Dave Vellante, wall to wall coverage of Dell Tech World 2022. We'll be right back. (gentle music)

>> Announcer: Live from San Francisco, it's theCUBE. covering Spark Summit 2017, brought to you by Databricks. (techno music) >> Welcome to theCUBE, at Spark Summit here at San Francisco, at the Moscone Center West, and we're going to be competing with all the excitement happening behind us. They're going to be going off with raffles, and I don't know what all. But we'll just have to talk above them, right? >> Clarke: Well at least we didn't get to win. >> Our next guest here on the show is Clarke Patterson from Confluent. You're the Senior Director of Product Marketing, is that correct? >> Yeah, you got it. >> All right, well it's exciting -- >> Clarke: Pleasure to be here >> To have you on the show. >> Clarke: It's my first time here. >> David: First time on theCUBE? >> I feel like one of those radio people, first time caller, here I am. Yup, first time on theCUBE. >> Well, long time listener too, I hope. >> Clarke: Yes, I am. >> And so, have you announced anything new that you want to talk about from Confluent? >> Yeah, I mean not particularly at this show per se, but most recently, we've done a lot of stuff to enable customers to adopt Confluent in the Cloud. So we came up with a Confluent Cloud offering, which is a managed service of our Confluent platform a couple weeks ago, at our event around Kafka. So we're really excited about that. It really fits that need where Cloud First or operation-starved organizations are really wanting to do things with storing platforms based on Kafka, but they just don't have the means to make it happen. And so, we're now standing this up as a managed service center that allows them to get their hands on this great set of capabilities with us as the back stop to do things with it. >> And you said, Kafka is not just a publish and subscribe engine, right? >> Yeah, I'm glad that you asked that. So, that one of the big misconceptions, I think, of Kafka. You know, it's made its way into a lot of organizations from the early use case of publish and subscribe for data. But, over the last 12 to 18 months, in particular, there's been a lot of interesting advancements. Two things in particular: One is the ability to connect, which is called a Connect API in Kafka. And it essentially simplifies how you integrate large amounts of producers and consumers of data as information flows through. So, a modernization of ETL, if you will. The second thing is stream processing. So there's a Kafka streams API that's built-in now as well that allows you to do the lightweight transformations of data as it flows from point A to point B, and you could publish out new topics if you need to manipulate things. And it expands the overall capabilities of what Kafka can do. >> Okay, and I'm going to ask George here to dive in, if you could. >> And I was just going to ask you. >> David: I can feel it. (laughing) >> So, this is interesting. But if we want to frame this in terms of what people understand from, I don't want to say prehistoric eras, but earlier approaches to similar problems. So, let's say, in days gone by, you had an ETL solution. >> Clarke: Yup. >> So now, let's put Connect together with stream processing, and how does that change the whole architecture of integrating your systems? >> Yeah, I mean I think the easiest way to think about this is if you think about some of the different market segments that have existed over the last 10 to 20 years. So data integration was all about how do I get a lot of different systems to integrate a bunch of data and transform it in some manner, and ship it off to some other place in my business. And it was really good at building these end-to-end workflows, moving big quantities of data. But it was generally kind of batch-oriented. And so we've been fixated on, how do we make this process faster? To some degree, and the other segment is application integration which said, hey, you know when I want applications to talk to one another, it doesn't have the scale of information exchange, but it needs to happen a whole lot faster. So these real-time integration systems, ESBs, and things like that came along and it was able to serve that particular need. But as we move forward into this world that we're in now, where there's just all sorts of information, companies want to become advanced-centric. You need to be able to get the best of both of those worlds. And this is really where Kafka is starting to sit. It's saying, hey let's take massive amounts of data producers that need to connect to massive amounts of data consumers, be able to ship a super-granular level of information, transform it as you need, and do that in real-time so that everything can get served out very, very fast. >> But now that you, I mean that's a wonderful and kind of pithy kind of way to distill it. But now that we have this new way of thinking of app integration, data integration, best of both worlds, that has sort of second order consequences in terms of how we build applications and connect them. So what does that look like? What do applications look like in the old world and now what enables them to be sort of re-factored? Or for new apps, how do you build them differently? >> Yeah, I mean we see a lot of people that are going into microservices oriented architecture. So moving away from one big monolithic app that takes this inordinate amount of effort to change in some capacity. And quite frankly, it happens very, very slow. And so they look to microservices to be able to split those up into very small, functional components that they can integrate a whole lot faster, decouple engineering teams so we're not dependent on one another, and just make things happen a whole lot quicker than we could before. But obviously when you do that, you need something that can connect all those pieces, and Kafka's a great thing to sit in there as a way to exchange state across all these things. So that's a massive use case for us and for Kafka specifically in terms of what we're seeing people do. >> You've said something in there at the end that I want to key off, which is, "To exchange state." So in the old world, we used a massive shared database to share state for a monolithic app or sometimes between monolithic apps. So what sort of state-of-the-art way that that's done now with microservices, if there's more than one, how does that work? >> Yeah, I mean so this is kind of rooted in the way we do stream processing. So there's this concept of topics, which effectively could align to individual microservices. And you're able to make sure that the most recent state of any particular one is stored in the central repository of Kafka. But then given that we take an API approach to stream processing, it's easy to embed those types of capabilities in any of the end-points. And so some of the activity can happen on that particular front, then it all gets synchronized down into the centralized hub. >> Okay, let me unpack that a little bit. Because you take an API approach, that means that if you're manipulating a topic, you're processing a microservice and that has state in it? Is that the right way to think about it? >> I think that's the easiest way to think about it, yeah. >> Okay. So where are we? Is this a 10 year migration, or is it a, some certain class of apps will lend themselves well to microservices, legacy apps will stay monolithic, and some new apps, some new Greenfield apps, will still be database-centric? How do you, or how should customers think about that mix? >> Yeah that's a great question. I don't know that I have the answer to it. The best gauge I can have is just the amount of interest and conversations that we have on this particular topic. I will say that from one of the topics that we do engage with, it's easily one of the most popular that people are interested in. So if that's a data point, it's definitely a lot of interested people trying to figure out how to do this stuff very, very fast. >> How to do the microservices? >> Yeah and I think if you look at some of the more notable tech companies of late, they're architected this way from the start. And so everyone's kind of looking at the Netflix of the world, and the Ubers of the world saying, I want to be like those guys, how do I do that? And it's driving them down this path. So competitive pressure, I think, will help force people's hands. The more that your competitors are getting in front of you and are able to deliver a better customer experience through some sort of mobile app or something like that, then it's going to force people to have to make these changes quicker. But how long that takes it'll be interesting to see. >> Great! Great stuff. Switch gears just a little bit. Talk about maybe why you're using Databricks and what some of the key value you've gotten out of that. >> Yeah, so I wouldn't say that we're using Databricks per se, but we integrate directly with Spark. So if you look at a lot of the use cases that people use Spark for, they need to obviously get data to where it is. And some of the principles that I said before about Kafka generally, it's a very flexible, very dynamic mechanism for taking lots of sources of information, culling all that down into one centralized place and then distributing it to places such as Spark. So we see a lot of people using the technologies together to get the data from point A to point B, do some transformation as they so need, and then obviously do some amazing computing horsepower and whatnot in Spark itself. >> David: All right. >> I'm processing this, and it's tough because you can go in so many different directions, especially like the question about Spark. I guess, give us some of the scenarios where Spark would fit. Would it be like doing microservices that require more advanced analytics, and then they feed other topics, or feed consumers? And then where might you stick with a shared database that a couple services might communicate with, rather than maintaining the state within the microservice? >> I think, let me see if I can kind of unpack that myself a little bit. >> George: I know it was packed pretty hard. (laughing) >> Got a lot packed in there. When folks want to do things like, I guess when you think about it like an overall business process. If you think about something like an order to cash business process these days, it has a whole bunch of different systems that hang off it. It's got your order processing. You've got an inventory management. Maybe you've got some real-time pricing. You've got some shipments. Things, like that all just kind of hang off of the flow of data across there. Now with any given system that you use for addressing any answers to each of those problems could be vastly different. It could be Spark. It could be a relational database. It could be a whole bunch of different things. Where the centralization of data comes in for us is to be able to just kind of make sure that all those components can be communicating with each other based on the last thing that happened within each of them individually. And so their ability to embed transformation, data transformations and data processing in themselves and then publish back out any change that they had into the shared cluster subsequently makes that state available to everybody else. So that if necessary, they can react to it. So in a lot of ways, we're kind of agnostic to the type of processing that happens on the end-points. It's more just the free movement of all the data to all those things. And then if they have any relevant updates that need to make it back to any of the other components hanging on that process flow, they should have the ability to publish that back down it. >> And so one thing that Jay Kreps, Founder and CEO, talks about is that Kafka may ultimately, or in his language, will ultimately grow into something that rivals the relational database. Tell us what that world would look like. >> It would be controversial (laughing). >> George: That's okay. >> You want me to be the bad guy? So it's interesting because we did Kafka Summit about a month ago, and there's a lot of people, a lot of companies I should say, that are actually using and calling Kafka an enterprise data hub, a central hub for data, a data distribution network. And they are literally storing all sorts (raffle announcements beginning on loudspeaker) of different links of data. So one interesting example was the New York Times. So they used Kafka and literally stored every piece of content that has ever been generated at that publisher since the beginning of time in Kafka. So all the way back to 1851, they've obviously digitized everything. And it sits in there, and then they disposition that back out to various forms of the business. So that's -- >> They replay it, they pull it. They replay and pull, wow, okay. >> So that has some very interesting implications. So you can replay data. If you run some analytics on something and you didn't get the result that you wanted, and you wanted to redo it, it makes it really easy and really fast to be able to do that. If you want to bring on a new system that has some new functionality, you can do that really quickly because you have the full pedigree of everything that sits in there. And then imagine this world where you could actually start to ask questions on it directly. That's where it starts to get very, very profound, and it will be interesting to see where that goes. >> Two things then: First, it sounds, like a database takes updates, so you don't have a perfect historical record. You have a snapshot of current values. Like whereas in a log, like Kafka, or log-structured data structure you have every event that ever happened. >> Clarke: Correct. >> Now, what's the impact on performance if you want to pull, you know -- >> Clarke: That much data? >> Yeah. >> Yeah, I mean so it all comes down to managing the environment on which you run it. So obviously the more data you're going to store in here, and the more type of things you're going to try to connect to it, you're going to have to take that into account. >> And you mentioned just a moment ago about directly asking about the data contained in the hub, in the data hub. >> Clarke: Correct. >> How would that work? >> Not quite sure today, to be honest with you. And I think this is where that question, I think, is a pretty provocative one. Like what does it mean to have this entire view of all granular event streams, not in some aggregated form over time? I think the key will be some mechanism to come onto an environment like this to make it more consumable for more business types users. And that's probably one of the areas we'll want to watch to see how that's (background noise drowns out speaker). >> Okay, only one unanswered question. But you answered all the other ones really well. So we're going to wrap it up here. We're up against a loud break right now. I want to think Clarke Patterson from Confluent for joining us. Thank you so much for being on the show. >> Clarke: Thank you for having me. >> Appreciate it so much. And thank you for watching theCUBE. We'll be back after the raffle in just a few minutes. We have one more guest. Stay with us, thank you. (techno music)