>> From theCUBE studios in Palo Alto, in Boston, bringing you data driven insights from theCUBE and ETR. This is Breaking Analysis with Dave Vollante. >> The rise of Kubernetes came about through a combination of forces that were, in hindsight, quite a long shot. Amazon's dominance created momentum for Cloud native application development, and the need for newer and simpler experiences, beyond just easily spinning up computer as a service. This wave crashed into innovations from a startup named Docker, and a reluctant competitor in Google, that needed a way to change the game on Amazon and the Cloud. Now, add in the effort of Red Hat, which needed a new path beyond Enterprise Linux, and oh, by the way, it was just about to commit to a path of a Kubernetes alternative for OpenShift and figure out a governance structure to hurt all the cats and the ecosystem and you get the remarkable ascendancy of Kubernetes. Hello and welcome to this week's Wikibon CUBE Insights powered by ETR. In this breaking analysis, we tapped the back stories of a new documentary that explains the improbable events that led to the creation of Kubernetes. We'll share some new survey data from ETR and commentary from the many early the innovators who came on theCUBE during the exciting period since the founding of Docker in 2013, which marked a new era in computing, because we're talking about Kubernetes and developers today, the hoodie is on. And there's a new two part documentary that I just referenced, it's out and it was produced by Honeypot on Kubernetes, part one and part two, tells a story of how Kubernetes came to prominence and many of the players that made it happen. Now, a lot of these players, including Tim Hawkin Kelsey Hightower, Craig McLuckie, Joe Beda, Brian Grant Solomon Hykes, Jerry Chen and others came on theCUBE during formative years of containers going mainstream and the rise of Kubernetes. John Furrier and Stu Miniman were at the many shows we covered back then and they unpacked what was happening at the time. We'll share the commentary from the guests that they interviewed and try to add some context. Now let's start with the concept of developer defined structure, DDI. Jerry Chen was at VMware and he could see the trends that were evolving. He left VMware to become a venture capitalist at Greylock. Docker was his first investment. And he saw the future this way. >> What happens is when you define infrastructure software you can program it. You make it portable. And that the beauty of this cloud wave what I call DDI's. Now, to your point is every piece of infrastructure from storage, networking, to compute has an API, right? And, and AWS there was an early trend where S3, EBS, EC2 had API. >> As building blocks too. >> As building blocks, exactly. >> Not monolithic. >> Monolithic building blocks every little building bone block has it own API and just like Docker really is the API for this unit of the cloud enables developers to define how they want to build their applications, how to network them know as Wills talked about, and how you want to secure them and how you want to store them. And so the beauty of this generation is now developers are determining how apps are built, not just at the, you know, end user, you know, iPhone app layer the data layer, the storage layer, the networking layer. So every single level is being disrupted by this concept of a DDI and where, how you build use and actually purchase IT has changed. And you're seeing the incumbent vendors like Oracle, VMware Microsoft try to react but you're seeing a whole new generation startup. >> Now what Jerry was explaining is that this new abstraction layer that was being built here's some ETR data that quantifies that and shows where we are today. The chart shows net score or spending momentum on the vertical axis and market share which represents the pervasiveness in the survey set. So as Jerry and the innovators who created Docker saw the cloud was becoming prominent and you can see it still has spending velocity that's elevated above that 40% red line which is kind of a magic mark of momentum. And of course, it's very prominent on the X axis as well. And you see the low level infrastructure virtualization and that even floats above servers and storage and networking right. Back in 2013 the conversation with VMware. And by the way, I remember having this conversation deeply at the time with Chad Sakac was we're going to make this low level infrastructure invisible, and we intend to make virtualization invisible, IE simplified. And so, you see above the two arrows there related to containers, container orchestration and container platforms, which are abstraction layers and services above the underlying VMs and hardware. And you can see the momentum that they have right there with the cloud and AI and RPA. So you had these forces that Jerry described that were taking shape, and this picture kind of summarizes how they came together to form Kubernetes. And the upper left, Of course you see AWS and we inserted a picture from a post we did, right after the first reinvent in 2012, it was obvious to us at the time that the cloud gorilla was AWS and had all this momentum. Now, Solomon Hykes, the founder of Docker, you see there in the upper right. He saw the need to simplify the packaging of applications for cloud developers. Here's how he described it. Back in 2014 in theCUBE with John Furrier >> Container is a unit of deployment, right? It's the format in which you package your application all the files, all the executables libraries all the dependencies in one thing that you can move to any server and deploy in a repeatable way. So it's similar to how you would run an iOS app on an iPhone, for example. >> A Docker at the time was a 30% company and it just changed its name from .cloud. And back to the diagram you have Google with a red question mark. So why would you need more than what Docker had created. Craig McLuckie, who was a product manager at Google back then explains the need for yet another abstraction. >> We created the strong separation between infrastructure operations and application operations. And so, Docker has created a portable framework to take it, basically a binary and run it anywhere which is an amazing capability, but that's not enough. You also need to be able to manage that with a framework that can run anywhere. And so, the union of Docker and Kubernetes provides this framework where you're completely abstracted from the underlying infrastructure. You could use VMware, you could use Red Hat open stack deployment. You could run on another major cloud provider like rec. >> Now Google had this huge cloud infrastructure but no commercial cloud business compete with AWS. At least not one that was taken seriously at the time. So it needed a way to change the game. And it had this thing called Google Borg, which is a container management system and scheduler and Google looked at what was happening with virtualization and said, you know, we obviously could do better Joe Beda, who was with Google at the time explains their mindset going back to the beginning. >> Craig and I started up Google compute engine VM as a service. And the odd thing to recognize is that, nobody who had been in Google for a long time thought that there was anything to this VM stuff, right? Cause Google had been on containers for so long. That was their mindset board was the way that stuff was actually deployed. So, you know, my boss at the time, who's now at Cloudera booted up a VM for the first time, and anybody in the outside world be like, Hey, that's really cool. And his response was like, well now what? Right. You're sitting at a prompt. Like that's not super interesting. How do I run my app? Right. Which is, that's what everybody's been struggling with, with cloud is not how do I get a VM up? How do I actually run my code? >> Okay. So Google never really did virtualization. They were looking at the market and said, okay what can we do to make Google relevant in cloud. Here's Eric Brewer from Google. Talking on theCUBE about Google's thought process at the time. >> One interest things about Google is it essentially makes no use of virtual machines internally. And that's because Google started in 1998 which is the same year that VMware started was kind of brought the modern virtual machine to bear. And so Google infrastructure tends to be built really on kind of classic Unix processes and communication. And so scaling that up, you get a system that works a lot with just processes and containers. So kind of when I saw containers come along with Docker, we said, well, that's a good model for us. And we can take what we know internally which was called Borg a big scheduler. And we can turn that into Kubernetes and we'll open source it. And suddenly we have kind of a cloud version of Google that works the way we would like it to work. >> Now, Eric Brewer gave us the bumper sticker version of the story there. What he reveals in the documentary that I referenced earlier is that initially Google was like, why would we open source our secret sauce to help competitors? So folks like Tim Hockin and Brian Grant who were on the original Kubernetes team, went to management and pressed hard to convince them to bless open sourcing Kubernetes. Here's Hockin's explanation. >> When Docker landed, we saw the community building and building and building. I mean, that was a snowball of its own, right? And as it caught on we realized we know what this is going to we know once you embrace the Docker mindset that you very quickly need something to manage all of your Docker nodes, once you get beyond two or three of them, and we know how to build that, right? We got a ton of experience here. Like we went to our leadership and said, you know, please this is going to happen with us or without us. And I think it, the world would be better if we helped. >> So the open source strategy became more compelling as they studied the problem because it gave Google a way to neutralize AWS's advantage because with containers you could develop on AWS for example, and then run the application anywhere like Google's cloud. So it not only gave developers a path off of AWS. If Google could develop a strong service on GCP they could monetize that play. Now, focus your attention back to the diagram which shows this smiling, Alex Polvi from Core OS which was acquired by Red Hat in 2018. And he saw the need to bring Linux into the cloud. I mean, after all Linux was powering the internet it was the OS for enterprise apps. And he saw the need to extend its path into the cloud. Now here's how he described it at an OpenStack event in 2015. >> Similar to what happened with Linux. Like yes, there is still need for Linux and Windows and other OSs out there. But by and large on production, web infrastructure it's all Linux now. And you were able to get onto one stack. And how were you able to do that? It was, it was by having a truly open consistent API and a commitment into not breaking APIs and, so on. That allowed Linux to really become ubiquitous in the data center. Yes, there are other OSs, but Linux buy in large for production infrastructure, what is being used. And I think you'll see a similar phenomenon happen for this next level up cause we're treating the whole data center as a computer instead of trading one in visual instance is just the computer. And that's the stuff that Kubernetes to me and someone is doing. And I think there will be one that shakes out over time and we believe that'll be Kubernetes. >> So Alex saw the need for a dominant container orchestration platform. And you heard him, they made the right bet. It would be Kubernetes. Now Red Hat, Red Hat is been around since 1993. So it has a lot of on-prem. So it needed a future path to the cloud. So they rang up Google and said, hey. What do you guys have going on in this space? So Google, was kind of non-committal, but it did expose that they were thinking about doing something that was you know, pre Kubernetes. It was before it was called Kubernetes. But hey, we have this thing and we're thinking about open sourcing it, but Google's internal debates, and you know, some of the arm twisting from the engine engineers, it was taking too long. So Red Hat said, well, screw it. We got to move forward with OpenShift. So we'll do what Apple and Airbnb and Heroku are doing and we'll build on an alternative. And so they were ready to go with Mesos which was very much more sophisticated than Kubernetes at the time and much more mature, but then Google the last minute said, hey, let's do this. So Clayton Coleman with Red Hat, he was an architect. And he leaned in right away. He was one of the first outside committers outside of Google. But you still led these competing forces in the market. And internally there were debates. Do we go with simplicity or do we go with system scale? And Hen Goldberg from Google explains why they focus first on simplicity in getting that right. >> We had to defend of why we are only supporting 100 nodes in the first release of Kubernetes. And they explained that they know how to build for scale. They've done that. They know how to do it, but realistically most of users don't need large clusters. So why create this complexity? >> So Goldberg explains that rather than competing right away with say Mesos or Docker swarm, which were far more baked they made the bet to keep it simple and go for adoption and ubiquity, which obviously turned out to be the right choice. But the last piece of the puzzle was governance. Now Google promised to open source Kubernetes but when it started to open up to contributors outside of Google, the code was still controlled by Google and developers had to sign Google paper that said Google could still do whatever it wanted. It could sub license, et cetera. So Google had to pass the Baton to an independent entity and that's how CNCF was started. Kubernetes was its first project. And let's listen to Chris Aniszczyk of the CNCF explain >> CNCF is all about providing a neutral home for cloud native technology. And, you know, it's been about almost two years since our first board meeting. And the idea was, you know there's a certain set of technology out there, you know that are essentially microservice based that like live in containers that are essentially orchestrated by some process, right? That's essentially what we mean when we say cloud native right. And CNCF was seated with Kubernetes as its first project. And you know, as, as we've seen over the last couple years Kubernetes has grown, you know, quite well they have a large community a diverse con you know, contributor base and have done, you know, kind of extremely well. They're one of actually the fastest, you know highest velocity, open source projects out there, maybe. >> Okay. So this is how we got to where we are today. This ETR data shows container orchestration offerings. It's the same X Y graph that we showed earlier. And you can see where Kubernetes lands not we're standing that Kubernetes not a company but respondents, you know, they doing Kubernetes. They maybe don't know, you know, whose platform and it's hard with the ETR taxon economy as a fuzzy and survey data because Kubernetes is increasingly becoming embedded into cloud platforms. And IT pros, they may not even know which one specifically. And so the reason we've linked these two platforms Kubernetes and Red Hat OpenShift is because OpenShift right now is a dominant revenue player in the space and is increasingly popular PaaS layer. Yeah. You could download Kubernetes and do what you want with it. But if you're really building enterprise apps you're going to need support. And that's where OpenShift comes in. And there's not much data on this but we did find this chart from AMDA which show was the container software market, whatever that really is. And Red Hat has got 50% of it. This is revenue. And, you know, we know the muscle of IBM is behind OpenShift. So there's really not hard to believe. Now we've got some other data points that show how Kubernetes is becoming less visible and more embedded under of the hood. If you will, as this chart shows this is data from CNCF's annual survey they had 1800 respondents here, and the data showed that 79% of respondents use certified Kubernetes hosted platforms. Amazon elastic container service for Kubernetes was the most prominent 39% followed by Azure Kubernetes service at 23% in Azure AKS engine at 17%. With Google's GKE, Google Kubernetes engine behind those three. Now. You have to ask, okay, Google. Google's management Initially they had concerns. You know, why are we open sourcing such a key technology? And the premise was, it would level the playing field. And for sure it has, but you have to ask has it driven the monetization Google was after? And I would've to say no, it probably didn't. But think about where Google would've been. If it hadn't open source Kubernetes how relevant would it be in the cloud discussion. Despite its distant third position behind AWS and Microsoft or even fourth, if you include Alibaba without Kubernetes Google probably would be much less prominent or possibly even irrelevant in cloud, enterprise cloud. Okay. Let's wrap up with some comments on the state of Kubernetes and maybe a thought or two about, you know, where we're headed. So look, no shocker Kubernetes for all its improbable beginning has gone mainstream in the past year or so. We're seeing much more maturity and support for state full workloads and big ecosystem support with respect to better security and continued simplification. But you know, it's still pretty complex. It's getting better, but it's not VMware level of maturity. For example, of course. Now adoption has always been strong for Kubernetes, for cloud native companies who start with containers on day one, but we're seeing many more. IT organizations adopting Kubernetes as it matures. It's interesting, you know, Docker set out to be the system of the cloud and Kubernetes has really kind of become that. Docker desktop is where Docker's action really is. That's where Docker is thriving. It sold off Docker swarm to Mirantis has made some tweaks. Docker has made some tweaks to its licensing model to be able to continue to evolve its its business. To hear more about that at DockerCon. And as we said, years ago we expected Kubernetes to become less visible Stu Miniman and I talked about this in one of our predictions post and really become more embedded into other platforms. And that's exactly what's happening here but it's still complicated. Remember, remember the... Go back to the early and mid cycle of VMware understanding things like application performance you needed folks in lab coats to really remediate problems and dig in and peel the onion and scale the system you know, and in some ways you're seeing that dynamic repeated with Kubernetes, security performance scale recovery, when something goes wrong all are made more difficult by the rapid pace at which the ecosystem is evolving Kubernetes. But it's definitely headed in the right direction. So what's next for Kubernetes we would expect further simplification and you're going to see more abstractions. We live in this world of almost perpetual abstractions. Now, as Kubernetes improves support from multi cluster it will be begin to treat those clusters as a unified group. So kind of abstracting multiple clusters and treating them as, as one to be managed together. And this is going to create a lot of ecosystem focus on scaling globally. Okay, once you do that, you're going to have to worry about latency and then you're going to have to keep pace with security as you expand the, the threat area. And then of course recovery what happens when something goes wrong, more complexity, the harder it is to recover and that's going to require new services to share resources across clusters. So look for that. You also should expect more automation. It's going to be driven by the host cloud providers as Kubernetes supports more state full applications and begins to extend its cluster management. Cloud providers will inject as much automation as possible into the system. Now and finally, as these capabilities mature we would expect to see better support for data intensive workloads like, AI and Machine learning and inference. Schedule with these workloads becomes harder because they're so resource intensive and performance management becomes more complex. So that's going to have to evolve. I mean, frankly, many of the things that Kubernetes team way back when, you know they back burn it early on, for example, you saw in Docker swarm or Mesos they're going to start to enter the scene now with Kubernetes as they start to sort of prioritize some of those more complex functions. Now, the last thing I'll ask you to think about is what's next beyond Kubernetes, you know this isn't it right with serverless and IOT in the edge and new data, heavy workloads there's something that's going to disrupt Kubernetes. So in that, by the way, in that CNCF survey nearly 40% of respondents were using serverless and that's going to keep growing. So how is that going to change the development model? You know, Andy Jassy once famously said that if they had to start over with Amazon retail, they'd start with serverless. So let's keep an eye on the horizon to see what's coming next. All right, that's it for now. I want to thank my colleagues, Stephanie Chan who helped research this week's topics and Alex Myerson on the production team, who also manages the breaking analysis podcast, Kristin Martin and Cheryl Knight help get the word out on socials, so thanks to all of you. Remember these episodes, they're all available as podcasts wherever you listen, just search breaking analysis podcast. Don't forget to check out ETR website @etr.ai. We'll also publish. We publish a full report every week on wikibon.com and Silicon angle.com. You can get in touch with me, email me directly david.villane@Siliconangle.com or DM me at D Vollante. You can comment on our LinkedIn post. This is Dave Vollante for theCUBE insights powered by ETR. Have a great week, everybody. Thanks for watching. Stay safe, be well. And we'll see you next time. (upbeat music)

>> Live from Barcelona, Spain, it's the Cube, covering KubeCon CloudNativeCon Europe 2019. Brought to you by Red Hat, the Cloud Native Computing Foundation, and Ecosystem Partners. >> Welcome back, this is theCube getting towards the end of two days live wall-to-wall coverage here at KubeCon, CloudNativeCon 2019 in Barcelona. I'm Stu Miniman, my co-host for this week has been Corey Quinn and happy to have on one of our hosts for this week from the Cloud Native Computing Foundation, Dee Kumar, the Vice President of Marketing, also helps with developer relations. Dee, welcome back to the program. >> Thanks for having me. >> And thank you for having us. We've been having a great time this week, a lot of buzz, a lot of people and obviously always a lot of enthusiasm at the show here. Thanks so much. Alright, so your team has been super busy. I've talked with a lot of them leading up to the show. >> That's right. >> Anybody that knows any show of this kind of magnitude know we're usually pretty exhausted before we get on planes and change all the time zones. So, you know, thank you for holding strong. Give us a little bit about, you know, when we talk marketing, you have a big annual report that came out recently from 2018. Give us some of the highlights of some of the things you've been seeing. >> Yeah, sure. Like you mentioned, you're seeing all the excitement and buzz here so this is our largest open-source developer conference, when compared to the last year we did in Copenhagen. So we have close to 8,000 attendees so we're really excited about that. And you're absolutely right, with that comes, we're so exhausted, but we really appreciate. I think the reason the conference has been so successful is primarily just because of the community engagement, which I highlight in the annual report. So it's a combination of our community, which is the developers, the contributors, also our end users, and the third significant portion of our ecosystem is our members. So we recently just announced that CNCF has crossed over 400 members, our end user community is growing, I think Sheryl mentioned this morning in the keynote, we have about 81 end users and this is phenomenal because end of the day, end users are companies who are not commercializing Cloud Native, but essentially they're using these products or technologies internally, so they are essentially the guinea pig of Cloud Native technologies and it's really important to learn from them. >> Well Dee, and actually it's interesting, you know, celebrating the five years of Kubernetes here, I happened to talk to a couple of the OG's of the community, Joe Beta, Tim Hawkin and Gabe Monroy. And I made a comment to Joe, and I'm like, "Well Google started it, but they brought in the Ecosync and pulled in a lot of other vendors too, it's people. And Gabe said, he's like "yeah, I started Deis and I was one of the people >> Absolutely. >> that joined in." So, we said this community is, it's people more than it's just the collection of the logos on the slides. >> Absolutely, I completely agree. And the other thing I also want to point out is a neutral home, like CNCF, it definitely increases contributions. And the reason I say that is, having a neutral home helps the community in terms of engaging and what is really interesting again, going back to the annual report is Google had a leadership role and most of the contributors were from Google, and now with having a neutral home, I think Google has done a phenomenal job to make sure that the contributors are not just limited to Google. And we're seeing all the other companies participating. We're also seeing a new little graph of independent contributors, who are essentially not associated with any companies and they've been again, very active with their comments or their engagement with overall, in terms of, not just limiting to Kubernetes, but all the other CNCF projects. >> So, this is sort of a situation of being a victim of your own success to some extent, but I've mentioned a couple of times today with various other guests, that this could almost be called a conference about Kubernetes and friends, where it feels like that single project casts an awfully long shadow, when you talk to someone who's vaguely familiar with the CNCF, it's "Oh you mean the Kubernetes people?" "Cool, we're on the same page." How do you, I guess from a marketing perspective begin to move out from under that shadow and become something that is more than a single project foundation? >> Yeah, that's a great question, and the way we are doing that is, I think, Kubernetes has become an economic powerhouse essentially, and what it has done is, it's allowed for other start-ups and other companies to come in and start creating new projects and technologies built around Kubernetes, so essentially, now, you're no longer talking about one single project. It's no longer limited to containers or orchestration, or just micro-services, which was the conversation 3 years ago at KubeCon, and today, what you will see is, it's about talking about the ecosystem. So, the way, from a marketing perspective, and it's actually the reality as well, is Kubernetes has now led to other growing projects, it's actually helped other developers come onboard, so now we are seeing a lot more co-ord, a lot more contributions, and now, CNCF has actually become a home to 35+ projects. So when it was founded, we had about 4 projects, and now it's just grown significantly and I think Kubernetes was the anchor tannin, but now we're just talking about the ecosystem as a whole. >> Dee, I'm wondering if it might be too early for this, but do you have a way of measuring success if I'm someone that has rolled out Kubernetes and some of the associated projects? When I talked to the early Kubernetes people, it's like, Kubernetes itself is just an enabler, and it's what we can do with it and all the pieces that go with it, so I don't know that there's spectrums of how are we doing on digital transformation, and it's a little early to say that there's a trillion dollars of benefit from this environm... but, do you have any measure today, or thoughts as to how we can measure the success of everything that comes out of the... >> Yeah, so I think there was Redmont, they published a report last year and it looks like they're in the process of updating, but it is just phenomenal to see, just based on their report, over 50% of fortune 100 companies have started to use Kubernetes in production, and then I would say, more than, I think, to be accurate, 71% of fortune 100 companies are using containers, so I think, right there is a big step forward. Also, if you look at it last year, Kubernetes was the first project to graduate, so one of the ways we also measure, in terms of the success of these projects, is the status that we have within CNCF, and that is completely community driven, so we have a project that's very early stage, it comes in as a sandbox, and then just based on the community growth, it moves onto the next stage, which is incubating, and then, it takes a big deal to graduate, and to actually go to graduation, so we often refer to those stages of the projects to Jeffery Moore, in terms of crossing the chasm. We've talked about that a lot. And again, to answer your question, in terms of how exactly you measure success is just not limited to Kubernetes. We had, this year, a few other projects graduates, we have 6 projects that have graduated within CNCF. >> How do you envision this unfolding in the next 5 years, where you continue to accept projects into the foundation? At some point, you wind up with what will only be described as a sarcastic number of logos on a slide for all of the included projects. How do you effectively get there without having the Cheesecake Factory menu problem of... the short answer is just 'yes', rather than being able to list them off coz no one can hold it all in their head anymore? >> Great question, we're still working on it. We do have a trail map that is a representation of 'where do I get started?', so it's definitely not prescriptive, but it kind of talks about the 10 steps, and it not only talks about it from a technology perspective, but it also talks about processes and people, so we do cover the DevOp, CICD cycle or pipeline. The other thing I would say is, again, we are trying to find other creative ways to move past the logos and landscape, and you're absolutely right, it's now becoming a challenge, but, you know, our members with 400+ members within CNCF. The other way to actually look at it is, back to my earlier point on ecosystems. So one of the areas that we are looking at is, 'okay, now, what next after orchestration?', which is all about Kubernetes is, now I think there's a lot of talks around security, so we're going to be looking at use cases, and also Cloud Native storage is becoming another big theme, so I would say we now have to start thinking more about solutions, solution, the terminology has always existed in the enterprise world for a long time, but it's really interesting to see that come alive on the Cloud Native site. So now we are talking about Kubernetes and then a bunch of other projects. And so now, it's like that whole journey from start to finish, what are the things that I need to be looking at and then, I think we are doing our best with CNCF, which is still a part of a playbook that we're looking to write in terms of how these projects work well together, what are some common use cases or challenges that these projects together can solve. >> So, Dee, we're here at the European show, you think back a few years ago it was a public cloud, there was very much adoption in North America, and starting to proliferate throughout the world. Alibaba is doing well in China and everything. CNCF now does 3 shows a year, you do North America, you do Europe and we've got the one coming up in China. We actually did a segment from our studio previewing the OpenStack Summit, and KubeCon show there, so maybe focus a little bit about Europe. Is there anything about this community and this environment that maybe might surprise people from your annual data? >> Yes, so if you look at... we have a tool called DevStart, it's open source, anyone can look at it, it's very simple to use, and based on that, we kind of monitor, what are the other countries that are active or, not just in terms of consuming, but who are actually contributing. So if you look at it, China is number 2, and therefore our strategy is to have a KubeCon in China. And then from a Euro perspective, I think the third leading country in terms of contributions would be Europe, and therefore, we have strategically figured out where do we want to host our KubeCon, and in terms of our overall strategy, we're pretty much anchoring to those 3 regions, which is North America, Europe as well as China. And, the other thing that we are also looking at is, we want to expand our growth in Europe as well, and now we have seen the excitement here at our KubeCon Barcelona, so we are looking to offer some new programs, or, I would say, new event types outside of KubeCon. Kind of you want to look at it as mini KubeCons, and so those would explore more in terms of different cities in Europe, different cities in other emerging markets as well. So that's still in the works. We're really excited to have, I would say 2 new event types that we're exploring, to really get the community to run and drive these events forward as well, outside of their participation in KubeCon because, oftentimes, I hear that a developer would love to be here, but due to other commitments, or, their not able to travel to Europe, so we really want to bring these events local to where they are, so that's essentially a plan for the next 5 years. >> It's fascinating hearing you describe this, because, everything you're saying aligns perfectly with what you'd expect from a typical company looking to wind up, building adoption, building footprints etc., Only, you're a foundation. Your fundamental goal at the end of it is user engagement, of people continuing to participate in the community, it doesn't turn into a 'and now, buy stuff', the only thing you have for sale here that I've noticed is a T-shirt, there's no... Okay, you also have other swag as well, not the important part of the story, I'm curious though, as far as, as you wind up putting all of this together, you have a corporate background yourself, was that a difficult transition to navigate, as far as, getting away from getting people to put money in towards something in the traditional sense, and more towards getting involved in a larger ecosystem and community. >> That was a big transition for me, just having worked on the classic B2B commercial software side, which is my background, and coming in here, I was just blown away with how people are volunteering their time and this is not where they're getting compensated for their time, it's purely based on passion, motivation and, when I've talked to some key community organizers or leaders who have done this for a while, one of the things that has had an impact on me is just the strong core values that the communities exhibit, and I think it's just based on that, the way they take a project and then they form a working group, and then there are special interest groups that get formed, and there is a whole process, actually, under the hood that takes a project from where Kubernetes was a few years ago, and where it is today, and I think it's just amazing to see that it's no longer corporate driven, but it's more how communities have come together, and it's also a great way to be here. Oftentimes... gone are the days where you try to set up a meeting, people look forward to being at KubeCon and this is where we actually get to meet face-to-face, so it's truly becoming a networking event as well, and to build these strong relationships. >> It goes even beyond just users, I mean, calling this a user conference would not... it would be doing it a bit of disservice. You have an expo hall full of companies that are more or less, in some cases, sworn enemies from one another, all coexisting peacefully, I have seen no fist-fights in the 2 days that we've been here, and it's fascinating watching a community effort get corporate decision makers and stakeholders involved in this, and it seems that everyone we've spoken to has been having a good time, everyone has been friendly, there's not that thousand yard stare where people are depressed that you see in so many other events, it's just something I've never experienced before. >> You know, that's a really amazing thing that I'm experiencing as well. And also, when we do these talks, we really make it a point to make sure that it's not a vendor pitch, and I'm not being the cop from CNCF policing everyone, and trying to tell them that, 'hey, you can't have a vendor pitch', but what I'm finding is, even vendors, just did a silverless talk with AWS, and he's a great speaker, and when he and I were working on the content, he in fact was, "you know, you're putting on that hat", and he's like, "I don't want to talk about AWS, I really want to make sure that we talk about the underlying technology, focusing on the projects, and then we can always build on top, the commercial aspect of it, and that's the job for the vendor. So, I think it's really great collaboration to see how even vendors put on the hat of saying, 'I'm not here to represent my products, or my thing', and of course they're here to source leads and stuff, but at the end of the day, the underlying common protocol that's already just established without having explicit guidelines saying, 'this is what you need to be following or doing', it's just like an implicit understanding. Everyone is here to promote the community, to work with the community, and again, I think I really want to emphasize on the point that people are very welcoming to this concept of a neutral home, and that really had helped with this implicit understanding of the communities knowing that it's not about a vendor pitch and you really want to think about a project or a technology and how to really use that project, and what are the use cases. >> It's very clear, that message has resonated well. >> Dee, thank you. We've covered a lot of ground, we want to give you the final word, anything else? We've covered the event, we've covered potential little things and the annual report. Any last words you have for us that you want people to take away? >> Not really, I think, like I said, it's the community that's doing the great work. CNCF has been the enabler to bring these communities together. We're also looking at creating a project journey it terms of how these projects come into CNCF, and how CNCF works with the communities, and how the project kind of goes through different stages. Yeah, so there are a lot of great things to come, and looking forward to it. >> Alright, well, Dee, thank you so much for all of the updates, and a big thank you, actually, to the whole CNCF team for all they've done to put this together. We really appreciate the partnership here. For Corey Quinn, I'm Stu Miniman. Back to wrap 2 days, live coverage, here at KubeCon, Cloud Native Con 2019, Thanks for watching the Cube. >> Thank you.

>>Live from Barcelona, Spain, execute covering CubeCon cloud native con Europe, 2019 onto you by red hat, the cloud native computing foundation and ecosystem partners. >>Welcome back. We're here in Barcelona, Spain where 7,700 attendees are here for Q con cloud native con. I'm Stu Miniman and this is the cubes live two day coverage having to have on the program to returning guests to talk about five years of Kubernetes. To my right is Tim Hawkin wearing the Barna contributors shirt. Uh, and uh, sitting to his right is gay Bon Roy. So, uh, I didn't introduce their titles and companies, but you know, so Tim's and Google gives it Microsoft, uh, but you know, heavily involvement in uh, you know, Coobernetti's since the very early days. I mean, you know, Tim, you're, you're on the Wikipedia page game, you know, I think we have to do some re editing to make sure we get the community expanded in some of the major contributors and get you on there. But gentlemen, thanks so much for joining us. Thanks for having us. >>Alright. Uh, so, you know, Tim just spoke to Joe Beda and we talked about, you know, the, the, the idea of, you know, Craig and Brendan and him sitting in the room and, you know, open source and, you know, really bringing this out there to community. But let's start with you. Cause he, you know, uh, I remember back many times in my career like, Oh, I read this phenomenal paper about Google. You know, we're going to spend the next decade, you know, figuring out the ripple effect of this technology. Um, you know, Coobernetti's has in five years had a major impact on, on what we're doing. Uh, it gives a little bit of your insight is to, you know, what you've seen from those early days, you know. >>Yeah. You know, um, in the early days we had the same conversations we produced. These papers are, you know, seminal in the industry. Um, and then we sort of don't follow up on them sometimes as Google. Um, we didn't want this to be that, right. We wanted this to be alive living thing with a real community. Uh, that took root in a different way than MapReduce, Hadoop sort of situation. Um, so that was very much front of mind as we work through what are we going to build, how are we going to build and how are we going to manage it? How are we going to build a community? How, how do you get people involved? How do you find folks like Gaiman and Deus and get them to say we're in, we want to be a part of this. >>All right, so Gabe, it was actually Joe corrected me when I said, well, Google started it and they pulled in some other like-minded vendors. Like he said, no, no stew. We didn't pull vendors in. We pulled in people and people that believed in the project and the vision, you were one of those people that got pulled in early. He were, you know, so help give us a little context in your, your viewpoint. I did. And, and, and you know, at the time I was working for a company, uh, called, uh, that I had started and we were out there trying to make developers more productive in industry using modern technology like containers. And you know, it was through the process of trying to solve problems for customers, sort of the lens that I was bringing, uh, to this where, um, I was introduced to some really novel technology approaches first through Docker. >>Uh, and you know, I was close with Solomon hikes, the, the founder over there. Uh, and then, you know, started to work closely with folks at Google, uh, namely Brendon burns, who I now work with at Microsoft. Um, you know, part of the, the founding Kubernetes team. Uh, and I, I agree with that statement that it is really about people. It's really about individual connections at the end of the day. Um, I think we do these things that at these coupons, uh, events called the contributor summits. And it's very interesting because when folks land at one of these summits, it's not about who you work for, what Jersey you're wearing, that sort of thing. It's people talking to people, trying to solve technical problems, trying to solve organizational challenges. Uh, and I think, you know, the, the phenomenon that's happened there and the scale with which that's happened is part of the reason why there's 8,000 people here in Barcelona today. >>Yeah. It's interesting to him cause you know, I used to be involved in some standards work and I've been, you know, working with the open source community for about 20 years. It used to be ah, you know, it was the side project that people did at nights and everything like that. Today a lot of the people that are contributing, well they do have a full time job and their job will either let them or asking them to do that. So I do talk to people here that when they're involved in the working groups, when they're doing these things, yes. You think about who their paycheck comes for, but that's secondary to what they're doing as part of the community. And it is, you know, some of the people what, what >>absolutely. It's part of the ethos of the project that the project comes first and if company comes second or maybe even third. Uh, and for the most part, this has been wildly successful. Uh, there's this huge base of trust among, uh, among the leadership and among the contributors. Um, and you know, it's, it's a big enough project now that I don't know every one of the contributors, but we have this web of trust. And, you know, I, I have this, this army of people that I know and I trust very well and they know people and they know people and it works out that the project has been wildly successful and we've never yet had a major conflict or strife that centered on company this or company that. >>Yeah. And I don't, I'd also add that it's an important development has happened in the wake of Kubernetes where, you know, for example, in my teams at Microsoft, I actually have dedicated PM and engineering staff where their only job is to focus on community engagements, right? Running the release team for communities one 15 or working on IPV six support or windows container support. Uh, and, and that work, that upstream work, uh, puts folks in contact with people from all different companies, Google, uh, uh, you know, Microsoft working closely together on countless initiatives. Uh, and the same is true really for the entire community. So I think it's really great to see that you can get not just sort of the interpersonal interactions. We can also get sort of corporate sponsorship of that model. Cause I do think at the end of the day people need to get their paychecks. Uh, and oftentimes that's going to come from a big company. Uh, and, and seeing that level of investment is, I think, uh, pretty encouraging. Okay. Well, you know, luckily five years in we've solved all the problems and everything works perfectly. Um, if that's not maybe the case, where do we need people involved? What things should we be looking at? Kind of the, the, the next year or two in this space, you know, a project >>of this size, a community of this size, a system of this scope has infinite work to do, right? The, the, the barrel is never going to be empty. Um, and in some cases it's filling faster than it's draining. Um, every special interest group, every SIG, it has a backlog of issues of things that they would like to see fixed of features that they have some user pounding the table saying, I need this thing to work. Uh, IPV six is a great example, right? And, and we have people now stepping up to take on these big issues because they have customers who need it or they see it as important foundational work for building future stuff. Um, so, you know, there's, there's no shortage of work to do. That's not just engineering work though, right? It's not just product definition or API. We have a, what we call a contributor experience. People who work with our community to entre online, uh, new contributors and um, and, and streamline how to get them in and involved in documentation and testing and release engineering. And there's so much sort of non-core work. Uh, I could go on on this for. >>Yeah, you're just reminding me of the session this morning is I don't manage clusters. I manage fleets. And you have the same challenge with the people. Yeah. And I also had another dimension to this about just the breadth of contribution. We were just talking before the show that, um, you know, outside at the logo there is this, uh, you know, characters, book characters, and such. And really that came from a children's book that was created to demonstrate core concepts, uh, to developers who were new to Kubernetes. And it ended up taking off and it was eventually donated to the CNCF. Um, but things like that, you can't underestimate the importance and impact that that can have on making sure that Kubernetes is accessible to a really broad audience. Okay. Uh, yeah, look, I want to give you both a, just the, the, the final word as to w what you shout out, you one for the community and uh, yeah. And any special things that have surprised you or exciting you? Uh, you know, here in 2019, >>uh, you know, exciting is being here. If you rewind five years and tell me I'm going to in Barcelona with with 7,500 of my best friends, uh, I would think you are crazy or are from Mars. Um, this is amazing. And uh, I thank everybody who's here, who's made this thing possible. We have a ton of work to do. Uh, and if you feel like you can't figure out what you need to work on, come talk to me and we'll, we'll figure it out. >>Yeah. And for me, I just want to give a big thank you to all the maintainers folks like Tim, but also, you know, some other folks who, you know, may, you may not know their name but they're the ones slogging it out and to get hub PRQ you know, trying to just make the project work and function day to day and were it not for their ongoing efforts, we wouldn't have any of this. So thank you to that. Well and look, thank you. Of course, to the community and thank you both for sharing with our community. We're always happy to be a small piece of a, you know, helping to spread the word and uh, give some voice to everything that's going on here. Thank you so much. All right, so we will be back with more coverage here from coupon cloud native con 2019 on Stu Miniman and thank you for watching the cube.

>> Announcer: Live, from Austin, Texas, it's theCube, covering KubeCon and Cloud Native Con 2017. Brought to you by Red Hat, The Linux Foundation, and theCube's ecosystem partners. >> Welcome back everyone, live here. This is theCube's exclusive coverage, live in Austin, Texas for Cloud Native Con and KubeCon with The Linux Foundation. I'm John Furrier, the founder. Silicon Angle Media, my cohost Stu Miniman, and next to us Joe Beda, who's the co-founder, co-founder and CTO of Heptio With Craig McLuckie, the famous startup that came out of the Google team, really one of the principal founders of Kubernetes with Craig and the team Brendon Burns and the like. Great to have you on theCube, thanks for coming on. >> Thank you very much for having me, it's exciting. >> Good time, first time on theCube, glad to have you, we've been trying to get your perspective because obviously we're fans of the Kubernetes, I just had Lou Tucker on, we were talking interclouding and some orchestration opportunity. You guys had that vision and it's really important to tell the story, at the beginning with Kubernetes. You guys were sitting around, having a little beer, free food at the Google cafeteria, what was it like? What happened? How did it all come together? >> All right well, I started at Google probably 10, 12 years ago, did a whole bunch of stuff but eventually landed doing cloud. Craig and I started up a Google compute engine, VM as a service and the odd thing to recognize is that nobody who had been at Google for a long time thought that there was anything to this VM stuff. Because Google had been on containers for so long, that was their mindset, Borg was the way that stuff was actually deployed, so my boss at the time, who's now in Cloud Era booted up a VM for the first time, and anybody in the outside world would be like hey, that's really cool and his response was like, well now what? You're sitting at a prompt, that's not super interesting, how do I run my app? That's what everybody's been struggling with with Cloud, it's not how do I get a VM, how do I actually run my code? As Google got more and more serious about Cloud, every big company wants to dog food their products. How do we make the experience that folks inside of Google have, developers inside of Google have, match the experience that Cloud customers have? The choice there was either we make everybody inside of Google start using VM's which would have felt like that step backwards, or we teach the rest of the world about Borg. Now around the same time, docker started getting a lot of attention and we were like hey, those guys are onto something, they really found a good way to make this technology accessible to users on a single node level, but our experience at Google really taught us that that clusters you, how do you actually create this abstraction that a whole bunch of computers are one thing that you operate with? That was the thing that was going to be interesting and so out of that, we decided Kubernetes was going to be the thing or at least getting Borg out to the rest of the world, and we knew for it to be effective, it couldn't just be Google doing it alone, we had to do it in a way that would bring the rest of the industry with us. That's the motivation behind Kubernetes. It took us about another three months to convince all the folks at Google that this was a good idea, it was controversial, the open source projects at the time were things like, the biggest things would be like Chrome and Android. Those things were, the relationship with their community was very different from what we were aiming for with Kubernetes, they were much more consumer focused versus infrastructure focused. >> It was early too for Google to recognize the multi cloud world. >> I think some it wasn't so much multi cloud as much as developers have a really strong sense of where the lock in is, where the vendor lock in is, and we knew that if we wanted to win the hearts and minds of engineers and developers and folks that took this stuff seriously, as the underdog in the cloud world at the time, you had to really go out there and build something that was going to be widely applicable. Because you don't want to invest your time and energy into something that's super specialized to one cloud and I think the whole multi cloud thing, honestly I think it's engineers and developers and operations folks that had that sense from the get go, we were just reacting to that. >> Good instincts too. Kubernetes certainly working out today, state of the union, cause we're still only less than three years old as a community, seems like 20, but the momentum's been amazing, has been a lot of revision, a lot of people have their own versions of Kubernetes, yet there's a core, vanilla Kubernetes, but it's working. People have gotten around this. What is the big thing that has surprised you the most and where are you most excited right now, where Kubernetes is at? >> Okay surprise, there's 4100 people here at KubeCon, that's absolutely insane. I think we had this idea that it could be a thing and that, but I don't think that any of us imagined that within three years we'd be sitting here, doing this type of thing. That I think for me is the most surprising. It's a challenge to take these ideas that have been successful inside at Google and translate those to the rest of the world and it wasn't an easy or obvious thing, there were a lot of good ideas but figuring out how to get those out there, I think that really is due to the larger community. Folks like Clayton Pullman from Red Hat coming in early with a lot of that really brought a lot of that outside DNA necessary to bridge that gap. Surprising that we got here, but really it took the community to make that happen. In terms of what I'm most excited about right now, with the announcement of EKS from Amazon, it definitely feels like we're moving into a new phase of Kubernetes where folks are being much more focused on what do you do with Kubernetes versus how do you get Kubernetes running. Kelsey tweeted it the other day, but I think we've been saying for a while, Kubernetes at its heart is a platform for building platforms, really we viewed it from the start as a toolbox and I think we're only now starting to see, what other things are people going to be building with that toolbox and I think that's going to be that larger ecosystem, is going to be much larger than Kubernetes itself. >> Joe, coming into this show, there were so many announcements around Kubernetes, there's like 42 certified different versions out there. I think you could help explain a little bit because there's the big cloud guys, you mentioned Clayton who we had earlier from Red Hat, there's all these companies, oh well, Kubernetes is just like it's a piece and it's in there. Your company is around Kubernetes, so what does this mean that Kubernetes is, I guess we'd say commoditized across there, I think it's a good thing for the industry, but what does it mean, why is there a need for Heptio and what do you guys see as your role in the ecosystem? >> There's a bunch of folks that are really concentrating on how do I get Kubernetes up and running and that's one thing, and I think that landscape is going to be changing and evolving over time. We're definitely happy to help folks be successful with Kubernetes, it's one of those things we're going to do, we're going to do an open source project, services, support and training with that, but when we look forward, I think a big part of it is, how do we bridge the gap to integrate Kubernetes into businesses, how do we start building those next layer tools on top of it and to some degree, it's a wild west. There's those 42 companies, everybody's trying to actually find something that's going to be interesting, start solving problems, but the thing that's really encouraging to me is that Kubernetes is the base and we're doing work, both Heptio and the community around conformance to make sure that we actually have a solid base that folks can build on top of. Then everybody's focused on how can we actually capture the attention of developers, how can we actually deliver value there and so that's a really great dynamic, when everybody's like I want to do something really great that people are going to get a lot out of, only good things are going to come from that. >> Yeah and I liked, there was a concern some people had, oh last week AWS is now all in, they've got EKS, but you had an announcement about the Heptio authenticator open source authentication, a little bit of a partnership with AWS it looked like. Maybe explain, it sounds like one of the things you're building on top of this. >> Yeah exactly. Like everybody else, we had heard all the rumors, hey is Amazon going to do a Kubernetes offering or not. In our mind, there were two ways. >> Didn't they have to Joe? >> Well that's what I thought last year, but who knows, I think Amazon doesn't have to do anything but when we first started Kubernetes, we reached out to the folks at Amazon including Deepak and we're like hey, you guys are welcome, come join us here and they were like yeah, yeah, we'll join you when the customers are asking for it. Well it turns out the customers were asking for it, so here they are and I think it's a great thing. I think it could've gone two ways, they could have built in a bunch of integrations into Kubernetes that were only available through EKS that really made EKS a more integrated, better Kubernetes than running open source Kubernetes on top of Amazon, or they could've worked with the community, with upstream to try and make Kubernetes run great on Amazon, better on Amazon as is but then run even better when you're running it with EKS and they actually have the management on top of it. I think they decided to go that second route which is much more community friendly. A couple weeks before the announcement, they reached out to us, said hey, we noticed you had this project, it looks really interesting, we need a way to bridge IM to authenticate to Kubernetes and we like the approach that you're taking, can we work together to continue to develop this and that was the first signal to us that they wanted to really reach out and work with the community and so we're like hey, that sounds great, let's work together and get that stuff out there. It's still very early, I think EKS is GA next year, they set an aggressive goal for themselves, so I'm really looking forward to see where they take that and we're going to partner with them where it makes sense around things like authenticator. >> You mentioned we're going to a whole other level with Kubernetes and Amazon's announcement goes to the next level, you also mentioned you worked at Google Compute, Apple, all these other cool names with Google and you got Heptio, you're solving making interesting things happen with Kubernetes and you got a new class of developers coming in that have never heard of what a local director is. Infrastructure as code is happening, so you got the cloud game going on. I got to ask you, as Kubernetes starts to continue to take shape, a lot of people are trying to survive. In this technical architecture decisions, almost a tech chess game, which side of history will you be on thing going on and customers want more clarity. You have a lot of movement and customers want clarity. How do you see it continuing and what is the right path in your mind because it's looking good right now and commoditization as some say, I think is a good thing because value, there's value in interoperability, there's value in orchestration, there's value in a new class of web developer creating, solving problems with code, whether it's societal problems or other things, so there's a lot of big picture, wholistic things happening and Kubernetes kind of strikes at the heart of that. What's the right path in your mind, what's the vision you think Kubernetes should go into. >> Well I think first of all, I think change happens in the industry both fast and slow. It feels like it's been three years since Kubernetes, since we open sourced Kubernetes, and it's come a huge way since then. That happened really fast. You look at Enterprise, you look at Enterprise adoption cycles, I believe last I heard the mainframe division was a growing profit center for IBM. This stuff doesn't go away so as we see things like containers and Kubernetes and serverless and cloud, as we see these things come on the scene, it doesn't necessarily replace stuff, it augments and it adds over time so we see the mix of where people invest shift. In that way, things become established quickly, but old things go away slowly. I don't think it's going to be as quick of a shift as maybe it might seem at first. Now in terms of where the opportunities are moving forward and where we see this developing, the thing that's exciting for me is as we have, and this is something early on, talking with Brendon, he got super excited about, is as we provide new abstractions, as we provide a new toolbox, how do people start creating systems and applications that take advantage of that. I'll give you an example, distributed systems, pre-systems like Kubernetes were very difficult because not only did you have to do the thing that you wanted to do, you had to build all of this plumbing to actually get your things to talk to each other, the finds, the secure, all that stuff had to be created from scratch and those systems were rare and hard to manage and few and far between. Now with things like Kubernetes, there's a whole set of problems that you actually don't have to solve. The floor that you need, the floor is that much higher for building these systems so I think we're going to see a shift not just to cloud native, but I also think we're going to see a set of applications that are Kubernetes native. These are applications that assume that Kubernetes is the substrate that they're running on, and they take special advantage of it and I think we're going to see amazing thing happens when we really democratize the plumbing for building distributed systems. >> And that's the key, make that frictionless so if people want to go Kubernetes native, they're taking advantage, that's cool. I want to get to, to take that to the next level, as the world of IOT comes down, you can almost look at the world now as all IOT. There's no on prem and there's no cloud. If you believe this service mission unpluggable architectures, you could argue that a data center is a network point, it's an attached device to a myriad things, so you're going to need policy, the light bulb has a process in it, the wifi has wifis everywhere, so in a way, this is all going to be a grid if you will, it's going to be kind of a mesh. This is the right direction don't you think, the more services that come online, you just want to connect to them. That's the nirvana right? Are we smoking the peace pipe here too much? >> I think there's a bunch of trends that we're seeing happen there. I think with IOT, we see also a move towards edge computing, this idea of, we're going to see much more stuff happening in a more distributed manner. Whether that edge happens to be in your house or whether it's in a telecom cabinet or whether it's just mini data centers that are dropped in to parking lots here and there. That introduces a whole bunch of new problems in terms of how do you manage that stuff at scale. One of the things that I see is that we're seeing an interesting overlap between CDM providers and cloud providers, so you have cloud flare introducing their cloud workers, where you can start running actual code in their CDM nodes and that's the culmination of CDM providers over time fighting with each other to drive more and more customization. On the other hand, you have Amazon taking lambda, finding ways to actually use lambda and push that out to the edge, even into devices that are doing local machine learning. There's this overlap between these two different worlds. Then also, as we move stuff closer out to the clouds, the political situations that people deal with become that much more complex. As you start running compute in all these different countries, all of a sudden you can't necessarily go to one provider to actually deal with all of that. We're moving from this world where, when you're centered around data which is the traditional cloud, when you want to put it all in one big pile with compute around the edges, that's kind of like the traditional data center. Going with a few large providers makes a ton of sense. As we move towards a much more distributed world, it becomes a more distributed problem both in terms of how do you manage the compute, but how do you manage the relationships and how do you actually understand what's happening across all that and I think Kubernetes can be a part of that puzzle for sure, but it's not the end of the answer, there's still a lot of problems to be solved there. >> No but you get the first mile post. You can say hey, I can start orchestrating workloads and have endpoints that have services that talk to each other as the first step. >> Joe, one thing I wanted to ask you, what are the stumbling blocks? What do people need to look out for? Because most companies out there aren't Google. >> This morning at today's keynote and you can find it online, there's that cloud native road map that Dan was showing. That is an interesting thing that cuts both ways. On the one hand, it shows an enormous amount of innovation, it shows that we're seeing this explosion of interest in this world and it's really invigorating. That's from an entrepreneur's view and a technologist's view. If I'm a customer, that thing's kind of horrifying. I look at that and I say wow, I really have to understand all of this stuff to get ahead? I think the biggest stumbling block is really being able to make sense of all the noise out there. I think that noise is part and parcel of an active, innovative, chaotic ecosystem, but I think it's one of those things that makes it that much harder for enterprises and for more mainstream developers to adopt. Tim, we've been saying this for a while, for Kubernetes to be successful, we had to make it boring. That's Tim Hawkin, I think maybe was the first one to say that, but we not only had to make Kubernetes boring, we had to make that entire stack boring, we had to make cloud native boring. That's when it will have succeeded. I don't know what this conference will look like when cloud native is boring, but it'll probably be very different than. >> It'll certainly create some excitement, boring is reliable, boring is safe, boring is secure, boring is comfortable. Mark Zuckerberg once said move fast, break stuff, then he revised it to move fast and be 100% reliable. That's boring. >> Did he actually say that? >> I don't know, he shifted his narrative because that was the maverick early days when he started running at five nines it's like a whole nother ball game. >> Actually that matters. >> Joe, great to have you on theCube, thanks for sharing your awesome insight into the dynamics of the computing industry that's going cloud native, going KubeCon, and certainly Kubernetes that you helped put together with the team, it's certainly taken on a life of its own, last minute, take a minute to talk about Heptio, what you guys are working on, get the plug in. >> Yeah Heptio, we have services, support and training that we're offering to make customers successful with Kubernetes today and that's been invigorating, really getting out there and talking with folks, seeing the problems that they're hitting now versus where we want it to go. We're doing a bunch of work around open source projects, we have Heptio Arc which is a backup disaster recovery project open source, we have Sona Boy, which is a diagnostic project for running the conformance tests and it underpins the Kubernetes conformance effort. We have K Sonic which helps you configure applications and then we also have Contour, which is an ingress controller building on top of Envoy and other CNCF project and then into 2018, we're going to be offering more products and projects and services that really start targeting the special needs of larger and larger enterprises and that's where our focus is going to shift over time. >> You guys are certainly helping customers who are under pressure to add more services, including what Amazon's doing, more pronouncements, there are little announcements, some big some little, but still, the cadence of new things happening is fast at all times right now. >> I can't keep up either, nobody else can. >> We try. Two and a half hour keynote, it's ridiculous. Joe Beda here inside theCube, cofounder CTO of Heptio a hot startup, making Kubernetes interesting and exciting and reliable and boring. Not boring, we should say that. >> Oh boring's good. >> Infrastructure's good, it's theCube, bringing you all the live action from Austin, Texas, I'm John Furrier, Stu Miniman, KubeCon and Cloud Native Con, we'll be right back after this short break.