>>from around the >>globe it's the cube with >>coverage of Kublai >>Khan and Cloud Native Con Europe 2020 >>one virtual >>brought to you by red hat. The cloud native computing foundation and ecosystem partners. Welcome back to the cubes coverage of Kublai khan 21 cloud native gone 21 virtual. I'm john for your host of the cube. We're here with a great segment of an entrepreneur also the creator and maintainer of fluent bit Eduardo Silva who's now the founder of Palihapitiya was a startup. Going to commercialize and have an enterprise grade fluent D influence bit Eduardo. Great to have you on. Thanks for coming on the cube >>during the place for having me here. So I'm pretty happy to share the news about the crew and whenever you want, >>exciting trends, exciting trends happening with C N C f koo Kahne cloud native cloud native a lot of data, a lot of management, a lot of logging, a lot of observe ability, a lot of end user um contributions and enterprise adoption. So let's get into it first by give us a quick update on fluent D anything upcoming to highlight. >>Yeah, well fluent is actually turning two years old right now. So it's the more metric project that we have a lot of management and processing in the market. And we're really happy to see that the sides are project that was started 10 years ago, its adoption. You can see continues growing ecosystem from a planning perspective and companies adopting the technology that that is really great. So it's very overwhelming and actually really happy to take this project and continue working with companies, individuals and and right now what is the position where we are now with through And these are part of the Roma is like one of the things that people is facing not because of the tool because people have every time there has more data, more Metro services the system are scaling up is like about performance, right? And performance is critical if you're slowing down data processing actually you're not getting the data at the right time where you need it right. Nobody's people needs real time query is real time analysis. So from a security perspective we're going to focus a lot on everything that is about performance I would say for this year and maybe the other one, I would say that we won't see many new futures around fluently itself as as a project so we'll be mostly about back texting and performance improvements. >>Yeah, I definitely want to dig in with you on the data and logging challenges around kubernetes especially with and to end workflows and there's the different environments that sits in the middle of. But first before we get there, just take a minute to explain for the folks um not that savvy with fluent bit. What is fluent bit real quick, explain what it is. >>Okay, so I will start with a quick story about this, so when we started flowing the, we envision that at some point I'm talking about six years ago, right, all this IOT train or embedded or h will be available and for that you we got back to heavy right? If you have a constraint environment or you want to process data in a more faster way without all the capabilities at that time we say that he might not be suitable for that. So the thing is okay and it was not longer like a single software piece right? We want to say through in this an ecosystem, right? And as part of the ecosystem we have sck where people can connect applications fluid the but also we say we need like a flu Indie but that could be lightweight and faster. Burundi is reading ruby right? And the critical part in C. But since it's written ruby of course there's some process calls on how do you process the data and how much you can scale? Right. So we said if you're going to dig into embedded or small constrained environment, let's write a similar solution. But in C language so we can optimize a memory, can optimize scenario and all this kind of um needs will be will will be effective, right? And we started to spread called fluent bed and through a bit it's like a nowadays like a lightweight version of Wendy, it has started for the Marilyn knows, but after a few years people from the cloud space, I'm talking about containers, kubernetes, they started to ask for more futures for flowing it because they wanted they have influence, but also they wanted to have flowing better than because of it was lively and nowadays we can see that what fluent established the market and true indeed, we're getting around $2 million dollars every single day. So nowadays the attraction of the break is incredible. And it's mostly used to um want to collect logs from the files from system be and for most of coordinated environment disabled, process all this information on a pen, meta data and solve all the problem of how do I collect my data? How do I make sure that the data has the right context meta data and I'm able to deliver this data. So a central place like a job provider or any kind of storage. >>That's great. And I love the fact that's written C, which kind of gives the, I'll say it more performance on the code. Less overhead, get deeper closer um and people No, no, see it's high performance, quick, quick stats. So how old is the project through a bit, What version are you on? >>Uh, a little bit. It's, I'm not sure it is turning six or seven this year, 96. It's been around >>for a while. >>Yeah, yeah. We just released this this week, one at 73 right. We have done more than 100 releases actually really settled two and it's pretty past sometimes we have releases every 23 weeks. So the operation, the club medical system is quite fast. People once and more future more fixes and they don't want to wait for a couple of months for the next release. They wanted to have the continue image right away to test it out and actually sends away as a project. We worked with most of providers like AWS Microsoft actor google cloud platform, the demon for this fixes and improvements are in a weekly basis. >>You guys got a lot of props, I was checking around on the internet, you guys are getting strong um, reviews on logging for kubernetes with the couple releases ago, you had higher performance improvements for google AWS logged in postgres equal and other environments. Um but the question that I'm getting and I'm hearing from folks is, you know, I have end to end workflows and they've been steady. They've been strong. But as more data comes in and more services are connecting to it from network protocols, two Other cloud services, the complexity of what was once a straight straightforward workflow and to end is impacted by this new data. How do you guys address that? How would you speak to that use case? >>Well, for for us data we have taken approaches. Data for us is agnostic on the way that it comes from but that it comes from and the format that comes from for for example, if you talk about the common uses case that we have now is like data come from different formats. Every single developer use the all looking format come from different channels, TCP file system or another services. So it is very, very different. How do we get this data? And that is a big challenge. Right? How do we take data from different sources, different format and you try to unify this internal and then if you're going to talk for example to less exert let's say you Jason you're going to talk to africa, they have their own binary protocol. So we are kind of the backbone that takes all the data transfer data and try to adapt to the destination expected payload from a technical perspective. Yeah, is really challenging. Is really challenging also that Nowadays, so two years ago people was finding processing, I don't know 500,000 messages per second, But nowadays they won 10, 20 40,000. So prime architecture perspective Yeah, there are many challenges and and I think that the teamwork from the maintaining this and with companies has provided a lot of value, a lot of value. And I think that the biggest proof here is that the adoption like adoption and big adoption, you have more banks reported more enhancement requests. All right. So if I get >>this right, you got different sources of data collection issues. If you look on the front end and then you got some secret sauce with bit fluent, I mean uh inside the kubernetes clusters um and then you deliver it to multiple services and databases and cloud services. That that right. Is that the key? The key value is that is that the key value proposition? Did I get that right with fluent bit? >>Mhm. Yeah, I would say most of the technical implementation when the of the value of the technical implementation, I would say that is towards being the vendor neutral. Right? So when you come, when you go to the market and you go to the talk to bank institution hospital form and if the company right, most of them are facing this concept of bender looking right, they use a Bender database but you have to get married. So they're tooling, right? And I'm not going to mention any inventor name. Right? Actually it's very fun. Well for example, the business model, this company that start with S and ends with swung right? For example is you pay as much money so you pay as much money compared to the data that you ingested. But the default tools in just the whole data. But in reality if you go to the enterprise they say yeah. I mean just in all my data into Splunk or X provider right? But from 100 that I'm interesting, which I'm paying for, I'm just using this service to query at least 20 of the data. So why I mean just in this 80 extra I didn't get it right. That's why I want to send and this is real use case there's this language is really good for where is analyzed the data But they said yeah, 80 of my data is just a five data. I will need it maybe in a couple of months just I want to send it to Amazon history or any kind of other a archive service. So users, the value that says is that I want to have a mentor neutral pipeline which me as a user, I went to this side work went to send data, went to send it and also I can come to my bills. Right? And I think that is the biggest value. So you can go to the market. They will find maybe other tools for logging or tools for Matrix because there's a ton of them. But I think that none of them can say we are gender neutral. Not all of them can offer this flexibility to the use, right? So from a technical language performance but from an end user is being the neutrality. >>Okay. So I have to ask you then here in the C n C F projects that are going on and the community around um um fluent bit, you have to have those kinds of enhancements integrations, for instance, for not only performance improvement, but extensive bility. So enterprises there, they want everything right. They make things very >>complicated. They're very >>complicated infrastructure. So if they want some policy they want to have data ingestion policies or take advantage of no vendor lock in, how is the community responding? How did what's your vision for helping companies now? You've got your new venture and you got the open source project, How does this evolve? How do you see this evolving eduardo? Because there is a need for use cases that don't need all the data, but you need all the data to get some of the data. Right. So it's a you have a new new >>paradigm of >>coding and you want to be dynamic and relevant. What's the how do you see this evolving? >>Yeah. Actually going to give you some spoilers. Right. So some years before report. Yeah. So users has this a lot of they have a lot of problems how to collect the data processing data and send the data. We just told them right, Performance is a continuous improvement, Right? Because you have always more data, more formats, that's fine. But one critical thing that people say, hey, you say, hey, I want to put my business logic in the pipeline. So think about this if you have to embed we are the platform for data. Right? But we also provide capabilities to do data processing because you can grab the data or you can do custom modifications over the data. One thing that we did like a year two years ago is we added this kind of stream processing capabilities, can you taste equal for Kaka? But we have our own sequel engine influence them. So when the data is flowing without having any data banks, any index or anything, we can do data aggregation. You can, you can put some business logic on it and says for all the data that matches this pattern, stand it to a different destination, otherwise send it to caracas plan or elastic. So we have, this is what we have now. Extreme processing capabilities. Now what is the spoiler and what we're going next. Right now there are two major areas. One of them is distributed. Extreme processing right? The capabilities to put this intelligence on the age, on the age I'm referring to for example, a cooper needs note right or constrained environment, right? Communities on the age is something that is going on. There are many companies using that approach but they want to put some intelligence and data processing where the data is being generated. Because there is one problem when you have more data and you want to create the data, you have to wait and to centralize all the data in the database for your service. And there's a legend see right, millions sometimes hours because data needs to be in Mexico. But what about it? To have 100 of notes, but each one is already right, influenced it. Why you don't run the queries there. That is one of the features that we have. And well now talking from the challenges from spoil perspectives, people says, okay, I love this pipeline. I noticed Lambert has a political architecture but the language see it's not my thing, right? I don't want to go and see. Nobody likes see that we are honest about that. And there are many mass words about security or not just nothing, which is true, right? It's really easy to mess up things and see. Right? So, and we said, okay, so now our next level, it's like we're going to provide this year the ability to write your own plug ins in Western webassembly. So with the web is simply interface. You can run your own pregnancy goal, rust or any kind of weapon sending support language and translate that implementation to native. Wasn't that fluent that will understand. So C as a language won't be with one being longer uploaded for you as a developer. As a company that wants to put more business logic into the bike. Well that is one of the things that are coming up and really we already have some docs but they're not ready to show. So maybe we can expect something for us at the end of this year. >>Great stuff by the way, from a c standpoint us, old timers like me used to program and see, and not a lot of C courses being taught, but if you do know see it's very valuable. But again, to your point, the developers are are focused on coding the apps, not so much the underlying. So I think that's that's key. I will like to ask you one final question of water before we wrap up, how do you deploy fluid bid? What's the is it is that you're putting it inside the cluster? Is there is that scripts, What's the what's the architecture real quick? Give us a quick overview of the architecture. >>Okay, so that it's not just for a classroom, you can run it on any machine. Windows, Linux, IBM Yeah, and that doesn't need to be a kubernetes. Classic. Right? When we created to invade Copernicus was quite new at the same time. So if you talk about kubernetes deploys as a demon set at the moment is pretty much a part that runs on every note like an agent. Right? Uh, all you can run necessarily on any kind of machine. Oh and one thing before we were, I just need to mention something that from the spoil it. But because it's just getting, we're having many news these days. Is that fluently used to be mostly for logging right? And influence the specifically project. We've got many people from years ago saying, you know what? I'm losing my agent for logging to a bed but I have my agents for metrics and sometimes this is quite heavy to have multiple agents on your age. So now flowing bed is extending the capabilities to deal with native metrics. Right. The first version will be available about this week in cuba come right. We will be able to process host matrix for application metrics and send them to permit use with open matrix format in a native way. So we extended the political system to be a better citizen with open metrics and in the future also with open telemetry, which is a hot thing that is coming up on this month. >>Everyone loves metrics. That's super important. Having the data Is really, really important as day two operations and get all this stuff is happening. I wanna thank you for coming on and sharing the update and congratulations on. The new venture will keep following you and look good for the big launch but fluent bit looking good. Congratulations. Thanks for coming on. >>Thank you so much help governments. >>Okay this is the cubes coverage of Kublai khan 21 cloud Native Con 21 virtual soon we'll be back in real life at the events extracting the signal from the noise. Thanks for watching. Yeah.

>> Narrator: Live from Santa Clara, California it's theCUBE. Covering Open Networking Summit 2017. Brought to you by the Linux Foundation. >> Hey welcome back everybody, Jeff Frick here with theCUBE. We're in Santa Clara at the Open Networking Summit 2017. We haven't been here for a couple years. Obviously Open is everywhere. It's in hardware, it's in compute, it's in store, and it's certainly in networking as well. And we're excited to be joined first off by Scott Raynovich who will be co-hosting for the next couple of days. Good to see you again Scott. >> Good to see you. >> And our next guest is Ihab Tarazi. He's the EVP and CTO of Equinix. Last time we saw Ihab was at Open Compute Project last year, so great to see you again. >> Yeah, thank you very much, good to be here. I really enjoyed the interview last year so thanks for having me again. >> Now you set it at the high bar, so hopefully we can pull it off again. >> We can do it. >> So first off for folks that aren't familiar with Equinix, give them kind of an overview. Because you don't have quite the profile of Amazon and Google and the other cloud providers, but you're a pretty important piece of the infrastructure. >> Ihab: Yeah absolutely. While we're nowhere close to the size of those players, the place we play in the universe is very significant. We are the edge of the cloud, I would say. We enable all these players, they're all our biggest customers. As well all the networks are our biggest customers. We have over 2,000 clouds in our data centers and over 1,400 networks. We have one of the largest global data center networks. We have 150 data centers and four eMarkets around the world. And that number is going to get a little bigger. Now we announce the acquisition of Verizon data center assets. So we'll have more data centers and a few more markets. >> I heard about the Verizon acquisition, so congratulations, just adding more infrastructure. But let's unpack it a little bit. Two things I want to dig into. One is you said you have clouds in your data centers. So what do you mean by that? >> Yeah the way the cloud architecture is deployed is that the big cloud providers will have these big data centers where they build them themselves and it hosts the applications. And then they work with an edge for the cloud. Either a caching edge or compute edge, or even a network edge in data centers like ours where they connect to all their enterprise customers and all the networks. So we have a significant number of edges, we have 21 markets around the world. We have just about the big list of names, edges, that you can connect to automatically. From AWS, Google, Microsoft, Salesforce.com, Oracle, anybody else you think of. >> So this is kind of an extension of what we heard back a long time ago with you guys and like Amazon specifically on this direct connect. So you are the edge between somebody else's data center and these giant cloud providers. >> Absolutely. And since the last time we talked, we've added a lot more density. More edge nodes and more markets and more new cloud providers. Everywhere from the assess to the infrastructure as a service provider. >> And why should customers care? What's the benefit to your customers for that? >> Yeah the benefit is really significant. These guys want direct access to the cloud for high performance and security. So everybody wants to build the hybrid cloud. Now it's very clear the hybrid cloud is the architecture of choice. You want to build a hybrid cloud, then you want to deploy in a data center and connect to the cloud. And the second thing that's happening, nobody's using just one cloud. Everybody's doing a multi-cloud. So if you want 40, 50 clouds like most companies do, most CIOs, then you're going to want to be in a data center that has as many as possible. If you're going to go global, connect to multi-cloud and have that proximity, you're going to have a hard time finding somebody like Equinix out there. >> Yeah but I've got a question. You mentioned the Verizon deal. There was a trend for a while where all these big service providers were buying data centers, including AT&T, CenturyLink, and now the trend appears to have reversed. Now they're selling the data centers that they bought. I'd love your insight on that. Why that just wasn't their core competency? Why are the selling them back to people like Equinix. >> Yeah that's a good question. What's happened over time as the cloud materialized, is the data canters are much more valuable if they're neutral. If you can come in and connect to all the clouds and all the networks, customers are much more likely to come in. And therefore if a data center is owned by a single network, customers are not as likely to want to use it because they want to use all the networks and all the clouds. And our model of neutrality and how we set up exchanges, and how we provide interconnection, and the whole way we do customer service, is the kind of things people are looking for. >> So you're the Switzerland of the cloud. >> And so the same assets become much more valuable in this new model. >> And I don't know if people understand quite how much direct connection and peer-to-peer, and how much of that's going on, especially in a business-to-business context to provide a much better experience. Versus you know the wild wooly internet of days of old where you're hopping all over the place, Lord knows how many hops you're taking. A lot of that's really been locked down. >> I think the most important step people can think about is by 2020 90% of all the internet, or at least 80 to 90, will be home to the top 10 clouds. Therefore the days of the wild internet, while that continues to be significant, the cloud access and interconnection is very critical, and continues to be even bigger. >> Go ahead. >> So tell us what the logistics are of managing the growth, like you opening how many data centers a year, and how much equipment are you moving into these data centers. We spend over a billion dollars a year on upgrading, adding capacity, and building new data centers. We usually announce five, six, new ones a year. We usually have 20 plus projects, if not more, active at any time. So we have a very focused process and people across the globe manage this thing. We don't want to go dark in any of our key matters like Washington DC, the D.C. market, or let's say the San Jose, Silicon Valley, etc. Because customers want to come in and continue to add and continue to bring people. And that means not only expanding the existing data centers, but buying land and building more data centers beside it, and continue to expand where we need to. And then every year or so we go into one or two more emerging markets. We went into Dubai a while ago and we continue to develop it. And those become long term investments to continue to build our global infrastructure. The last few years we've made massive acquisitions between Telecity in Europe, Bit-isle in Japan, and now the Verizon assents that expanded our footprint significantly into new markets, Eastern Europe, give us bigger markets in places like Tokyo which helped us get to where we are today. >> One of the themes in networking and cloud in general is that the speed of light is just too damn slow. At the end of the day, stuff's got to travel and it actually takes longer than you would think. So does having all these, increased presence, increased egos, increased physical locations, help you address some of that? Because you've got so many more points kind of into this private network if you will. >> Oh yeah absolutely. The content has become more and more localized by market. And the more you have things like IOT and devices pulling in more data, not all the data needs to go all over the globe. And also there is now jurisdiction and laws that require some of the content to stay. So the market approach that we have is becoming the center of mass for where the data resides. And once the data gets into our data center, the value of the data is how you exchange it with other pieces of information, and increasingly how you make immediate decisions on it, you know with automation and machine learning. So when you go to that environment you need massive capacity, very low latency, to many data warehouses or data lakes, and you want to connect that to the software that can make decisions. So that's how we see the world is evolving now. One thing we see though is that complementing that will be a new edge that will form. A lot of people in this conference were talking about that. A lot of the discussion about the open networks here is how we support the 5G, all the explosion of devices, and what we see that connecting to that dense market approach that we have where the data is housed. >> That's interesting you just mentioned all the devices which was going to be my next question. So the internet of things, how will this change the data center edge, as you refer to it? >> Yeah that's the biggest question in the industry, especially for networks. And the same discussion happened at Mobile Work Congress here a little while ago. People now believe that there'll be this compute edge, that the network will be a compute edge. Because you want to be able to put compute, keep pushing it out all the way to the edge. And that edge needs to support today's technologies but also all the open wireless spectrum, all the low powered networks, open R which is one of the frequencies for the millimeter frequencies, and also the 5G as you know. So when you add all that up you're going to need this edge to support. So all the different wireless options plus some amount of compute, and that problem is very hard to solve without an open source model, which is where a lot of people are here looking for solutions. >> It's interesting because your definition of the edge feels like it's kind of closer to the cloud where's there's a lot of converstion, we do a lot of stuff with GE about the edge, which is you know right out there on the device and the sensor. Because as you said depending on the application, depending on the optimization, depending on what you're trying to do, the device is some level of compute and store that's going to be done locally, and some of it will go upstream and get processed and come downstream. But you're talking about a different edge. Or you know of see you guys extending all the way down to that edge. >> We don't see ourselves extending at this time but definitely it's something we're spending a lot of time analyzing to see what happens. I would say a couple of big stats is that today our edge is maybe 100 milliseconds from devices in a market or a lot less in some cases. The new technology will make that even shorter. So with the new technology like you said, you can't beat the speed of light, but with more direct connections you'll get to 40, 50 milliseconds, which is fantastic for the vast majority of applications people want. There'll be very few applications that need much slower latency all the way down to the sub-10 millisecond. For those somebody like a network would need to put compute at the edge to do some of it. So that world of both types will continue. But even the ones that need the very low latency, for some of the data it still needs to compare it to other sources of data and connect to clouds and networks but some of the data will still come back to our data centers. So I think this is how we see the world evolving but it's early days and a lot of brain power will be spent on that. >> So as you look forward to 2017, what are some of the big items on your plate that you're trying to take down for this calendar year? >> The biggest thing I want on our list is that we have an explosion of software model. Everybody who was a software now has a software platform. When we were at OCP for example you saw NetApp, they showed their software as an open source. Every single company from security to storage, even networking, are now creating their platform available as a software. Well those platforms have no place to go today. They have no deployment model. So one of the things we are working on is how we create a deployment model for this as a service model. And most of them is open source, so it needs decoupling of software and hardware. So we are really actively working with all these to create an open source software and just software in general, ecosystem plus this whole open source hardware. >> So do you guys have a pretty aggressive software division inside Equinix, especially in these open source projects? Or how do you kind of interact with them? >> Our model is to enable the industry. So we have some of our tools but mostly for enabling customers and customer service, as well as some of the basic interconnection we do. The vast majority of all the stuff is our partners, and these are our customers. So our model is to enable them and to connect them to everybody else they need at ecosystem to succeed and help them set up as a service model. And as the enterprise customers come to our data center, how to they connect to them. So I would say that's one of the most sought after missions when we go to conferences like this. Everybody who announced today is talking to us about how they enable the announcements they make and given our place in the universe, we would be a very key player in enabling that ecosystem. >> Do you have like a special lab where you test these new technologies? Or how do you do that? >> Yeah that's the plan. And we connect this effort to also what we're doing with OCP and Telecom Infrastructure Project where we have a leadership position and highly engaged. We are creating a lab environment where people can come in and test not only the hardware from TIP and OCP, but also the software from open network, but many other open source software in general under the Linux Foundation or others. In our situation not only can they test it against each other, but they can test the performance against the entire world. How does this work with the internet, the cloud? And that leading us to deployment and go to market models that people are looking for. >> Alright sounds pretty exciting. Equinix, a company that probably handles more of your internet traffic than you ever thought. >> Ihab: That's very true. >> Well thanks again for stopping by. We'll look for you at our next open source show. >> Thank you very much. >> Ihab Tarazi from Equinix. He's Scott Raynovich, I'm Jeff Frick, you're watching theCube from Open Networking Summit 2017, see you next time after this short break. (techno music)