>> Narrator: From around the globe, it's theCUBE, covering Fortinet Security Summit brought to you by Fortinet. >> Welcome to theCUBE. I'm Lisa Martin. We are live at the Fortinet Championship, the PGA Tour Kickoff to the 2021-2022 FedEx Regular Season Cup. And this is so exciting to be here with Fortinet, to be at an in-person event, and to be talking about a very important topic of cybersecurity. One of our alumni is back with me, Sandra Wheatley is here, the SVP of Marketing, Threat Intelligence, and Influencer Communications at Fortinet. Sandra, it's great to see you. >> You too, Lisa. Thank you for having me. >> This is a great event. >> Yeah, it's awesome, yeah. >> Great to be outdoors, great to see people again, and great for Fortinet for being one of the first to come back to in-person events. One of the things I would love to understand is here we are at the PGA tour, what's the relationship with Fortinet and the PGA Tour? >> Well, first of all, I think the PGA tour is an amazing brand. You just have to look around here and it's extremely exciting, but beyond the brand, there's a lot of synergies between the PGA tour and Fortinet CSR initiatives, particularly around STEM, diversity inclusion, as well as veterans rescaling. And so some of the proceeds from the Fortinet Championship will go to benefit local nonprofits and the local community. So that's something we're very excited about overall. >> Lisa: Is this a new partnership? >> It is a new partnership and we will be the Fortinet Championship sponsor for about the next five years. So we're looking forward to developing this partnership and this relationship, and benefiting a lot of nonprofits in the future. >> Excellent, that's a great cause. One of the things, when you and I last saw each other by Zoom earlier in the summer, we were talking about the cybersecurity skills gap. And it's in its fifth consecutive year, and you had said some good news on the front was that data show that instead of needing four million professionals to fill that gap, it's down to three, and now there's even better news coming from Fortinet. Talk to me about the pledge that you just announced to train one million people in the next five years. >> Absolutely, we're very excited about this. You know, Fortinet has been focused on reducing the skills gap for many years now. It continues to be one of the biggest issues for cybersecurity leaders if you think about it. You know, we still need about 3.1 million professionals to come into the industry. We have made progress, but the need is growing at about 400,000 a year. So it's something that public and private partnerships need to tackle. So last week we did announce that we are committed to training a million professionals over the next five years. We're very excited about that. We're tackling this problem in many, many ways. And this really helps our customers and our partners. If you really think about it, in addition to the lack of skills, they're really tackling cybersecurity surface that's constantly changing. In our most recent FortiGuard's threat report, we saw that ransomware alone went up 10 times over the last year. So it's something that we all have to focus on going forward. And this is our way of helping the industry overall. >> It's a huge opportunity. I had the opportunity several times to speak with Derek Manky and John Maddison over the summer, and just looking at what happened in the first half, the threat landscape, we spoke last year, looking at the second half, and ransomware as a service, the amount of money that's involved in that. The fact that we are in this, as Fortinet says, this work from anywhere environment, which is probably going to be somewhat persistent with the attack surface expanding, devices on corporate networks out of the home, there's a huge opportunity for people to get educated, trained, and have a great job in cybersecurity. >> Absolutely, I like to say there's no job security like cybersecurity, and it is. I mean, I've only been in this industry about, I'm coming up on six years, and it's definitely the most dynamic industry of all of the IT areas that I've worked in. The opportunities are endless, which is why it's a little bit frustrating to see this big gap in skills, particularly around the area of women and minorities. Women make up about 20%, and minorities are even less, maybe about 3%. And so this is a huge focus of ours. And so through our Training Advancement Agenda, our TAA initiative, we have several different pillars to attack this problem. And at the core of that is our Network Security Expert Training or NSC training and certification program. We made that freely available to everybody at the beginning of COVID. It was so successful, at one point we we're seeing someone register every five minutes. And that was so successful, we extended that indefinitely. And so to date, we've had about almost 700,000 certifications. So it's just an amazing program. The other pillars are Security Academy Program, where we partner with nonprofits and academia to train young students. And we have something like 419 academies in 88 countries. >> Lisa: Wow. >> And then the other area that's very important to us is our Veterans Program. You know, we have about 250,000 veterans every year, transfer out of the service, looking for other jobs in the private sector. And so not only do we provide our training free, but we do resume building, mentoring, all of these types of initiatives. And we've trained about 2,000 veterans and spouses, and about 350 of those have successfully got jobs. So that's something we'll continue to focus on. >> That's such a great effort. As the daughter of a Vietnam combat veteran, that really just hits me right in the heart. But it's something that you guys have been dedicated for. This isn't something new, this isn't something that is coming out of a result of the recent executive order from the Biden administration. Fortinet has been focused on training and helping to close that gap for a while. >> That's exactly true. While we made the commitment to train a million people on the heels of the Biden administration at Cybersecurity Summit about two weeks ago, we have been focused on this for many years. And actually, a lot of the global companies that were part of that summit happened to be partners on this initiative with us. For example, we work with the World Economic Forum, IBM, and Salesforce offer our NSC training on their training platforms. And this is an area that we think it's really important and we'll continue to partner with larger organizations over time. We're also working with a lot of universities, both in the Bay Area, local like Berkeley, and Stanford and others to train more people. So it's definitely a big commitment for us and has been for many years. >> It'll be exciting to see over the next few years, the results of this program, which I'm sure will be successful. Talk to me a little bit about this event here. Fortinet is 100% partner driven company, more than 300 or so partners and customers here. Tell me a little bit about what some of the interesting topics are that are going to be discussed today. >> Sure, yeah, so we're delighted to bring our partners and customers together. They will be discussing some of the latest innovations in cybersecurity, as well as some of the challenges and opportunities. We are seeing, you know, during COVID we saw a lot of change with regards to cybersecurity, especially with remote working. So we'll discuss our partnership with LYNX that we just announced. We'll also be talking about some of the emerging technologies like CTNA, 5G, SASE, cloud, and really understanding how we can best help protect our customers and our partners. So it's very exciting. In addition to our Technology Summit, we have a technology exhibition here with many of our big sponsors and partners. So it's definitely going to be a lot of dynamic conversation over the next few days. >> We've seen so much change in the last year and a half. That's just an understatement. But one of the things that you touched on this a minute ago, and we're all feeling this is is when we all had to shift to work from home. And here we are using corporate devices on home networks. We're using more devices, the edge is expanding, and that became a huge security challenge for enterprises to figure out how do we secure this. Because for some percentage, and I think John Maddison mentioned a few months ago to me, at least 25% will probably stay remote. Enterprises have to figure out how to keep their data secure as people are often the weakest link. Tell me about what you guys announced with LYNX that will help facilitate that. >> Well, we're announcing an enterprise grade security offering for people who are working remotely. And the nice thing about this offering is it's very easy to set up and implement, so consumers and others can easily set this up. It also provides a dashboard for the enterprise, IT organization to, they can see who's on the network, devices, everything else. So this should really help because we did see a big increase in attacks, really targeting remote workers. As cyber criminals try to use their home as a foothold into the enterprise. So we're very excited about this partnership, and definitely see big demand for this going forward. >> Well, can you tell me about the go-to market for that and where can enterprises and people get it? >> Well, we're still working through that. I know you'll talk with John later on, he'll have more details on that. But definitely, we'll be targeting both of our different sets of customers and the channel for this. And I definitely think this is something that will, it's something that enterprises are definitely looking for, and there'll be more to come on this over the next few months. >> It's so needed. The threat landscape just exploded last year, and it's in a- >> Sandra: Yeah, absolutely. >> Suddenly your home. Maybe your kids are home, your spouse is working, you're distracted, ransomware, phishing emails, so legitimate. >> Sandra: They do. >> Lisa: But the need for what you're doing with LYNX is absolutely essential these days. >> Sandra: Yeah, these threats are so sophisticated. They're really difficult. And the other thing we did in addition to LYNX was as we got into COVID, we saw that, or the most successful organizations were really using this as an opportunity to invest for the longterm in cybersecurity. We also saw that, and this continues to be the case that, the insider threat continues to be one of the biggest challenges, where an employee will accidentally hit on a phishing email. So we did roll out an infosec awareness training, and we made that free for all of our customers and partners. So we're trying to do everything we can to really help our customers through this demanding time. >> Lisa: Right, what are some of the feedback that you're hearing from customers? I'm sure they're very appreciative of the education, the training, the focus effort from Fortinet. >> Sandra: Absolutely, it's definitely huge. And more and more we're seeing partners who want to work with us and collaborate with us on these initiatives. We've had a really positive response from some of the companies that I mentioned earlier, some of the big global names. And we're very excited about that. So we feel like we have some key initiatives on pillars, and we'll continue to expand on those and bring more partners to work with us over time. >> Lisa: Expansion as the business is growing amazingly well. Tell me a little bit about that. >> Sandra: Yeah, I think, in our last quarter we announced our largest billings growth for many, many years. And so, Fortinet, we're been very fortunate over the last few years, has continued to grow faster than the market. We now have half a million customers, and I think our platform approach to security is really being adopted heavily. And we continue to see a lot of momentum, especially around our solutions like SD-WAN. I think we're the only vendor who provides security in SD-WAN appliance. And so that's been a key differentiator for us. The other thing that's increasingly important, especially with the rollout of 5G is performance. And, you know, Fortinet, from the very beginning, created its own customized ASX or SPU, which really provides the best performance in security compute ratings in the industry. So all of this is really helping us with our growth, and we're very excited about the opportunities ahead. >> Lisa: And last question, on that front, what are some of the things that you're excited about as we wrap up 2021 calendar year and go into 2022? >> Sandra: Well, this been very exciting year for Fortinet. And I think we're in a great position to take advantage of many of the different growth areas we're seeing in this new and changing space. And, you know, we're all on board and ready to take advantage of those opportunities, and really fire ahead. >> Lisa: Fire ahead, I like that. Sandra, thank you so much for joining me today, talking about the commitment, the long standing commitment that Fortinet has to training everybody from all ages, academia, veterans, to help close that cybersecurity skills gap. And such an interesting time that we've had. There's so much opportunity, and it's great to see how committed you are to helping provide those opportunities to people of all ages, races, you name it. >> Sandra: Thank you, Lisa, I really appreciate it. >> Lisa: Ah, likewise. For Sandra Wheatley, I'm Lisa Martin. You're watching theCube at the Fortinet Championship Security Summit. (soft bright music)

>>from around the globe. It's the >>cube with digital >>coverage of IBM >>Think 2021 brought to you >>by IBM. Welcome back everyone to the cube coverage of IBM Think 2021 virtual um john for your host of the cube. Our next guest taylor Holloway. Chief technology officer at advent one. Tyler welcome to the cube from down under in Australia and we're in Palo alto California. How are you? >>Well thanks john thanks very much. Glad to be glad to be on here. >>Love love the virtual cube of the virtual events. We can get to talk to people really quickly with click um great conversation here around hybrid cloud, multi cloud and all things software enterprise before we get started. I wanna take a minute to explain what you guys do at advent one. What's the main focus? >>Yeah. So look we have a lot of customers in different verticals. Um so you know generally what we provide depends on the particular industry the customers in. But generally speaking we see a lot of demand for operational efficiency, helping our clients tackle cyber security risks, adopt cloud and set them up to modernize the applications. >>And this is this has been a big wave coming in for sure with you know, cloud and scale. So I gotta ask you, what are the main challenges that you guys are solvent for your customers um and how are you helping them overcome come that way and transformative innovative way? >>Yeah, look, I think helping our clients um improve their security posture is a big one. We're finding as well that our customers are gaining a lot of operational efficiency by adopting sort of open source technology red huts an important partner of ours as his IBM um and we're seeing them sort of move away from some more proprietary solutions. Automation is a big focus for us as well. We've had some great outcomes with our clients or helping them automate um and you know, to live up um you know the stand up and data operations of environments a lot quickly a lot more easily and uh and to be able to sort of apply some standards across multiple sort of areas of their I. T. Estate. >>What are some of the solutions that you guys are doing with IBM's portfolio on the infrastructure side, you got red hat, you've got a lot of open source stuff to meet the needs of clients. What do you mean? What's the mean? >>Uh Yeah I think on the storage side will probably help our clients sort of tackle the expanding data in structured and particularly unstructured data they're trying to take control of so you know, looking at spectrum scale and those type of products from an audio perspective for unstructured data is a good example. And so they're flush systems for more block storage and more run of the mill sort of sort of environments. We have helped our clients consolidate and modernize on IBM power systems. Having Red Hat is both a Lynx operating system and having open shift as a container platform. Um really helps there. And Red Hat also provides management overlay, which has been great on what we do with IBM power systems. We've been working on a few different sort of use cases on power in particular. More recently, SAP Hana is a big one where we've had some success with our clients migrating Muhanna on to onto IBM power systems. And we've also helped our customers, you know, improve some um some environments on the other end of the side, such as IBM I, we still have a large number of customers with, with IBM I and and you know how do we help them? You know some of them are moving to cloud in one way or another others are consuming some kind of IRS and we can sort of wrap around a managed service to to help them through. >>So I gotta ask you the question, you know U C T. Oh you played a lot of technologies kubernetes just become this lingua franca for this kind of like I'll call a middleware kind of orchestration layer uh containers. Also you're awesome but I gotta ask you when you walk into a client's environment you have to name names but you know usually you see kind of two pictures man, they need some serious help or they got their act together. So either way they're both opportunities for Hybrid cloud. How do you how do you how do you evaluate the environment when you go in, when you walk into those two scenarios? What goes through your mind? What some of the conversations that you guys have with those clients. Can you take me through a kind of day in the life of both scenarios? The ones that are like I can't get the job done, I'm so close in on the right team and the other ones, like we're grooving, we're kicking butt. >>Yeah. So look, let's start well, I supposed to start off with you try and take somewhat of a technology agnostic view and just sort of sit down and listen to what they're trying to achieve, how they're going for customers who have got it. You know, as you say, all nailed down things are going really well. Um it's just really understanding what what can we do to help. Is there an opportunity for us to help at all like there? Um, you know, generally speaking, there's always going to be something and it may be, you know, we don't try and if someone is going really well, they might just want someone to help with a bespoke use case or something very specific where they need help. On the other end of the scale where a customer is sort of pretty early on and starting to struggle. We generally try and help them not boil the ocean at once. Just try and get some winds, pick some key use cases, you know, deliver some value back and then sort of growing from there rather than trying to go into a customer and trying to do everything at once tends to be a challenge. Just understand what the priorities are and help them get going. >>What's the impact been for red hat? Um, in your customer base, a lot of overlap. Some overlap, no overlap coming together. What's the general trend that you're seeing? What's the reaction been? >>Yeah I think it's been really good. Obviously IBM have a lot of focus on cloud packs where they're bringing their software on red hat open shift that will run on multiple clouds. So I think that's one that we'll see a lot more of overtime. Um Also helping customers automate their I. T. Operations with answerable is one we do quite a lot of um and there's some really bespoke use cases we've done with that as well as some standardized one. So helping with day two operations and all that sort of thing. But there's also some really sort of out there things customers have needed to automate that's been a challenge for them and being able to use open source tools to do it has worked really well. We've had some good wins there, >>you know, I want to ask you about the architecture and I'm just some simplify it real. Just for the sake of devops, um you know, segmentation, you got hybrid clouds, take a programmable infrastructure and then you've got modern applications that need to have a I some have said I've even sit on the cube and other broadcast that if you don't have a I you're gonna be at a handicap some machine learning, some data has to be in there. You can probably see ai and mostly everything as you go in and try to architect that out for customers um and help them get to a hybrid cloud infrastructure with real modern application front end with using data. What's what's the playbook? Do you have any best practices or examples you can share or scenarios or visions that you see uh playing >>out? I think you're the first one is obviously making sure customers data is in the right place. So if they might be wanting to use um some machine learning in one particular cloud provider and they've got a lot of their applications and data in another, you know, how do we help them make it mobile and able to move data from one cloud to another or back into court data center? So there's a lot of that. I think that we spend a lot of time with customers to try and get a right architecture and also how do we make sure it's secure from end to end. So if they're moving things from into multiple one or more public clouds as well as maybe in their own data center, making sure connectivity is all set up properly. All the security requirements are met. So I think we sort of look at it from a from a high level design point of view, we look at obviously what the target state is going to be versus the current state that really take into account security, performance, connectivity or those sort of things to make sure that they're going to have a good result. >>You know, one of the things you mentioned and this comes up a lot of my interviews with partners of IBM is they always comment about their credibility and all the other than the normal stuff. But one of the things that comes out a lot pretty much consistently is their experience in verticals. Uh they have such a track record in verticals and this is where AI and machine learning data has to be very much scoped in on the vertical. You can't generalize and have a general purpose data plane inside of vertically specialized kind of focus. How how do you see that evolving, how does IBM play there with this kind of the horizontally scalable mindset of a hybrid model, both on premise in the cloud, but that's still saying provide that intimacy with the data to fuel the machine learning or NLP or power that ai which seems to be critical. >>Yeah, I think there's a lot of services where you know, public cloud providers are bringing out new services all the time and some of it is pre can and easy to consume. I think what IBM from what I've observed, being really good at is handling some of those really bespoke use cases. So if you have a particular vertical with a challenge, um you know, there's going to be sort of things that are pre can that you can go and consume. But if you need to do something custom that could be quite challenging. How do they sort of build something that could be quite specific for a particular industry and then obviously being able to repeat that afterwards for us, that's obviously something we're very interested in. >>Yeah, tell I love chatting whether you love getting the low down also, people might not know your co author of a book performance guy with IBM Power Systems, So I gotta ask you, since I got you here and I don't mean to put you on the spot, but if you can just share your vision or any kind of anecdotal observation as people start to put together their architecture and again, you know, Beauty's in the eye of the beholder, every environment is different. But still, hybrid, distributed concept is distributed computing. Is there a KPI is there a best practice on as a manager or systems architect to kind of keep an eye on what what good is and how how good becomes better because the day to operations becomes a super important concept. We're seeing some called Ai ops where okay, I'm provisioning stuff out on a hybrid Cloud operational environment. But now day two hits are things happen as more stuff entered into the equation. What's your vision on KPs and management? What to keep tracking? >>Yeah, I think obviously attention to detail is really important to be able to build things properly. A good KPI particularly managed service area that I'm curious that understanding is how often do you actually have to log into the systems that you're managing? So if you're logging in and recitation into servers and all this sort of stuff all the time, all of your automation and configuration management is not set up properly. So, really a good KPI an interesting one is how often do you log into things all the time? If something went wrong, would you sooner go and build another one and shoot the one that failed or go and restore from backup? So thinking about how well things are automated. If things are immutable using infrastructure as code, those are things that I think are really important when you look at, how is something going to be scalable and easy to manage going forward. What I hate to see is where, you know, someone build something and automates it all in the first place and they're too scared to run it again afterwards in case it breaks something. >>It's funny the next generation of leaders probably won't even know like, hey, yeah, taylor and john they had to log into systems back in the day. You know, I mean, I could be like a story they tell their kids. Uh but no, that's a good Metro. This is this automation. So it's on the next level. Let's go the next level automation. Um what's the low hanging fruit for automation? Because you're getting at really the kind of the killer app there, which is, you know, self healing systems, good networks that are programmable but automation will define more value. What's your take? >>I think the main thing is where you start to move from a model of being able to start small and automate individual things which could be patching or system provisioning or anything like that. But what you really want to get to is to be able to drive everything through, get So instead of having a written up paper, change request, I'm going to change your system and all the rest of it. It really should be driven through a pull request and have things through it and and build pipelines to go and go and make a change running in development, make sure it's successful and then it goes and gets pushed into production. That's really where I think you want to get to and you can start to have a lot of people collaborating really well on this particular project or a customer that also have some sort of guard rails around what happens in some level of governance rather than being a free for all. >>Okay, final question. Where do you see event one headed? What's your future plans to continue to be a leader? I. T. Service leader for this guy? BMS Infrastructure portfolio? >>I think it comes down to people in the end, so really making sure that we partner with our clients and to be well positioned to understand what they want to achieve and and have the expertise in our team to bring to the table to help them do it. I think open source is a key enabler to help our clients adopt a hybrid cloud model to sort of touched on earlier uh as well as be able to make use of multiple clouds where it makes sense from a managed service perspective. I think everyone is really considering themselves and next year managed service provider. But what that means for us is to provide a different, differentiated managed service and also have the strong technical expertise to back it up. >>Taylor Holloway, chief technology officer advent one remote videoing in from down under in Australia. I'm john ferrier and Palo alto with cube coverage of IBM thing. Taylor, thanks for joining me today from the cube. >>Thank you very much. >>Okay, cube coverage. Thanks for watching ever. Mhm mm

>> Narrator: Live from Boston, Massachusetts, this is theCUBE covering Spark Summit East 2017. Brought to you by Databricks. Now, here are your hosts, Dave Vellante and George Gilbert. >> Everybody the euphoria is still palpable here, we're in downtown Boston at the Hynes Convention Center. For Spark Summit East, #SparkSummit, my co-host and I, George Gilbert, will be unpacking what's going on for the next two days. George, it's good to be working with you again. >> Likewise. >> I always like working with my man, George Gilbert. We go deep, George goes deeper. Fantastic action going on here in Boston, actually quite a good crowd here, it was packed this morning in the keynotes. The rave is streaming. Everybody's talking about streaming. Let's sort of go back a little bit though George. When Spark first came onto the scene, you saw these projects coming out of Berkeley, it was the hope of bringing real-timeness to big data, dealing with some of the memory constraints that we found going from batch to real-time interactive and now streaming, you're going to talk about that a lot. Then you had IBM come in and put a lot of dough behind Spark, basically giving it a stamp, IBM's imprimatur-- >> George: Yeah. >> Much in the same way it did with Lynx-- >> George: Yeah. >> Kind of elbowing it's way in-- >> George: Yeah. >> The marketplace and sort of gaining a foothold. Many people at the time thought that Hadoop needed Spark more than Spark needed Hadoop. A lot of people thought that Spark was going to replace Hadoop. Where are we today? What's the state of big data? >> Okay so to set some context, when Hadoop V1, classic Hadoop came out it was file system, commodity file system, keep everything really cheap, don't have to worry about shared storage, which is very expensive and the processing model, the execution of munging through data was map produced. We're all familiar with those-- >> Dave: Complicated but dirt cheap. >> Yes. >> Dave: Relative to a traditional data warehouse. >> Yes. >> Don't buy a big Oracle Unix box or Lynx box, buy this new file system and figure out how to make it work and you'll save a ton of money. >> Yeah, but unlike the traditional RDBMS', it wasn't really that great for doing interactive business intelligence and things like that. It was really good for big batch jobs that would run overnight or periods of hours, things like that. The irony is when Matei Zaharia, the co-creator of Spark or actually the creator and co-founder of Databricks, which is steward of Spark. When he created the language and the execution environment, his objective was to do a better MapReduce than Radue, than MapReduce, make it faster, take advantage of memory, but he did such a good job of it, that he was able to extend it to be a uniform engine not just for MapReduce type batch stuff, but for streaming stuff. >> Dave: So originally they start out thinking that if I get this right-- >> Yeah. >> It was sort of a microbatch leveraging memory more effectively and then it extended beyond-- >> The microbatch is their current way to address the streaming stuff. >> Dave: Okay. >> It takes MapReduce, which would be big long running jobs, and they can slice them up and so each little slice turns into an element in the stream. >> Dave: Okay, so the point it was improvement upon these big long batch jobs-- >> George: Yeah. >> They're making it batch to interactive in real-time, so let's go back to big data for a moment here. >> George: Yeah. >> Big data was the hottest topic in the world three or four years ago and now it's sort of waned as a buzz word, but big data is now becoming more mainstream. We've talked about that a lot. A lot of people think it's done. Is big data done? >> George: Not it's more that it's sort of-- it's boring for us, kind of pundits, to talk about because it's becoming part of the fabric. The use cases are what's interesting. It started out as a way to collect all data into this really cheap storage repository and then once you did that, this was the data you couldn't afford to put into your terra data, data warehouse at 25,000 per terabyte or with running costs a multiple of that. Here you put all your data in here, your data scientists and data engineers started munging with the data, you started taking workloads off your data warehouse, like ETL things that didn't belong there. Now people are beginning to experiment with business intelligence sort of exploration and reporting on Hadoop, so taking more workloads off the data warehouse. The limitations, there are limitations there that will get solved by putting MPP SQL back-ends on it, but the next step after that. So we're working on that step, but the one that comes after that is make it easier for data scientists to use this data, to create predictive models-- [Dave] Okay, so I often joke that the ROI on big data was reduction on investment and lowering the denominator-- >> George: Yeah. >> In the expense equation, which I think it's fair to say that big data and Hadoop succeeded in achieving that, but then the question becomes, what's the real business impact. Clearly big data has not, except in some edge cases and there are a number of edge cases and examples, but it's not yet anyway lived up to the promise of real-time, affecting outcomes before, you know taking the human out of the decision, bringing transaction and analytics together. Now we're hearing a lot of that talk around AI and machine learning, of course, IoT is the next big thing, that's where streaming fits in. Is it same line new bottle? Or is it sort of the evolution of the data meme? >> George: It's an evolution, but it's not just a technology evolution to make it work. When we've been talking about big data as efficiency, like low cost, cost reduction for the existing type of infrastructure, but when it starts going into machine learning you're doing applications that are more strategic and more top line focused. That means your c-level execs actually have to get involved because they have to talk about the strategic objectives, like growth versus profitability or which markets you want to target first. >> So has Spark been a headwind or tailwind to Hadoop? >> I think it's very much been a tailwind because it simplified a lot of things that took many, many engines in Hadoop. That's something that Matei, creator of Spark, has been talking about for awhile. >> Dave: Okay something I learned today and actually I had heard this before, but the way I phrased it in my tweet, Genomiocs is kicking Moore's Law's ass. >> George: Yeah. >> That the price performance of sequencing a gene improves three x every year to what is essentially a doubling every 18 months for Moore's Law. The amount of data that's being created is just enormous, I think we heard from Broad Institute that they create 17 terabytes a day-- >> George: Yeah. >> As compared to YouTube, which is 24 terabytes a day. >> And then a few years it will be-- >> It will be dwarfing YouTube >> Yeah. >> Of course Twitter you couldn't even see-- >> Yeah. >> So what do you make of that? Is that just the fun fact, is that a new use case, is that really where this whole market is headed? >> It's not a fun fact because we've been hearing for years and years about this study about data doubling every 18 to 24 months, that's coming from the legacy storage guys who can only double their capacity every 18 to 24 months. The reality is that when we take what was analog data and we make it digitally accessible, the only thing that's preventing us from capturing all this data is the cost to acquire and manage it. The available data is growing much, much faster than 40% every 18 months. >> Dave: So what you're saying is that-- I mean this industry has marched to the cadence of Moore's Law for decades and what you're saying is that linear curve is actually reshaping and it's becoming exponential. >> George: For data-- >> Yes. >> George: So the pressure is on for compute, which is now the bottleneck to get clever and clever about how to process it-- >> So that says innovation has to come from elsewhere, not just Moore's Law. It's got to come from a combination of-- Thomas Friedman talks a lot about Moore's Law being one of the fundamentals, but there are others. >> George: Right. >> So from a data perspective, what are those combinatorial effects that are going to drive innovation forward? >> George: There was a big meetup for Spark last night and the focus was this new database called SnappyData that spun out of Pivotal and it's being mentored by Paul Maritz, ex-head of Development in Microsoft in the 90s and former head of VMWare. The interesting thing about this database, and we'll start seeing it in others, is you don't necessarily want to be able to query and analyze petabytes at once, it will take too long, sort of like munging through data of that size on Hadoop took too long. You can do things that approximate the answer and get it much faster. We're going to see more tricks like that. >> Dave: It's interesting you mention Maritz, I heard a lot of messaging this morning that talked about essentially real-time analysis and being able to make decisions on data that you've never seen before and actually affect outcomes. This narrative I first heard from Maritz many, many years ago when they launched Pivotal. He launched Pivotal to be this platform for building big data apps and now you're seeing Databricks and others sort of usurp that messaging and actually seeming to be at the center of that trend. What's going on there? >> I think there's two, what would you call it, two centers of gravity and our CTO David Floyer talks about this. The edge is becoming more intelligent because there's a huge bandwidth and latency gap between these smart devices at the edge, whether the smart device is like a car or a drone or just a bunch of sensors on a turbine. Those things need to analyze and respond in near real-time or hard real-time, like how to tune themselves, things like that, but they also have to send a lot of data back to the cloud to learn about how these things evolve. In other words it would be like sending the data to the cloud to figure out how the weather patterns are changing. >> Dave: Um,humm. >> That's the analogy. You need them both. >> Dave: Okay. >> So Spark right now is really good in the cloud, but they're doing work so that they can take a lighter weight version and put at the edge. We've also seen Amazon put some stuff at the edge and Azure as well. >> Dave: I want you to comment. We're going to talk about this later, we have a-- George and I are going to do a two-part series at this event. We're going to talk about the state of the market and then we're going to release our big data, in a glimpse to our big data numbers, our Spark forecast, our streaming forecast-- I say I mention streaming because that is-- we talk about batch, we talk about interactive/real-time, you know you're at a terminal-- anybody who's as old as I am remembers that. But now you're talking about streaming. Streaming is a new workload type, you call these things continuous apps, like streams of events coming into a call center, for example, >> George: Yeah. >> As one example that you used. Add some color to that. Talk about that new workload type and the roll of streaming, and really potentially how it fits into IoT. >> Okay, so for the last 60 years, since the birth of digital computing, we've had either one of two workloads, they were either batch, which is jobs that ran offline, you put your punch cards in and sometime later the answer comes out. Or we've had interactive, which is originally it was green screens and now we have PCs and mobile devices. The third one coming up now is continuous or streaming data that you act on in near real-time. It's not that those apps will replace the previous ones, it's that you'll have apps that have continuous processing, batch processing, interactive as a mix. An example would be today all the information about how your applications and data center infrastructure are operating, that's a lot of streams of data that Splunk first, took amat and did very well with-- so that you're looking in real-time and able to figure out if something goes wrong. That type of stuff, all the coulometry from your data center, that is a training wheel for Internet things, where you've got lots of stuff out at the edge. >> Dave: It's interesting you mention Splunk, Splunk doesn't actually use the big data term in its marketing, but they actually are big data and they are streaming. They're actually not talking about it, they're just doing it, but anyway-- Alright George, great thanks for that overview. We're going to break now, bring back our first guest, Arun Murthy, coming in from Hortonworks, co-founder at Hortonworks, so keep it right there everybody. This is theCUBE we're live from Spark Summit East, #SparkSummit, we'll be right back. (upbeat music)