Image Title

Search Results for MLOps:

Adam Wenchel, Arthur.ai | CUBE Conversation


 

(bright upbeat music) >> Hello and welcome to this Cube Conversation. I'm John Furrier, host of theCUBE. We've got a great conversation featuring Arthur AI. I'm your host. I'm excited to have Adam Wenchel who's the Co-Founder and CEO. Thanks for joining us today, appreciate it. >> Yeah, thanks for having me on, John, looking forward to the conversation. >> I got to say, it's been an exciting world in AI or artificial intelligence. Just an explosion of interest kind of in the mainstream with the language models, which people don't really get, but they're seeing the benefits of some of the hype around OpenAI. Which kind of wakes everyone up to, "Oh, I get it now." And then of course the pessimism comes in, all the skeptics are out there. But this breakthrough in generative AI field is just awesome, it's really a shift, it's a wave. We've been calling it probably the biggest inflection point, then the others combined of what this can do from a surge standpoint, applications. I mean, all aspects of what we used to know is the computing industry, software industry, hardware, is completely going to get turbo. So we're totally obviously bullish on this thing. So, this is really interesting. So my first question is, I got to ask you, what's you guys taking? 'Cause you've been doing this, you're in it, and now all of a sudden you're at the beach where the big waves are. What's the explosion of interest is there? What are you seeing right now? >> Yeah, I mean, it's amazing, so for starters, I've been in AI for over 20 years and just seeing this amount of excitement and the growth, and like you said, the inflection point we've hit in the last six months has just been amazing. And, you know, what we're seeing is like people are getting applications into production using LLMs. I mean, really all this excitement just started a few months ago, with ChatGPT and other breakthroughs and the amount of activity and the amount of new systems that we're seeing hitting production already so soon after that is just unlike anything we've ever seen. So it's pretty awesome. And, you know, these language models are just, they could be applied in so many different business contexts and that it's just the amount of value that's being created is again, like unprecedented compared to anything. >> Adam, you know, you've been in this for a while, so it's an interesting point you're bringing up, and this is a good point. I was talking with my friend John Markoff, former New York Times journalist and he was talking about, there's been a lot of work been done on ethics. So there's been, it's not like it's new. It's like been, there's a lot of stuff that's been baking over many, many years and, you know, decades. So now everyone wakes up in the season, so I think that is a key point I want to get into some of your observations. But before we get into it, I want you to explain for the folks watching, just so we can kind of get a definition on the record. What's an LLM, what's a foundational model and what's generative ai? Can you just quickly explain the three things there? >> Yeah, absolutely. So an LLM or a large language model, it's just a large, they would imply a large language model that's been trained on a huge amount of data typically pulled from the internet. And it's a general purpose language model that can be built on top for all sorts of different things, that includes traditional NLP tasks like document classification and sentiment understanding. But the thing that's gotten people really excited is it's used for generative tasks. So, you know, asking it to summarize documents or asking it to answer questions. And these aren't new techniques, they've been around for a while, but what's changed is just this new class of models that's based on new architectures. They're just so much more capable that they've gone from sort of science projects to something that's actually incredibly useful in the real world. And there's a number of companies that are making them accessible to everyone so that you can build on top of them. So that's the other big thing is, this kind of access to these models that can power generative tasks has been democratized in the last few months and it's just opening up all these new possibilities. And then the third one you mentioned foundation models is sort of a broader term for the category that includes LLMs, but it's not just language models that are included. So we've actually seen this for a while in the computer vision world. So people have been building on top of computer vision models, pre-trained computer vision models for a while for image classification, object detection, that's something we've had customers doing for three or four years already. And so, you know, like you said, there are antecedents to like, everything that's happened, it's not entirely new, but it does feel like a step change. >> Yeah, I did ask ChatGPT to give me a riveting introduction to you and it gave me an interesting read. If we have time, I'll read it. It's kind of, it's fun, you get a kick out of it. "Ladies and gentlemen, today we're a privileged "to have Adam Wenchel, Founder of Arthur who's going to talk "about the exciting world of artificial intelligence." And then it goes on with some really riveting sentences. So if we have time, I'll share that, it's kind of funny. It was good. >> Okay. >> So anyway, this is what people see and this is why I think it's exciting 'cause I think people are going to start refactoring what they do. And I've been saying this on theCUBE now for about a couple months is that, you know, there's a scene in "Moneyball" where Billy Beane sits down with the Red Sox owner and the Red Sox owner says, "If people aren't rebuilding their teams on your model, "they're going to be dinosaurs." And it reminds me of what's happening right now. And I think everyone that I talk to in the business sphere is looking at this and they're connecting the dots and just saying, if we don't rebuild our business with this new wave, they're going to be out of business because there's so much efficiency, there's so much automation, not like DevOps automation, but like the generative tasks that will free up the intellect of people. Like just the simple things like do an intro or do this for me, write some code, write a countermeasure to a hack. I mean, this is kind of what people are doing. And you mentioned computer vision, again, another huge field where 5G things are coming on, it's going to accelerate. What do you say to people when they kind of are leaning towards that, I need to rethink my business? >> Yeah, it's 100% accurate and what's been amazing to watch the last few months is the speed at which, and the urgency that companies like Microsoft and Google or others are actually racing to, to do that rethinking of their business. And you know, those teams, those companies which are large and haven't always been the fastest moving companies are working around the clock. And the pace at which they're rolling out LLMs across their suite of products is just phenomenal to watch. And it's not just the big, the large tech companies as well, I mean, we're seeing the number of startups, like we get, every week a couple of new startups get in touch with us for help with their LLMs and you know, there's just a huge amount of venture capital flowing into it right now because everyone realizes the opportunities for transforming like legal and healthcare and content creation in all these different areas is just wide open. And so there's a massive gold rush going on right now, which is amazing. >> And the cloud scale, obviously horizontal scalability of the cloud brings us to another level. We've been seeing data infrastructure since the Hadoop days where big data was coined. Now you're seeing this kind of take fruit, now you have vertical specialization where data shines, large language models all of a set up perfectly for kind of this piece. And you know, as you mentioned, you've been doing it for a long time. Let's take a step back and I want to get into how you started the company, what drove you to start it? Because you know, as an entrepreneur you're probably saw this opportunity before other people like, "Hey, this is finally it, it's here." Can you share the origination story of what you guys came up with, how you started it, what was the motivation and take us through that origination story. >> Yeah, absolutely. So as I mentioned, I've been doing AI for many years. I started my career at DARPA, but it wasn't really until 2015, 2016, my previous company was acquired by Capital One. Then I started working there and shortly after I joined, I was asked to start their AI team and scale it up. And for the first time I was actually doing it, had production models that we were working with, that was at scale, right? And so there was hundreds of millions of dollars of business revenue and certainly a big group of customers who were impacted by the way these models acted. And so it got me hyper-aware of these issues of when you get models into production, it, you know. So I think people who are earlier in the AI maturity look at that as a finish line, but it's really just the beginning and there's this constant drive to make them better, make sure they're not degrading, make sure you can explain what they're doing, if they're impacting people, making sure they're not biased. And so at that time, there really weren't any tools to exist to do this, there wasn't open source, there wasn't anything. And so after a few years there, I really started talking to other people in the industry and there was a really clear theme that this needed to be addressed. And so, I joined with my Co-Founder John Dickerson, who was on the faculty in University of Maryland and he'd been doing a lot of research in these areas. And so we ended up joining up together and starting Arthur. >> Awesome. Well, let's get into what you guys do. Can you explain the value proposition? What are people using you for now? Where's the action? What's the customers look like? What do prospects look like? Obviously you mentioned production, this has been the theme. It's not like people woke up one day and said, "Hey, I'm going to put stuff into production." This has kind of been happening. There's been companies that have been doing this at scale and then yet there's a whole follower model coming on mainstream enterprise and businesses. So there's kind of the early adopters are there now in production. What do you guys do? I mean, 'cause I think about just driving the car off the lot is not, you got to manage operations. I mean, that's a big thing. So what do you guys do? Talk about the value proposition and how you guys make money? >> Yeah, so what we do is, listen, when you go to validate ahead of deploying these models in production, starts at that point, right? So you want to make sure that if you're going to be upgrading a model, if you're going to replacing one that's currently in production, that you've proven that it's going to perform well, that it's going to be perform ethically and that you can explain what it's doing. And then when you launch it into production, traditionally data scientists would spend 25, 30% of their time just manually checking in on their model day-to-day babysitting as we call it, just to make sure that the data hasn't drifted, the model performance hasn't degraded, that a programmer did make a change in an upstream data system. You know, there's all sorts of reasons why the world changes and that can have a real adverse effect on these models. And so what we do is bring the same kind of automation that you have for other kinds of, let's say infrastructure monitoring, application monitoring, we bring that to your AI systems. And that way if there ever is an issue, it's not like weeks or months till you find it and you find it before it has an effect on your P&L and your balance sheet, which is too often before they had tools like Arthur, that was the way they were detected. >> You know, I was talking to Swami at Amazon who I've known for a long time for 13 years and been on theCUBE multiple times and you know, I watched Amazon try to pick up that sting with stage maker about six years ago and so much has happened since then. And he and I were talking about this wave, and I kind of brought up this analogy to how when cloud started, it was, Hey, I don't need a data center. 'Cause when I did my startup that time when Amazon, one of my startups at that time, my choice was put a box in the colo, get all the configuration before I could write over the line of code. So the cloud became the benefit for that and you can stand up stuff quickly and then it grew from there. Here it's kind of the same dynamic, you don't want to have to provision a large language model or do all this heavy lifting. So that seeing companies coming out there saying, you can get started faster, there's like a new way to get it going. So it's kind of like the same vibe of limiting that heavy lifting. >> Absolutely. >> How do you look at that because this seems to be a wave that's going to be coming in and how do you guys help companies who are going to move quickly and start developing? >> Yeah, so I think in the race to this kind of gold rush mentality, race to get these models into production, there's starting to see more sort of examples and evidence that there are a lot of risks that go along with it. Either your model says things, your system says things that are just wrong, you know, whether it's hallucination or just making things up, there's lots of examples. If you go on Twitter and the news, you can read about those, as well as sort of times when there could be toxic content coming out of things like that. And so there's a lot of risks there that you need to think about and be thoughtful about when you're deploying these systems. But you know, you need to balance that with the business imperative of getting these things into production and really transforming your business. And so that's where we help people, we say go ahead, put them in production, but just make sure you have the right guardrails in place so that you can do it in a smart way that's going to reflect well on you and your company. >> Let's frame the challenge for the companies now that you have, obviously there's the people who doing large scale production and then you have companies maybe like as small as us who have large linguistic databases or transcripts for example, right? So what are customers doing and why are they deploying AI right now? And is it a speed game, is it a cost game? Why have some companies been able to deploy AI at such faster rates than others? And what's a best practice to onboard new customers? >> Yeah, absolutely. So I mean, we're seeing across a bunch of different verticals, there are leaders who have really kind of started to solve this puzzle about getting AI models into production quickly and being able to iterate on them quickly. And I think those are the ones that realize that imperative that you mentioned earlier about how transformational this technology is. And you know, a lot of times, even like the CEOs or the boards are very personally kind of driving this sense of urgency around it. And so, you know, that creates a lot of movement, right? And so those companies have put in place really smart infrastructure and rails so that people can, data scientists aren't encumbered by having to like hunt down data, get access to it. They're not encumbered by having to stand up new platforms every time they want to deploy an AI system, but that stuff is already in place. There's a really nice ecosystem of products out there, including Arthur, that you can tap into. Compared to five or six years ago when I was building at a top 10 US bank, at that point you really had to build almost everything yourself and that's not the case now. And so it's really nice to have things like, you know, you mentioned AWS SageMaker and a whole host of other tools that can really accelerate things. >> What's your profile customer? Is it someone who already has a team or can people who are learning just dial into the service? What's the persona? What's the pitch, if you will, how do you align with that customer value proposition? Do people have to be built out with a team and in play or is it pre-production or can you start with people who are just getting going? >> Yeah, people do start using it pre-production for validation, but I think a lot of our customers do have a team going and they're starting to put, either close to putting something into production or about to, it's everything from large enterprises that have really sort of complicated, they have dozens of models running all over doing all sorts of use cases to tech startups that are very focused on a single problem, but that's like the lifeblood of the company and so they need to guarantee that it works well. And you know, we make it really easy to get started, especially if you're using one of the common model development platforms, you can just kind of turn key, get going and make sure that you have a nice feedback loop. So then when your models are out there, it's pointing out, areas where it's performing well, areas where it's performing less well, giving you that feedback so that you can make improvements, whether it's in training data or futurization work or algorithm selection. There's a number of, you know, depending on the symptoms, there's a number of things you can do to increase performance over time and we help guide people on that journey. >> So Adam, I have to ask, since you have such a great customer base and they're smart and they got teams and you're on the front end, I mean, early adopters is kind of an overused word, but they're killing it. They're putting stuff in the production's, not like it's a test, it's not like it's early. So as the next wave comes of fast followers, how do you see that coming online? What's your vision for that? How do you see companies that are like just waking up out of the frozen, you know, freeze of like old IT to like, okay, they got cloud, but they're not yet there. What do you see in the market? I see you're in the front end now with the top people really nailing AI and working hard. What's the- >> Yeah, I think a lot of these tools are becoming, or every year they get easier, more accessible, easier to use. And so, you know, even for that kind of like, as the market broadens, it takes less and less of a lift to put these systems in place. And the thing is, every business is unique, they have their own kind of data and so you can use these foundation models which have just been trained on generic data. They're a great starting point, a great accelerant, but then, in most cases you're either going to want to create a model or fine tune a model using data that's really kind of comes from your particular customers, the people you serve and so that it really reflects that and takes that into account. And so I do think that these, like the size of that market is expanding and its broadening as these tools just become easier to use and also the knowledge about how to build these systems becomes more widespread. >> Talk about your customer base you have now, what's the makeup, what size are they? Give a taste a little bit of a customer base you got there, what's they look like? I'll say Capital One, we know very well while you were at there, they were large scale, lot of data from fraud detection to all kinds of cool stuff. What do your customers now look like? >> Yeah, so we have a variety, but I would say one area we're really strong, we have several of the top 10 US banks, that's not surprising, that's a strength for us, but we also have Fortune 100 customers in healthcare, in manufacturing, in retail, in semiconductor and electronics. So what we find is like in any sort of these major verticals, there's typically, you know, one, two, three kind of companies that are really leading the charge and are the ones that, you know, in our opinion, those are the ones that for the next multiple decades are going to be the leaders, the ones that really kind of lead the charge on this AI transformation. And so we're very fortunate to be working with some of those. And then we have a number of startups as well who we love working with just because they're really pushing the boundaries technologically and so they provide great feedback and make sure that we're continuing to innovate and staying abreast of everything that's going on. >> You know, these early markups, even when the hyperscalers were coming online, they had to build everything themselves. That's the new, they're like the alphas out there building it. This is going to be a big wave again as that fast follower comes in. And so when you look at the scale, what advice would you give folks out there right now who want to tee it up and what's your secret sauce that will help them get there? >> Yeah, I think that the secret to teeing it up is just dive in and start like the, I think these are, there's not really a secret. I think it's amazing how accessible these are. I mean, there's all sorts of ways to access LLMs either via either API access or downloadable in some cases. And so, you know, go ahead and get started. And then our secret sauce really is the way that we provide that performance analysis of what's going on, right? So we can tell you in a very actionable way, like, hey, here's where your model is doing good things, here's where it's doing bad things. Here's something you want to take a look at, here's some potential remedies for it. We can help guide you through that. And that way when you're putting it out there, A, you're avoiding a lot of the common pitfalls that people see and B, you're able to really kind of make it better in a much faster way with that tight feedback loop. >> It's interesting, we've been kind of riffing on this supercloud idea because it was just different name than multicloud and you see apps like Snowflake built on top of AWS without even spending any CapEx, you just ride that cloud wave. This next AI, super AI wave is coming. I don't want to call AIOps because I think there's a different distinction. If you, MLOps and AIOps seem a little bit old, almost a few years back, how do you view that because everyone's is like, "Is this AIOps?" And like, "No, not kind of, but not really." How would you, you know, when someone says, just shoots off the hip, "Hey Adam, aren't you doing AIOps?" Do you say, yes we are, do you say, yes, but we do differently because it's doesn't seem like it's the same old AIOps. What's your- >> Yeah, it's a good question. AIOps has been a term that was co-opted for other things and MLOps also has people have used it for different meanings. So I like the term just AI infrastructure, I think it kind of like describes it really well and succinctly. >> But you guys are doing the ops. I mean that's the kind of ironic thing, it's like the next level, it's like NextGen ops, but it's not, you don't want to be put in that bucket. >> Yeah, no, it's very operationally focused platform that we have, I mean, it fires alerts, people can action off them. If you're familiar with like the way people run security operations centers or network operations centers, we do that for data science, right? So think of it as a DSOC, a Data Science Operations Center where all your models, you might have hundreds of models running across your organization, you may have five, but as problems are detected, alerts can be fired and you can actually work the case, make sure they're resolved, escalate them as necessary. And so there is a very strong operational aspect to it, you're right. >> You know, one of the things I think is interesting is, is that, if you don't mind commenting on it, is that the aspect of scale is huge and it feels like that was made up and now you have scale and production. What's your reaction to that when people say, how does scale impact this? >> Yeah, scale is huge for some of, you know, I think, I think look, the highest leverage business areas to apply these to, are generally going to be the ones at the biggest scale, right? And I think that's one of the advantages we have. Several of us come from enterprise backgrounds and we're used to doing things enterprise grade at scale and so, you know, we're seeing more and more companies, I think they started out deploying AI and sort of, you know, important but not necessarily like the crown jewel area of their business, but now they're deploying AI right in the heart of things and yeah, the scale that some of our companies are operating at is pretty impressive. >> John: Well, super exciting, great to have you on and congratulations. I got a final question for you, just random. What are you most excited about right now? Because I mean, you got to be pretty pumped right now with the way the world is going and again, I think this is just the beginning. What's your personal view? How do you feel right now? >> Yeah, the thing I'm really excited about for the next couple years now, you touched on it a little bit earlier, but is a sort of convergence of AI and AI systems with sort of turning into AI native businesses. And so, as you sort of do more, get good further along this transformation curve with AI, it turns out that like the better the performance of your AI systems, the better the performance of your business. Because these models are really starting to underpin all these key areas that cumulatively drive your P&L. And so one of the things that we work a lot with our customers is to do is just understand, you know, take these really esoteric data science notions and performance and tie them to all their business KPIs so that way you really are, it's kind of like the operating system for running your AI native business. And we're starting to see more and more companies get farther along that maturity curve and starting to think that way, which is really exciting. >> I love the AI native. I haven't heard any startup yet say AI first, although we kind of use the term, but I guarantee that's going to come in all the pitch decks, we're an AI first company, it's going to be great run. Adam, congratulations on your success to you and the team. Hey, if we do a few more interviews, we'll get the linguistics down. We can have bots just interact with you directly and ask you, have an interview directly. >> That sounds good, I'm going to go hang out on the beach, right? So, sounds good. >> Thanks for coming on, really appreciate the conversation. Super exciting, really important area and you guys doing great work. Thanks for coming on. >> Adam: Yeah, thanks John. >> Again, this is Cube Conversation. I'm John Furrier here in Palo Alto, AI going next gen. This is legit, this is going to a whole nother level that's going to open up huge opportunities for startups, that's going to use opportunities for investors and the value to the users and the experience will come in, in ways I think no one will ever see. So keep an eye out for more coverage on siliconangle.com and theCUBE.net, thanks for watching. (bright upbeat music)

Published Date : Mar 3 2023

SUMMARY :

I'm excited to have Adam Wenchel looking forward to the conversation. kind of in the mainstream and that it's just the amount Adam, you know, you've so that you can build on top of them. to give me a riveting introduction to you And you mentioned computer vision, again, And you know, those teams, And you know, as you mentioned, of when you get models into off the lot is not, you and that you can explain what it's doing. So it's kind of like the same vibe so that you can do it in a smart way And so, you know, that creates and make sure that you out of the frozen, you know, and so you can use these foundation models a customer base you got there, that are really leading the And so when you look at the scale, And so, you know, go how do you view that So I like the term just AI infrastructure, I mean that's the kind of ironic thing, and you can actually work the case, is that the aspect of and so, you know, we're seeing exciting, great to have you on so that way you really are, success to you and the team. out on the beach, right? and you guys doing great work. and the value to the users and

SENTIMENT ANALYSIS :

ENTITIES

EntityCategoryConfidence
John MarkoffPERSON

0.99+

MicrosoftORGANIZATION

0.99+

GoogleORGANIZATION

0.99+

Adam WenchelPERSON

0.99+

JohnPERSON

0.99+

Red SoxORGANIZATION

0.99+

John DickersonPERSON

0.99+

AmazonORGANIZATION

0.99+

AdamPERSON

0.99+

John FurrierPERSON

0.99+

Palo AltoLOCATION

0.99+

2015DATE

0.99+

Capital OneORGANIZATION

0.99+

fiveQUANTITY

0.99+

100%QUANTITY

0.99+

2016DATE

0.99+

13 yearsQUANTITY

0.99+

SnowflakeTITLE

0.99+

threeQUANTITY

0.99+

first questionQUANTITY

0.99+

twoQUANTITY

0.99+

fiveDATE

0.99+

todayDATE

0.99+

oneQUANTITY

0.99+

four yearsQUANTITY

0.99+

Billy BeanePERSON

0.99+

over 20 yearsQUANTITY

0.99+

DARPAORGANIZATION

0.99+

third oneQUANTITY

0.98+

AWSORGANIZATION

0.98+

siliconangle.comOTHER

0.98+

University of MarylandORGANIZATION

0.97+

first timeQUANTITY

0.97+

USLOCATION

0.97+

firstQUANTITY

0.96+

six years agoDATE

0.96+

New York TimesORGANIZATION

0.96+

ChatGPTORGANIZATION

0.96+

SwamiPERSON

0.95+

ChatGPTTITLE

0.95+

hundreds of modelsQUANTITY

0.95+

25, 30%QUANTITY

0.95+

single problemQUANTITY

0.95+

hundreds of millions of dollarsQUANTITY

0.95+

10QUANTITY

0.94+

MoneyballTITLE

0.94+

waveEVENT

0.91+

three thingsQUANTITY

0.9+

AIOpsTITLE

0.9+

last six monthsDATE

0.89+

few months agoDATE

0.88+

bigEVENT

0.86+

next couple yearsDATE

0.86+

DevOpsTITLE

0.85+

ArthurPERSON

0.85+

CUBEORGANIZATION

0.83+

dozens of modelsQUANTITY

0.8+

a few years backDATE

0.8+

six years agoDATE

0.78+

theCUBEORGANIZATION

0.76+

SageMakerTITLE

0.75+

decadesQUANTITY

0.75+

TwitterORGANIZATION

0.74+

MLOpsTITLE

0.74+

supercloudORGANIZATION

0.73+

super AI waveEVENT

0.73+

a couple monthsQUANTITY

0.72+

ArthurORGANIZATION

0.72+

100 customersQUANTITY

0.71+

Cube ConversationEVENT

0.69+

theCUBE.netOTHER

0.67+

Boost Your Solutions with the HPE Ezmeral Ecosystem Program | HPE Ezmeral Day 2021


 

>> Hello. My name is Ron Kafka, and I'm the senior director for Partner Scale Initiatives for HBE Ezmeral. Thanks for joining us today at Analytics Unleashed. By now, you've heard a lot about the Ezmeral portfolio and how it can help you accomplish objectives around big data analytics and containerization. I want to shift gears a bit and then discuss our Ezmeral Technology Partner Program. I've got two great guest speakers here with me today. And together, We're going to discuss how jointly we are solving data analytic challenges for our customers. Before I introduce them, I want to take a minute to talk to provide a little bit more insight into our ecosystem program. We've created a program with a realization based on customer feedback that even the most mature organizations are struggling with their data-driven transformation efforts. It turns out this is largely due to the pace of innovation with application vendors or ICS supporting data science and advanced analytic workloads. Their advancements are simply outpacing organization's ability to move workloads into production rapidly. Bottom line, organizations want a unified experience across environments where their entire application portfolio in essence provide a comprehensive application stack and not piece parts. So, let's talk about how our ecosystem program helps solve for this. For starters, we were leveraging HPEs long track record of forging technology partnerships and it created a best in class ISB partner program specific for the Ezmeral portfolio. We were doing this by developing an open concept marketplace where customers and partners can explore, learn, engage and collaborate with our strategic technology partners. This enables our customers to adopt, deploy validated applications from industry leading software vendors on HPE Ezmeral with a high degree of confidence. Also, it provides a very deep bench of leading ISVs for other groups inside of HPE to leverage for their solutioning efforts. Speaking of industry leading ISV, it's about time and introduce you to two of those industry leaders right now. Let me welcome Daniel Hladky from Dataiku, and Omri Geller from Run:AI. So I'd like to introduce Daniel Hladky. Daniel is with Dataiku. He's a great partner for HPE. Daniel, welcome. >> Thank you for having me here. >> That's great. Hey, would you mind just talking a bit about how your partnership journey has been with HPE? >> Yes, pleasure. So the journey started about five years ago and in 2018 we signed a worldwide reseller agreement with HPE. And in 2020, we actually started to work jointly on the integration between the Dataiku Data Science Studio called DSS and integrated that with the Ezmeral Container platform, and was a great success. And it was on behalf of some clear customer projects. >> It's been a long partnership journey with you for sure with HPE. And we welcome your partnership extremely well. Just a brief question about the Container Platform and really what that's meant for Dataiku. >> Yes, Ron. Thanks. So, basically I like the quote here Florian Douetteau, which is the CEO of Dataiku, who said that the combination of Dataiku with the HPE Ezmeral Container Platform will help the customers to successfully scale and put machine learning projects into production. And this basically is going to deliver real impact for their business. So, the combination of the two of us is a great success. >> That's great. Can you talk about what Dataiku is doing and how HPE Ezmeral Container Platform fits in a solution offering a bit more? >> Great. So basically Dataiku DSS is our product which is a end to end data science platform, and basically brings value to the project of customers on their past enterprise AI. In simple ways, we can say it could be as simple as building data pipelines, but it could be also very complex by having machine and deep learning models at scale. So the fast track to value is by having collaboration, orchestration online technologies and the models in production. So, all of that is part of the Data Science Studio and Ezmeral fits perfectly into the part where we design and then basically put at scale those project and put it into product. >> That's perfect. Can you be a bit more specific about how you see HPE and Dataiku really tightening up a customer outcome and value proposition? >> Yes. So what we see is also the challenge of the market that probably about 80% of the use cases really never make it to production. And this is of course a big challenge and we need to change that. And I think the combination of the two of us is actually addressing exactly this need. What we can say is part of the MLOps approach, Dataiku and the Ezmeral Container Platform will provide a frictionless approach, which means without scripting and coding, customers can put all those projects into the productive environment and don't have to worry any more and be more business oriented. >> That's great. So you mentioned you're seeing customers be a lot more mature with their AI workloads and deployment. What do you suggest for the other customers out there that are just starting this journey or just thinking about how to get started? >> Yeah. That's a very good question, Ron. So what we see there is actually the challenge that people need to go on a pass of maturity. And this starts with a simple data pipelines, et cetera, and then basically move up the ladder and basically build large complex project. And here I see a very interesting offer coming now from HPE which is called D3S, which is the data science startup pack. That's something I discussed together with HPE back in early 2020. And basically, it solves the three stages, which is explore, experiment and evolve and builds quickly MVPs for the customers. By doing so, basically you addressed business objectives, lay out in the proper architecture and also setting up the proper organization around it. So, this is a great combination by HPE and Dataiku through the D3S. >> And it's a perfect example of what I mentioned earlier about leveraging the ecosystem program that we built to do deeper solutioning efforts inside of HPE in this case with our AI business unit. So, congratulations on that and thanks for joining us today. I'm going to shift gears. I'm going to bring in Omri Geller from Run:AI. Omri, welcome. It's great to have you. You guys are killing it out there in the market today. And I just thought we could spend a few minutes talking about what is so unique and differentiated from your offerings. >> Thank you, Ron. It's a pleasure to be here. Run:AI creates a virtualization and orchestration layer for AI infrastructure. We help organizations to gain visibility and control over their GPO resources and help them deliver AI solutions to market faster. And we do that by managing granular scheduling, prioritization, allocation of compute power, together with the HPE Ezmeral Container Platform. >> That's great. And your partnership with HPE is a bit newer than Daniel's, right? Maybe about the last year or so we've been working together a lot more closely. Can you just talk about the HPE partnership, what it's meant for you and how do you see it impacting your business? >> Sure. First of all, Run:AI is excited to partner with HPE Ezmeral Container Platform and help customers manage appeals for their AI workloads. We chose HPE since HPE has years of experience partnering with AI use cases and outcomes with vendors who have strong footprint in this markets. HPE works with many partners that are complimentary for our use case such as Nvidia, and HPE Ezmeral Container Platform together with Run:AI and Nvidia deliver a word about solution for AI accelerated workloads. And as you can understand, for AI speed is critical. Companies want to gather important AI initiatives into production as soon as they can. And the HPE Ezmeral Container Platform, running IGP orchestration solution enables that by enabling dynamic provisioning of GPU so that resources can be easily shared, efficiently orchestrated and optimal used. >> That's great. And you talked a lot about the efficiency of the solution. What about from a customer perspective? What is the real benefit that our customers are going to be able to gain from an HPE and Run:AI offering? >> So first, it is important to understand how data scientists and AI researchers actually build solution. They do it by running experiments. And if a data scientist is able to run more experiments per given time, they will get to the solution faster. With HPE Ezmeral Container Platform, Run:AI and users such as data scientists can actually do that and seamlessly and efficiently consume large amounts of GPU resources, run more experiments or given time and therefore accelerate their research. Together, we actually saw a customer that is running almost 7,000 jobs in parallel over GPUs with efficient utilization of those GPUs. And by running more experiments, those customers can be much more effective and efficient when it comes to bringing solutions to market >> Couldn't agree more. And I think we're starting to see a lot of joint success together as we go out and talk to the story. Hey, I want to thank you both one last time for being here with me today. It was very enlightening for our team to have you as part of the program. And I'm excited to extend this customer value proposition out to the rest of our communities. With that, I'd like to close today's session. I appreciate everyone's time. And keep an eye out on our ISP marketplace for Ezmeral We're continuing to expand and add new capabilities and new partners to our marketplace. We're excited to do a lot of great things and help you guys all be successful. Thanks for joining. >> Thank you, Ron. (bright upbeat music)

Published Date : Mar 11 2021

SUMMARY :

and how it can help you journey has been with HPE? and integrated that with the and really what that's meant for Dataiku. and put machine learning and how HPE Ezmeral Container Platform and the models in production. about how you see HPE and and the Ezmeral Container Platform or just thinking about how to get started? and builds quickly MVPs for the customers. and differentiated from your offerings. and control over their GPO resources and how do you see it and outcomes with vendors efficiency of the solution. So first, it is important to understand and new partners to our marketplace. Thank you, Ron.

SENTIMENT ANALYSIS :

ENTITIES

EntityCategoryConfidence
DanielPERSON

0.99+

Ron KafkaPERSON

0.99+

Florian DouetteauPERSON

0.99+

RonPERSON

0.99+

Omri GellerPERSON

0.99+

HPEORGANIZATION

0.99+

Daniel HladkyPERSON

0.99+

NvidiaORGANIZATION

0.99+

twoQUANTITY

0.99+

2020DATE

0.99+

2018DATE

0.99+

DataikuORGANIZATION

0.99+

DSSORGANIZATION

0.99+

last yearDATE

0.99+

todayDATE

0.99+

OmriPERSON

0.99+

Data Science StudioORGANIZATION

0.98+

early 2020DATE

0.98+

firstQUANTITY

0.98+

EzmeralORGANIZATION

0.98+

Dataiku Data Science StudioORGANIZATION

0.97+

about 80%QUANTITY

0.97+

bothQUANTITY

0.97+

HPEsORGANIZATION

0.95+

three stagesQUANTITY

0.94+

two great guest speakersQUANTITY

0.93+

oneQUANTITY

0.93+

almost 7,000 jobsQUANTITY

0.92+

Analytics UnleashedORGANIZATION

0.91+

HPE Ezmeral Container PlatformTITLE

0.84+

HBE EzmeralORGANIZATION

0.83+

RunORGANIZATION

0.83+

Ezmeral Container PlatformTITLE

0.82+

D3STITLE

0.81+

about five years agoDATE

0.8+

HPE Ezmeral Container PlatformTITLE

0.79+

2021DATE

0.76+

Run:AIORGANIZATION

0.72+

EzmeralTITLE

0.7+

PlatformTITLE

0.69+

Ezmeral Container PlatformTITLE

0.68+

ICSORGANIZATION

0.67+

Partner Scale InitiativesORGANIZATION

0.66+

HPETITLE

0.62+

DSSTITLE

0.6+

Ezmeral ContainerTITLE

0.59+

ContainerTITLE

0.56+

HPE EzmeralEVENT

0.55+

FirstQUANTITY

0.52+

RunTITLE

0.51+

DayEVENT

0.51+

BizOps Panel V1


 

>> Announcer: From around the globe. It's theCUBE. With digital coverage of BizOps Manifesto Unveiled. Brought to you by BizOps Coalition. >> Hey, welcome back everybody ,Jeff Frick here with theCUBE. Welcome back to our ongoing coverage of the BizOps Manifesto Unveiled. Something has been in the works for a little while. Today's the formal unveiling and we're excited to have three of the core founding members of the manifesto, authors of the manifesto, if you will. And joining us again, we've had them all on individually, now we're going to have a great power panel. First up, we're going to have Mik Kersten returning. He's the founder and CEO of Tasktop. Mik, good to see you again. Where are you dialing in from? >> Great to see you again, Jeff. I'm dialing from Vancouver, Canada. >> Vancouver, Canada. One of my favorite cities in the whole wide world. Also we've got Tom Davenport, coming in from across the country. He's a distinguished professor and author from Babson College. Tom, great to see you. And I think you said you're at a fun exotic place on the East Coast. >> From Massachusetts, Cape Cod. >> Nice, great to see you again. And also joining Serge Lucio. He is the VP and General Manager Enterprise Software Division at Broadcom. Serge, great to see you again, where are you coming in from? >> From Boston right next to Cape Cod. >> Terrific. So welcome back, everybody again. Congratulations on this day. I know it's been a lot of work to get here for this unveil. But let's just jump into it. BizOps Manifesto, what was the initial reason to do this? And how did you decide to do it in a kind of a coalition, way bringing together a group of people versus just making it an internal company initiative that you know, you can do better stuff within your own company? Serge, why don't we start with you? >> Yeah, so I think we were at a really critical juncture, right. Many large enterprises are basically struggling with their digital transformation. In fact, many recognized that the business (indistinct) collaboration has been one of the major impediments to drive that kind of transformation. And if we look at the industry today, many people are, whether we're talking about vendors or system decorators, consulting firms, are talking about the same kind of concepts, but using very different language. And so we believe that bringing all these different players together as part of the coalition and formalizing, basically the core principles and values in a BizOps Manifesto, we can really start to kind of have a much bigger movement where we can all talk about kind of the same concepts and we can really start to provide, could have a much better support for large organizations to transform. So whether it is technology or services or training, I think that's really the value of bringing all of these players together. >> Great. And Mik to you. Why did you get involved in this effort? >> So I've been close and follow the agile movement since it started two decades ago with that manifesto. And I think we got a lot of improvement at the team level and I think as Serge has noted, we really need to improve at the business level. Every company is trying to become a software innovator, trying to make sure that they can pivot that quickly and then changing market economy and what everyone's dealing with in terms of needing to deliver value to customers sooner. However, agile practices have really focused that these metrics, these measures and understanding processes that help teams be productive. Those things now need to be elevated to the business as a whole. And that just hasn't happened. Organizations are actually failing because they're measuring activities and how they're becoming more agile, how teams are functioning not how much quickly they're delivering value to the customer. So we need to now move past that. And that's exactly what the BizOps Manifesto provides. >> Right, great And Tom to you, you've been covering tech for a very very long time. You've been looking at really hard challenges and a lot of work around analytics and data and data evolution. So there's a definitely a data angle here. I wonder if you could kind of share your perspective of what you got excited to sign onto this manifesto. >> Sure. Well, I have, you know, for the past 15 or 20 years, I've been focusing on Data Analytics and AI, but before that I was a process management guy and a knowledge management guy. And in general, I think, you know we've just kind of optimize that to narrow a level whether you're talking about agile or DevOps or MLops, any of these kind of ops oriented movements. We're making individual project performance and productivity better but we're not changing the business effectively enough. And that's the thing that appealed to me about the BizOps idea that we're finally creating a closer connection between what we do with technology and how it changes the business and provides value to it. >> That's great. Serge back to you, right. I mean, people have been talking about digital transformation for a long time and it's been you know, kind of trucking along and then COVID hit and it was instant light switch. Everyone's working from home, you've got a lot more reliance on your digital tools, digital communication, both within your customer base and your partner base but also then your employees. One of you can share how that really pushed this all along, right. Because now suddenly the acceleration of digital transformation is higher. Even more importantly, you got much more critical decisions to make into what you do next. So kind of your portfolio management of projects has been elevated significantly when maybe revenues are down and you really have to prioritize and get it right. >> Yeah. Maybe I'll just start by quoting Satina Nello, basically recently said that there's been two years of digital transformation just last two months. And in any many ways that's true. But yet when we look at large enterprises, they're still struggling with a kind of a changes in culture. That they really need to drive to be able to disrupt themselves. And not surprisingly you know, when we look at certain parts of the industry you know, we see some things which are very disturbing, right? About 40% of the personal loans today, are being originated by fintechs of a like of Sophie or LendingClub, right? Not to traditional brick and mortar for a bank. And so the, well, there is kind of a much more of an appetite and it's a more of a survival type of driver these days. The reality is that in order for these large enterprises to truly transform and engage on this digital transformation they need to start to really align the business in IT. You know, in many ways and make cover that agile really emerge from the core desire to truly improve software predictability which we've really missed is all that we start to aligning the software predictability to business predictability and to be able to have continual sleep continuous improvement and measurement of business outcomes. So by aligning that of these discuss inward metrics that's, IT is typically being using to business outcomes. We think we can start to really help different stakeholders within the organization to collaborate. So I think there is more than ever. There's an imperative to acts now and resolves I think is kind of the right approach to drive that kind of transformation. >> Great. I want to follow up on the culture comment with you, Tom because you've talked before about kind of process flow and process flow throughout a whore and an organization. And, you know, we talk about people process and tech all the time. And I think the tech is the easy part compared to actually changing the people the way they think. And then the actual processes that they put in place. It's a much more difficult issue than just the tech issue to get this digital transformation in your organization. >> Yeah. You know, I've always found that the soft stuff about, you know, the culture of a behavior the values is the hard stuff to change and more and more we realized that to be successful with any kind of digital transformation you have to change people's behaviors and attitudes. We haven't made as much progress in that area as we might have. I mean, I've done some surveys suggesting that most organizations still don't have data driven cultures. And in many cases there is a lower percentage of companies that say they have that then did a few years ago. So we're kind of moving in the wrong direction, which means I think that we have to start explicitly addressing that cultural, behavioral dimension and not just assuming that it will happen if we build system. You know, if we build it, they won't necessarily come. >> Right. So I want to go to you Nick. 'Cause you know, we're talking about workflows and flow and, and you've written about flow both in terms of, you know, moving things along a process and trying to find bottlenecks, identify bottlenecks which is now even more important again when these decisions are much more critical 'cause you have a lot less wiggle room in tough times, but you also talked about flow from the culture side and the people side. So, I wanted if you can just share your thoughts on, you know, using flow as a way to think about things, to get the answers better. >> Yeah, absolutely. And I'll refer back to what Tom has said. If you're optimized, you need to optimize your system. You need to optimize how you innovate and how you deliver value to the business and the customer. Now, what we've noticed in the data, since that we've learned from customers, value streams, enterprise organizations value streams, is that when it's taking six months at the end to deliver that value with the flow is that slow. You've got a bunch of unhappy developers unhappy customers when you're innovating house. So high performing organizations we can measure their end flow time and dates. All of a sudden that feedback loop the satisfaction your developer's measurably goes up. So not only do you have people context, switching glass you're delivering so much more value to customers at a lower cost because you've optimized for flow rather than optimizing for these other approximate tricks that we use which is how efficient is my agile team. How quickly can we deploy software? Those are important, but they do not provide the value of agility of fast learning of adaptability to the business. And that's exactly what the BizOps Manifesto pushes your organization to do. You need to put in place this new operating model that's based on flow on the delivery of business value and on bringing value to market much more quickly than you were before. >> Right. I love that. And I'm going back to you, Tom, on that to follow up 'cause I think, I don't think people think enough about how they prioritize what they're optimizing for 'cause you know if you're optimizing for A versus B, you know you can have a very different product that you kick out and let you know. My favorite example is with Clayton Christensen and innovator's dilemma talking about the three inch hard drive. If you optimize it for power, you know, is one thing if you optimize it for vibration is another thing and sure enough, you know, they missed it on the poem because it was the game console which drove that whole business. So when you when you're talking to customers and we think we hear it with cloud all the time people optimizing for a cost efficiency instead of thinking about it as an innovation tool. How do you help them kind of rethink and really, you know, force them to look at the prioritization and make sure they're prioritizing on the right thing is make just said what are you optimizing for? >> Oh yeah, you have one of the most important aspects of any decision or attempt to resolve a problem in an organization is the framing process. And you know, it's a difficult aspect to the decision to frame it correctly in the first place. There, it's not a technology issue. In many cases, it's largely a human issue, but if you frame that decision or that problem incorrectly to narrowly say, or you frame it as an either or situation where you could actually have some of both, it's very difficult for the process to work out correctly. So in many cases that I think we need to think more at the beginning about how we bring this issue or this decision in the best way possible before we charge off and build a system to support it. You know, it's worth that extra time to think carefully about how the decision has been structured. >> Right. Serge, I want to go back to you and talk about the human factors, because as we've just discussed, you could put it in great technology, but if the culture doesn't adopt it and people don't feel good about it, you know, it's not going to be successful and that's going to reflect poorly on the technology, even if it had nothing to do with it. And you know, when you look at the core values of the Bezos Manifesto, you know, a big one is trust and collaboration, you know, learn, respond and pivot. One of you can share your thoughts on trying to get that cultural shift so that you can have success with the people or excuse me, with the technology in the process and helping customers, you know, take this more trustworthy and kind of proactive position. >> So I think, at the ground level, it truly starts with the realization that we're all different. We come from different backgrounds. Often times we tend to blame the data. It's not uncommon my experiments that we spend the first you know 30 minutes of any kind of one hour conversation to debate the validity of the data. And so one of the first kind of probably manifestations that we've had or revelations as we start to engage with our customers is like just exposing high-fidelity data sets to different stakeholders from their different lens. We start to enable these different stakeholders to not debate the data. That's really collaborate to find a solution. So in many ways, when we think about kind of the types of changes that we're trying to truly effect around data driven decision making it's all about bringing the data in context, the context that is relevant and understandable for different stakeholders, whether we're talking about an operator or a developer or a business analyst. So that's, the first thing. The second layer I think, is really to provide context to what people are doing in their specific cycle. And so I think one of the best examples I have is if you start to be able to align business KPI whether you are counting you know, sales per hour, or the engagements of your users on your mobile applications, whatever it is. You can start to connect that KPI to business KPI to the KPIs that developers might be looking at, whether it is the number of defects or a velocity or whatever, you know metrics that they are used to actually track. You start to be able to actually contextualize in what we are the effecting, basically a metric that is really relevant in which we see is that this is a much more systematic way to approach the transformation than say, you know, some organizations kind of creating some of these new products or services or initiatives to drive engagements, right? So if you look at zoom for instance, zoom giving away it's service to education, is all about, I mean, there's obviously a marketing aspect in therapists. It's fundamentally about trying to drive also the engagement of their own teams. And because now they're doing something for good and the organizations are trying to do that. But you only can do this kind of things in a limited way. And so you really want to start to rethink how you connect to everybody's kind of a business objective through data and now you start to get people to stare at the same data from their own lens and collaborate on all the data. >> Right, great That's a good. Tom I want to go back to you. You've been studying IT for a long time, writing lots of books and getting into it. Why now, you know, what why now (laughs) are we finally aligning business objectives with IT objectives? You know, why didn't this happen before? And you know, what are the factors that are making now the time for this move with the BizOps? >> Well, much of a past, IT was sort of a back office related activity. And, you know, it was important for producing your pay check and capturing the customer orders but the business wasn't built around it. Now, every organization needs to be a software business data business a digital business, the auntie has been raised considerably. And if you aren't making that connection between your business objectives and the technology that supports it you run a pretty big risk of, you know going out of business or losing out to competitors totally. So, and even if you're you know, an industry that hasn't historically been terribly technology oriented customer expectations flow from, you know, the digital native companies that they work with to basically every industry. So you're compared against the best in the world. So we don't really have the luxury anymore of screwing up our IT projects or building things that don't really work for the business. It's mission critical that we do that well almost every time. >> Right. And I just want to follow up by that, Tom In terms of the, you've talked extensively about kind of these evolutions of data and analytics from artisanal stage to the big data stage, the data economy stage the AI driven stage and what I find diff interesting that all those stages, you always put a start date. You never put an end date. So, you know, is the big data I'm just going to use that generically moment in time, finally here, where we're you know, off mahogany row with the data scientists but actually can start to see the promise of delivering the right insight to the right person at the right time to make that decision. >> Well, I think it is true that in general, these previous stages never seemed to go away. The artisanal stuff is still being done but we would like for less and lesser of it to be artisanal, we can't really afford for everything to be artisanal anymore. It's too labor and time consuming to do things that way. So we shift more and more of it to be done through automation and to be done with a higher level of productivity. And, you know at some point maybe we reached the stage where we don't do anything artisanally anymore. I'm not sure we're there yet but you know, we are making progress. >> Right And Mick, back to you in terms of looking at agile 'cause you're such a student of agile, when you look at the opportunity with BizOps and taking the lessons from agile, you know what's been the inhibitor to stop this in the past. And what are you so excited about? You know, taking this approach will enable. >> Yeah. I think both Serge and Tom hit on this is that in agile what's happened is that we've been you know measuring tiny subsets of the value stream right. We need to elevate the data's there. Developers are working on these tools that delivering features that the foundations for great culture are there. I spent two decades as a developer. And when I was really happy is when I was able to deliver value to customers, the quicker I was able to do that the fewer impediments are in my way the quicker was deployed and running in the cloud the happier I was, and that's exactly what's happening. If we can just get the right data elevated to the business, not just to the agile teams but really these values of ours are to make sure that you've got these data driven decisions with meaningful data that's oriented around delivering value to customers. Not only these legacies that Tom touched on, which has cost center metrics from an IT, for IT being a cost center and something that provided email and then back office systems. So we need to rapidly shift to those new meaningful metrics that are customized business centric and make sure that every developer the organization is focused on those as well as the business itself, that we're measuring value and we're helping that value flow without interruptions. >> I love that Mik 'cause if you don't measure it, you can't improve on it but you got to be measuring the right thing. So gentlemen, thank you again for your time. Congratulations on the unveil of the BizOps Manifesto and bringing together this coalition of industry experts to get behind this. And you know there's probably never been a more important time than now to make sure that your prioritization is in the right spot and you're not wasting resources where you're not going to get the ROI. So congratulations again. And thank you for sharing your thoughts with us here on theCUBE. >> Thank you. >> Thank you from Vancouver. >> Alright, so we had Serge, Tom and Mik. I'm Jeff, you're watching theCUBE. It's a BizOps Manifesto Unveiled. Thanks for watching. We'll see you next time. (soft music)

Published Date : Oct 9 2020

SUMMARY :

Brought to you by BizOps Coalition. Mik, good to see you again. Great to see you again, Jeff. And I think you said you're Serge, great to see you again, that you know, you can do better stuff kind of the same concepts And Mik to you. to the business as a whole. of what you got excited to And that's the thing that appealed to me to make into what you do next. of the industry you than just the tech issue to of digital transformation you have to in terms of, you know, You need to optimize how you innovate and sure enough, you know, And you know, it's a difficult aspect of the Bezos Manifesto, you to rethink how you connect And you know, what are the And if you aren't making that connection that all those stages, you and more of it to be And Mick, back to you in of ours are to make sure of industry experts to get behind this. We'll see you next time.

SENTIMENT ANALYSIS :

ENTITIES

EntityCategoryConfidence
TomPERSON

0.99+

SergePERSON

0.99+

Jeff FrickPERSON

0.99+

JeffPERSON

0.99+

Mik KerstenPERSON

0.99+

MikPERSON

0.99+

30 minutesQUANTITY

0.99+

BostonLOCATION

0.99+

one hourQUANTITY

0.99+

six monthsQUANTITY

0.99+

MickPERSON

0.99+

Cape CodLOCATION

0.99+

TasktopORGANIZATION

0.99+

Babson CollegeORGANIZATION

0.99+

Tom DavenportPERSON

0.99+

Vancouver, CanadaLOCATION

0.99+

two decadesQUANTITY

0.99+

second layerQUANTITY

0.99+

Satina NelloPERSON

0.99+

two yearsQUANTITY

0.99+

SophieORGANIZATION

0.99+

Serge LucioPERSON

0.99+

threeQUANTITY

0.99+

bothQUANTITY

0.99+

FirstQUANTITY

0.99+

two decades agoDATE

0.98+

firstQUANTITY

0.98+

three inchQUANTITY

0.98+

NickPERSON

0.98+

VancouverLOCATION

0.98+

oneQUANTITY

0.98+

BizOps CoalitionORGANIZATION

0.98+

BroadcomORGANIZATION

0.98+

Clayton ChristensenPERSON

0.97+

LendingClubORGANIZATION

0.97+

agileTITLE

0.97+

About 40%QUANTITY

0.97+

todayDATE

0.96+

DevOpsTITLE

0.96+

OneQUANTITY

0.96+

TodayDATE

0.96+

one thingQUANTITY

0.96+

first thingQUANTITY

0.95+

Massachusetts, Cape CodLOCATION

0.95+

MLopsTITLE

0.87+

BizOpsTITLE

0.86+

BizOps ManifestoTITLE

0.85+

15QUANTITY

0.84+

last two monthsDATE

0.84+

theCUBEORGANIZATION

0.82+

few years agoDATE

0.81+

20 yearsQUANTITY

0.81+

Enterprise SoftwareORGANIZATION

0.7+

loansQUANTITY

0.7+

East CoastLOCATION

0.69+

BizOpsORGANIZATION

0.56+