>>From around the globe. It's the cube covering data citizens. 21 brought to you by Colibra >>Welcome to the cubes coverage of Collibra data citizens 21. I'm Lisa Martin. I have three guests with me here today. Colibra customer Freddie Mac, please welcome JAG chief data officer and vice president of single family data and decisions. Jog. Welcome to the cube. >>Thank you, Lisa. Look forward to be, >>Uh, excellent on Kiko LSU as well. Vice president data transformation and analytics solution on Kay. Good to have you on the program. >>Thank you, Lisa. Great to be here and >>A teeth Malik senior director from the single family division at Freddie Mac is here as well. A team welcome. So we have big congratulations in order. Uh, pretty Mac was just announced at data citizens as the winners of the Colibra excellence award for data program of the year. Congratulations on that. We're going to unpack that. Talk about what that means, but I'd love to get familiar with the 3d Jack. Start with you. Talk to me a little bit about your background, your current role as chief data officer. >>Appreciate it, Lisa, thank you for the opportunity to share our story. Uh, my name is Arvind calls me Jack. And as you said, I'm just single-family chief data officer at Freddie Mac, but those that don't know, Freddie Mac is a Garland sponsored entity that supports the U S housing finance system and single family deals with the residential side of the marketplace, as CDO are responsible for our managed content data lineage, data governance, business architecture, which Cleaver plays a integral role, uh, in, in depth, that function as well as, uh, support our shared assets across the enterprise and our data monetization efforts, data, product execution, decision modeling, as well as our business intelligence capabilities, including AI and ML for various use cases as a background, starting my career in New York and then moved to Boston and last 20 years of living in the Northern Virginia DC area and fortunate to have been responsible for business operations, as well as led and, um, executed large transformation efforts. That background has reinforced the power of data and how, how it's so critical to meeting our business objectives. Look forward to our dialogue today, Lisa, once again. >>Excellent. You have a great background and clearly not a dull moment in your job with Freddy, Matt. And tell me a little bit about your background, your role, what you're doing at Freddie >>Mac. Definitely. Um, hi everyone. I'm,, I'm vice president of data transformation and analytics solutions. And I worked for JAG. I'm responsible for many of the things he said, including leading our transformation to the cloud and migrating all our existing data assets front of that transformation journey. I'm also responsible for our business information and business data architecture, decision modeling, business intelligence, and some of the analytics and artificial intelligence. I started my career back in the day as a computer engineer, but I've always been in the financial industry up in New York. And now in the Northern Virginia area, I called myself that bridge between business and technology. And I would say, I think over the last six years with data found that perfect spot where business and technology actually come together to solve real problems and, and really lead, um, you know, businesses to the next stage of, so thank you Lisa for the opportunity today. Excellent. >>And we're going to unpack you call yourself the bridge between business and it that's always such an important bridge. We're going to talk about that in just a minute, but I want to get your background, tell our audience about you. >>Uh, I'm Alec Malek, I'm senior director of business, data architecture, data transformation, and Freddie Mac. Uh, I'm responsible for the overall business data architecture and transformation of the existing data onto the cloud data lake. Uh, my team is responsible for the Kleberg platform and the business analysts that are using and maintaining the data in Libra and also driving the data architecture in close collaboration with our engineering teams. My background is I'm a engineer at heart. I still do a lot of development. This is my first time as of crossing over onto the bridge onto business side of maintaining data and working with data teams. >>Jan, let's talk about digital transformation. Freddie Mac is a 50 year old and growing company. I always love talking with established businesses about digital transformation. It's pretty challenging. Talk to me about your initial plan and what some of the main challenges were that you were looking to solve. >>Uh, great question, Lisa, and, uh, it's definitely pertinent as you say, in our digital world or figuring out how we need to accomplish it. If I look at our data, modernization is it is a major program and, uh, effort, uh, in, in our, in our division, what started as a reducing cost or looking at an infrastructure play, moving from physical data assets to the cloud, as well as enhancing our resiliency as quickly morphed into meeting business demand and objectives, whether it be for sourcing, servicing or securitization of our loan products. So where are we as we think about creating this digital data marketplace, we are, we are basically forming, empowering a new data ecosystem, which Columbia is definitely playing a major role. It's more than just a cloud native data lake, but it's bringing in some of our current assets and capabilities into this new data landscape. >>So as we think about creating an information hub, part of the challenges, as you say, 50 years of having millions of loans and millions of data across multiple assets, it's frigging out that you still have to care and feed legacy while you're building the new highway and figuring out how you best have to transform and translate and move data and assets to this new platform. What we've been striving for is looking at what is the business demand or what is the business use case, and what's the value to help prioritize that transformation. Exciting part is, as you think about new uses of acquiring and distribution of data, as well as news new use cases for prescriptive and predictive analytics, the power of what we're building in our daily, this new data ecosystem, we're feeling comfortable, we'll meet the business demand, but as any CTO will tell you demand is always, uh, outpaces our capacity. And that's why we want to be very diligent in terms of our execution plan. So we're very excited as to what we've accomplished so far this year and looking forward as we offered a remainder year. And as you go into 2022. Excellent, >>Thanks JAG. Uh, two books go to you. As I mentioned in the intro of that Freddie Mac has won the Culebra excellence award for data program of the year. Again, congratulations on that, but I'd love to understand the Kleber center of excellence that you're building at Freddie Mac. First of all, define what a center of excellence is to Freddie Mac and then what you're specifically building. Yeah, sure. >>So the Cleaver center of excellence provides us the overall framework from a people and process standpoint to focus in on our use of Colibra and for adopting best practices. Uh, we can have teams that are focused just on developing best practices and implementing workflows and lineage within Collibra and implementing and adopting a number of different aspects of Libra. It provides the central hub of people being domain experts on the tool that can then be leveraged by different groups within the organization to maintain, uh, the tool. >>Put another follow on question a T for you. How does Freddie Mac define, uh, dated citizens as anybody in finance or sales or marketing or operations? What does that definition of data citizen? >>It's really everyone it's within the organization. They all consume data in different ways and we provide a way of governing data and for them to get a better understanding of data from Collibra itself. So it's really everyone within the organization that way. >>Excellent. Okay. Let's go over to you a big topic at data citizens. 21 is collaboration. That's probably a word that we used a ton in the last 15 plus months or so it was every business really pivoted quickly to figure out how do we best collaborate. But something that you talked about in your intro is being the bridge between business and it, I want to understand from your perspective, how can data teams help to drive improved collaboration between business and it, >>The collaboration between business and technology have been a key focus area for us over the last few years, we actually started an agile transformation journey two years ago that we called modern delivery. And that was about moving away from project teams to persistent product teams that brought business and technology together. And we've really been able to pioneer that in the data space within Freddie Mac, where we have now teams with product owners coming from the data team and then full stack ID developers with them creating these combined teams to meet the business needs. We found that bringing these teams together really remove the barriers that were there in the interaction and the employee satisfaction has been high. And like you said, over the last 16 months with the pandemic, we've actually seen the productivity stay same or even go up because the teams were all working together, they work as a unit and they all have the sense of ownership versus working on a project that has a finite end date to fail. So we've, um, you know, we've been really lucky with having started this two years ago. Well, and >>That's great. And congratulations about either maintaining productivity or having it go up during the last 16 months, which had been incredibly challenging. Jack. I want to ask you what does winning this award from Collibra what does this mean to you and your team and does this signify that you're really establishing a data first culture? >>Great question, Lisa again. Um, I think winning the award, uh, just from a team standpoint, it's a great honor. Uh, Kleber has been a fantastic partner. And when I think about the journey of going from spread sheets, right, that all of us had in the past to now having all our business class returns lineage, and really being at the forefront of our data monetization. So as we think about moving to the cloud Beliebers step in step with us in terms of our integral part of that holistic delivery model, when I ultimately, as a CDO, it's really the team's honor and effort, cause this has been a multi-year journey to get here. And it's great that Libra as a, as a partner has helped us achieve some of these goals, but also recognized, um, where we are in terms of, uh, as looking at data as a product and some of our, um, leading forefront and using that holistic delivery, uh, to, uh, to meet our business objectives. So overall poorly jazzed when, uh, we've been found that we wanted the data program here at Collibra and very honored, um, uh, to, to win this award. That's >>Where we got to bring back I'm jazzed. I liked that jug sticking with you, let's unpack a little bit, some of those positive results, those business outcomes that you've seen so far from the data program. What are those? >>Yeah. So again, if you were thinking about a traditional CDO model, what were the terms that would have been used few years ago? It was around governance and may have been viewed as an oversight. Um, maybe less talking, um, monetization of what it was, the business values that you needed to accomplish collectively. It's really those three building blocks managing content. You got to trust the source, but ultimately it's empowering the business. So the best success that I could say at Freddy, as you're moving to this digital world, it's really empowering the business to figure out the new capabilities and demand and objectives that we're meeting. We're not going to be able to transform the mortgage industry. We're not going to be able or any, any industry, if we're still stuck in old world thinking, and ultimately data is going to be the blood that has to enable those capabilities. >>So if you tell me the business best success, we're no longer talking a okay, I got my data governance, what do we have to do? It's all embedded together. And as I alluded to that partnership between business and it informing that data is a product where you now you're delivering capabilities holistically from program teams all across data. It's no longer an afterthought. As I said, a few minutes ago, you're able to then meet the demand what's current. And how do we want to think about going forward? So it's no longer buzzwords of digital data marketplace. What is the value of that? And that's what the success, I think if our group collectively working across the organization, it's just not one team it's across the organization. Um, and we have our partners, our operations, everyone from business owners, all swimming in the same direction with, and I would say critical management support. So top of the house, our, our head of business, my, my boss was the COO full supportive in terms of how we're trying to execute and I've makes us, um, it's critical because when there is a potential, trade-offs, we're all looking at it collectively as an organization, >>Right. And that's the best viewpoint to have is that sort of centralized unified vision. And as you say, JAG, the support from, from up top, uh, I'd see if I want to ask you, you establish the Culebra center of excellence. What are you focused on now? >>So we really focused in allowing our users to consume data and understand data and really democratizing data so that they can really get a better understanding of that. So that's a lot of our focus and engaging with Collibra and getting them to start to define things in Colibra law form. That's a lot of focus right now. >>Excellent. Want to stay with you one more question and take that I'm gonna ask to all of you, what are you most excited about a lot of success that you've talked about transforming a legacy institution? What are you most excited about and what are the next steps for the data program? Uh, teak what's are your thoughts? >>Yeah, so really modernizing onto, uh, onto a cloud data lake and allowing all of the users and, uh, Freddie Mac to consume data with the level of governance that we need around. It is a exciting proposition for me. >>What would you say is most exciting to you? >>I'm really looking forward to the opportunities that artificial intelligence has to offer, not just in the augmented analytics space, but in the overall data management life cycle. There's still a lot of things that are manual in the data management space. And, uh, I personally believe, uh, artificial intelligence has a huge role to play there. And Jackson >>Question to you, it seems like you have a really strong collaborative team. You have a very collaborative relationship with management and with Collibra, what are you excited about? What's coming down the pipe. >>So Lisa, if I look at it, you know, we sit back here June, 2021, where were we a year ago? And you think about a lot of the capabilities and some of the advancements that we may just in a year sitting virtually using that word jazzed or induced or feeling really great about. We made a lot of accomplishments. I'm excited what we're going to be doing for the next year. So there's other use cases, and I could talk about AIML and OCHA talks about, you know, our new ecosystem. Seeing those use cases come to fruition so that we're, we are contributing to value from a business standpoint. The organization is what really keeps me up. Uh, keeps me up at night. It gets me up in the morning and I'm really feeling dues for the entire division. Excellent. >>Well, thank you. I want to thank all three of you for joining me today. Talking about the successes that Freddie Mac has had transforming in partnership with Colibra again, congratulations on the Culebra excellence award for the data program. It's been a pleasure talking to all three of you. I'm Lisa Martin. You're watching the cubes coverage of Collibra data citizens 21.

>> Announcer: Live, from Orlando Florida It's theCUBE! Covering Pentaho World 2017. Brought to you by Hitachi Ventara. >> Welcome back to theCUBE's live coverage of Pentaho World brought to you by Hitachi Ventara I'm your host Rebecca Knight along with my co-host Dave Vellante, we're joined by Brendan Aldrich he is the chief data officer at Ivy Tech which is Indiana's community college system Thanks so much for joining us. >> Thank you very much I appreciate it. >> And congratulations because I know that you've just won the Pentaho Excellence Award for the Social Impact category. At Ivy Tech you are you using the power of data to combat one of the toughest problems in education higher education drop out rate so tell us a little bit about what you're doing and how you're using data. >> Certainly, well Ivy Tech has been really one of the more innovative players in the higher education space when it comes to how we're utilizing data. Both from the work that data engineering and our chief technology officer has done to the work we're doing now from my area to make that data very useful and very usable for the organization. And we're tackling it on multiple fronts. We're using data in order to help more quickly identify students that have already completed the requirements to graduate. Or if they are close to or have already potentially completed the requirements to graduate on another major other than their declared major and starting those conversations with the students. >> And what about the drop out too so you are obviously also looking at students that are at risk. >> We've been engaged in a project called Project Early Success where we work in the first two weeks of a 16 week term to identify which students we believe are at risk for failure. And then we spend the next two weeks, weeks 3 and 4 of the term coordinating hundreds of faculty staff and administrators to reach out and try to talk to those students and see if we can move them back on track. The first term that we did that we saw a great success with, we, by mid-term were showing a 3.3 percentage point drop in our number of D's and F's being reported. For an organization our size, that meant over 3000 students, more student, who were passing their courses at mid-term as compared to failing them, compared to the year before. >> Scope of the organization? Student size? >> Ivy Tech, we are Indiana state wide community college system so we have 19 campuses, almost 9000 employees and we educate around 160 000 students per year. >> Wow. So just getting back to that college drop out, so professors are putting in the data about who's going to class, who's not going to class >> Brendan: That's right. >> The grades that their getting. And then that's all being fed in and you're finding out who the at risk people are, and it's really just reaching out to them and it's saying "Hey, what's going on?" >> Absolutely. And in fact a lot of the work was done with our engineering team to actually identify data that related to the behaviors of the students. So it's not just their attendance it's not just previous performance in similar classes. But it's really finding those data elements that relate to behaviors of the students that we believe are going to put them on a less successful track. >> Brendan I wonder if we can talk about the role of the Chief Data Officer. When we talk to CDO's in for profit organizations they always say we start with an understanding of how data can help with our monetization strategies. Now let's translate that for a community college. Is that a reasonable starting point if I frame it as how data adds value to the organization is that where you started and take us through sort of the journey of your role. >> Absolutely. Well first of all Chief Data Officers in higher education are still fairly rare. At the time Ivy Tech hired me in December of 2015 I was only the 9th Chief Data Officer working at any college or university in the country. And the first that had been appointed at a two year college. So whereas a public institution like ours is not necessarily as driven by profitability students success is something that's very high on our priority list and being sure that we were able to make data very available to everyone in the organization that was working with our students so that they could use that data to more directly target the areas that they could help the student best. Now there can be profitability components as a public institution we do receive funds from the state, performance funding for students who successfully graduate. In some ways we've been able to use data to help our registrars identify those students more quickly. Which certainly gives us a lot of opportunity not only to help the students on their own educational goals and careers but to be able to increase the amount of performance funding that Ivy Tech receives from the state as well. >> So that you brought to the other point CDO's tell us is data access, making that data accessible. And then there's a trust component too. It's got to be reliable and it's hard with all this data and all this data growth is how are you addressing kind of those challenges? >> One of the things that's really unique about how we're approaching data at Ivy Tech is this idea of a data democracy. It's more than self-service business intelligence or self-service analytics. Because instead of just providing access we wanted to make sure that once our employees had access, that the data was intuitive. That it was relevant to their responsibilities. That it was interactive. So that as their needs and challenges and questions evolved they could continue to use data to answer those questions without having to go back to a central IT team or a central research team. So the data democracy is a really unique aspect of ours that was important to us and I think at the moment we have about 4000 of our employees trained and running on our platform today. >> So everybody wants to be data driven these days your job is to actually affect that data driven initiative. Culturally, people say they're data driven but they don't necessarily act that way. They still act on gut feel and this is the way we've always done it. How have you been able to affect the cultural transformation? >> Well it's important to remember that if you can make the right data available to the people who are ready to use it, that's a transformational opportunity. For us, before we began on this project less than 2% of our employee base actually had the ability to create a report. Everyone else had to make requests wait for data to be made available it could take time and maybe that data wasn't available by the time they actually needed it. So if you think about that, moving from a place where less than 2% of our employees had access to data to a point where we're approaching 50% of our employees now having really good access to data we didn't want just a few silver bullets we feel that every one of our employees has the potential, if they have the right data available to test their ideas with data and come up with brand new, innovative ideas. So we could have thousands of silver bullets coming to rise throughout our organization. >> So give us some examples, I mean we've talked a little bit about how the data is transforming the student experience and student success rate but how, what are some of your grand ideas about how faculty and how employees can use data to test ideas and make their lives easier and make Ivy Tech more successful. >> Oh absolutely. And even if you think about Project Early Success and the idea that we were helping to identify students that we believe may be struggling behaviorally in being successful in their courses. Now if you can take that as an attribute and you can surface it through our system to the employees that are using it which includes our faculty. Our faculty members now have the ability to see very quickly which of their students may be struggling and have the chance to intervene with those students as well on a regular basis. So it's not just one phone call at the beginning of the term. It's not just Project Early Success but now what we're talking about as Project Student Success how do we continue to use that kind of information to engage the student over the entire course of the term to ensure that we're not just changing their trajectory a little bit in the beginning but that we're following that journey with them over the course of their educational goal. >> Can you talk about the regime in your organization? The reporting structure, to whom do you report is there a CIO- >> Brendan: There is. >> What's the relationship there? >> There is a CIO who I report to the Chief Technology Officer and I both report to the CIO and we had a recent change in our leadership within the organization as well. Back a year ago this last July we have a new president of the state wide organization Dr. Sue Ellspermann who was formerly our lieutenant governor for the state of Indiana. >> So that's interesting that you report to the CIO. Most Chief Data Officers, we find, I wonder if you can comment don't report to the CIO there's sort of a parallel organization for a variety of reasons. People generally believe that well, it maybe one day was the CIO's job it's sort of the CIO's job morphed into kind of keeping the lights on and the infrastructure going, but what do you see amongst your colleagues with that regard? >> You know what's important for me and I think that if you look at every organization across the country there is this data knowledge gap. This idea that you've got your IT and engineering staff that knows everything there is about how to build, support, augment and de-commission these systems but generally have not been as involved in what the data means inside those systems or what decisions are being made off that data. On the other half of that gap you've got all of the rest of your organization the people that are using data who know what it means and who are making decisions from it but generally don't know enough about how to think about structuring that data so that they could get the engineering teams to build them new tools. This is really the place where a Chief Data Officer in my mind comes to sit. Because my goal is to build those bridges between the organization so that we can help engineering learn more about what we're doing as an organization with data and then use that information to build tools that will drive the rest of the organization closer to those goals through data. >> Now you're not a bank so you've got, I'm imagining a pretty small team. >> Brendan: We do. >> So maybe you can talk about that and how you manage with such a small team. >> You know it's interesting most organizations when you think about a build versus buy scenario you think about well I don't have a lot of people I don't have a lot of bandwiths, maybe we need to buy. Now Ivy Tech went through that process and every one of the RP's that came back were too expensive We couldn't afford to do it. So as a team we had to sit down and think about how do we really rethink the way that we approach this in order to still accomplish what we need out of data and out of our data warehouse and analytic systems. Part of what I'll be speaking at the conference today is some of those entrenched data practices that we had to overcome or rethink and rewrite in order to get to where we are today. >> Well Brendan it's been so much fun having you on theCUBE, thanks so much. >> Well thank you, I appreciate it. >> I'm Rebecca Knight for Dave Vellante you are watching theCUBE, we will have more from Pentaho World in just a little bit. (electronic music)

>> Announcer: Live from Orlando, Florida it's theCUBE covering Pentaho World 2017. Brought to you by Hitachi Vantara. (upbeat techno music) (coughs) >> Welcome to Day Two of theCUBE's live coverage of Pentaho World, brought to you by Hitachi Vantara. I'm your host Rebecca Knight along with my co-host Dave Vellante. We're joined by Robert Walsh. He is the Technical Director Enterprise Business Intelligence at ZeniMax. Thanks so much for coming on the show. >> Thank you, good morning. >> Good to see ya. >> I should say congratulations is in order (laughs) because you're company, ZeniMax, has been awarded the Pentaho Excellence Award for the Big Data category. I want to talk about the award, but first tell us a little bit about ZeniMax. >> Sure, so the company itself, so most people know us by the games versus the company corporate name. We make a lot of games. We're the third biggest company for gaming in America. And we make a lot of games such as Quake, Fallout, Skyrim, Doom. We have game launching this week called Wolfenstein. And so, most people know us by the games versus the corporate entity which is ZeniMax Media. >> Okay, okay. And as you said, you're the third largest gaming company in the country. So, tell us what you do there. >> So, myself and my team, we are primarily responsible for the ingestion and the evaluation of all the data from the organization. That includes really two main buckets. So, very simplistically we have the business world. So, the traditional money, users, then the graphics, people, sales. And on the other side we have the game. That's where a lot of people see the fun in what we do, such as what people are doing in the game, where in the game they're doing it, and why they're doing it. So, get a lot of data on gameplay behavior based on our playerbase. And we try and fuse those two together for the single viewer or customer. >> And that data comes from is it the console? Does it come from the ... What's the data flow? >> Yeah, so we actually support many different platforms. So, we have games on the console. So, Microsoft, Sony, PlayStation, Xbox, as well as the PC platform. Mac's for example, Android, and iOS. We support all platforms. So, the big challenge that we have is trying to unify that ingestion of data across all these different platforms in a unified way to facilitate downstream the reporting that we do as a company. >> Okay, so who ... When it says you're playing the game on a Microsoft console, whose data is that? Is it the user's data? Is it Microsoft's data? Is it ZeniMax's data? >> I see. So, many games that we actually release have a service act component. Most of our games are actually an online world. So, if you disconnect today people are still playing in that world. It never ends. So, in that situation, we have all the servers that people connect to from their desktop, from their console. Not all but most data we generate for the game comes from the servers that people connect to. We own those. >> Dave: Oh, okay. >> Which simplifies greatly getting that data from the people. >> Dave: So, it's your data? >> Exactly. >> What is the data telling you these days? >> Oh, wow, depends on the game. I think people realize what people do in games, what games have become. So, we have one game right now called Elder Scrolls Online, and this year we released the ability to buy in-game homes. And you can buy furniture for your in-game homes. So, you can furnish them. People can come and visit. And you can buy items, and weapons, and pets, and skins. And what's really interesting is part of the reason why we exist is to look at patterns and trends based on people interact with that environment. So for example, we'll see America playerbase buy very different items compared to say the European playerbase, based on social differences. And so, that helps immensely for the people who continuously develop the game to add items and features that people want to see and want to leverage. >> That is fascinating that Americans and Europeans are buying different furniture for their online homes. So, just give us some examples of the difference that you're seeing between these two groups. >> So, it's not just the homes, it applies to everything that they purchase as well. It's quite interesting. So, when it comes to the Americans versus Europeans for example what we find is that Europeans prefer much more cosmetic, passive experiences. Whereas the Americans are much things that stand out, things that are ... I'm trying to avoid stereotypes right now. >> Right exactly. >> It is what it is. >> Americans like ostentatious stuff. >> Robert: Exactly. >> We get it. >> Europeans are a bit more passive in that regard. And so, we do see that. >> Rebecca: Understated maybe. >> Thank you, that's a much better way of putting it. But games often have to be tweaked based on the environment. A different way of looking at it is a lot of companies in career in Asia all of these games in the West and they will have to tweak the game completely before it releases in these environments. Because players will behave differently and expect different things. And these games have become global. We have people playing all over the world all at the same time. So, how do you facilitate it? How do you support these different users with different needs in this one environment? Again, that's why BI has grown substantially in the gaming industry in the past five, ten years. >> Can you talk about the evolution of how you've been able to interact and essentially affect the user behavior or response to that behavior. You mentioned BI. So, you know, go back ten years it was very reactive. Not a lot of real time stuff going on. Are you now in the position to effect the behavior in real time, in a positive way? >> We're very close to that. We're not quite there yet. So yes, that's a very good point. So, five, ten years ago most games were traditional boxes. You makes a game, you get a box, Walmart or Gamestop, and then you're finished. The relationship with the customer ends. Now, we have this concept that's used often is games as a service. We provide an online environment, a service around a game, and people will play those games for weeks, months, if not years. And so, the shift as well as from a BI tech standpoint is one item where we've been able to streamline the ingest process. So, we're not real time but we can be hourly. Which is pretty responsive. But also, the fact that these games have become these online environments has enabled us to get this information. Five years ago, when the game was in a box, on the shelf, there was no connective tissue between us and them to interact and facilitate. With the games now being online, we can leverage BI. We can be more real time. We can respond quicker. But it's also due to the fact that now games themselves have changed to facilitate that interaction. >> Can you, Robert, paint a picture of the data pipeline? We started there with sort of the different devices. And you're bringing those in as sort of a blender. But take us through the data pipeline and how you're ultimately embedding or operationalizing those analytics. >> Sure. So, the game theater, the game and the business information, game theater is most likely 90, 95% of our total data footprint. We generate a lot more game information than we do business information. It's just due to how much we can track. We can do so. And so, a lot of these games will generate various game events, game logs that we can ingest into a single data lake. And we can use Amazon S3 for that. But it's not just a game theater. So, we have databases for financial information, account users, and so we will ingest the game events as well as the databases into one single location. At that point, however, it's still very raw. It's still very basic. We enable the analysts to actually interact with that. And they can go in there and get their feet wet but it's still very raw. The next step is really taking that raw information that is disjointed and separated, and unifying that into a single model that they can use in a much more performant way. In that first step, the analysts have the burden of a lot of the ETL work, to manipulate the data, to transform it, to make it useful. Which they can do. They should be doing the analysis, not the ingesting the data. And so, the progression from there into our warehouse is the next step of that pipeline. And so in there, we create these models and structures. And they're often born out of what the analysts are seeing and using in that initial data lake stage. So, they're repeating analysis, if they're doing this on a regular basis, the company wants something that's automated and auditable and productionized, then that's a great use case for promotion into our warehouse. You've got this initial staging layer. We have a warehouse where it's structured information. And we allow the analysts into both of those environments. So, they can pick their poison in respects. Structured data over here, raw and vast over here based on their use case. >> And what are the roles ... Just one more follow up, >> Yeah. >> if I may? Who are the people that are actually doing this work? Building the models, cleaning the data, and shoring data. You've got data scientists. You've got quality engineers. You got data engineers. You got application developers. Can you describe the collaboration between those roles? >> Sure. Yeah, so we as a BI organization we have two main groups. We have our engineering team. That's the one I drive. Then we have reporting, and that's a team. Now, we are really one single unit. We work as a team but we separate those two functions. And so, in my organization we have two main groups. We have our big data team which is doing that initial ingestion. Now, we ingest billions of troves of data a day. Terabytes a data a day. And so, we have a team just dedicated to ingestion, standardization, and exposing that first stage. Then we have our second team who are the warehouse engineers, who are actually here today somewhere. And they're the ones who are doing the modeling, the structuring. I mean the data modeling, making the data usable and promoting that into the warehouse. On the reporting team, basically we are there to support them. We provide these tool sets to engage and let them do their work. And so, in that team they have a very split of people do a lot of report development, visualization, data science. A lot of the individuals there will do all those three, two of the three, one of the three. But they do also have segmentation across your day to day reporting which has to function as well as the more deep analysis for data science or predictive analysis. >> And that data warehouse is on-prem? Is it in the cloud? >> Good question. Everything that I talked about is all in the cloud. About a year and a half, two years ago, we made the leap into the cloud. We drunk the Kool-Aid. As of Q2 next year at the very latest, we'll be 100% cloud. >> And the database infrastructure is Amazon? >> Correct. We use Amazon for all the BI platforms. >> Redshift or is it... >> Robert: Yes. >> Yeah, okay. >> That's where actually I want to go because you were talking about the architecture. So, I know you've mentioned Amazon Redshift. Cloudera is another one of your solutions provider. And of course, we're here in Pentaho World, Pentaho. You've described Pentaho as the glue. Can you expand on that a little bit? >> Absolutely. So, I've been talking about these two environments, these two worlds data lake to data warehouse. They're both are different in how they're developed, but it's really a single pipeline, as you said. And so, how do we get data from this raw form into this modeled structure? And that's where Pentaho comes into play. That's the glue. If the glue between these two environments, while they're conceptually very different they provide a singular purpose. But we need a way to unify that pipeline. And so, Pentaho we use very heavily to take this raw information, to transform it, ingest it, and model it into Redshift. And we can automate, we can schedule, we can provide error handling. And so it gives us the framework. And it's self-documenting to be able to track and understand from A to B, from raw to structured how we do that. And again, Pentaho is allowing us to make that transition. >> Pentaho 8.0 just came out yesterday. >> Hmm, it did? >> What are you most excited about there? Do you see any changes? We keep hearing a lot about the ability to scale with Pentaho World. >> Exactly. So, there's three things that really appeal to me actually on 8.0. So, things that we're missing that they've actually filled in with this release. So firstly, we on the streaming component from earlier the real time piece we were missing, we're looking at using Kafka and queuing for a lot of our ingestion purposes. And Pentaho in releasing this new version the mechanism to connect to that environment. That was good timing. We need that. Also too, get into more critical detail, the logs that we ingest, the data that we handle we use Avro and Parquet. When we can. We use JSON, Avro, and Parquet. Pentaho can handle JSON today. Avro, Parquet are coming in 8.0. And then lastly, to your point you made as well is where they're going with their system, they want to go into streaming, into all this information. It's very large and it has to go big. And so, they're adding, again, the ability to add worker nodes and scale horizontally their environment. And that's really a requirement before these other things can come into play. So, those are the things we're looking for. Our data lake can scale on demand. Our Redshift environment can scale on demand. Pentaho has not been able to but with this release they should be able to. And that was something that we've been hoping for for quite some time. >> I wonder if I can get your opinion on something. A little futures-oriented. You have a choice as an organization. You could just take roll your own opensource, best of breed opensource tools, and slog through that. And if you're an internet giant or a huge bank, you can do that. >> Robert: Right. >> You can take tooling like Pentaho which is end to end data pipeline, and this dramatically simplifies things. A lot of the cloud guys, Amazon, Microsoft, I guess to a certain extent Google, they're sort of picking off pieces of the value chain. And they're trying to come up with as a service fully-integrated pipeline. Maybe not best of breed but convenient. How do you see that shaking out generally? And then specifically, is that a challenge for Pentaho from your standpoint? >> So, you're right. That why they're trying to fill these gaps in their environment. To what Pentaho does and what they're offering, there's no comparison right now. They're not there yet. They're a long way away. >> Dave: You're saying the cloud guys are not there. >> No way. >> Pentaho is just so much more functional. >> Robert: They're not close. >> Okay. >> So, that's the first step. However, though what I've been finding in the cloud, there's lots of benefits from the ease of deployment, the scaling. You use a lot of dev ops support, DBA support. But the tools that they offer right now feel pretty bare bones. They're very generic. They have a place but they're not designed for singular purpose. Redshift is the only real piece of the pipeline that is a true Amazon product, but that came from a company called Power Excel ten years ago. They licensed that from a separate company. >> Dave: What a deal that was for Amazon! (Rebecca and Dave laugh) >> Exactly. And so, we like it because of the functionality Power Excel put in many year ago. Now, they've developed upon that. And it made it easier to deploy. But that's the core reason behind it. Now, we use for our big data environment, we use Data Breaks. Data Breaks is a cloud solution. They deploy into Amazon. And so, what I've been finding more and more is companies that are specialized in application or function who have their product support cloud deployment, is to me where it's a sweet middle ground. So, Pentaho is also talking about next year looking at Amazon deployment solutioning for their tool set. So, to me it's not really about going all Amazon. Oh, let's use all Amazon products. They're cheap and cheerful. We can make it work. We can hire ten engineers and hack out a solution. I think what's more applicable is people like Pentaho, whatever people in the industry who have the expertise and are specialized in that function who can allow their products to be deployed in that environment and leverage the Amazon advantages, the Elastic Compute, storage model, the deployment methodology. That is where I see the sweet spot. So, if Pentaho can get to that point, for me that's much more appealing than looking at Amazon trying to build out some things to replace Pentaho x years down the line. >> So, their challenge, if I can summarize, they've got to stay functionally ahead. Which they're way ahead now. They got to maintain that lead. They have to curate best of breed like Spark, for example, from Databricks. >> Right. >> Whatever's next and curate that in a way that is easy to integrate. And then look at the cloud's infrastructure. >> Right. Over the years, these companies that have been looking at ways to deploy into a data center easily and efficiently. Now, the cloud is the next option. How do they support and implement into the cloud in a way where we can leverage their tool set but in a way where we can leverage the cloud ecosystem. And that's the gap. And I think that's what we look for in companies today. And Pentaho is moving towards that. >> And so, that's a lot of good advice for Pentaho? >> I think so. I hope so. Yeah. If they do that, we'll be happy. So, we'll definitely take that. >> Is it Pen-ta-ho or Pent-a-ho? >> You've been saying Pent-a-ho with your British accent! But it is Pen-ta-ho. (laughter) Thank you. >> Dave: Cheap and cheerful, I love it. >> Rebecca: I know -- >> Bless your cotton socks! >> Yes. >> I've had it-- >> Dave: Cord and Bennett. >> Rebecca: Man, okay. Well, thank you so much, Robert. It's been a lot of fun talking to you. >> You're very welcome. >> We will have more from Pen-ta-ho World (laughter) brought to you by Hitachi Vantara just after this. (upbeat techno music)

>> Announcer: Live from Orlando, Florida. It's theCube covering PentahoWorld 2017, brought to you buy Hitachi Ventara. >> Welcome back to theCube's live coverage of PentahoWorld, brought to you of course by Hitachi Ventara. I'm your host, Rebecca Knight, along with my cohost James Kobielus. We are joined by Stephano Celati. He is a Pentaho Solutions consultant at BNova. Thanks so much for coming on theCube, Stephano. >> Thank you for having me. >> So I should say congratulations are in order because you are here to accept the Pentaho Excellence Award for the ROI category on behalf of LAZIOcrea. Tell us about the award. >> Yes, as I was saying, I'm really proud of this award because it is something that is related to public administration savings, which is a good thing, first of all for me as a citizen, let's say. This project is about healthcare spending. In Italy the National Healthcare Services allows the drugstore to sell medicines to total or partial reimbursement by NHS itself. And they also have the possibility to replace the medicine with a generic drug which normally costs less to the people and also to the health service itself. So a couple of years ago (speaks in foreign language) which is the political area to which Rome belongs just to explain, launched a new project to monitor, analyze and inspect the spending flow in drugs. So we partnered with LAZIOcrea to create a business analytics platform based on Pentaho obviously, and which collects all the data coming from the prescriptions and store it in an analytical database that is Vertica, and uses PDI/ETL tools to store this data. >> That's for Pentaho Data Integration. >> Yes, PDI is Pentaho Data Integration, good point. And after that we present the data in terms of reporting, analysis, dashboards, to all the people that are interested in this data. So we talk about regional managers, we talk about auditors, and also to local district users which are in charge of managing the expenditure for drugs. The outcome of this project was real impressive because we had an expenditure fell by 3.6%, which in a region where we have more than 200 million prescriptions every year means 34 million Euros in a years. >> Rebecca: Wow. >> So it was really huge result. We were very happy about that. And it was so simple because simply monitoring better the expenditure, monitoring how they deliver the drugs out, what kind of medicine they prescribe and targeting what pharmacies sell to the end user just gave these impressive results. And this year they are forecasting for 41 million Euros in savings more, so it's a huge result. It's something that is for us really a good result. >> So here in the U.S., I mean we have problems very similar to what you just described in Italy. And just putting the transparency around the data would be a huge revelation for the United States, too. How big a departure was it in Italy? >> Well, it was a really a big problem to start because they didn't have any system to collect all this data. So they had to set up everything from scratch, let's say, just by acquiring the paper where the physician writes the recipe, so it was not that easy to build it from scratch. But after that the region has had the opportunity to monitor this data and also to publish this data, which is something that in Italy is really relevant in this moment because we are talking about open government, we are talking about open data, and so again, the result was really impressive. >> Do you see any follow on opportunities to use this data for other purposes other than the initial application? >> Yes, we already experienced a different usage of this data because during the last major earthquake we have in 2016 in this area, those guys from LAZIOcrea were able to produce a list of mostly the drugs in that area just in a couple of hours, just by using the ETL and setting up this list that somehow help the first aid units in giving the right assistance on time. And next steps will be about hyper prescriptions because we want to monitor if there are any doctors that prescribe drugs that are not really necessary. And we also try to move our inspection also to hospitals because when you do a surgery, you get medicine, you get a lot of assistance in the hospital. So we want also to monitor that kind of the aspect, which is again in charge of the health system. >> To make sure that the right medicines are being distributed to the right regions at the right time for the intent to likely-- >> Yes, this could also lead to something that is a correlation analysis, meaning what is your pain and what are you assuming so that they can have an historical data they can use to prescribe better medicines. >> But the anecdote he was sharing about the earthquake too is really compelling too, if you think about a public health crisis and outbreak of some sort, to be able to get drugs quickly to those in needs, it's really astonishing. >> Again, this morning we were talking about data lake. This is a sort of data lake. We found several ways to use that data, to fish them back from the data, let's say from the lake, and it's really impressive what you can do if you have the right information and you know how to use it. >> How do you see the market developing over the next year, next five years? >> Yes, the problem in Italy is that the market is not so responsive to innovation like others, let's say U.S. or U.K. and Europe. So for this reason my company Bnova set up annual event which is called Big Data Tech, and the purpose of this event is to spread knowledge about big data systems, products, architecture and so on, which helps companies in knowing better what they can do with these platforms. So in the next month we see a lot of opportunities. Generically speaking data mining field, we start talking about predictive analysis, we start talking about smart cities and other stuff like that. So again, we will need maybe to enter in a new phase of let's say (mumbling) because companies like BNova and others that operate in this field of business analytics need to put to general knowledge what other innovative companies are doing. So in the next month we will for sure move to newer architectures, new technology, and we will have to support all the companies with this kind of stuff. >> In terms of the new technology you're moving to, is there a role for the internet of things, both in your plans and really in terms of the Italian market. What sort of potential applications are there for IOT related perhaps to the use of it with health data going forward in Italy? >> Yes, also for healthcare, but in Italy the IOT team is a parallel line that is growing thanks to a governmental initiative which is called Industry 4.0, which encourages the usag of interconnected machines, connected to the internet, so classical approach of the IOT field. So with this new approach and the government sustain we believe that the IOT will have a big improvement in the next years. Again, we are talking about Italy, so we are not so fast in growing. But again, we are starting to talk about smart cities for energy saving, sustainable energy and other stuff in which the IOT plays a key role. So as far as our business is concerned, that is business analytics, so on top of that we see a lot of opportunities coming from predictive analysis, which means to prevent the maintenance of a machine, for example, or to use virtual reality to simulate a laboratory test and other stuff. So with these opportunities for sure the usage of data mining tools, such Wake Up when we're talking about Pentaho Solutions, could be a great advantage because you will apply the knowledge to your data. So you will not only analyze the data, but you will also extract some sort of knowledge from the data which can help companies. >> Of course, Italy is where the renaissance began, and it just sounds like you, I mean renaissance use of analytics to help the Italian people and the Italian economy to continue to grow and innovate. >> Stephano: Yes, yes. >> So I want to see not a data lake, a data colosseum, that should be on your to do list. >> I want a data gallery with lots of data masterpieces hanging on the walls all around Italy. >> Exactly. >> You'll be the new Leonardo and Michelangelo. >> Stefano , I love it. Well, thank you so much for coming on theCube. >> Thank you for having me. >> I am Rebecca Knight for Jim Kubielus. We will have more from PentahoWorld just after this.