>>live from Atlanta, Georgia. It's the Q covering answerable best 2019. Brought to you by Red hat. >>Hey, welcome back to the Cuban Live coverage in simple fest. Two days of coverage. Day one, wrapping up. I'm John forwards. Accused Too many men. My guest co host today, our next two guests at his van. Van Velzen. Okay, welcome to the Cube. You're an engineer at I n G Bank and Robert de Bock, product owner, engineer I n g. Bank. Hey, guys, Thanks for coming on. Thank you. Have the practitioner on. Well, first of all, we have a lot of great feedback from the practitioners here. And also people in deploying answerable and other other cool Dev ops Tools on automation is at the top of the list. Yes, More efficient. Getting things done. Focus. You got satisfaction in job because things go awaiting time savings. I'm saving security drives a conversation and re skilling opportunities. Love. These are cutting edge. Things you got to do is take a minute to explain what you guys do. What a night. What a night. Angie bank. >>Yeah. I work in a team that provides redhead images for other teams. in 90 to consume to use two insane she ate way. Also live from playbooks, amendable code and rolls to manage those things. And he's very scattered, which sort of decentralized, which is a good thing. In my opinion, it's ready for scaling. In that case, I used to work with Dennis are lots in the tower team, so take it away. >>Okay, so I still work at the answer, built our squad What we do, it's ah, We make sure that the instable tower service keeps running 24 7 and we also ensure that we, uh, provide updates next to all this. We also have unanswerable community where we basically support our end users, which are their love. So, uh, from some numbers, I heard we have 1200 applications teams that are using our service. Um, and they all have, like, answerable playbook, sensible rolls, questions, difficulties with, uh, with anything. And we're basically there to support them as well. >>So 1200 teams are using answerable, Yes, inside the bank. Yes. Yeah, like >>it's set up very decentralized. And I think what I hear from instable fest that is not very common. I still think it's very good thing to do. We try to basically give these teams all the tools they need to do their stuff on. What I hear hear mostly is that there's essential team off administrators pushing the buttons for them. Towers. Great answer was great in that case, I think, for our case is really it's a perfect fit. >>E guess help Explain. Is this do you provide? You know, he said it's not centralized, but is this you know, here's best practices here. Some play boat out. How do you end? You support them? Because they're a little bit those relationships. >>Okay. Okay. Um so what we do is we basically all the rules and get ah ah, good lap. So it's an own premise. Get environment. You can search in this. Get for rules. Uh, not like all rules are easily to be found when searching for them. So that's why there are these communities to share what you have made. Um, >>plus these teams, they can themselves pick and choose. Some will try to rewrite everything That's fine. Others can can benefit from existing coat, so it's just a good trick. Thio enable these team to participate on it really different. Some people make it all themselves another >>next to this. So we basically have these 12 on the teams do their own thing. But next to this, we also have a self service portal where they can choose, like from, uh, generic finks like us. But your machine at new disc. So New capacity Cp use memory. That's all being done through a portal s so they don't need to do anything on their own for this they can, but most of them choose the easy way off using this portal. This portal basically doesn't a vehicle to instable tower, which executes a sensible playbook and some other stuffs. Maybe some AP eyes. And this is one of the things you guys create A manage these books. So, um >>and if you go back in time so the alternative way, which we happily got rid off, is to do it ourselves. I think it was before we we work together. Way had batch weekends, for example, and it >>was no very different. No life. Oh, that's working on weekends, >>weekends and, for example, he used to patch machine some 10,000 or so, and we were not aware what was important. What? Not so you you'd stop the whole pitch. Oh, this machine has a problem. Let's stop everything in focus and that's >>not important. Was like a complete order. >>And the other way around Also this machine. I guess it's not that important. Let's just >>continue this >>Sunday morning. Oh, my God. Everything's broken. >>Can you give us a little flavor of kind of the spectrum of solutions that you leverage answerable on >>tap? Yeah. We, uh I think what we see Moses for Lennox machines, eso fetching is a big one. We got a second operation, so there's a few of them. The deployment also depends on and small. So if you order a new machine, answer was involved somewhere to do to make it happen on network on board and the Windows teams are very interested. I'm not sure if we notice on board yet. To >>be honest, I know we did some book in the boss so a couple of months ago, using wind around when you needed set on policies there, But you can see that the networking teams were getting more momentum. Uh, five. There's some suffer suffer to find switches Bob. I don't know. The, uh Never mind the name, but ah, you can see some momentum in the in the networking. Uh, it's not Morgan departments >>configuration network networking with the activists. So that's where the action is in the >>network. Um, there were some cool talks also here on five workshops. So you can see there is, um, that there is some attention on these modules and integrations as well. >>What's your guy's goal here for the show? What brought you here? I'll see Big user. >>Yeah. So what do you think was like sharing our own thing? We did. They talk this morning. Ah, regarding and programming A really cool we wanted to share. It is this behavioral thing, and and >>we'll talk about take a minute and programming. >>So, um, basically, it's, ah programming with the whole team and making sure that you get something done with all the knowledge in the team. So you don't have to align off the words or if some other if you're Kulik says from basically session, you can do better using this staying. It's all, um it's It's all done during the decision >>as basically a good way to get a team up to speed. So in a team that's probably a few few people that are very quick and understand the concept and few starters or so So >>you guys decentralized, which makes sense for scale. I get that. So this sounds like you can operate decentralized, but where danceable. You can still have that common a book Switch >>teams, for example. So it used to be very specific. H team would have their own type of coat. Now that more answers used people can switch a little easier to to another product of surface because the languages have lied, shared, steal it, steal. It's quite >>well happy with this, right? I am. I really, really have to work on the weekend. That's good. I think >>the good thing is that you have one generic way of working. So his playbook is readable by all engineers. And if you want to learn this thing, you just do the inevitable course. So you know what this thing is? A mosque and roll, and it's all like >>way. We do see horrible >>koto. Come on, don't throw your college under the bus. But here's the international tough question can see is what we have been here. I want you guys to test this. We hear that there's a lot of time savings involved. Yes, with answer. True or false. That's true order of magnitude. What? What kind of saving way talking about? I >>think it depends on the thing because we saw a huge I don't know, except numbers. But this this os patching that Really? Really Uh, >>yes. Now, especially waas. Two people working a full time basically collecting, who needs to do what? The win. And then for a weekend, 10 15 people or so. So, uh, that's reduced now to sort of nothing. Yes, some maintenance to that playbook and roll. But I mean, yeah, it's difficult to express what message? So >>no one's getting phone call? Hey, come in on the weekend. So 15 people on the weekend jam and then to Fulton will just managing it all Go away. >>Yeah, not needed, but not needed. But they basically they can do something else, so those people are still there. But now they're not doing Os patching and doing all the excel sheets and keeping order off. The systems are important, and this shall be the first, and then they because way are basically doing the thing they know better. This application team knows their dependency, so they know they. But first I need to patch the database machine and then there during the front end or Andi. It's difficult to do this so they do it themselves. >>That's Dev Ops. That's that's the way it's supposed to be, right? >>So you've matured this thes deployments over time. As you look back, What key learnings do you have that maybe you'd recommend to your peers toe? You know how things could run a little bit smoother >>next time, a good amount of time. So they're stools. That's not the problem, So answer is great, but there's others to their great Give it time to sink in with the people. So you start something and you have to have a pretty strong team to do the long the long stretch with it and give it some time, maybe a year or so before everyone's on board it. In our case, in the beginning, we spend lots of time on this community model where we basically organized small meet ups or get together, too, show things or to hear problems and try to express them. That really helped a lot. And by now it's starting to get normal, more normal. So all the teams do sensible, basically. And problem starts slowly disappearing. Also. So So >>one of the things, um, that will be better. Probably in our scenario. Housekeeping metrics. So what are the improvements over time? I don't know how to measure this. No, no, no aspect. But it will be better if you had, like, better numbers like we did hair Very good. Or this is something like, what did the community thing bring way indirectly what the results are Because the engineers are doing things really, really things. They're really patching the replication. And they're really, um, restarting their own machines, for example, when there is something wrong. Whatever. Um, but our days related to our community thing or all that's really related to Sensible Tower >>last. I think we we are very technical focus. So So we like it as a nerd, so to say, to do things but what the business value is, for example, I'm not so interested or less interested so way typically, like the technology, so it could be good to have some someone onboard and your team that says, Yeah, but this is the problem. It's crossed. This amount of money and that solved now are improved. >>Well, they assume the applications are doing a good job. So you guys helped those guys out. They get to do their own thing. They do the heavy lifting. They're doing the coding anyway for those guys that were coming in managing full time on the 15 or so on the weekend. What are they doing now? >>Most are spread across. All the application teams go back. But the other side there is now it's our team that was not there s. So that's the price you have to pay. And that's a serious team. I mean, it's far six people now 86 people and 100 machines or so. So it is a serious amount of time, but it makes it at least much more constant. So people are not surprised by machines being patched, and Monday they come back into the half broken or so. So it's a lot more control now, so I don't know if you can express it in price, but at least it's more stable >>more consistent. >>Well, one of the things that we hear here and I want to get your thoughts as we wrap up is as you go forward, you got answerable 1200 teams using it. You got a lot of collaboration. The work cultures change. Sounds like a shower. Team steps service everything else. So some scale building out what's next? Because as it becomes a platform. Okay, you have to enable something. There has value there. Okay, technical nerd value and then business value >>scaling, uh, because we continuously see this thing growing like more application teams are adapting answerable, invincible tower. So, um, right now we have, like, a cluster. We have different clusters running. Go into much detail, but we can see that the load is getting higher and higher, so we need to skill. Um, and this is sort of difficult, but red. That is really supporting in this because they're going to change some things at the application level two to allow scaling even better. Um, >>plus, also, for most teams, they're starting their configuration. Everything is coat process. They're not there yet. As soon as they discover the power of it, I'm sure that's being used a lot. A lot more. And plus, there's other countries that are going to be connected. So you have a lot of work >>because your engineering doing some getting down and dirty with the code, automating everything. >>Yeah. Yeah. So, um, what else do we >>Oh, what's the coolest thing you've done that you've automated? >>Uh >>uh, Pick your favorite. >>So but the child during Encircle Tower and with answerable, um, let me think about this. >>I I really like the patching that saved us so much work. And, uh, I think also one of the next goes to make much more simpler. So we as a company, we're complex and the people also like complexity. That's wrong. We should change >>that. Patching up our >>offense, Melissa Simplicity. So we should really use that. >>You don't want any open holes in the network housely and assistance >>about your previous question. Like I have sort of a finger and all these small things. So it's sort of what I did. It's more like an A team thing. We created the OS patch playbooks, the configure stuff, the second day offs. So we did this as a team >>like sports but the playbooks together run the play. Some defense on security >>and programming. So you're doing >>this as a team, which is very cool. Has a scoreboard look good? Winning? >>Yeah, Yeah, yeah, yeah. We're looking at the graphite. Uh, it's girl. >>Final question. How you enjoying the show here? Having a good time? What's the vibe here? What's it like here? Share for the people who aren't here. What's going on? What's the vibe with >>a conversation? It's great. We went to some sessions yesterday really technical stuff with developers. And this was really amazing because you heard details that that are not in the India in the talks today and tomorrow. Um, yeah, it's great. It's great community. It's just I really I really enjoy it because you can. It's You can have, like one on one conversations go into depth. I was showing something I created, and this guy's we'll hold. This is really great in the It's cool. It's just if you it's really great. It's really >>cool. Really? Yeah, for me also, it feels like coming home, So I know these people and I think the first day, the collaboration day, what's it called and I'm not sure you community, that's it's great because it's been a bit rough and unpolished in today's more polished and more presented and prepared to, uh, both are great. >>Good. Give the hard feedback. >>Yeah, you meet all the people. So, for example, I used instable a lot, and then I'm getting up. I see all these names. Like, who would that be there walking here and shake hands like, Oh, that's >>why guys like your code looking good. Yeah. Looks good. A contributor. Summit contributed. Okay. Sorry. After it for >>anyone that goes to visit that day, too. That's just great. >>It's great to see people face to face that, you know, online for their digital identity or the code >>you can You can't complain about stuff out on. Do you know that you don't hurt them or something with just commenting on get like after this issue and this issue and this issue. Then you can see them in person. And then you >>him a high five assault, you know? Hey, >>it's really very cool. >>Guys. Great conversations were coming on cue. Thanks, Dennis. Appreciate Robert. Thanks for coming on. Skew coverage here Day one of two days of live coverage here inside the Cube here in Atlanta, Georgia for Ansel Fest is the cute I'm John 1st 2 minute. Thanks for watching.