>> Narrator: From around the globe, it's The Cube, with digital coverage of PagerDuty summit 2020. Brought to you by PagerDuty. >> Welcome to the Cube's coverage of PagerDuty Summit 2020, the virtual edition. I'm Lisa Martin and I'm pleased to welcome back to the program Cube alumni, Jonathan Randy, the Senior Vice President of Product at PagerDuty. Jonathan, welcome back. >> Good to be here. Great to be here again, Lisa, thank you. >> Quite the week for you guys, just wrapping up the three day virtual event this year reaching thousands of folks. Lots of news coming out, as we even kind of talked about the other day announcements, you said this was the biggest product release in the company's history, which is amazing to achieve during a pandemic, but AIOps, integration with Microsoft Teams, customer service solution. And we've heard a lot about automation in the keynotes and of course, with respect to the acquisition of Rundeck. Give us a quick little 60 second kind of overview of some of the things that you announced this week at the summit. >> Oh, it's been busy, as you said, and it has been really the biggest set of investments that we've brought all together at one time in the history of the company and so kind of leading the list was everything we're doing around, the category of AIOps. And so there's been a focus on automation, there's been a focus on what we're doing around event intelligence, and many new enhancements and updates to that product that's a part of the PagerDuty platform. We've also applied machine learning to our analytics, which is great with a recommendation engine to help organizations mature and really understand where they are and then, as you mentioned, big announcements around communication and collaboration with zoom, and Microsoft Teams, and even a new product from PagerDuty built on our core platform called PagerDuty for customer service. So it's been incredibly busy. >> And I'm sure lots of great feedback from customers and partners across the globe. You know, one of the things that you and I have already talked about is in the last six months, this explosion and a number of incidents that your customers are having to deal with and how PagerDuty is helping them to respond to those a lot faster. We talked about automation a lot last week, but as we think about the folks on the digital front line, have to be empowered with the information should be able to respond immediately to a customer inquiry, or risk the customer churning, talk to me a little bit about how automation, is this really kind of the next essential for combating that digital stress that the frontline workers are facing? >> Yeah, so automation has always been important to PagerDuty, and there really a couple kinds of automation that are so important. The first of which, and this is what many people know PagerDuty for is what we always refer to as people orchestration, it is automation, but it's automating is really the identification of issues and then engaging responders, these frontline workers on the right issues at the right time to make the right decisions with the right information. And so that's been the type of automation PagerDuty has really been focused on and more recently, we've taken some baby steps in the area of machine automation. We've done some things with custom actions in our web hook technology that we've delivered, but really to address some of the issues that you're referring to for workers on the front lines. We've had integrations with Rundeck, runbook automation vendors before and we have several partners in this area that do what's referred to many times as machine learning, not people orchestration and automation but machine learning. And we really felt it was important to have a world class capability as a part of PagerDuty, because it's one thing to engage individuals. But then if they still have to undergo manual toil, manual work and resolving issues, and much of that can be automated with machine automation. It's just a perfect match and it should be something that I would expect if I was a customer of PagerDuty ultimately to have. >> So PagerDuty has been working with Rundeck for about a year now, so to talk to us about some of the things that you saw from the capabilities, compatibilities rather, perspective, that you guys thought this is going to be a phenomenal addition to what PagerDuty delivers and exceeding our customer expectations. >> Well, this acquisition and the coming together of Rundeck with PagerDuty, we're super excited about, it's the first really major acquisition that PagerDuty has done and it's an extension to PagerDuty in multiple ways and it's an extension to PagerDuty in the use cases. And that customers can use us, you know, with Rundeck and PagerDuty. It's an extension to, as I just mentioned, people orchestration automation with machine automation. It's an extension of value. There's no overlap anyway, anywhere. But it's also, there's a lot of synergies and the coming together of these two organizations in particular as you know working more closely with Rundeck now, is really about their culture. Their culture is very similar to PagerDuty. And more importantly, like, as I've gotten to know, many of their customers, many of their users and there are, we have some of the same customers in the enterprise and mid market, which is really exciting, is that, although many of them are in the ITOps area, and while we have customers in ITOps, as well as in development, they all refer to themselves, those customers have Rundeck today as DevOps. And so they're very much along the same philosophy, as, you know, empowering self service, being able to take action as somebody on the on the front lines, and being able to take that action, not just be notified of it, but complete that work. And so, that notion of, you know, ubiquitous use, self service, empowerment, that's very consistent in Rundeck's culture, and their customers as it is with PagerDuty and our customers and our culture. >> I know both companies are steeped in DevOps and digital transformation, but it's nice to hear about the cultural alignment, because it's a big thing. It's not just a big thing for the two companies coming together, but also for your customers to ensure not just a seamless transition, but they really get to unlock the value of what Rundeck is going to add to PagerDuty's technologies, right? >> Very much so, very much so. In talking to some of their customers, who are our customers as well, it's just been so clear that it's a very similar use in many ways, although it's a different product, meaning a small group will start to use Rundeck and then other teams in the organization see the value of that and it grows virally. PagerDuty works in much the same way. And their product can be used for a lot of different automation uses in an organization from automating a data processing ETL process to provisioning systems for internal development teams. But one use case that really brings us both together is the focus on the incident response process, the incident response lifecycle and that's where we really got excited. And I'm seeing this week that our customers, our mutual customers are excited. Also, this notion of being able to not only identify, but also engage the right teams, prevent issues from happening in the first place, and then automate the diagnosing and the resolving of these issues before then you learn from that. So it's better the next time. So those automation steps in there, the diagnosing, and the the resolution, it's such an important part of the incident process that our customers just need in these times when digital services are more important than ever. >> Right digital services are the new norm. So is Rundeck, sort of a piece that allows PagerDuty to automate 100% of the incident response lifecycle? >> Much more than ever before, yes. So again, I look at it as take people orchestration and automation, add machine automation, the ability to bring down and bring back up a service as a part of a Rundeck set of steps or jobs, like having that together in one solution really does automate all of the incident response and gives the ability to incident to automate more and more of that incident response process. You know, the other key thing too, I was thinking through the other, obviously, throughout this process, in the other day was the synergy between, not only our customers, but our communities. And I always think of communities as a little different than just customers and PagerDuty has a thriving, growing community around it, in addition to our paying customers. One of the things that's in common with Rundeck is they have the same thing. They are an open source product with an enterprise product on top and it's a open source community of 60,000 DevOps professionals that we're bringing together with the PagerDuty community. So very excited about that synergy as well. >> Tell me a little bit about some of the feedback that you've heard from that community as these announcements including Rundeck have been made and this real obvious pivot towards automation. What are some of the things that you've heard that pleased you? >> Yeah, a couple things. From the community, from the customers, from internal teams, both on the Rundeck side of the house and on the PagerDuty side of the house. Sometimes it's just when things are, it's a good match, you don't have to explain it that much. People just see the natural synergy in it, you don't have to spend a lot of time explaining why machine automation and runbook automation is such a natural hand-in glove fit with PagerDuty and what we do today. And I think that's a huge validation. And, that message has been very consistent in what I've heard back. Some other specifics that were exciting to hear is some of our existing customers today who attended summit, who obviously had no background as to the announcement we were going to make with with Rundeck, contacted the Rundeck leadership, who then forwarded that information to me saying how excited they were, as they were attending summit, sitting in the virtual audience during our keynote addresses, as they heard the coming together of Rundeck as a part of PagerDuty, and immediately sent notes to the leadership on Rundeck saying how excited they were about that and how they wanted to expand the use, which then got forwarded to myself which nothing can be better validation. Nothing's more exciting than to see the community really understand what we're doing and see the benefits of it. >> You're right. That's the most public objective validation that the brand, any brand could get. So what would be the next steps, for example, you know, we talked last week about a whole bunch of PagerDuty customers, 13,000 plus great brands, many types of brands, Zoom, Slack, AWS, they were on main stage with you and Jennifer and the team. But if we think about some of those existing customers, what would be the next step for them to start leveraging the value that Rundeck can deliver to their environment? >> So a couple things. First, there's so much that can be automated today, if you think of just like the two big departments that use Rundeck, and PagerDUty, and there are more frontline teams than just these two. But if you think of just Dev and development, and then ITOps as two organizations that are working more closely together than ever before. You know, the real opportunity is for them to really start to shorten the time it takes for them to do so many things in their world on via Rundeck, you know, Rundeck automation and going back to some of the comments, you know, questions you asked me earlier about where some of the synergies they've made it so easy, they being Rundeck, to automate to create what they call jobs, and then make those jobs, you know, everybody be able to run those in a standard way. And then from a compliance standpoint, get the reporting on that, that the use, I think will really not only grow within IT, but for the most part, a lot of the development community, the core DevOps teams out there that use PagerDuty on the dev side, I think that you know, run books have been largely a manual activity for them, manual steps that they do. If I had to guess, the majority of our, you know, partners, community, customers today, who use PagerDuty when they actually get pulled into a real event and they're walking through the steps that they need, whether it's pulling together all the diagnostics information, and then going out in action to solve a major incident, a major event, the majority of that is manual today. And so the fact that we're allowing the equivalent of a big red easy button for those individuals for those teams on the development side, who really have been doing this unassisted today, to automate more of what they're doing, to cut down on the time, to cut down on the toil, to reduce the time that digital services are out in their organization. I think that's a huge opportunity for the larger PagerDuty customer base. >> I was looking at the press release, and with respect to the Rundeck acquisition, and about Rundeck saying and customers have experienced up to 50% reduction in incident response time using Rundeck automated run books. So from a team productivity perspective, that's huge. >> Especially when, you know, minutes are millions of dollars. And we were talking about this the other day that so many casual services are now mission critical, they're critical path for all of us, we need them, both in our professional and in our personal lives. So given that, given what's riding on these services, and how PagerDuty has always been about, you know, behind all of those services, our people and those people have to respond in the most effective efficient way in those really critical important moments, that type of savings, you know, reducing the time that it takes by another 50% on top of that, hopefully our customers will see the value in that Just like we do today. >> Big reduction in digital strategy, which I think we could all use today. Let me ask you one last question. Since this was the fifth PagerDuty summit, but the first virtual, you got to interact, or rather had the chance to impact a lot more customers than our traditional in-person event. But what was your take on having this virtual experience? Did you feel that you were able to really engage those customers as much as you would like to in a digital world? >> I'm really glad you asked. So much of us put so much of our time and effort into this, and I know our customers depend on us to do that. That usually, when you meet in person, you know, as you say, this is our fifth PagerDuty summit, and the other four have all been live, but they've all been in person, that nothing does substitute for the interaction, the live interaction you get, whether it's delivering something on main stage, or interacting one on one, with customers and clients, nothing, I think is a substitute for that. We are where we are and I do believe we're making, you know, obviously the best of it. And it has been great, we've generated probably five times as much content in this event than we do for a normal in person event. So while the the interaction isn't quite what you would expect in a three dimensional versus a two dimensional world, and I think the positive is, there is more content, and all of that content is kind of imminently more shareable than ever before, I personally have gone in to look at some of the track sessions, more in, you know, via zoom than I have in the past when they were recorded, but you know, it was a live event because I was so busy with other things. So I think the downside is some of the real personal interaction, we can still have personal interaction, of course, but it's not quite the same, but the content, the material, and then the reuse of that over time. I see that as being positive. >> Absolutely, I couldn't agree more. Well, congratulations on a very successful event. I imagine you must need a good weekend rest after delivering the most product news and announcements in the history of the company, especially in the last six months. Jonathan, it's been great having you on the program. >> It's always a pleasure, Lisa, thank you so much for having us and I hope you get some rest this weekend too. >> Likewise, I'm looking forward to that. For Jonathan Randy, I'm Lisa Martin. You're watching The Cube. (lighthearted music)

>> Narrator: From around the globe. It's theCUBE with digital coverage of PagerDuty summit 2020, brought to you by PagerDuty. >> Welcome to theCUBES coverage of PagerDuty summit 20, I'm Lisa Martin. Very pleased to welcome back to theCUBE, one of our alumna, distinguished alumna, the CEO of PagerDuty, Jennifer Jehada. Jennifer it's great to be talking with you today. >> Thanks Lisa, it's great to be here with theCUBE again and great to see you. >> Yeah, so lots happened in the last six months alone with that whiplash from all that, but you've been fifth year of the PagerDuty summit. The first year virtual, lot of things have changed. Talk to us about the evolution of PagerDuty over the last few years in particularly the last six months. >> Well, let's start with the last six months. I mean, I think we have all seen a society go through a big transformation with a global pandemic, kind of underpinning a volatile economic environment, a very difficult jobs environment. But in many cases, we've also seen tremendous acceleration. We've seen companies pull forward 10 years of transformation into a matter of months. And we saw that recently in some Kinsey research. And this is really been driven by the compulsory need for brands to meet their consumers online, for companies to enable and empower their employees online and for children to be able to learn online. And so, as we've moved, made this shift to doing everything in the digital world, it means that all of our customers, the biggest brands in the fortune 500, the most innovative tech companies that you're aware of. They've all had to really transform quickly to deliver an entire, nearly perfect customer experience online. And the stakes are higher, because they can't depend on their bricks and mortar revenue for business success. And that's meant that IT teams and developer teams have become the frontline of the digital default era because digital really truly is, the new operating system. That kind of fits squarely into how PagerDuty is evolve. Because we started out as a platform that served developers and helping them manage on-call notifications and alerting. So, engineers who wanted to be alerted when something went wrong and make sure they could address an issue in a service they were responsible for, before it had customer impact. Over the last five years, we've really evolved the platform, leveraging over a decade of proprietary data, about events, about incidents, about people, responder behavior, with machine learning, to really help our customers and engineering and IT, and IT ops and security and in customer support, truly manage what is an increasingly complex digital tech ecosystem. And this means that we're using software and automation to detect issues. We're then intelligently routing those issues in that work, that unplanned spontaneous work to the right people in the right moments. So that a customer and employee doesn't even feel any pain. There is no issue with availability. They can continue to engage with a brand or a service the way they want to. And that's become increasingly important because that's where all the revenue is today. >> It's essential, it's like, we've been talking for months about essential frontline workers and we think right away of healthcare, fire police, things like that. But, the digital default that you talked about, there's new digital frontline. I know PagerDuty has over 13,000 customers and some of the new sort of digital frontline that are enabling people to do everything from work, shop, learn, zoom, Netflix for example, Peloton helping us, keep fit in this time of such isolation, are now considered essential and depending on PagerDuty to help them be able to do that. To meet those increasing customer demands. >> Sure, all of these are PagerDuty customers. And the thing about the digital frontline is they can be invisible. You don't necessarily see them because they're behind the scenes trying to manage all the complex technology that makes that on demand Peloton class efficient and amazing for you. And when that class doesn't work, you're unhappy with Peloton. It really directly impacts the brand. Luckily Peloton is very reliable. I'm a big Peloton fun myself. And I really like to acknowledge and just let the frontline know that we do see them. We know that digital workers have been putting in on average, an extra 10 to 15 hours a week. During this environment, many of them are also either living in isolation on their own because of shelter in place rules, or they're trying to manage their own children's schooling. And, we all ask ourselves this question, are we working from home or are we living at work? It's sometimes those lines are blurred. So, anything that we can do as a platform to automate more and more of this work for the digital frontline, is really our focus. And this year at summit, we're going to be talking in particular about freeing our users from complexity about helping them orchestrate and automate work more effectively. And about leveraging machine learning and analytics to improve the cost efficiency, the productivity and the team, the health of their digital teams and their digital operations. >> So, in your keynote, you're going to be talking about digital ops. That's kind of dig into that. Cause we've shifted from this very structured way of working to sort of this chaotic approach, the last six months. Digital ops, what does it mean from PagerDuty's perspective and how is it going to impact every business? >> Well, I think when we look forward in a couple of years, we won't even use the word digital. It'll just be the operations of a company of a modern organization. How do you bring together all the application technology, the infrastructure technology, the networking, the Wi-Fi connectivity, the customer engagement data. How do you bring all of that together, to deliver these wonderful experiences that we've become reliant? You use the word essential, right? Well, PagerDuty essentially become the critical foundation or infrastructure that helps companies manage all this technology. And the problem is, with architecture becoming more distributed with powerful tools like the cloud, that's actually proliferated the complexity. It's actually increased the speed of the number of applications and services that an organization has mattered. And so, adopting the cloud can be very powerful for a company. It can be very freeing. It can allow you to innovate much faster. But it also, is not an easy thing to do. There's a lot of change management associated with it. And you have to make sure, that your team is ready for it. PagerDuty really facilitates a cultural shift, leveraging DevOps, which really, in a DevOps culture really in methodology allows companies to empower people closest to the action, to make better decisions. If you think about this digital world, we're living in, a consumer wait a nanosecond, a microsecond, maybe a couple of seconds. If you don't get that experience to be perfect for them. And yet traditional ways of solving technology problems, or ticketing systems and command and control environments that would take hours, maybe days to resolve issues. We don't have that time anymore. And so, digital operations is all about instantly detecting an issue, being able to run correlation and consolidate those issues to start to become more proactive, to predict whether or not, this small issue could become a major incident. And address it, resolve it, leveraging automation, before customers feel any pain before you see any impact to the business, the bottom line or brand reputation. >> All of those, are absolutely critical for every type of company, every size, every industry, because as you talked about, customers are demanding, we're also ready to, if something doesn't happen right away, we're going to go find the next service that's going to be able to deliver it. And the cost of that to a business, is I saw some numbers that you shared that if that costs you a hundred, a second of a minute, rather of downtime. A year ago, costs you a $100,000. That's now 4 to 5X. So, that costs can actually put a company adding up out of business. And we're in this. Let's not just survive, but thrive mode. And, to be able to have that immediate response. And as you say, shift from being reactive to proactive is I think absolutely business critical. >> Lisa, you should come work for us. >> You have this down pat. >> (laughs) And you're exactly right. I mean, I remember back in the day when I used to work in an office and walk out onto the street before I went home, you would see employees standing outside, switching back and forth between their rideshare app, their food delivery app, maybe their dating app, or their movie entertainment app. And if one thing is not serving them fast enough, they just switched to the other one. And, consumers are very fickle. They've got become increasingly more demanding, which means there are more demands on our teams and that digital frontline and our technology. And in fact, to your point, because all of that revenue has shifted online over the last six months. We've seen the cost of a minute and that cost is really calculated based on loss, labor productivity, but also lost revenue. We've seen that cost go up, from if you lost a $100,000 during disruption last year, you're maybe losing half a million dollars a minute when your app is disrupted. And, these apps and websites don't really go down very often anymore, but small disruptions, when you're trying to close out your shopping cart, when you're trying to select something, when you're trying to do some research. It can be very frustrating, when all of those little pieces backed by very complex technology, don't come together beautifully. And, that's where PagerDuty brings the power of automation, the power of data and intelligence and increasingly orchestrates all this work. We don't start our day anymore by coming into an office, having a very structured well laid out calendar and environment. We often are interrupted constantly throughout the day. And PagerDuty was designed and architected to serve unpredictable, spontaneous, but emergent, meaning time critical and mission critical work. And I think that's really important because that digital environment is how companies and brands build trust with their consumers or their employees. PagerDuty essentially operationalizes that trust. The challenge with trust, is it can take years to build trust up and you can destroy it in a matter of seconds. And so, that's become really important for our customers. >> Absolutely, another thing that obviously has gone on, in the last six months is, you talked about those digital frontline workers working an extra 10 to 15 hours a week, living at work basically, but also the number of incidents has gone up. But how has PagerDuty helping those folks respond to and reduce the incidents faster? >> Well, this is something that I'm very proud of, and PagerDuty's entire product and engineering team should be extremely proud of. I mean, we were held to a very high standard. Because we're the platform that is expected to be up, when everything else is having a bad day. And in this particular environment, we've seen a number of our customers experience unprecedented demand and scale, like zoom and Netflix, who you mentioned earlier. And when that happens, that puts a lot of pressure, events transiting across our platform on PagerDuty. PagerDuty has not only held up extremely well. Seeing some customers experiencing 50 times the number of incidents and other customers experiencing maybe 12 times the number of incidents they used to. Those customers are actually seeing an improvement in their time to resolve an incident by about 20%. So, I love the fact that, not only have we scaled almost seamlessly in this environment with the customers of ours that are seeing the most demand and the most change. And at the same time, we've helped all of our customers improve their time to resolve these incidents, to improve their overall business outcomes. >> One of the things I saw Jennifer recently, I think it was from McKinsey, was that 92% of this, is the survey before the pandemics. That, yeah, we've got to shift to a digital business. So, I'm curious customers that were on that cussing. We're not there yet, but we need to go. When this happened six months ago, when they came to PagerDuty, how did you advise them to be able to do this when time was of the essence? >> Well, first of all, one of our first company value, is champion the customer. So, I think our initial response to what we saw happen as COVID started to impact many industries was to listen. Was to lean in with empathy and try and understand the position our customers were in. Because just like our employees, every person is affected differently by this environment. And every customer has had a different experience. Some industries have done very well, and we hear a lot about that on the news, but many industries are really having a very difficult time and have had to massively transform their business model just to survive, much less to thrive. And so, PagerDuty has really worked with those customers to help them manage the challenge of trying to transform and accelerate their digital offerings and at the same time, reduce their overall costs. And we do that very effectively. We did a study with IDC about a year ago, and found that, most of our enterprise customers experience a 730% return on investment in four months. And that's because we automate what has traditionally been a lot of manual work, instead of just alerting someone there's a problem. We orchestrate that problem across cross-functional teams, who otherwise might not be able to find each other and are now distributed. So, there's even more complicated. You can't just sit in a room and solve these problems together anymore. We actually capture all of the data that is created in the process of resolving an incident. And now, we're using machine learning and AI to make recommendations, to suggest ways to resolve an incident, to leverage past incident experiences and experts within the platform to do that. And that means that we're continually consolidating the time that it takes to resolve an incident from detection all the way through to being back to recovery, but also reducing the amount of manual work that people have to do, which also reduces their stress when they're under fire and under time constraints. Because they know these types of incidents can have a public and a financial impact on their companies. We also help them learn from every incident that runs on the platform. And we're really bringing a more power to the table on that front, with some of the new releases. I'll be talking about later on this morning with analytics and our analytics lab. >> As we look at the future, the future of life is online, right? The future of work is online, but also distributed teams. Cause we know that things are going to come back to normal, but a lot isn't. So, being able to empower organizations to make that pivot so quickly, you brought up a great point about it's not just the end-user customer who can churn and then go blast about it to social media and cause even more churn. But it's also the digital frontline worker who totally needs to be cared for, because of burnout happens. That's a big issue that every company has to deal with. How is PagerDuty kind of really focused on, you mentioned culture on helping that digital frontline worker not feel burnout or those teams collaborate better? >> Well, we look at operations through the lens of sort of humanity. And we think about what's the impact of the operational environment today on what we call team health. And in our analytics solution, we can heat map your team for you and help you understand who in your team is experiencing the most incident response stress. they're having to take on work during dinner time, after hours on weekends, in the middle of the night. Cause these big incidents, for some reason, don't seem to happen at one on a Tuesday. They tend to happen at 4:00 AM on a Saturday. And oftentimes what happens is what I call the hero syndrome. You have a particularly great developer who becomes the subject matter expert, who gets pulled into every major difficult puzzle or incident to solve. And the next thing, that person's spending 50% of their time on unplanned, unpredictable high stress work. And we can see that, before it becomes that challenging and alert leaders that they potentially have a problem. We also, in our analytics products can help managers benchmark their teams in terms of their overall productivity, how much their services are costing them to run and manage. And also looking after the health of those folks. And, we've often said PagerDuty is for people. We really build everything from design to architecture, in service of helping our users be more efficient, helping our users get to the work that matters the most to them. And helping our users to learn. Like I said, with every incident or problem or challenge that runs on the platform. And likewise, I believe culture is a business imperative. Likewise is diversity and equality and PagerDuty as a platform from a technology perspective that doesn't discriminate. And we're also a company that is really focused on unbalanced, on belonging, on inclusion, diversity and equality in everything that we do. And I'm really excited that at summit, we have Derek Johnson who is the president of the NAACP, speaking with us to talk about how we get out the vote, how we support individuals in having a say in leveraging their voices at a time when I think it's more important than ever. >> And that was one of the things that really struck me Jennifer, when I was looking at, Hey, what's going on with PagerDuty summit 20. And just even scanning the website with the photographs of the speakers from keynotes and general session to break out influencers, the amount of representation of women and people of color and diversity, really struck me. Because we just don't see that enough. And I just wanted to say, congratulations as a woman who's been in tech for 15 years. That is so important, but it's not easy to achieve. >> Well, thank you for saying that. I mean, honestly, I think that when you look on that summit website and at those speakers, it really is a great picture or snapshot of the richly diverse community that PagerDuty serves and engages in partners in. Sometimes you just have to be more intentional about identifying some of those phenomenal speakers, who are maybe not like the obvious person to have on a topic because we become accustomed used to having the same types of speakers over and over again. So, this started with intent, but to be honest, like these people are out there and I think we have to give them a stage. We have to give them a spotlight. And it's not about whether you're a man or a woman at our stage. It's making sure that the entire summit environment really brings a diverse and I think rich collection of expertise of experience to the table, so that we all benefit. And I'm really excited. There are just so many fantastic folks joining us from Brett Taylor, who is the president and CEO of Salesforce and was the founding CTO of Facebook to Andy Jassy, who is leading Amazon web services right now. There's Ebony Beckwith who's going to speak about some of the great things that we're doing with pagerduty.org and the list goes on and on. I could spend, all morning talking about the people I'm excited to hear from and learn from. But I would encourage everybody who's putting an event together, to have a strategy and be intentional and be insistent about making sure that your content and the people providing that content, the experts that you're bringing to bear really do reflect the community that we're all trying to serve. >> That is outstanding and congratulations on PagerDuty summit by the first virtual, but you're going to have the opportunity to influence and educate so many more people. Jennifer, it's been such a pleasure talking to you and having you back on theCUBE. I look forward to seeing you again soon. >> Thank you so much, Lisa. It's been great to be with you. >> All right, for Jennifer Tejada. I'm Lisa Martin. You're watching theCUBE conversation. (upbeat music)

>> Narrator: From around the globe. It's theCUBE with digital coverage of PagerDuty summit 2020, brought to you by PagerDuty >> Welcome to theCUBE's coverage of PagerDuty summit 20, I'm Lisa Martin, and I'm pleased to welcome back, one of the PagerDuty alumni of theCUBE, Rachel Obstler the VP of product for PagerDuty. Rachel, it's great to talk to you today. >> Oh, it's great to talk to you too, Lisa. Thank you for having me. >> So one benefit of this, you know, massive pivot in the last six months is companies like PagerDuty get to reach even more folks that would come in person. So, I know the summit is expecting a lot more people to attend because there's no travel limits, but since this massive pivot happened in the last a few months, I want to to understand what some of the things are that you've observed as the VP of product. What have you seen that really is revolutionary? >> You know, one thing that we saw, and this is back a couple of months when COVID first happened, we thought, you know, it seems like there's an unprecedented shift to people using online services and so we wanted to check and see if that load was represented in our platform. And of course, you know, we help companies manage digital operations, respond to incidents. And so we actually looked at the incident load and we saw that some industries or some verticals had seen an unprecedented growth in incidents. So, this load was really impacting their platforms and in some cases like with online learning or e-learning, we saw they had over 10 times the number of incidents and the period immediately following the start of the pandemic and everyone shifting to work from home, from what they had seen just before. >> So, was this, some of the things that you looked at at your platform, and then it was that what prompted the survey that you guys just released last week? >> Yeah, that's exactly right. So, we saw that in our platform, we've also seen since then it is calmed down a bit. So, if we look at the six months after the pandemic really started and everyone moved to work from home versus the six months before, we saw about a 38% increase. So it's still an increase even now and so then this did prompt us to do a survey because we wanted to see not just what was reflected in our platform, but we wanted to talk to maybe companies that may not be PagerDuty customers as well as customers, and also understand how their attitudes you know were changing and what they were seeing. So, it's not just about the data, but it's also about the beliefs and what sort of stress people are feeling. >> And that stress is so real and it's something that if it's not addressed, we're talking about customer support, folks who are on the digital front lines and can affect a customer churning, for example, the brand reputation is on the line. So, what are some of the interesting things that you've found talking to these, IT practitioners, these Devops folks about what they've experienced in terms of incidents and their time in the last six months? >> Yeah, that is a great question. So I'll share some of the data that we found. I mean, one is that responders said that pressure on their digital services has increased about 80%. So that's, a pretty significant number, 62% of IT and Devops practitioners are working in additional or spending an additional 10 hours per week, on responding to incidents and so if you think about, you know, the average work week, maybe it's 40 hours, I know most of us don't actually work 40 hours, maybe they're working 50 hours, even in that case, like that's a 1/5 of their time. So, this is pretty significant amount of their time that they're spending on responding to issues as opposed to innovating, which is really what they want to be doing is building new goods and services and, you know, capabilities for their customers. >> So spending some, you know, 10 hours extra a week reacting, and I imagine that a good amount of those 10 hours are in the middle of the night or kind of random hours, whereas before the volume they didn't see. So, what are some of the things that PagerDuty is can do to help with that, What are some of the things that these practitioners talk to you guys about? This will help us tremendously because we know that this crazy time it's going to be TBD for a little while longer. >> Yeah, that's a really good question and just some stats on that, because we also have stats on that from the survey, we saw that more than half of the respondents of the survey are being asked to respond to incidents five plus times, more than five times on personal time during the week. And so that could be, it doesn't have to be in the middle of the night. It could be in the middle of the night, it could be after hours, dinner time, breakfast time, but that's still a lot of interruptions for you know, your life. And so there are a number of things that PagerDuty can do. One of a couple of the things that we really focus on are around intelligence and automation and so examples of intelligence are, if you have a lot of issues that are coming at you, you may not know which ones are important, which ones you should work on, which ones you can ignore, which ones are part of a larger problem. And so we have a lot of capabilities in the system that group things together, help you understand which ones are critical, which ones are not critical, get them to the right person and also provide important context for fixing them. So, you may want to know things like, this is impacting my service right now, our other services impacted, which teams are working on that. Who should I collaborate with? Or you may want to know, Hey, I've never seen this before myself. Has it ever happened before? I'd like to see past that are similar. So, those are just some examples of the things that we can provide. It's intelligence when someone is, you know, interrupted and has to immediately figure out, what do I do with this issue? When it comes to automation, you know, we can help customers in a number of different ways. One is we can automate menial tasks, like let's imagine that you find out there's an issue, you think this is a very serious issue, you need to pull in more people, well, pulling them into a bridge a chat channel, making sure they have the right information. We make it super easy for customers to do things like that. But we also make it easy for them to automate maybe diagnostics. Like maybe they want to call out to assist them and pull in more information. Maybe they want to actually be start a server. So there's all sorts of ways that you can automate. We also help you automate communication to the broader environment or the broader set of people. So, you mentioned earlier customer service teams. Well, if you're a development team and you know, there's an issue and you know, that customer service teams are soon going to be getting a whole bunch of tickets. They need to know what's going on, so that they can answer those tickets and maybe get ahead of them, maybe even post something on a status page, telling customers, yes, we know we have an issue so they know it's being worked on and they know that it's being taken care of. >> You know, one of the things I didn't think about when in the beginning of this pandemic, because there was such chaos, there still is chaos, is the demand for digital services dramatically increased and it wasn't just ordering groceries online or okay, I can't go to a store so, I'm going to depend even more on Amazon than I have before. And we have this culture where we expect, we can get anything we want and some cities overnight, or rather in a couple of hours, the demand is there. The customer expectation is there and the patient system enabling if I think of like a Netflix, which is a customer of PagerDuty's and all of the competing streaming services, if I'm not going to get what I want, within a second, I'm going to go find somebody else, who's going to be able to deliver the service that I'm expecting. To the demand on the digital services is greater and greater and one of the things I saw in that survey that you guys just published is that 40% of the respondents think it's actually going to get worse from here. So they got to be able to implement a AIOps tools and automation. Now, if the volume isn't going to decrease, right? >> Yeah, you've really nailed it Lisa. That's exactly what's happening out there and I think it's not going to decrease. We've basically not just had a, a blip in time, people have shifted how they're operating to being online and now they're used to it. And this is probably not going to change in the foreseeable future. And so absolutely when you're seeing these types of increases in demand for your services, which leads to more incidents that leads to more noise, it leads to a lot more operational work, basically you have to find a way to manage it if you want to keep innovating and to your point, customers or end users expect more innovation, right? They're not going to expect that a company is going to stop innovating just because they have a got a lot more users now. So, absolutely the main way or one of the big ways that customers really need to address this is to be able to work smarter and, you know, tools that help you automate things and help you gather data faster and provide intelligence to things and help you find the signal from the noise like the PageDuty are really important to serving that bigger need that is not going away as you said. Yeah, that's theCuBEs tagline extracting signal from the noise and the thing that's important about that is right now, as you talked about there's blurred lines, right? We either work from home or we live at work and I think it every day it can change and that's challenging. Not only is there no commute so you can work or the expectation is you going to to be online, you going to to be accessible but also one of the very real challenges that we're all experiencing, no matter what industry you work in is burnout is real. It's been real for a long time, but right now it's critical for organizations to help reduce, address it and help reduce it. What are some of the things that you're hearing when you're talking to customers about, hey guys, PagerDuty, how can you help my practitioners, my DevOps folks become less reactive? How can you help us manage these incidents so that they can go back to innovating, which is what they like to do, because we want to be able going to have productive, happy employees? >> Yeah, that's a great question. So, some of the things that we can do is help you look across all your incidents and understand where are you getting repeat incidents. We can also help you look at things that are showing up as incidents that are notifying people, but aren't real incidents. So, for instance, we've looked at our system and we've seen that a decent percentage of incidents auto resolve within two minutes or three minutes and so those are incidents that are still notifying someone, but then maybe there's auto resolution capabilities in the platform, maybe there's maybe it was just a very delicate monitor that was finding something wasn't really there. But in any case, this is disturbing someone and maybe waking them up for no reason and so there are tools that we can provide that allow you to set rules around things like this. Like, don't tell me about this, unless it's still going for three minutes, don't tell me, unless it happens three times in a row. Like, there's really easy ways to cut down on a lot of noise that distracts people that interrupts them that maybe bothers them off hours, which you really want to avoid. And then beyond that, there's also things that you can do in our system and in general, that help you just understand when someone had a bad on call. So, knowing when there's certain people that are getting, woken up a lot or responding off hours or spending a lot of time, responding to issues or responding to just a lot of issues in general, that's something that we can provide so that, you know, any manager can look across team and just see like, which people really need a little bit of relief. >> And I'm sure that would be welcomed by everybody in every industry. You know, we talk about customer experience all the time, pandemic or no pandemic, but really ultimately something that I've always believed and seen it is that, if the employee experience isn't really good, then that is directly able to negatively impact the customer experience. But one of the things I was looking at too, like with respect to like first Gen AIOps tools, with respect to ROI companies saying, I'm not really getting that yet. So give me an insight into how PagerDuty thinks that second Gen AIops tools are going to help dial up that ROI for companies to really invest in this so, that they are the winners of tomorrow? >> That's a really good question. So, a lot of the earlier AIOps tools require a lot of training. So, you know, people to spend time telling the system, this should be grouped, or that should be grouped and also requires not just that upfront training for them to work, but also ongoing training. So, continually training the system. And so second Gen AI really uses the data and the system to automatically make suggestions about things. And that's very straightforward with a tool like PagerDuty because we have all this information about what happened in the past. What happened when you were responding to incidents, who responded to them, how long they took, how bad they were. And so we can really leverage a lot of that data to help automatically reduce noise and point out the things that are important, without having people needing to spend a lot of time with the system upfront, before anything actually works. And so, in fact, like we can just have you turn it on, it works and it continues to learn and get better. >> And that's critical because in this digital default, as I know you've got PagerDuty is talking about, I spoke with Jennifer Todd about that. There is no more luxury of time about a company determining, well, how should we go on our digital transformation? That time luxury is gone. Last question, Rachel, for you, fifth PD summit, first virtual, but the opportunity to engage and interact with a lot more customers since there are no trouble limits. I'm just curious some of the things that are, that you're excited about at this year's event. >> You know, one of the things I'm excited about is I think we're able to give our attendees a lot more choice of what do they attend because it's virtual, so you don't have to have a room, you know, where you can have a certain number of, you know, sessions and only one session at a time. So, I think there's going to be more choice for our customers. We're also going to have a great lineup of speakers. So, I think this also means that not only can we have more attendees show up because it's more convenient, but we can have more really great speakers and industry luminaries because they don't have to also travel to the site, but they can do things from where they are. So, I think those are two of the really great things about, you know, the remote world that we live in. I, of course am disappointed that I'm not going to be able to see more customers, face to face, or at least in the same room and have that interaction, but we'll still have plenty of meetings even though we'll be doing it online. >> Silver linings, well Rachel, it's been great having you on the program. Can't wait to hear about all the great things that come from the summit 20. Appreciate your time. >> Thank you, Lisa. It's great to be here. I'm Lisa Martin. You've been watching this CUBE conversation. (upbeat music)

>> Illustrator: From around the globe, it's the cube with digital coverage of PagerDuty summit 2020. Brought to you by pagerduty. >> Welcome to the cubes coverage of PagerDuty Summit 2020, the virtual edition. I'm Lisa Martin, and I'm pleased to welcome the Senior Vice President of Product for PagerDuty. Jonathan Rendy. Jonathan, welcome back to the cube. Thank you, Lisa. It's great to be here. So this is our virtual cube, virtual summit 2020. But one of the things that I know from talking with Jennifer yesterday 6is that this is the opportunity to reach way more people because there's, you know, no travel restrictions and budget and things like that. But one of the things that is quite impressive is that you're going to be in your keynote talking about a lot of changes and enhancements to the products the biggest release in pagerduty's History During COVID-19 really impressive. Talk to us about why this is such an exciting time. >> Well, it's it's exciting for a lot of reasons. And great to be here, although I'm getting so tired of working from home these days. But be that as it may, yeah, we we do have the biggest set of releases and investments and innovation that we're unleashing in the history of the company, which in these times is is no small feat. I want to thank all the teams have done a wonderful job. But we're using our summit event, as you know, to to talk about that to bring that out to discuss and we have some very high profile speakers coming. Joining us at the event. We have Andy Jassy, we have Eric Diwan, Stewart Butterfield and more. So it'll be a fantastic event, for executives and for practitioners alike. So sharing what we're doing new with all of this, these leaders joining us is going to be a great thing. >> One of the things that's become so critical in the last six months is digital services. And I think so many of us don't realize or don't think about the folks under, I don't want to say under the hood, but behind the scenes really, that are critical for you mentioned, the CEOs of AWS and zoom, and Slack, which are all essential. I mean, zoom is a household name, right? My mom even uses zoom, she's 75 that's pretty cool. But all of the criticality under the hood to ensure that these services continue because we're all now even more dependent on them than we ever have been before. >> Yeah, it's really interesting, I was thinking about this the other day, there were so many casual services that we all relied on, you know, pre March pre February, that now have become just mission critical and, and to everything that we do professionally and personally. And to your point, whether you're working out at home with, you know, your peloton, or whether you're in the two dimensional world with zoom all the time, we just expect all these services to be up and running and be available for us. And behind all those services that we expect to be there is a an amazing amount of complexity and dependencies. And behind all those complexity and dependencies our people and and that's a big part of what PagerDuty focuses on which is engaging people on the right issues at the right time. And of course, allowing them not just to be engaged but complete the work work, major issues, unexpected work, unplanned work, and complete all that in when moments and seconds and microseconds matters. So Pedro duty has a unique place in that whole ecosystem of what's considered crucial and critical now. >> We'll we've been hearing the term essential workers for since March right and thinking of them in a traditional sense of doctors and nurses and firemen and obviously grocery workers and, and deliver companies. But looking at it from pages through your lens, it's this the whole like digital frontline, the DevOps folks, the IT folks, the customer support folks who are really on the front lines of helping that brand be protected. Now it's, you know, the fact that everything is real time that now is now more important than ever is never been more important. So talk to us about sort of this switch to this digital default and what that means for operations. >> Yeah, as we were just saying, to your point, it's never been the services have never been more important and more essential to everything that we do. So it just makes perfect sense that all of the individuals who are responsible for building and delivering and supporting those services are essential. Now also and as a part of that we talk a lot about going from what everybody knows as DevOps to digital ops. And while it may sound like a marketing phrase, words matter, and it really means going from being responsive to being proactive and predictive. And that's so important for these individuals. To get ahead of this, we've seen super interesting data, when we look at our platform where there 13,000 customers of how life has changed for all of those customers and those half a million users of our platform today, pre COVID. And now that we're in the middle of this with, again, reflecting how important services are the increased use of those, and then the rise in issues. And what's the great news is that individuals and companies using the platform are actually getting better at addressing them than they were pre COVID. So with the bad news, there's, there's good news, too. >> I agree, there are always silver linings, I was looking at my notes here. And one of the things when PagerDuty evaluated your platform, and as we mentioned over 13,000 customers, during COVID, seeing an increase in traffic and demand for digital services, more than a 38% increase in incidence compared to the prior period. But you also talked about how the big impact that pager duty is helping your customers make and resolving those incidents faster. And I guess maybe sorting through the noise, and a better more automated way. >> Exactly. And a lot of it has to do with what we've been doing. And then another piece is our new releases. And so again, we've looked at our data to your point. And we've seen this over a third rise, in the number of issues, that organizations are running into across the board. And with our new releases, we're able to reduce interruptions by over 65%. So it's great news that again, with with the rising use and the rise in interruptions and people having to context switch from what they're doing to you know, firefight and jump in the middle one and collaborate across organizations that there's light on the horizon, the light at the end of the tunnel, I should say, and then things are going to get better. And our new releases are going to help in a big way. >> Okay, I'm assuming you have a crystal ball, which is great. So I'm going to be looking for some more predictions, but talking to your customers. And you know, I can imagine now there's more noise. You mentioned this switch from DevOps to digital ops and this now this digital default that I know, Jennifer has talked about, and it's this probably going to be one of the things that that shapes the winners and the losers of tomorrow in every industry. But tell me a little bit about how you're helping how you're using, you know, the traditional buzzwords, AI, machine learning, and putting them really effectively to work so that it's now not just a buzzword that companies in any industry should be thinking about, but it's actually machine learning is going to be critical to sorting through this increased volume of data and helping resolve incidents faster to not just, you know, prevent customer churn, but also to make sure that your folks on the digital front lines aren't burned out. >> Well, with the transition that we were talking about before, you know, everybody realizes that they have to be all in now, there's no, we're migrating to the cloud. And there's reasons for that, moving from on prem systems to to the public cloud, in many ways, we've seen that massively accelerate. And with that comes and how the systems are, have to be built and managed and delivered there, you see this increasing complexity. And going back to what we were talking before, individuals are behind all of that complexity. And so it's so important that in our new releases, we really up the bar, we've really raised the game, so to speak on what we're doing to take advantage of our data that we capture. And also this increase in information that's coming in, we refer to it a lot of times as telemetry when you, you know, start to refactor and rebuild your systems in the public cloud, and you have all those dependencies and you have more information, more data flowing to you, which can translate to more interruptions. And very easy, It's very easy for organizations and teams to get overwhelmed by that. And so our new releases, focus on making sense of that we talked about the reduction in interruptions and the reduction in noise. But we've also focused equally, on helping folks with context with information when something goes south, when something is different than what a team expected. How do you fix that once you engage the right people, they're so big part of our releases also been about applying machine learning to add context to speed up fixing and resolving and finding the root cause of these issues in a big way. And we do that through a number of different ways in our in our products, in our PagerDuty platform, event intelligence, and also our analytics, again, to draw these relationships around service dependencies and our analytics, we've included a recommendation engine. So now we can show organizations and teams predict. If you make these changes, you will see these improvements. And this will be your returns and using our data combined with the data that's coming in, That's a big part of what the PagerDuty platform is all about. >> well that analytics piece is, critical as as the machine learning because the volumes of data are getting bigger and bigger and bigger such that it can't be can't depend on just humans. There's something that I'm curious about, too, is with the rise in incidents, how can PagerDuty help customers kind of sort through the noise and maybe Park things that might be able to be resolved on their own without having to escalate? >> It's a great question. And we do it through a couple of ways. One, we've applied machine learning so many times when, when interruptions when issues alerts come in, and they can look different, but they're all related to the same thing. So we're applying machine learning to better group and intelligently organize and group all of those informations into the singular incidents that really matter that you really need to pull teams together on which is important. The next thing we're doing is we're using machine learning to say, Hmm, okay, it looks like these, these issues, these incidents are happening on different services that teams own. And what we're also using the machine learning to do now is to show the dependencies between those services. So we often see situations where you can have a couple of teams in your organization, working on issues that are delivered to them, not knowing that they're related. And in some ways they can be working against each other. So having information to know that one issue is upstream. And the other issue is downstream allows one team to step forward and the other team to step back. And we're using our machine learning for that, to give that additional context and help pinpoint where the issues are. So it's the most effective use of these teams when they come in, Nothing's more frustrating by the way than being interrupted, whether it's the middle of the day or the middle of the night, only to find out that either you're being unproductive or you didn't need to be there in the first place. >> Oh, absolutely, yes. And I'm seeing some stats that people are the folks on the digital front lines are working an average of 10 hours more a week. And so many more of those interruptions are happening and when you'd like to be off on the weekends and the middle of the night. But one of the things that that you took context, absolutely critical, but also collaboration, different teams that need to be to your point, are we working on the same thing, and we don't know, the collaboration now that work is distributed is even more critical than ever? What are some of the things that you're hearing from customers about what PagerDuty is doing to facilitate that collaboration so that things just run much more smoothly, and the demanding consumer on the other end is satisfied? >> Well, to your point, one of the most critical things, since we're talking about not just a technology issue, we're talking about a people issue is communication, and collaborating. And that is so important, not only in general, but in these moments that matter. And so one of the things we've done in the new platform is we're introducing industry firsts, video war rooms, with our partners and customers zoom, as well as Microsoft Teams. And so we're also updating our slack integrations as well. But as we live in this two dimensional world, those responders, those teams that have to come together to fix issues with the single click of a button, now they can participate in those issues, in a video sense, in a video war room, but not just engage in that way. We've also added the ability to manage the issue through zoom through Microsoft Teams as a part of PagerDuty. So individual don't need to context switch from one product to another, they can do everything they need to do from from that world. So a big part of that collaboration and communication is all about the in the moment, you know, teams working together in those forums. But there's another side of communication collaboration in these major events. That's critical as well. And that has to do with what I always think of as the ripple effect. There's there are the teams working the issues. And then there are all the teams adjacent to that, whether they're business stakeholders, whether they're customer service teams, that also need to take action. They may not be fixing the issue, but they have to engage and they have worked to do they have actions they need to take equally, that are different. And so for those other organizations, it's we've increased the scalability of our stakeholder notification into the 10s of thousands. So those folks can keep in touch in tight alignment to what's happening to an issue being fixed, which, again, in today's world, this effect, affects everyone in an organization, not just the teams tasked with addressing the problems. >> Right. And of course, the demanding consumer on the other end isn't considering the fact that the customer support person that they're talking to might not have access to everything they need. And it's critical. It's business critical for any type of organization to understand that, even their customer support folks, and I shouldn't say even those guys and girls are on the digital front lines. And brand reputation hangs on the data that they have the context that they have, and their ability to resolve a customer issue because we were more demanding as consumers before COVID. And now I think even more than other because we're dependent on it. We're dependent on zoom, or dependent on Slack, we're dependent on Amazon and AWS, and so many other digital services. And we don't get what we want as consumers, right, we're going to go I'm going to go find someone else who's going to be able to respond to this in in one second, because I'm only going to give it a half a second. So last question, Jonathan for you so much announced this PagerDuty Summit 2020, unique in that way unique in the virtual asset. But what are some of the things that you see on the horizon, say, the next six months, because I'm pretty sure you have a crystal ball, let's open that up. >> Well, I see a couple of things. And while I never said that I'm Nostradamus, I see a couple of things. And one is that there is a material, seismic shift towards full service ownership. and so teams, and this was happening before as a part of DevOps. But when I was talking previously about moving to digital Ops, we're seeing large organizations have major initiatives around this notion of the frontline teams have to be empowered to work directly on these issues. And we always call that this phrase, full service ownership, which means you build it, you ship it, you own it. And that's both for development and IT organizations. And I think you brought up a really interesting point before, in this trend that I see happening and only accelerating, it's happening because people want to innovate faster. And those individuals, those teams, whether you're, again, in Dev, it Ops, or even in customer service, it's important that you're empowered to do this to help in that innovation. So I see that as the first seismic shift. And actually, as a part of that. The other big part of our announcements is where we're at summit, announcing PagerDuty for customer service. It's a curated product, just for customer service teams, because they're part of that big triangle with Dev and IT teams that they need to be in the loop, they need to be empowered with the same types of tools, they need to be able to act as a, essentially an incident commander, they have cases that come in, and they need to be able to engage the right individuals to provide that customer service to what you were saying before. And they need to have a direct link to everything that's happening in Dev and it so they can be proactive and get ahead of customer cases also. So again, to your question of, like, what do I see? I think that shift is brought on by people being all in, you know, with with their, their cloud migrations and refactoring. And then full service ownership being something that empowering individuals on the front lines, democratizing, you know, decision making and empowering those teams. I see that as the biggest shift happening overall. >> Excellent, Jonathan, thanks for sharing what you are unpacking at summit 20 and the opportunities that had a lot of silver linings. We appreciate your time. >> Thank you, Lisa. It's been a pleasure being here. >> For Jonathan Randy. I'm Lisa Martin. You're watching the cube (upbeat music)

>> Presenter: From around the globe, it's the cube, with digital coverage of pager duty summit 2020. Brought to you by pager duty. >> Welcome to this cube conversation. I'm Lisa Martin, today talking with Tammy Bryant is a cube alumna, the principal Site reliability engineer at Gremlin and the co-founder and CTO of the Girl Geek Academy. Tammy, it's great to have you on the program again. >> Hi Lisa, thanks so much for having me again. It's great to be here. >> So one of the things I saw in your background 10 plus years of technical expertise, and SRE, and chaos engineering, and I thought chaos engineering, I feel like I'm living in chaos right now. What is chaos engineering and why do you break things on purpose? >> Yep. So the idea of chaos engineering is that we're, breaking systems but in a thoughtful controlled way, to identify weaknesses in systems. So that's really what it's all about. The idea there is, you know, When you're doing really complicated work with technical systems, so like, for example, distributed systems and say, for example, you're working at a bank, it's tough to be able to pinpoint the exact failure mode that could cause a really large outage for your customers. And that's what chaos engineering is all about. you inject the failure proactively, to identify the issues and then you fix them before they actually cause really big problems for customers and you do it during the middle of the day, you know, when you're feeling great, instead of being paged in the middle of the night for an incident, that's actually like causing your customers pain, and making you lose a lot of money. So that's what chaos engineering really is. >> Are you seeing in the last six months since the world is so different, are you seeing an increase in customers? Now with, the for example, Brick and Mortars shut down and everything having to convert to digital if it wasn't already? Is there an increase in demand for chaos engineering services? >> Yeah, definitely. So a lot of people are asking what is chaos engineering, how can I use ,it will it help me reduce my incidents? and definitely because there are a lot of new services that have been rolled out recently, say, for example, curbside pickup. That's a whole new thing that had to be created really recently to be able to handle a large amount of load. And you know, people show up, they want to get their product really fast, 'cause they want to be able to just get back home quickly. And that's something that we've been working on with our customers is to make sure that curbside pickup experience is really great. The other interesting thing that we've been working on because of the pandemic is making sure that banks are really reliable, and that customers are able to get access to their money when they need it. And able to see that information too. And you can imagine that not as when you're in lockdown, and you only can leave your house for maybe an hour a day, you need to be able to quickly get access to your money to buy food, and we've seen some big incidents recently, where that hasn't been the case. Yeah. >> And I can imagine I mean, just thinking of what happened with, everything six months ago and how people were, we are just, demanding, right, consumers were demanding, we expect to get whatever we want, whether it's something we buy on Amazon, something that we stream on Netflix, or whatnot, we have this expectation that we can almost get it in real time. But there was a there was, you know what, there was a delay a few months ago, and there still is to some degree. But companies like Amazon and Netflix, I can imagine, really must have a big focus on chaos engineering, to test these things regularly. And now have proved, I would imagine to some degree that with chaos engineering that they have built, they're built to withstand that. >> Yes, exactly. So our founders at Gremlin came from Netflix and Amazon, our CEO had worked at both where he done chaos engineering, and that's actually why he decided to create Gremlin. It's the first company in the world to offer chaos engineering as a service. And you know, obviously, when you're working somewhere like Netflix, you know the whole product, you have to be able to get access to that movie, that TV show, right in that moment, and also customers expect to be able to see that on for example. There PlayStation in their living room and it should work and there paying for a subscription, So, to be able to keep them on that subscription, you need to offer a great service. Same thing with Amazon, you know, Amazon.com, they've done a lot of chaos engineering work over many years now to be able to make sure that everything is available. And it's not just that, the entire amazon.com is up and running. It's also for example, that when you go and look at a page that the recommendation service works toO and they're able to show you, hey, here's some other things that you might like to get to buy at this time. And I like as as a consumer, I love that 'cause it helps me save time and effort and even money as well 'cause it's giving you some good advice. So that's the type of statement we do. >> Exactly, So. when you're working with customers, I'd love to understand just a little bit from the, like the conversational standpoint is this now, is chaos engineering now, at kind of the sea level or is it still sort of in within the engineering folks 'cause looking at this as a make or break, knowing that for example, Netflix, there's Hulu, there's Disney Plus, there's Apple TV. Plus, if we don't get something that we're looking for right away, there's prime, we're going to go to another streaming service. So are you starting to see like an increase in demand from companies that no, we have competition right behind us, we've got to be able to set up the infrastructure and ensure that it is reliable. Now more than ever. >> Yeah, exactly. That's really, really important. I'm seeing a lot of executives. I mean, I've seen that since the beginning, really, since I first started working at Gremlin. I would often be invited by executives to come and give talks actually, within their company, to help the teams learn about chaos engineering, and I love doing that, It's really great. So I'd be invited by C levels, or VPs, from different departments. And I often get people adding me on LinkedIn from all over the world who are in leadership roles, because really, like, you know, they're responsible for making sure that their companies can hit those critical metrics and make sure that they're able to achieve their really, you know, demanding business goals, and then they're trying to help their teams be able to achieve that, too. So I've actually been so pleased to see that as well. Like it is really cool to have an executive reach out and say, hey, I'm thinking of helping my team, I'd like to get them introduced to you can you come and just teach them about this topic? And I love being able to do that it's really positive. And it's the right way to improve. >> It is, and I think nowadays, with reliability being more important than ever, you know, we talked to leaders from industry, from every industry. And there are certain things right now that are going to be shaping the winners and the losers of tomorrow. And it sounds to me like chaos engineering is one of those things that's going to be fundamental to any type of business to not just survive these times, but to thrive going forward. >> Yes, I definitely think so. I mean, obviously, people can easily just go to a different URL and try and use a different service. And you know, we're seeing now failure across so many different industries. We didn't see that before. But for example, you know, I'm sure you've seen in the news or heard from friends and family about schools, now being completely online. And then kids can't actually access, their calls their resources, what they need to learn every day. So that really just shows you how much it's impacting us as a society, we really know that the internet is critical. It's amazing that we have the internet, like how lucky we are to have this, but it needs to work for us to actually be able to get value out of it. And that's what chaos engineering is all about. You know, were able to make sure that everything is reliable, so it's up and running. And we do that by looking at things like redundancy. So we'll do failover work where we completely shut down an application or service and make sure it gracefully fails over. We also do a lot of dependency failure work, where you're actually looking to say, this is the critical path of this service. And a lot of people don't think about this, but the critical path really starts at sign in. So you need to make sure that login and sign in works really well. It's not just about like the experience once you've signed in, that has to work well all the way through. So actually if you have a good understanding of user experience, it helps you create a much better pathway and understand those critical pieces that the customer needs to be able to do to have a great experience. And I care a lot about that. Like whenever I go and work somewhere, I always read customer tickets, I always try and understand what are the customer pain points. And I love listening to customers and then just solving their problems. The last thing I want them to do is, you know, be complaining or be really annoyed on Twitter because something just isn't working when they need it to be working. And it is really critical these days. It's a the internet is a really serious part of our day to day life. >> Oh, it's a lifeline. I mean, that's, some folks. It's the only way that they're connecting with the outside world, is through the internet. So when things aren't, I had a friend whose son first day of college couple weeks ago, freshman year, first class couldn't get into zoom. And that's a stressful situation. But I imagine too, though, that and I know you're going to be speaking at the pager duty summit that more folks need to understand what this is. And I can tell the you have a real authentic passion for it. Talk to us about what you're going to be talking about at the pager duty summit. >> Sure thing, I'm really excited to be speaking at Pager Duty Summit very soon. My talk is called building, and scaling SRE teams, so site reliability engineering teams. And this is something that I've done previously. I've built out the SRE teams at Dropbox for both databases as well as storage. So block storage, and then I also lead the code workflows team. And that's for, you know, over 500 million users, people accessing the critical data that they store on Dropbox all the time. You know the way that folks use Dropbox is in so many different ways. Maybe it's like really famous music musicians who are trying to create an amazing new album that happens or maybe it's a lawyer preparing for a court case, and they need to be able to access their documents. So those are a lot of customer stories that would come up over time. And prior to that, I worked at the National Australia Bank as well leading teams too and obviously like people care about their money if they can't access their money. If there incorrect transactions, if there are missing transactions, you know, duplicate transactions, maybe people don't mind so much about it you get like a double deposit, but it's still not good from the bank's perspective. So there's all types of different chaos that can happen. And I found it to be really interesting to be able to dive into that and make sure that you can make improvements. And I love that it makes customers happier. And also, it helps you improve your company as a whole. So it's a really good thing to be able to do, And with my talk, I'm going to talk to folks about, you know, not only why it's important to build out a reliability practice at your organization, you know, back in the day, people used to go, why would you need a security team? You know, why would we need that? now everybody has a security team, everyone has a chief security officer as well. But why don't we focus on reliability, like we know that we see incidents out in the news all the time, but for some reason, we don't have the chief reliability officer. I think that's definitely going to be something that will appear in the future just like the chief security officer roll up. But that's what I'm going to talk about there. How you can find site reliability engineers, I'll share a few of my secrets. I won't give any spoilers out. But there's actually quite a few places that you can find amazing people. There's even a school that you can hire them from, which I've done in the past. And then I'll talk to you about how you can interview them to make sure that you get the best people on your team. There are a number of things that I think are very important to interview for. And then once you've got those folks on your team, I'll talk to you about how you can make sure that they're successful. How to set them up for success and make sure that they're aligned to not only your business goals, but also your core values as a company, which is really important too. >> Yeah, that's fantastic. It's very well rounded, I'm curious, what are some of the the characteristics that you think are really critical for someone to become a successful SRE? >> Yeah, so there's a few key things that I look for. One thing is that, somebody who is really good at troubleshooting, so they need to be able to be comfortable with complexity, ambiguity and open ended challenges and problems and also thrive in those types of environments. Because often you're seeing something that you've never seen happen before. And also you're working with really complicated systems. So you just need to be able to feel good in that moment. And you can test for that during an interview question on troubleshooting and debugging. So that's something that I'll go into in more detail. But that's definitely the first characteristic. The other thing, of course, is you want to have someone who is good at being able to build solutions. So they can code, they understand automation, they can figure out how can I take this pain point, this problem? And how can I automate it and then scale this out and make it available for everyone across my organization? So someone who has that mindset of building tools for others, and often they are internal tools, because maybe you're building a tool that helps everybody know, who's on call every single critical service at the company and also non critical service and they can identify that in a minute or less like maybe even just in a few seconds, and then they can quickly get that person involved, if anything need to escalate to them. Via for example, a tool like pager duty, that's really what you want. You want them to be able to think, how can I just make this efficient? How can I make sure that we can get really great results? And yeah, I think they also just need to be really personable too and work well in a really complicated organizational structure. Because usually they have to work with the engineering team, the finance team to understand the revenue impact. They need to be able to work with the PR team and the social media team, if they're incidents, and then they need to provide information about when this incident is going to be resolved, and how they can update VIP customers. They need to talk to the sales team, because what happens if you're giving a demonstration, and then somehow there's an issue, or failure that happens, an incident and then in the middle of your very important sales demo, you're not able to actually deliver it that can happen a lot too. So there are a lot of very important key skills. >> Sounds like it's a really cross functional role, pivotal to an organization, that needs to understand how these different functions not only operate, but also operate together, is that somebody that you think has certain types of previous work experience? Is this something that you talked to the Girl Geek Academy girls about? How did they get into? I'm curious, like what the career path is? >> Yeah, it's interesting, like I find a lot of SRE's often come from either a few different backgrounds. One is they came through the world of Linux and understanding systems, and just being really interested in that. Like deep diving into the kernel, understanding how to improve performance of systems. The other side is maybe they came from coding background where they were actually building applications and features. I started off actually on that side, but I also had a passion for Linux. And then I sort of spread over into the other side and was able to learn both. And then often you know, someone who's comfortable with being on call and handling incidents, but it is a lot of skills, like that's actually something that I often talk to folks about, and they asked me how can I become a great SRE? There's so many things I need to learn. And I just say, you know, take it slow, try and gradually increase your number of skills. People often say that there is like there's some curve for SRE's, where you have the operations side, on one side, and then the coding side on the other. And often like the best person sits right in the middle where they have both ops and engineering skills. But it's really hard to find those people. It's okay if you have someone that's like, really deep, has amazing knowledge of Linux and scaling systems and internet management, and then you can pair them up with a really amazing programmer who's great at software engineering and software architecture, that's okay, too. >> We've been hearing for a long time about this sort of negative unemployment with respect to cyber security professionals. Is that, are you guys falling into that same category as well with SRE? Or is it somehow different or you just know this is exactly what we're looking for? We want to go out there, and even in the Girl, Greek Academy, maybe help girls learn how to be able to find what I imagine are a lot of opportunities. >> Yeah, there are so many opportunities for this. So it's definitely an opportunity because what I see is there's not enough SRE's. So tons of companies all over the world will actually ping me and say, hey, Tommy, how do I hire SRE's, that's why I decided to give this talk because I wanted to package that up and just share that information as to how you can do it. And also, maybe you can't find the SRE's because they don't exist. But you can help retrain your team. So you can have an engineer learn the skills that are required to be an SRE, that's totally possible too, maybe move them over to become an SRE. With girl geek Academy, one of the things that I've done is run hackathons and workshops and just online training sessions to help girls learn these new skills. So that's exactly what our mission is, is to teach 1 million girls technical skills by 2025. And I love to do mentoring at scale, which is why it's been really cool to be able to do it online and through these like workshops and remote hackathons. And I definitely love to do something where else work with some of our customers actually, and run an event. I did one a while back, it was really cool, we were able to have all of the girls come in and be at the customer's office and actually learn skills with the customer, which was really fun. And it helps them actually think, hey, I could work one day that would be really amazing. And I'm going to do that again in November. And it's kind of fun too. We can do things like have like, you know, dad and mom and then daughter day, where you actually bring your daughter to work and help her learn technical skills. That's really fun because they get to see what you do and they understand it more and see how cool chaos engineering really is. Then they think oh, wow, you're so awesome, this is great. >> I love it, that's fantastic. Well it sounds like, like I said before your passion for it is really there. What, I think is really interesting is how you're talking about chaos engineering and just the word in and of itself chaos. But you painted in such a positive lights critical business critical, but also the all the opportunities there that businesses have to learn and fine tune so such an interesting conversation. Yeah, Tammy. We have you back on the program. But I thank you so much for joining me today. And for those folks that lucky enough that are attending the pager duty summit, they're going to get to learn a lot from you. Thank you. >> Thanks so much for having me, Lisa. >> For Tammy Bryant, I'm Lisa Martin. You're watching this cube conversation. (upbeat music)

>>from >>around the >>globe. It's the Cube with digital coverage of pager duty. Summit 2020. Brought to you by pager duty. Hey, welcome back to Brady. Jeffrey here with the Cube in Palo Alto studios today. And we're talking about an upcoming event. It's one of our favorites. This will be the fourth year that we've been doing it. And it's pager duty summit. And we're excited to have from the pager duty team. She's Caroline Gus, the VP of corporate marketing from pager duty. Caroline, Great to see you. >>Hi, Jeff. Great to see you again. >>Absolutely. So, you know, I was thinking before we turn on the cameras we've been doing pager duty for I think this will be like, say, our fourth year that first year was in the cool, um, cruise ship terminal pier. I gotta written appear 27 which was which was nice. And then the last two years, you've been in the, you know, historic Westin ST Francis in downtown San Francisco, which is a cool old venue, but oh, my goodness. You guys were busting at the seams last year. So this year, year to go virtual. There's a whole bunch of new things that that you could do in virtual that you couldn't do in physical space. At least when you're busting out of the seems so First off, Welcome and >>talk a little >>bit about planning for virtual versus planning for a physical event from, you know, head of marketing perspective. >>Absolutely. I mean, the first thing that's changed for us is the number of people that can come. It's five x the number of people that were able to join us, the Western last year. So we have, uh, we we expect to have 10,000 people registered on attending age duty summit. The second thing is thea share number of sessions that we can put on. Last year, I think we had around 25 sessions. This year we have between 40 and 50 on again. That's because we're not constrained by space and physical meeting rooms, so it's being a really exciting process for us. We've built a fantastic agenda on. It's very much personalized, you know, developers come to our event. They love our event for the opportunity to learn mixed with their peers, get best practices and hands on experience. So we have many more of those types of sessions when we have done previously, and that things like labs and Bird of Feather Sessions and Emma's. But we've also built a whole new track of content this year for executives. Page Julie has, um, many of the Fortune 500 on 4100 customers. We work very closely with CEO CTO, so we have built sessions that are really designed specifically for that audience on I think for us it's really opened up. The potential of this event made it so much broader and more appealing than we were able to do when we were, As you say, you know, somewhat confined by the location in downtown San Francisco. >>I think it's such an interesting point. Um, because before you were constrained, right, If you have X number of rooms over a couple of days, you know you've got to make hard decisions on breakouts and what could go in and what can't go in. And, you know, will there be enough demand for these for this session versus another session? Or from the perspective of an attendee, you know, do they have to make hard tradeoffs? I could only attend one session at one oclock on Tuesday and I got to make hard decisions. But this is, you said really opens up the opportunities. I think you said you doubled. You doubled your sessions on and you got five X a number of registrations. So I think, you know, way too many people think about what doesn't happen in digital vs talking about the things that you can do that are impossible in physical. >>Yeah, I think at the very beginning. Well, first of all, we held our Amir summit events in London in July. So that was great because we got Thio go through this experience once already. And what we learned was the rial removal of hurdles in this process. So, to your point about missing the session because you're attending another session, we were calling this sort of the Pelton version of events where you have live sessions. It's great to be there, live participate in the live Q and A, but equally you have an entire on demand library. So if you weren't able to go because there was something else at the same time, this is available on demand for you. So we are actually repeating live sessions on two consecutive day. So on the Monday we're on everything on the Tuesday I ask because show up again for life Q and A at the end of their sessions. But after that it's available forever on an on demand library. So for us, it was really removing hurdles in terms of the amount of content, the scheduling of the content on also the number of people that content in attend, no geographical boundaries anymore. It used to be that a customer of ours would think, Well, I'll send one or two people to the page duty summit. They could learn all the great innovation from page duty, and they'll bring it back to the team that's completely changed. You know, we have tens of 20 signing up on. All of them are able to get that experience firsthand. >>That's really interesting. I didn't didn't even think about, you know, kind of whole teams being able to attend down instead of just certain individuals because of budget constraints, or you can't send your whole team, you know, a way for a conference in a particular area. But the piece to that you're supporting that were over and over is that the net new registrants goes up so dramatically in terms of the names and and and who those individuals are because a lot of people just couldn't attend for for various reasons, whether it's cost, whether it's, uh, geography, whether it's they just can't take time off from from from leaving their primary job. So it's a really interesting opportunity to open up, um, the participation to such a much bigger like you said five x five X, and increase in the registration. That's pretty good number. >>That's right. Yeah. I mean, that crossed boundaries gone away. This event is free on DWhite. That's actually meant is, as I say, you know, larger teams from the same company are attending. Uh, In addition, we have a number of attendees who are not actually paid to duty customers right now to previously. This was very much a community event for, you know, our page duty users on now we actually have a large number of I asked, interested future customers that will be coming to the event. So that's really important for us. And also, I think, for our sponsor partners as well, because it's bordering out the audience for both of us. So let's >>talk about sponsors for a minute, because, um, one of the big things in virtual events that people are talking about quite often is. Okay, I can do the keynotes, and I could do the sessions. And now I have all these breakout sessions for, um, you know, training and certification and customer stories, etcetera. But when it comes to sponsors, right sponsors used, you know, go to events to set up a booth and hand out swag and wander badge. Right? And it really was feeding kind of a top level down funnel. That was really important. Well, now those have gone away. Physical events. So from the sponsor perspective, you know, what can they expect? What? What do you know the sponsor experience at pager duty Summit. Since I don't have a little tiny booth at the Westin ST Francis given out swag this year. >>Yeah. So one important thing is the agenda and how we're involving our sponsors in our agenda this time, something that we learned is we used to have very long keynotes. You know, the keynote could be an hour long on involved multiple components and people would stay in that room for a now er on did really stay and watch sessions all day. So we learned in the virtual format that we need to be shorter and more precise in our sessions on that opened up the opportunity to bring in more of our partners, our sponsorship partners. So zendesk Salesforce, Microsoft some examples. So they actually get to have their piece of both of our keynote sessions and of our technical product sessions. I'm really explain both the partnership with pager duty, but also they're called technology and the value that they provide customers. So I think that the presence of sponsors in content is much higher than it was before on we are still repeating the Expo format, so we actually do have on Expo Hall that any time there's breaking between sessions, you could go over to the Expo ball, and it actually runs throughout as well, and you can go in and you can talk to the teams. You can see product demos, so it's very much a virtual version of the Expo Hall where you went and you want around and you picked up a bit of swag, >>so you mentioned keynotes and and Jennifer and and the team has always had a fantastic keynotes. I mean, I just saw Jennifer being interviewed with Frank's Luqman and and Eric Juan from Zoom By by Curry, which was pretty amazing. I felt kind of jealous that I didn't get to do that. But, um, talk tell us a little bit about some of the speakers I know there'll be some some, you know, kind of big rally moment speakers as well as some that are more down to technical track or another track. Give us some highlights on on some of the people. I will be sharing the stage with Jennifer. >>Absolutely, I said. I think what's really unique about Page duty Summit is that we designed types of content for different types of attendees. So if you're a developer, your practitioner, we have something like this from Jones of Honeycombs, who's talking about who builds the tools that we all rely on today, and how do they collaborate to build them together in this virtual world? Or we have J. Paul Reed from Netflix talking about how to handle the stress of being involved in incidents, So that's really sessions for our core audience of developers who are part of our community and pager duty really helps them day to day with with that job. And then we have the more aspirational senior level speakers who could really learn from a ZA leader. So Bret Taylor, president and CEO of Salesforce, will be joining us on the main stage. You'll be talking about innovation and trust in today's world on. Then we have Derrick Johnson. He is president of N A A. C P, and he'll be talking about community engagement and particularly voter engagement, which is such an important topic for us right now. Aan den. We have leaders from within our customers who are really talking about the way they use pager duty thio drive change in their organization. So an example would be porches, bro. He runs digital for Fox on, and he's gonna be talking about digital acceleration. How large organization like Fox can really accelerate for this digital first world that we find ourselves living in right now, >>right? Well, you guys have such a developer focus because pager duty, the product of solution, has to integrate with so many other, um, infrastructure, you know, monitoring and, uh, and all of all those different systems because you guys were basically at the front line, you know, sending them the signals that go into those systems. So you have such a broad, you know, kind of ecosystem of technology partners. I don't know if people are familiar with all the integrations that you guys have built over the years, which is such a key piece of your go to market. >>That's right. I mean, we we like to say we're at the center of the digital ecosystem. We have 203 170 integrations on. That's important because we want anyone to be able to use page duty no matter what is in their technology stack technology stacks today are more complex than they've ever been before, particularly with businesses having to shift to this digital first model since we all began shelter in place, you know, we all are living through digital on working and learning through digital on DSO. The technology stacks that power that are more complicated than ever before. So by having 370 integrations, we really know that we conserve pretty much any set of services that your business. It's using. >>Yeah, we've all seen all the means right about who's who's pushing your digital transformation. You know, the CEO, the CEO or or covert. And we all know the answer to toe what's accelerated that whole process. So okay, but so before I let you go, I don't even think we've mentioned the date. So it's coming up Monday, September, September 21st through Thursday, September 24th not at the West End Online and again. What air? What are you hoping? You're kind of the key takeaways for the attendees after they come to the summit? >>Yeah, a couple of things. I mean, first of all, I think will be a sense of belonging. Three attendees, the uses, a pager duty. They are really the teams that are at the forefront of keeping our digital services working on. But what that means is responding to incidents we've actually seen. Ah, 38% increase in the volume of incidents on our platform since covert and shelter in place began. Wait 30 >>38% increase in incidents since mid March. >>That's correct. Since the beginning of on bear in mind incidents. Prior to that in the six months prior, they were pretty flat. There wasn't instant growth. But what we've also seen is a 20% improvement in the time that it takes to resolve an incident from five minutes down to four minutes. So what that really means is that the pager duty community is working really hard. They're improving their practices. Hopefully our platform, our platform is a key part of how, but these are some people under pressure, so I hope that people can come and they can experience a sense of belonging. They can learn from each other about experiences. How do you manage the stress of that situation on what are some of the great innovations that make your job easier in the year ahead? The second thing that we don't for that community is that we are offering certification for P. D. You page due to university for free this year. It's of course, with a value of $7500. Last year, you would attend page duty summit on you would sit through your sessions and you would learn and you would get certified. So this year it's offered for free. You take the course during summit. But you can also carry on if you miss anything for 30 days after. So we're really feeling that, you know, we're giving back there, offering a great program for certification and improved skills completely free to help our community in this in this time of pressure, >>right? Right. Well, it is a very passionate community, and, you know, we go to so many events and you can you can really tell it's palatable, you know, kind of what the where the tight communities are and where people are excited to see each other and where they help each other, not necessarily only at the event, but you know, throughout the year. And I think you know a huge shout out to Jennifer on the culture that she's built there because it is very warm. It's very inclusive, is very positive. And and that energy, you know, kind of goes throughout the whole company and ice the teaser. You know this in something that's built around a device that most of the kids today don't even know what a pager is, and just the whole concept of carrying a pager and being on call right and being responsible. It's a very different way to kind of look at the world when you're the one that has that thing on your hip and it's buzzing and someone's expecting, Ah, return call and you gotta fix something So you know, a huge shout out to keep a positive and you're smiling nice and big culture in a job where you're basically fixing broken things most of the time. >>Yeah, absolutely. I mean, there's, I think, a joke that we make you know these things only break on Friday night or your wedding anniversary or Thanksgiving. But one of the announcements we're most excited about this year is the level of automation on artificial intelligence that we're building into our platform that is really going to reduce the number of interruptions that developers get when they are uncle. >>Yeah, I look forward to more conversations because we're gonna be doing a bunch of Cube interviews like Normal and, uh, you know, applied artificial intelligence, I think, is where all the excitement is. It's not a generic thing. It's where you applied in a specific application to get great business outcomes. So I look forward to that conversation and hopefully we'll be able to talk again and good luck to you and the team in the last few weeks of preparation. >>Thanks so much, Jeff. I've enjoyed talking to you. Thanks for having me. >>Alright. You too. And we'll see you later. Alright. She is Caroline. I'm Jeff. You're watching the Cube. Thanks for watching. We'll see you next time.