Tallapragada and Hartman for review
>>from around the globe. It's >>the Cube with digital coverage of >>AWS Public Sector Partner Awards >>brought to you by >>Amazon Web services. Everyone, welcome to this cube coverage of AWS Public Sector Partner Awards program. I'm John Furrow, your host of the Cube with two great guests here. Travis Department director of analytics and Weather at Max. Our technologies and VJ teleplay Gotta Who's the chief? Modeling and data a simulation branch at Noah. Tell us about the success of this. What's the big deal? Take us through the award and why Max are what you guys do. >>Yeah, so Macs are is an organization. Does a lot of different activities unearth intelligence as well as space? We have about 4000 employees around the world. One side of the economy works on space infrastructure, actually building satellites on all the infrastructure that's going to help us get us back to the moon and things like that. And then on the other side we have a north of intelligence group, which is where, I said, and we leverage remote sensing information for science information to help people better understand how, how and what they do might impact the Earth or have the earth, and it's activities might impact their business mission. Our operation. So what we wanted to set out to do was help people better understand how weather could impact their mission, business or operations. And a big element of that was doing it with speed. Ah, so we we knew? No. I had capabilities running America weather prediction models and very traditional on Prem. Big, beefy ah, high performance compute supercomputers. But we wanted to do it in The cloud we want to do is AWS is a key part. So we collaborated with B. J and Noah and his team is there to help pull that off. They gave this access public domain information, but they showed us the right places to look. We've had some of the research scientists talking, and after pretty short effort, it didn't take a lot of time. We were able to pull something off that a lot of people didn't think was possible. I'm we got pretty excited. Once we saw some of the outcome >>Travis to be, Jay was just mentioning the relationship. Can you talk about the relationship together because this is not your classic Amazon partner client relationship that you have. You guys have been partnering together V. J and your team with AWS. Talk about the relationship and that and how Amazon plays because it's a unique partnership plane in more detail at specific relationship. >>Yeah, with Max or in AWS. You know, our partnership has gone back A number of years on Macs are being a fairly large organization. There's lots of different activities. I think Max Star was the first client of AWS Snowmobile, where they have the big tractor trailer back up to a data center, load all the data in and then take it to an AWS data center. We were the first users of that because we had over 100 petabytes of satellite imagery and archive that just moving across the Internet would probably still be going. Um, so the snowmobile is a good success story for us, but just with >>the >>amount of data that we have, the amount of data we collect every day and all the analytics that we're running on it, whether it's in an HPC environment or, you know, the scalable Ai ml were able to scale out that architecture scale out that compute the much easier, dynamic and really cost effective way with AWS, because when we don't need to use the machines, we turn them off. We don't have a big data center sitting somewhere. We have to have security, have all the overhead costs of just keeping the lights on. Literally. AWS allows us to run our organization and a much more efficient way. Um and Noah, you know, they're They're seeing some of that same success story that we're seeing as far as how they can use the cloud for accelerating research, accelerating how the advancement of numerical weather prediction from the United States can benefit from cloud from cloud architecture, cloud computer, things like that. And I think a lot of the stuff that we've done here, Max our with our HPC HPC solution in the cloud. It's something that's pretty interesting to know, and it's it's a good opportunity for us to continue our collaboration. >>If I could drill down on that solution architecture for a minute. How did you guys set up the services, and what lessons did you learn from that process? >>We're still learning. It was probably the the short answer, but it all started with our people. Uh, you know, we have some really strong engineers, really strong data scientists that fundamentally have a background in meteorology or atmospheric science, you know? So they understand the physics. So you know why the wind blows is the way it doesn't. Why Cloud's doing clouds to do, Um, but we also having a key strategic partnership with AWS. We really have to tap into some of their subject matter experts. And we really put those people together, you know, and come up with new solutions, new innovative ideas, stuff that people hadn't tried before. We're able to steer a little bit of AWS is product roadmap for is what we were trying to do and how their current technology might not have been able to support it. But by interacting with us gave them some ideas as far as what the tech had to move towards. And then that's that's what allowed us to move pretty quick fashion. Um, you know, it's it's neat stuff technology, but it really comes down to the people. Um, and I feel very honored and privileged to work with both great people here. Attacks are as well as aws, um, as well as being able to collaborate with your great teams. That power, it's been a lot of fun. Well, >>Travis gonna create example? I think it's a template that could be applied to many other areas, certainly even beyond. You've got large scale, multi scale situation there. Congratulations. Final question. What does it mean to be an award winner for AWS Partner Awards as part of the show? You're the best in show for HPC. What's it like? What's the feeling? Give us a quick side from the field? >>Yeah. I mean, I don't know if there's really a lot of good words that kind of sum it up. It's Ah, I shared the news with the team last night, and you know, there are a lot of a lot of good responses that came from a lot of people think it's cool. And at the end of the day, a lot of people on our team, you know, took a hobby or a passion of weather and turned it into a career. Ah, and being acknowledged and recognized by groups like AWS for best solution in a particular thing. Um, I think we take a lot of that to heart. And, ah, we're very honored and proud of what we were able to do and proud that other people recognize the need stuff that we're doing well, >>Certainly taking advantage. The cloud, which is large scale. But you you're on a great wave. You've got a great area. I mean, whether you talk about whether it's exciting, it's dynamic. It's always changing. It's big data. It's large scale. So you get a lot of problems to solve in a lot of impact to get it right. So congratulations on ECs. >>Thank you very much. Great mission. Thank you. >>Love what you do love to follow up again. Maybe do another interview and talk about the impact of weather and all the HPC kind of down the road. But, Travis, thank you very much. >>Thank you. Appreciate it. >>Good to see you. >>Thank you. Good to be here. >>So Noah, National Oceanic Atmospheric Administration, National Weather Center, National Center for Environmental Predictions, Environmental Modeling Center year. That's your organization? You guys are competing to be best in the world. Tell us what you guys do at a high level. Then we'll jump into some of the successes. >>So the national Weather Service is responsible for providing weather forecast to save lives and property and improve the economy of the nation. And that's part of that. That the national weather services responsible for providing data and also the forecasts to the public and the industry and be responsible for providing the guidance on how they create the forecasts. So we are at the Environmental Modeling Center, uh, the nation's finest institute in advancing our numerical weather prediction modelling development, and you play it off all the data that's available from the world to initialize our models and provide the future state of the atmosphere from hours all the way to seasons and years. That's that's the kind of a range of products that we don't lock and provide are our key for managing the emergency services and patch it management and mitigation and also improving the nation's economy by preparing well in advance for the future events. And it's it's a science based organization, and we have ah well class scientists working in this organization. I manage about 170 of them at the moment of modeling center. They're all PhDs from various disciplines, mostly from meteorology, atmospheric sciences, oceanography, land surface modelling space weather, all weather related areas and the mathematics and computer science. And we are at the stage where we are probably the most. Uh huh. Most developed, uh, advanced modelling center that we use almost all possible computational resources available in the world. So this is a really computational in terms of user data, user computer seems off. Uh, all the power that we can get and we have a 3.5 petaflop machine that we use to provide these weather forecasts, and they provide the services every hour. For some sense is like the CDO rather our rates for every three hours for hurricanes and for every six hours for the regular, Rather like the participation, uh, the temperature forecast. So all the data that you see coming out from either the public media, our department agencies, they are originated in our center and disseminated in various forms. I think no one is the only center in the world that provides all this information for your past. So it is, ah, public service organization and we riding on a visa with society. >>We'll I love your title, Chief modeling and data, a simulation title branch of a lot of these organizations. This >>is >>whether it's ever critical. I want to get your thoughts cause we were talking before we came on about how the Hurricane Katrina was something that really kind of forcing you to rethink things. Whether it is an evolving system, it's always changing. Either the catastrophe or something happens. Were you trying to proactive predicting, say, whether it's a fire season in California, all kinds of things going on that's not It's always hard to get a certain prediction. You have big job. It's a lot of data you need. Horsepower need computing. You need to stand up. Some HPC take us through like like the thinking around the organization. And what was The impact is that you see, because whether does have that impact. >>So traditionally, you know, as you mentioned, there are radius weather phenomenon that you describe like the five rather the Americans, every presentation, the flooding. So we developed solutions for individual weather phenomena, and, uh, we have grown in that direction by developing separate solutions for separate problems. And very soon it became obvious that we cannot manage all these independent modeling systems to provide the best possible forecasts. So the thinking has to be changed. And then there is Another big problem is that there's a lot of research going out in the community like the academic institutes, the universities, other government labs. There are several people working in these areas, and all their work is not necessarily a coordinated, uh, development activity that we cannot take advantage. And they have no incentive for people to come and contribute towards the mission that we are engaged in. So that actually prompted to change the direction of thinking. And as you mentioned, Hurricane Katrina was an eye opener. We had the best forecasts, but the dissemination of that information waas not probably accurate enough, and also there is a lot of room for improvement in predicting these catastrophic events. How are >>you guys using AWS? Because HPC high performance computing I mean you can't ask for more resources in the massive cloud that is Amazon. How is that help to you? Can you take a minute to explain, but walk us through? >>What? >>Aws? There >>are a few example. Second site. But before then, I would like to really appreciate a Travis Hartman from Max. Are you know who is probably the only private sector partner that we had in the beginning. And now we're expanding on. That s so we were able to share our community. Cores with Max are and without how they were able to establish this and drive modeling system as it is done in operations that Noah and they were able to reproduce operational forecast using the cloud resources. And then they went ahead and did even more by scaling the modeling systems is that it can run even faster and quicker them are what insert no operations can do. So that gives us one example of how the cloud can be used. You know, the same forecast that we produce, ah, globally, which will take about eight minutes per day. And, uh, Max I was able to do it much faster, like 50% improvement and in the efficiency of the colors. And now the one piece of this is that the improvements that matter are other collaborators are using, or cords that they're putting into the system are coming back to us. So we take advantage of that, improving the efficiency in operations. So this is that this is like a win win situation for both, uh, who are participating in the R and D on who are using it in operations, and on top of it, you can create multiple configurations of this model in various instances on the cloud when you can run it more efficiently and you can create an ensemble of solutions that can be captured toe individual needs. And the one additional thing I want to mention about User Cloud is, is that you know, this is like when you have a need, you can search the compute you can. Instead she 8000 sub simulations to test a new innovation. For instance, you don't need to wait for the resources to be done in a sequential manner. Instead, you can ramp up the production off these apartments in no kind and without Don't worry about. Of course, the cost is the fact that we need to worry about, but otherwise the capacity is there. The facilities are reacting to take advantage of the cloud solutions. If I'm a >>computer scientist person, I'm working on a project. Now I have all this goodness in the cloud, how's morale been and what's the reaction been like from from people doing the work. Because usually the bottleneck has been like I gotta provision resource. I gotta send a procurement request for some servers or I want to really push some load. And right now, I got a critical juncture. I mean, it's got a push morale up a bit, and you talk about the impact to the psychology of the people in your organization. >>Um, I haven't. I have two answers to this question. One from a scientist perspective like me. You know, I was not a computer scientist from the beginning, but I became a software engineer, kind of because I have to work with these software and hardware stuff more more on solving the computational problems than the critical problems. So people like us who have invested their careers in improving the science, they were not care whether it's ah, uh hbc on premise Cloud, what will be delighted to have, uh, resources available alleviate that they can drive. But on the other hand, the computer computational engineers are software engineers who are entering into this field. I think they are probably the most excited because of these emerging opportunities. And so there is a kind of a friction between the scientific and the computational aspects off personnel, I would say. But that difference is slowly raising on and we are working together as never before. So the collective moral is very high to take advantage of these resources and opportunities. I think way of making the we're going in the right direction. >>It's so much faster. I mean, in the old days, you write a paper, you got to get some traction. Gonna do a pilot now It's like you run an experiment, get it out there. VJ I'm very impressed with the organization. Love to do a follow up with you. I love the impact that you're doing certainly in the weather impact society from forecasting disasters and giving people the ability to look at supply chain, whether it's providing for potentially a fire season or water shortage or anything going on there. But also it's a template. You're exceeding a new kind of waiting to innovate with community with large scale, multi scale data points. So congratulations and >>thank you. >>Thank you very much. I'm John Furrier here part of AWS partner Awards program. Best HPC solution. Great. Great Example. Great use case. Great conversation. Thanks for watching two great interviews. Here is part of AWS Public Sector Partner Awards program. I'm John Furrier. The best in show for HPC Solutions. China's Hartman Max, our technologies and Vijay tell Apartado at Noah. Two great guests. Thanks for watching. Yeah, Yeah, yeah, yeah, yeah, yeah
SUMMARY :
from around the globe. What's the big deal? We have about 4000 employees around the world. Talk about the relationship and that and how Amazon plays because it's a unique partnership plane of satellite imagery and archive that just moving across the Internet would probably still be going. that compute the much easier, dynamic and really cost effective way with set up the services, and what lessons did you learn from that process? And we really put those people together, you know, and come up with new solutions, You're the best in show for HPC. And at the end of the day, a lot of people on our team, you know, I mean, whether you talk about whether it's exciting, it's dynamic. Thank you very much. Maybe do another interview and talk about the impact Thank you. Good to be here. what you guys do at a high level. So all the data that you see coming out from branch of a lot of these organizations. And what was The impact is that you see, So the thinking has to be changed. Can you take a minute to explain, but walk us through? You know, the same forecast that we produce, it's got a push morale up a bit, and you talk about the impact to the psychology of the people in your organization. So the collective moral is very high to I mean, in the old days, you write a paper, you got to get some traction. Thank you very much.
SENTIMENT ANALYSIS :
ENTITIES
Entity | Category | Confidence |
---|---|---|
Jay | PERSON | 0.99+ |
AWS | ORGANIZATION | 0.99+ |
John Furrow | PERSON | 0.99+ |
National Oceanic Atmospheric Administration | ORGANIZATION | 0.99+ |
Amazon | ORGANIZATION | 0.99+ |
Travis | PERSON | 0.99+ |
50% | QUANTITY | 0.99+ |
National Weather Center | ORGANIZATION | 0.99+ |
John Furrier | PERSON | 0.99+ |
Vijay | PERSON | 0.99+ |
National Center for Environmental Predictions | ORGANIZATION | 0.99+ |
California | LOCATION | 0.99+ |
earth | LOCATION | 0.99+ |
Tallapragada | PERSON | 0.99+ |
Earth | LOCATION | 0.99+ |
Noah | PERSON | 0.99+ |
five | QUANTITY | 0.99+ |
over 100 petabytes | QUANTITY | 0.99+ |
Hurricane Katrina | EVENT | 0.99+ |
both | QUANTITY | 0.99+ |
Environmental Modeling Center | ORGANIZATION | 0.99+ |
United States | LOCATION | 0.99+ |
One | QUANTITY | 0.99+ |
VJ | PERSON | 0.99+ |
first users | QUANTITY | 0.98+ |
B. J | PERSON | 0.98+ |
two answers | QUANTITY | 0.98+ |
Hurricane Katrina | EVENT | 0.98+ |
One side | QUANTITY | 0.98+ |
last night | DATE | 0.98+ |
Hartman | PERSON | 0.98+ |
one | QUANTITY | 0.98+ |
Second site | QUANTITY | 0.98+ |
America | LOCATION | 0.97+ |
China | LOCATION | 0.97+ |
about 4000 employees | QUANTITY | 0.97+ |
Hartman Max | PERSON | 0.97+ |
Two great guests | QUANTITY | 0.97+ |
one piece | QUANTITY | 0.97+ |
Max | PERSON | 0.97+ |
V. J | PERSON | 0.96+ |
first client | QUANTITY | 0.96+ |
two great guests | QUANTITY | 0.96+ |
one example | QUANTITY | 0.95+ |
Apartado | PERSON | 0.94+ |
national Weather Service | ORGANIZATION | 0.93+ |
Travis Hartman | PERSON | 0.93+ |
Macs | ORGANIZATION | 0.93+ |
Noah | ORGANIZATION | 0.93+ |
HPC Solutions | ORGANIZATION | 0.91+ |
AWS Public Sector Partner Awards | EVENT | 0.89+ |
about eight minutes per day | QUANTITY | 0.89+ |
Americans | PERSON | 0.89+ |
Cube | COMMERCIAL_ITEM | 0.89+ |
every six hours | QUANTITY | 0.88+ |
every three hours | QUANTITY | 0.84+ |
Environmental Modeling Center year | ORGANIZATION | 0.84+ |
snowmobile | ORGANIZATION | 0.83+ |
8000 sub simulations | QUANTITY | 0.81+ |
HPC | ORGANIZATION | 0.81+ |
two great interviews | QUANTITY | 0.81+ |
Macs | COMMERCIAL_ITEM | 0.8+ |
3.5 petaflop machine | QUANTITY | 0.8+ |
Amazon Web | ORGANIZATION | 0.8+ |
about 170 of | QUANTITY | 0.79+ |
AWS Partner Awards | EVENT | 0.73+ |
people | QUANTITY | 0.73+ |
Max Star | PERSON | 0.65+ |
national weather services | ORGANIZATION | 0.64+ |
Public Sector Partner Awards | TITLE | 0.62+ |
Max. | ORGANIZATION | 0.61+ |
thing | QUANTITY | 0.58+ |
moon | LOCATION | 0.55+ |