live from Las Vegas it's the cube covering AWS reinvent 2018 brought to you by Amazon Web Services Intel and their ecosystem partners hey welcome back everyone we're live here in Las Vegas with AWS Amazon webster's reinvent our 6th year I'm Jeff our table what they did six years two sets people rolling out of the keynote so much action we got another day coming tomorrow they're two great guests here we got dr. feci philomon is the general manager the machine learning and AI at Amazon Web Services and dr. Taha costs senior leader at healthcare and AI at Amazon guys welcome to the cube Thank You thanks itíd that you're here because I've been waiting to have this conversation Dave and I have been we just had an analysis of the distractions and glued up the stack around machine learning so much value now coming online that's been in the works around AI are really mainly machine learning that's creating a I like benefits and II just had to spend a lot of time with key nuts they almost a third of it around a I like capabilities and how Amazon integrates in from you know chipsets with elastic inference beautiful it's just good stuff so congratulations so what does it mean what does it mean for customers right now who want to kind of grok what's going on with Amazon and AI is that new sense the services coming online is that how long has been the works explaining yeah our mission at AWS has always been to take technologies that have been traditionally available for a few special technology companies and take that and make it available to all developers and we've done that I should say that we've done that fairly well when it comes to compute when it comes to storage when it comes to databases the analytics and we're doing the same thing for machine learning and AI and what we're doing because it's a new field is we've got to innovate at three layers of our stack to the bottom most layer as you saw in the keynote earlier has to do with frameworks and infrastructure so this is more for the people that fully understand how to deal with machine learning models and like to go in and tweak these models the middle layer then is for everyday developers and the data scientists and that's sort of where sage maker fits in and finally at the top layer of the stack is where we have our application services and this is meant for developers that don't want to get into the weeds of machine learning but they still want to use make use of all of these technologies to make their applications more smarter so they get the insight benefits get the insights have the day that without getting in town on the weeds exactly who want to get down in the weeds you can get down and dirty with all this other stuff yeah look at that right yeah and typically what we do with the top layer of the stack as we try and solve really hard problems and so customers can now take advantage of it because we've solved it for them and they can just take that and integrate it into their Apple quick what what's the hardest problem that you guys solve I mean traditionally speech recognition is a very hard problem that's one of the hard problems the other one is NLP natural language processing but I would say speech recognition is probably a hard problem and we just launched streaming transcription so you can now transcribe live as somebody speaks and of course you can connect it to translate and translate it as well live so great for our cute beers looking forward to having that on as a health care practitioner how does this all apply to that industry what kind of projects are you guys working on in that regard of course yeah so I mean to to posses point is want to continue to innovate on behalf of the customers across all layers of the stack machine learning in particular this week we launched Amazon comprehend medical particularly in a hardier heart problem where the majority of healthcare data is captured conversation and observations and unstructured formality so petabytes of data is stored across entire healthcare system that's a nun structure for form so to drive actionable insights and to be able to find the right elements to treat patients or to manage a population or even to do accurate billing it's been really an important that we can empower our customers with building blocks for them to build the right solutions to take advantage of that so Amazon comprehend Medical is able to understand the medical language and the context similar how clinicians understand the medical language and context for example if you're looking at a patient medical note Amazon campaign medicals able to with high accuracy extract medical conditions medications tests procedures being done on the patients as well as the relationship between those and understanding that context at this condition and this treatment go together as well as the nuances for example you know a patient has no family history of X or there's no smoking history all those are things in relation in the past or in the future or other members and this is really what we're really proud about launched an Amazon comprehend medical talk about how it works because you know I Healthcare has been a great field around where a is old-fashioned a is a queer when I wasn't doing it in the 80s early 90s ontologies were really popular and it's linguistics is kind of known but now that but you need that linguistics guru to do that he mentioned streaming the transcribed got metadata how do you guys get this kind of benefit when the balls moving so fast around these rapidly changing and verticals like healthcare because healthcare is got a big problem like other verticals where it's too many notifications what I pay attention to so much data how do you put the puzzle together let me first give you some context here as you probably we're at last reinvent we launched Amazon comprehend right comprehend is a text analytics service it helps you look into text and understand what's in there right we started out with general things that we could detect like people places things sentiment the language the text is written in and so on but when we started customers are picked on it and they're using it a lot but as they keep using it they came back to us and said hey it's great that you guys have this this you're giving us the capability to understand general language but some of our domains have some special language like jargon like yeah like take the legal domain for example right it's got charges and defendants and very particular things that are very relevant to the legal domain so they were asking us for a capability to sort of extend the comprehend to include their custom domain terms and phrases as well right so last week we actually launched a custom custom entities feature that allows them to bring in their custom domain into comprehend so the comprehend be extended to include their domain the so legal language is difficult to understand but medical language on the other hand is even more harder to understand that quick right acronyms jargon absolutely what is an entity looks like extracting that and extracting it uses alone yeah miss spells right but relating those entities together is super important because you could in one clinical note you could have multiple drugs in there with different dosages different frequencies and so you need to be able to relate those entities together right and that's the sort of thing that comprehend Medical allows our customers to do to solve some really so you're doing one of that entity extraction is under the covers is that right has it were I mean how does comprehending the medical work I mean just out of the box you have to train it there's no training meet needed know machine learning expertise needed so the algorithm extract these entities as well as the relationship between those entities and then also extracts any attributes that might be related such as negation or past and future or what's anatomy of the body relates one now all that is done out of the box and that's super important you want to know whether the patient's stopped taking a medication right yeah so negation things like that you want to know because that gives you the context just getting the terms alone doesn't really tell you much it each has had a great video about the f1 point of ethics imagine that for personal that's right you're not doing good right now take a break yeah so I feel like we're kind of now scratching the service of stress in the surface of health care yeah information yeah think about the health care industry for years it's been compliance-driven yeah whether it's hip Affordable Care Act yeah EMR and meaningful use right but the industry hasn't been you know dramatically transformed and disrupted and it kind of needs to be yeah how do you guys see that evolving I feel like you're now beginning to see that see change and that's going to take a while it's a high-risk business obviously but what's your sort of prognosis for that transformation and what's the vision as to the outcome yes now that's a really great question I mean one thing I mean one great things happen over the last decade is the digitization of your medical record so and that's really wonderful because before was all paper-based primarily unless you were an acute setting so now the majority of the US for example and globally there's this huge adopt adoption and propagation of these electronic medical records the issue there remains now when the majority of that data is observations and conversations as well as unstructured that that creates a different kind of roadblock for our customers and this is what we're hoping for service like Amazon comprehend medical that's HIPPA eligible means a lot of the early the compliance or help our customer meet their compliance needs that we'll be able to remove the heavy lifting of this undepreciated task about you know having in a large amount of time being spent on analyzing this text and extracting very low we're now with Amazon company and medical be able to really fast track that and be able to elevate it hit the nail on the head of the undifferentiated heavy lifting right that's the ethos of DevOps is that yeah let me give you some stats actually there are one point two billion medical documents that are generated every year in the US and 80% of them it's unstructured text so to make sense of that it's going to enable our customers to do some really amazing things one of the things one of the use cases that we see is its clinical trial recruitment so Fred Hutchinson which is one of the yeah the nation's top cancer research centers they recruit patients for clinical trials if you go to clinical trials.gov you'll see like 290 thousand four and 50 clinical trials open and typically from history we know that most of these clinical trials don't end up recruiting they don't end up meeting their recruiting goals because it's very hard to figure out which patients fit the clinical trial that you're actually trying to perform so comprehend medical helps these customers to very quickly narrow it down expand on the involvement of people in the community mentioned Fred hutch Roach has also been involved what I heard yeah what who was involved in this project sound it was a collaboration take a minute to explain that right I mean it's very similar to a lot of other services that we put it into the market we collaborate a lot with customers 90% of what we do is really coming from customers so we've collaborated with people like Fred hutch and some of the nation's top institutions to help us validate the service that we've built to actually make sure that its meeting sort of the requirements for those use cases that they are thinking of so we collaborate closely with them to get the service to where this today and we announced it as generally available yesterday ok so what's the use case I'll go ahead yeah I can expand a little bit some of the customers as well their use cases we're talking anywhere from hospital systems that when I use or take advantage of their unstructured text for things such as identify people who are for their follow-up appointments or stopping treatments or find an alternative routes to billers we're trying to identify it is accurate procedures were done if we account for all the procedures or care for all the billing which often time is hidden in those unstructured text and require a lot of manual process and often time the rules that can't really scale to things such as clinical trials recruitment how can you if example in Fred Hutchinson Cancer Institute use case for identify a patient and match them to the right clinical trial these patients often time have Harry Potter's worth of clinical notes down on the minute their longitudinal journey and to go from one institution another another and be able to really find it's no longer needed a haystack it's like a needle in the bottom of Atlantic Ocean and then be able to really do that match from hours and months down to a few seconds and that's really the beauty about the service John likes to talk about the 20 mile stare and I wonder if we could just look ahead how far can we take AI and machine learning in in healthcare and how far should we take it and maybe a more specific question as as a practitioner you know when do you think machines might make better diagnosis than doctors if ever how do you feel about that where do you see this all going I think I mean the whole idea about machine learning the beauty about it I mean the seta scope was introduced or how the thermometer was introduced in medicine and these are tools that we use to our advantage to really provide better care and and better outcomes and that's really what we're that's the mission that our health IT and customers and wanna are really driving tower's machine learning can do a lot of great things for routine things that human being can't can go and focus their attention to other things such as the Fred Hutchinson instead of going and mining these diagnoses in mountain amounts of data a machine learning will be able to identify that with a clinical staff can focus on care and that's really where I think I mean over the next decade and so we can see a lot of this advancement in in these building blocks as well as what Amazon's offering from forecasting and prediction algorithms Rana will be able to find you know fine-tune our capabilities to help customers achieve even precision medicine real-world impact because you're changing the workflow I mean someone's within the wrong line or the wrong process based upon their history yeah HIPPA HIPPA requirements really cause a lot of this record sharing thing to be a problem from what we've been reporting over the years it's kind of a solution to that so if I move to a service medical service I get all that records with me it's just kind of how you see going and how does other regulations that are holding you back that are blockers is that clear now how does that solve the industry challenge it's of privacy and if you look at the healthcare system today there are lots of inefficiencies in there right in the end this is all about improving patient outcomes and making sure that we reduce costs and that's what this boils down to and these are tools that allow our customers to do exactly that well guys thanks for sharing this insight comprehend medicals really awesome opportunities I think it's early days day one is you guys think right I think there's so much more that could be there I'd love to see the industry just from the personal is decided change it's just get out of the way of all these pretty broad hurdles get the data out there expose the data check the privacy box would be good right this is gonna change the game yeah maybe we should say a little bit about the how we built the service in terms of that right as you know at AWS security and privacy is number one for us right so this service is HIPAA eligible it's a stateless service what that means is nothing gets stored this is not the data is not used to improve the models or anything like that the only person that can actually see the data is the customer he's got the keys he's the only one that's sending the data to the endpoint and whatever he gets back only he can decrypt it so we've taken care to make sure that we can remove some of those hurdles that people have always been worried about well doctors take you so much for sharing thank you so much for having us here we are bringing you all the action here from 80s reinvent again as the compute power is increased as software is written with new apps a eyes changing the game of course the cube a lot of video we don't need some of these services to make these transcribes on the fly they succumb and I really appreciate it you think back on the more after this short break [Music]