Billions of times each year, people turn to Google’s web search box for help figuring out what’s wrong with their skin. Now, Google is preparing to launch an app that uses image recognition algorithms to provide more expert and personalized help. A brief demo at the company’s developer conference last month showed the service suggesting several possible skin conditions based on uploaded photos.
Machines have matched or outperformed expert dermatologists in studies in which algorithms and doctors scrutinize images from past patients. But there’s little evidence from clinical trials deploying such technology, and no AI image analysis tools are approved for dermatologists to use in the US, says Roxana Daneshjou, a Stanford dermatologist and researcher in machine learning and health. “Many don’t pan out in the real world setting,” she says.
Google’s new app isn’t clinically validated yet either, but the company’s AI prowess and recent buildup of its health care division make its AI dermatology app notable. Still, the skin service will start small—and far from its home turf and largest market in the US. The service is not likely to analyze American skin blemishes anytime soon.
At the developer conference, Google’s chief health officer, Karen DeSalvo, said the company aims to launch what it calls a dermatology assist tool in the European Union as soon as the end of this year. A video of the app suggesting that a mark on someone’s arm could be a mole featured a caption saying it was an approved medical device in the EU. The same note added a caveat: “Not available in the US.”
The company’s America-not-first strategy highlights how it can be easier to win approval for medical apps in Europe than in the US. A Google spokesperson said the company would like to offer the service in the US but didn’t have a timeline on when it might cross the Atlantic; they declined to comment on whether Google has talked with the US Food and Drug Administration about the app but acknowledged the agency’s approval process can be longer.
That flips the traditional Silicon Valley view of Europe as a red-tape-strewn landscape hostile to new ideas. Between 2012 and 2018, Facebook did not offer face-recognition suggestions in the EU after an audit by Ireland’s data regulator forced the company to deactivate the feature and delete its stockpile of European faceprints. Since 2014, Google has been required to allow EU citizens to request that old links about them be scrubbed from the company’s search engine under the “right to be forgotten.”
Google says its skin app has been approved “CE marked as a Class I medical device in the EU,” meaning it can be sold in the bloc and other countries recognizing that standard. The company would have faced relatively few hurdles to secure that clearance, says Hugh Harvey, managing director at Hardian Health, a digital health consultancy in the UK. “You essentially fill in a form and self-certify,” he says. Google’s conference last month took place a week before tighter EU rules took effect that Harvey says require many health apps, likely including Google’s, to show that an app is effective, among other things. Preexisting apps have until 2025 to comply with the new rules.
Last month’s demo was brief, and the app’s design is not final, but US experts on AI health software say that Google could face a more involved process from the FDA if it brings its skin app home. The FDA did not immediately respond to a request for comment.
The design shown in the demo requires a person to snap three photos of their blemish from different angles and distances. The user can optionally add information such as the body part affected and how long they’ve had the problem. Tapping “Submit” zips the images off to Google. The app then displays “Suggested conditions,” showing possible conditions illustrated by images. Tapping on one brings up a list of key information such as symptoms, contagiousness, and treatment options. Google says the app was trained on “hundreds of thousands of skin images” and can identify 288 conditions, including skin cancers, covering roughly 90 percent of common dermatology web searches.
The FDA exempts some health software it deems “lower risk”—such as “wellness” advice like diabetes management or information about health symptoms—from medical device approvals. It requires approval for others, such as those offering specific diagnoses, or apps that function as medical devices such as a stethoscope. The line between apps that need clearance and those that do not is hard to pinpoint because medical software and the rules governing it are relatively new.
Bradley Thompson, a regulatory lawyer with Epstein Becker Green, asks clients a handful of key questions when trying to determine whether they’ll need FDA sign-off. They include how the software’s output is presented to a person and whether a company makes specific medical claims.