Cancer survival AI that predicts a patient’s chances from a single photograph of their face has been developed by doctors at Mass General Brigham, in one of the most comprehensive demonstrations yet of how a selfie could guide medical care.
The AI system was custom-built by experts at the nonprofit, integrated academic health care system in Massachusetts to estimate biological age and directly predict survival outcomes in patients diagnosed with cancer. Details of the breakthrough were published on Monday in the journal Lancet Digital Health, according to The Guardian.
The underlying model, called FAHR-Face, was trained on more than 40 million facial photographs covering a range of ages and ethnicities, plus photographs of more than 30,000 cancer patients, many of whom had already died. From it, the researchers developed two complementary tools.
The first, FAHR-FaceAge, estimates a patient’s biological age, the age a person looks rather than their chronological age, and predicts cancer survival from it. The second, FAHR-FaceSurvival, predicts survival from a facial photograph directly, without going through biological age. Although derived from the same model, the two captured different and complementary information about a patient’s health.
Raymond Mak, a radiation oncologist at Mass General Brigham Cancer Institute and one of the study’s authors, said doctors are trained to assess patients just by how they look but are in general not very good at estimating end of life expectancy. The researchers hope AI can capture physiological reserve and mortality risk objectively from a face photo.
How the cancer survival AI estimates risk
The results were striking. Among American cancer patients receiving radiotherapy, those estimated to look at least five years older than their chronological age had a 21 per cent higher risk of death during a follow-up that averaged four years. Patients estimated to look at least five years younger had a 17 per cent lower risk.
In a test group of 3,820 cancer patients, more than half of those with the highest risk score, 64 out of 122, died within 90 days of when their photograph was taken. The tool gave patients risk scores, and those with the highest scores were more likely to die within that window.
The researchers also tracked where the algorithm was looking when it made its predictions, a technique they call attention mapping. For age prediction, the AI tended to base its predictions on facial areas such as the nasolabial folds, the creases between the nose and mouth, and parts of the forehead. For risk of death, it focused on the bridge of the nose and areas below the eyes.
It is unclear why those areas specifically correlated with a person’s risk of death. The team says the model learned the associations itself from the vast training data, and further work will be needed to understand the biological mechanisms involved.
What cancer survival AI could change for care
The scientists say the findings are a first. To their knowledge, this is the first report of an AI algorithm that can directly predict cancer patient survival from a simple face photograph. The tool could complement doctors’ gut instincts to potentially guide treatment decisions, especially when medical data is scarce.
One promising use is assessing frailty and physical reserve before difficult interventions. A facial analysis could support judgments about whether a patient is fit for radiation, surgery or systemic therapy, helping doctors and patients make more informed, objective decisions about cancer treatment and end-of-life care.
The approach echoes what clinicians already do informally. Doctors are trained to assess patients by how they look, but that subjective assessment varies from physician to physician. An AI system that quantifies the same cues could make those judgments more consistent and reproducible.
There are also obvious limits. The researchers cautioned that more research is needed before the tools can enter widespread clinical use. A single photograph cannot capture the full clinical picture, and the risk scores would need validation across more diverse populations and cancer types.
Ethical questions will also need attention. A tool that assigns mortality risk from a face photo could influence how aggressively patients are treated, raising concerns about whether the technology would be used to support patients or to ration care.
For now, the study stands as a powerful demonstration of what AI can extract from ordinary images. As facial analysis matures, the humble selfie may become an unexpected ally in one of medicine’s hardest tasks, giving doctors a clearer picture of the patients in front of them.