Apple is working on iPhone features to help detect depression, cognitive decline

Using an array of sensor data that includes mobility, physical activity, sleep patterns, typing behavior and more, researchers hope they can tease out digital signals associated with the target conditions so that algorithms can be created to detect them reliably, the people said. Apple hopes that would become the basis for unique features for its devices, according to the people and documents.

The efforts spring from research partnerships that Apple has announced with the University of California, Los Angeles, which is studying stress, anxiety and depression, and pharmaceutical company Biogen Inc., which is studying mild cognitive impairment. “Seabreeze” is Apple’s code name for the UCLA project and “Pi” is the code name for the Biogen project, according to the people and documents.

Biogen launched its study on Monday, but many of the details about Apple’s studies haven’t been reported. The pharmaceutical company received approval this summer from the U.S. Food and Drug Administration for a new drug to treat mild cognitive impairment.

Representatives for Apple, Biogen and UCLA declined to comment.

Much of Apple’s past health work has focused on features for its smartwatch. The mental-health and cognitive-decline research leverages more-sensitive iPhone data and shows Apple’s health unit is now looking at features for the company’s flagship product, according to people familiar with the plans.

The research projects are still at early stages, and may never lead to new device features, the people said. While prior academic studies have shown some evidence that people with certain mental-health conditions use their digital devices differently than others, it remains to be seen if reliable algorithms can be created to detect the conditions, according to researchers.

Proper diagnosis of mental-health conditions and brain disorders typically requires close observation by specialists, but many people have no access to such specialists. Researchers working with Apple hope their work leads to a widely available alternative.

Even though the effort is at an early stage, top Apple executives are excited about the possibility. Chief Operating Officer Jeff Williams, who oversees Apple’s health unit, has spoken enthusiastically to employees about the company’s potential to address surging rates of depression and anxiety as well as other brain disorders, according to people who have heard him talk about the efforts.

If they are successful, Apple and its partners could improve the detection of the conditions, which affect tens of millions of people world-wide. But the extent of user tracking that may be required could spark privacy concerns. To address them, Apple aims for algorithms that work on users’ devices and don’t send the data to Apple servers, the documents show.

Achieving its health ambitions could depend on consumers’ trusting Apple with sensitive data, underscoring why privacy is a business imperative for the company. The new research comes as Apple faces intense scrutiny over how it planned to access user data to warn authorities of child pornography, which raised new concerns about the company’s commitment to privacy after years of battles against governments seeking to access their customers’ devices.

The company has said privacy remains paramount, arguing the anti-child-pornography initiative is meant to guard against intrusion while also combating the exploitation of children. Apple has said it is slowing the effort.

Scores of companies are chasing the opportunity in the broader digital behavioral-health sector, where startups are on pace this year to nearly double the record $2.7 billion in financing raised in 2020, according to Rock Health, a venture-investment and advisory firm.

The pandemic drove an increase in mental-health-related complaints. The percentage of adults reporting anxiety or depression-related symptoms reached 41% in January, according to the Kaiser Family Foundation, nearly quadruple the early-2019 figure. Mild cognitive impairment, which can develop into dementia, affects around 5 million Americans over 60 years old, estimates the Alzheimer’s Association.

Apple has a third brain-related research partnership with Duke University that it hasn’t disclosed. It aims to create an algorithm to help detect childhood autism, according to the documents and people familiar with the work. The research looks at using the iPhone’s camera to observe how young children focus, how often they sway back and forth, and other measures, according to the documents.

Apple has developed previous health features after working with researchers. For example, work at Stanford University showed that its smartwatch could identify an irregular heart rhythm known as atrial fibrillation. Soon after Apple added a watch feature to do so.

UCLA has said its research studying signs of stress, anxiety and depression began with a pilot phase last fall tracking Apple Watch and iPhone data from 150 people and will continue with a main phase tracking similar data for 3,000 people starting this year.

UCLA researchers will track data from the iPhone’s video camera, keyboard and audio sensors, and data from the watch related to movement, vital signs and sleep, according to the documents and people familiar with the study. The data that may be used includes analysis of participants’ facial expressions, how they speak, the pace and frequency of their walks, sleep patterns, and heart and respiration rates. They may also measure the speed of their typing, frequency of their typos and content of what they type, among other data points, according to the people familiar with the research and the documents.

Each bit of data could give researchers clues about device users’ emotions, concentration, energy level, state of mind and more, according to the people and the documents.

To compare this data with other measures of stress, anxiety or depression, the researchers are having participants complete questionnaires about how they feel, according to people familiar with the work and the documents. They are also looking at the amount of the stress hormone cortisol in follicles of participants’ hair, according to the documents and one of these people.

If the research finds that any of that data correlates with relevant mental-health conditions, the hope is to turn those signals into an app or feature that could warn people they might be at risk and prompt them to seek care, according to the documents and people familiar with the work.

Biogen and Apple said in January they are collaborating on a study to use the iPhone and Apple Watch to track cognitive function over time and identify mild cognitive impairment, a condition that can develop into Alzheimer’s. The two-year study aims to follow about 20,000 participants—half of them at high risk of cognitive impairment—and will use device data in a way similar to the UCLA mental-health research, according to the documents and people familiar with the matter. The work follows a 2019 feasibility study that showed that 31 adults with cognitive impairment exhibited different behavior on their Apple devices than healthy older adults.

Biogen is collaborating on the study because it hopes it can help Apple develop an iPhone feature to detect mild cognitive impairment early and encourage relevant users to seek care earlier, according to a person familiar with the matter. The company will compare the data against standard tests of brain health including traditional cognitive assessments and scans that track plaque buildup in the brain, according to the documents and the person familiar with the work.

Biogen’s drug Aduhelm, which costs about $56,000 a year, was approved earlier this year by the FDA for people with early-stage Alzheimer’s.