AI for physical vs. mental health | Partner voice | FDA’s ‘rush’ to the AI altar, AI and Medicare Advantage, more

News You Need to Know Today
View Message in Browser

AI for physical vs. mental health | Partner voice | FDA’s ‘rush’ to the AI altar, AI and Medicare Advantage, more

Tuesday, May 13, 2025
Link to Twitter Link to Facebook Link to Linkedin Link to Vimeo

Nabla Logo ●  Fellow

LLM generative AI for mental healthcare

Patients size up GenAI for mental healthcare one way, for physical healthcare another

Healthcare consumers considering the use of large language AI for mental healthcare are apt to shy away from the technology if they feel it might put their privacy at risk. By comparison, those who might turn to LLMs for physical healthcare are most put off by models that seem troublesome to use. 

On the other hand, there’s a good deal of overlap. 

The findings are from a study conducted at Queensland University of Technology in Australia and published this month in AI & Society

Sage Kelly, PhD, and colleagues recruited 216 Australian residents—a mix of college students and members of the general public—between the ages of 18 and 77 (median 26.5 years). The team surveyed the participants on how likely they would be to seek advice and/or information from ChatGPT. 

Here are highlights from their findings. 

1. Perceived usefulness significantly and positively predicts behavioral intentions in both mental health and physical health. 

This suggests that the more people perceive ChatGPT as useful for seeking health services, the more they are inclined to use the technology, the authors write. 

This finding is consistent with prior research demonstrating that perceived usefulness strongly predicts intentions above and beyond demographic factors, they note before adding: “To encourage use, companies such as OpenAI should promote the usefulness of their AI products.” More: 

‘In the context of healthcare, companies should promote the ability of AI to reduce barriers like cost, time and stigma to drive perceived usefulness.’ 

2. Perceived ease of use is a significant positive predictor of behavioral intentions to use ChatGPT for physical health advice. 

As the perceived ease of use rises, so do users’ intentions to use ChatGPT for physical healthcare, Kelly and co-authors report. 

By comparison, in the present study, perceived ease of use was not a significant predictor in the mental healthcare scenario. “As mental healthcare is largely language-driven,” the researchers point out, “LLMs could be perceived as more straightforward to use for this concern in comparison to physical healthcare, which often involves the visualization of a body part (e.g., rash) to diagnose.”

It could be that consumers are not familiar with the use of ChatGPT for healthcare purposes. ‘Consequently, developers should aim to maintain—or increase—perceived ease of use by designing devices that are simple to use, provide clear instructions and are responsive to users’ issues.’

3. Privacy concerns are significantly and negatively predictive of consumer intentions in mental healthcare settings. 

The more individuals worry about their privacy, the less likely they are to intend to use ChatGPT for their mental healthcare, Kelly and colleagues observe. 

“Although the mean scores were not significantly different for privacy concerns between the two scenarios,” they write, “it appears that the effect of privacy concerns on users’ behavioral intentions [is] stronger in the mental health scenario compared to physical healthcare.”  

‘This finding is supported by prior research showing mental health data are some of the most sensitive data one can reveal due to the stigma and association with life events and additional health issues.’  

4. The influence of each major variable—usefulness, ease of use, trust concerns and privacy vulnerabilities—differs across the two healthcare domains. 

For this reason, the current findings cannot be generalized across industries, Kelly and colleagues state. 

“To our knowledge, this is the first study that has shown the difference in users’ acceptance of using ChatGPT for physical healthcare compared to mental healthcare,” they write. “The difference between the two models underscores the need to conduct industry-specific analysis and the importance of including users’ perspectives in the design and use of ChatGPT for specific applications since users’ behavior cannot be generalized.”

‘It is recommended that future research analyzing multiple industries use this methodology to compare their results.’

5. Future research should conduct different sampling techniques and data collection to study a more diverse range of participants. 

Moreover, the present study “treated physical and mental health issues as separate entities; however, many health issues are a combination of physical and mental health symptoms,” the authors write in acknowledging the limitations in their study design. 

‘Based on our initial examination, future studies should recruit from various countries to understand the influence of income and healthcare systems on the willingness to use ChatGPT.’

The study is posted in full for free

 

 Share on Facebook Share on Linkedin Send in Mail

The Latest from our Partners

Nurses and the Documentation Challenge: Where Ambient AI Can Help

Nurses are at the heart of patient care, managing chronic conditions, delivering virtual care, and coordinating with complex teams. But even with advances in healthcare technology, one persistent challenge remains—documentation.

Documentation is a critical part of care, but it is also a significant source of frustration. For many nurses, it means time away from patients, navigating cumbersome systems, and dealing with repetitive data entry. 

So how can ambient AI truly help? 

👉 Read more about Nabla's journey with nurses here

 Share on Facebook Share on Linkedin Send in Mail
FDA artificial intelligence AI aggressive

Healthcare AI newswatch: FDA’s ‘rush’ to the AI altar, AI and Medicare Advantage, OpenAI benchmarks healthcare AI

Buzzworthy developments of the past few days.

  • For some, the FDA is moving too fast in its drive to adopt generative AI agency-wide. Less than a week after Commissioner Martin Makary announced the plan—pledging to cut product review times from days to minutes—initial reactions seem mixed. Former FDA Commissioner Robert Califf says he’s cautiously enthusiastic about the aggressive, all-in approach his successor is taking to AI adoption. But digital health pioneer Eric Topol is feeling something closer to apprehensive optimism. Or maybe it’s optimistic apprehension. “The idea is good,” Topol tells Axios, “but the lack of details and the perceived rush [are] concerning.” The outlet’s crisp analysis is here
     
  • AI agents are quicker than humans at assessing risk in Medicare Advantage enrollees. This matters to insurance companies offering “MA” plans because the Centers for Medicare and Medicaid Services uses health risk scores to set payment amounts for MA-covered procedures. The bigger the risk pool the insurer takes on, the higher its payment rate from CMS. At the same time, though, there often comes a point of diminishing returns for carriers: Take on too many high-risk patients, and the balance sheet heads toward the red. This means carriers who set out to turn a nice profit by offering MA can become perversely incentivized to decline enrollment to sicker and thus riskier MA candidates—the very patients CMS most wants to help. So it is that, as the population ages, AI-led health risk assessments of MA candidates can be something of a double-edged sword. As the AI-enthusiastic COO of the MA specialty firm Zing Health tells Modern Healthcare, AI-assisted health risk assessments are “a faster way to scale and work through those peaks that the Medicare system has for us. How can we get efficiencies to optimize our human workforce?” The executive stresses that Zing uses AI agents to augment, not replace, human workers. For a second opinion, Modern Healthcare quotes a senior fellow at the Brookings Institution’s Center on Health Policy. “Insurers are investing everything they can to vacuum up as many diagnoses as possible purely for risk-adjustment purposes, and it’s socially wasteful,” the Brookings thought leader says. “It’s a waste of the plan’s time to pay whoever’s operating this AI tool, and it’s a waste of the beneficiary’s time to answer the questions.” Full article here (behind paywall).
     
  • OpenAI is splashing a new open-source toolkit for benchmarking healthcare AI systems against optimal performance aims. Calling the LLM toolkit HealthBench, the ChatGPT maker says it built the system largely by partnering with 262 physicians in 60 countries. From those sources of training transcripts, the company has produced 5,000 realistic health conversations, “each with a custom physician-created rubric to grade model responses,” OpenAI states in a May 12 announcement. These conversations “were created to be realistic and similar to real-world use of large language models: They are multi-turn and multilingual, capture a range of layperson and healthcare provider personas, span a range of medical specialties and contexts and were selected for difficulty.” The announcement presents some examples of the toolkit in action and a link to a related white paper. HealthBench itself is here
     
  • Large language AI is the fastest-adopted technology in the history of the world. And with less than 10% of the world’s population using it as of now, its advance may only accelerate. The point was suggested at a healthcare workforce summit hosted by the University of Delaware earlier this month. So was a point about why the technology should be brandished in healthcare to begin with. “Healthcare systems should build and test these models to enable a better patient experience,” keynote speaker Dan Weberg, executive director of workforce development and innovation at Kaiser Permanente, said. “If we don’t lead this integration, then Apple, Google and Amazon will.”
     
  • For healthcare workers encountering AI as newbies, first impressions are everything. And sometimes it’s best to let a bot make its own friends. That seemed to be a common theme at a population health colloquium hosted by Thomas Jefferson University in Philadelphia last week. For example, Stephen Parodi, MD, executive VP of Permanente Medical Group in San Franciso, told attendees ambient AI dropped into his organization practically unannounced—and wowed a tough crowd. In the past, he explained, an enterprise-level technology rollout would have taken months if not years to plan out, implement and help end-users to master. Instead, the group rolled out an ambient AI scribe to some 24,000 physicians in just one month with nothing more than a one-page user guide and a hyperlink. “I’m like, ‘Oh my god, this is a disaster,’” Parodi said, recalling the project’s early days. “But you know what? There were some hiccups, there were a couple of failures along the way, but we didn’t bring down any systems. It was well received, and we didn’t take years to roll it out.” Colloquium coverage by MedPage Today.
     
  • AI is supposed to relieve healthcare workers of overfull workloads. Sometimes it does the opposite. This can happen when clinicians have to verify and correct AI-generated content. And that’s just one problem rooted in poor data quality. Jay Anders, MD, chief medical officer at Medicomp Systems, a vendor in the EHR usability space, takes a holistic look at the challenge for KevinMD. “By combining AI technologies with evidence-based algorithms, healthcare organizations can work toward normalizing historical data, matching related diagnoses, recategorizing inappropriate items and fixing inadequate or missing codes,” Anders writes. “Before healthcare organizations can fully realize the potential of AI, they must solve their data quality challenges—generating text alone is not enough.” 
     
  • Remember how intensely COVID-19 focused U.S. healthcare’s attention on weak links in its supply chain? That chapter gave AI a way to penetrate the field ever more deeply. Today the technology is not just optimizing supply chain management—it’s redefining the discipline. So says Baxter International’s VP of advanced engineering and innovation, A.K. Karan, MBA, in an interview with MD+DI. “[AI] provides us with scale and computing power that was not possible using traditional networks,” Karan tells the outlet ahead of a conference talk he’ll soon be giving. “With cloud infrastructure, we’re able to ingest massive data loads and use computing power in the cloud to detect anomalies using machine learning and AI in real time.”
     
  • It’s always good to see parts of the developing world use AI to improve healthcare, isn’t it? The Nigeria-based newspaper Punch reports that numerous African countries have launched national AI programs, many of which include healthcare in their planning. “Incorporating AI into healthcare is not just about technology,” explains Dr. Uzma Alam of the Science Policy Engagement with Africa’s Research program. “It is about enhancing our policy frameworks to ensure these advancements lead to better health outcomes for all Africans.” 
     
  • Recent research in the news:
     
  • Funding news of note: 
     
  • From AIin.Healthcare’s news partners: 
     

 

 Share on Facebook Share on Linkedin Send in Mail

Innovate Healthcare thanks our partners for supporting our newsletters.
Sponsorship has no influence on editorial content.

Interested in reaching our audiences, contact our team

*|LIST:ADDRESSLINE|*

You received this email because you signed up for newsletters from Innovate Healthcare.
Change your preferences or unsubscribe here

Contact Us  |  Unsubscribe from all  |  Privacy Policy

© Innovate Healthcare, a TriMed Media brand
Innovate Healthcare