Portal-trained AI | Partner voice | Devices of unknown generalizability, promises of uncertain keepability, more

News You Need to Know Today
View Message in Browser

Portal-trained AI | Partner voice | Devices of unknown generalizability, promises of uncertain keepability, more

Friday, May 2, 2025
Link to Twitter Link to Facebook Link to Linkedin Link to Vimeo

Nabla Logo ●  Fellow

AI patient portal messages personalized care

Patient portal messages can train AI to support personalized care in endocrinology (and beyond)

AI tools that help inform patients are highly useful, but those that directly delve into patient data for communications cues are risky. That’s according to a small group of physicians asked by Stanford researchers to judge precision AI tools developed from a large dataset of diabetes patients’ expressed needs.

Corresponding author Jiyeong Kim, PhD, MPH, and colleagues describe the project in NPJ Digital Medicine

The researchers first created a tentative set of AI algorithms for a discrete use case: crafting tailored care for patients with diabetes. They trained AI models on more than 324,000 messages posted in patient portals over an 11-year period by more than 11,000 patients. The team applied multiple prompt-engineering techniques for querying the models. 

Next the investigators had five physicians, all endocrinologists, evaluate the tools. The main study objective was gauging specialized physician perception of usefulness vs. risk in the tools, all of which were intended to help individualize care.  

In their study’s discussion section, Kim and co-authors note their findings may offer “essential ramifications for developing potential AI tools for precision patient care for diabetes and beyond.” They present a number of takeaways from the work. Here are highlights. 

1. AI tools that physicians consider ‘highly useful’ help with clinically undemanding tasks. 

Examples include tools that expedite administrative processes (e.g., drafting templates of authorization letters) and aid in patient education (e.g., creating educational materials for common lab inquiries and customizable responses for glucose monitoring and pump usage), the authors report. They remark: 

‘These AI tools may help clinicians with timely interaction and streamlined support, and in an efficient manner.’ 

2. AI tools deemed ‘risky’ directly handle patient data. 

Examples include synthesizing patient data for message triage by urgency and topic.  

‘Our work contributes to offering critical ramifications for the development and advancement of potential AI tools for precision care.’

3. A holistic approach that accounts for all relevant and essential data could be ‘ultimately optimal.’ 

AI tools can prepare evidence-based yet easily understood educational materials on the impact of meal timing and nutrient composition with real-life examples to empower patients, the authors point out before adding: “This may help them understand those important relationships and have more autonomy in dietary management.” 

Future studies might ‘further develop AI tools that can craft meal plans for individuals with specific dietary restrictions to enhance tailored patient care and embrace diversity.’

4. Appointment-related issues were very common. 

“This highlights the need to reinforce the existing scheduling system,” Kim and co-authors state. “Perhaps a real-time interactive assistant could soon triage scheduling queries and efficiently schedule patient visits in the patient portal.”

‘Moreover, this AI-enabled conversational agent may especially help those with limited proficiency in direct scheduling, including older adults and non-English speakers, which could narrow the digital divide and possibly reduce related health access differences.’ 

5. Real-time resource updates could be worth pursuing further.

Examples might include policy changes and medication supplies. “During the widespread shortage of [certain diabetes] medications over the past few years, patients were exposed to the risks of falsified medications and unreasonable consequences,” the authors note. More: 

‘AI-enhanced prediction models based on past medication use and supply could help avoid future imbalances of supply and demand, creating an environment for equitable medication access.’ 

6. An interdisciplinary educational approach is important.

This was so for the study cohort, the authors point out, because “the combination of good glycemic control, medications for diabetes and osteoporosis and a dietary and lifestyle-based approach is optimal for bone disease care in patients with diabetes.”  

‘AI-driven automated Q&A for common queries for bone imaging and surgery and a decision-support tool for clinicians to optimize MRI referrals could be further refined for development.’

7. Proactive mental health screening or telepsychiatry-based support could be helpful.

As needed, AI assistance “may step in as a frontline symptom screener along with contemporaneous efforts,” the authors write. More:

‘Future efforts could focus on targeted mental health support by harnessing AI tools for women as a start, because women were found to use telehealth for mental healthcare more than men.’ 

In their conclusion, Kim et al. underscore that they found AI-powered analyses “able to comprehensively voice patients’ needs and concerns.” More:

‘Demonstrated AI tools could expand the scope of AI’s use in tailored patient care that is not limited to diabetes.’

The study is available in full for free.

 Share on Facebook Share on Linkedin Send in Mail

The Latest from our Partners

Nabla's ambient AI assistant is helping Tia set a new benchmark in women’s healthcare.
With faster note-taking and stronger patient-provider connections, Tia clinicians are reclaiming time and deepening care.
Read the case study and hear what clinicians have to say: https://www.nabla.com/case-studies/tia-health

 Share on Facebook Share on Linkedin Send in Mail
overpromising AI artificial intelligence capabilities

Healthcare AI newswatch: Devices of unknown generalizability, promises of uncertain keepability, more

Buzzworthy developments of the past few days.

  • Makers of AI-equipped medical devices must give the FDA enough info to clear the gear for sale in the U.S. Of course they must. And do. But many aren’t sharing enough data for the agencies to know if the devices will prove generalizable in real-world settings—both now and later. This is no small problem. Why? Because lacking vigorous evidence of generalizability, these devices may fail at safety and/or effectiveness “when used outside of the controlled conditions in which they were initially validated.” The warning is sounded by researchers in a study published April 30 in JAMA Network Open. George Siontis, MD, PhD, and colleagues examined information on the 900-plus AI-enabled medical devices listed on the FDA website as of last August. They found not many more than half, only 55%, included comprehensive performance metrics from clinical studies. “Performance data—both overall and within specific sex and age subgroups—were frequently lacking,” the authors stress. “Ongoing monitoring and regular re-evaluation,” they emphasize, “are essential to detect and address unexpected changes in performance during broader clinical use.” Read the whole thing.
     
  • AI for flagging patients with high cardiovascular risk is thrilling some users. It’s happening at the University of Texas Medical Branch, where every CT scan of the midsection gets run through an algorithm. The new standard operating procedure is applied even for—or maybe especially for—patients with no known heart problems. “What I love about this is that AI doesn’t have to do anything superhuman,” Peter McCaffrey, the institution’s chief AI officer, tells Venture Beat. “It’s performing a low intellect task but at very high volume. That provides a lot of value, because we’re constantly finding things that we miss.”
     
  • Healthcare AI can do a lot of things. One thing it can’t do is relate. The CEO of a 45-site organization in the post-acute-care space describes some of each in a piece published May 1 by Modern Healthcare. Kenny Rozenberg, MPH, of Centers Health Care, which operates in the Northeast, checks off a few AI use cases his outfit is enjoying. Wound care tracking, admissions data cleaning, length-of-stay shortening all make his short list of AI can-do’s. For the “can’t-do” side, he tells about an elderly woman who didn’t care about high-tech clinical capabilities. She was just tired of being home alone. “We helped place her in a facility with a vibrant recreation program and a lively social calendar,” Rozenberg shares. “Within weeks, she was active, engaged and genuinely happy. Her daughter was relieved. That outcome didn’t come from AI. It came from a conversation.”
     
  • Here’s an option for healthcare professionals wishing for college-level training in healthcare-specific AI. Purdue University has launched an all-online course. It’s aimed not only at patient-facing workers but also administrators and other support staff. Those who complete the curriculum become certified in healthcare AI as well as, where applicable, receiving continuing education credits. Details here.  
     
  • Sometimes medical chatbots can be easier to talk to than medical professionals. One circumstance that springs to mind is when a talkative physician gives you too much to think about while you’re still woozy from a procedure. A chatbot might answer your question the next day. And do so succinctly and at a time of your choosing. Which is to say, as Pymnts does, that medical chatbots “can provide essential support, offering assistance around the clock.” A subject matter expert qualifies the shoutout for the outlet. “It’s crucial to remember that, while medical chatbots can offer valuable assistance, they are not a replacement for professional medical advice,” he says. “The integration of AI in healthcare also raises important concerns about data privacy and security that need to be addressed when implementing these tools.”
     
  • And then there are the ethical questions swirling around the use of AI in healthcare. TechTarget fleshes out a bunch of those. Hot spots include creating and enforcing ethics policies, maintaining data security and patient privacy, applying human oversight to AI recommendations and—not least—ensuring a positive patient experience. “Part of patient involvement also includes clear and concise patient consent,” senior technology editor Stephen Bigelow writes. This “delineates the information collected, why it’s needed and how it’s used—including further AI training, if needed—and allowing patients to opt out of certain data uses.”
     
  • Overpromising AI capabilities to stakeholders—now there’s a mistake healthcare AI enthusiasts have been known to make. Other pitfalls to avoid: unresolved issues with data quality, poor integrations with existing workflows and one-size-fits-all model development. HackerNoon walks you through these four and four more here
     
  • We already knew the new CMS administrator to be a fan of AI in healthcare. He expressed his enthusiasm for the technology before he’d even taken up his post. This week he made known his simple expectations for CMS personnel and, by extension, medical practitioners. “Ask real questions and be curious about the answers,” he said at a health innovation summit hosted by the U.S. Chamber of Commerce. “When you get them, have courage, be compassionate and look out for people.”
     
  • Recent research in the news:
     
  • FDA activity: 
     
  • Funding news of note:
     
  • From AIin.Healthcare’s news partners: 
     

 

 Share on Facebook Share on Linkedin Send in Mail

Innovate Healthcare thanks our partners for supporting our newsletters.
Sponsorship has no influence on editorial content.

Interested in reaching our audiences, contact our team

*|LIST:ADDRESSLINE|*

You received this email because you signed up for newsletters from Innovate Healthcare.
Change your preferences or unsubscribe here

Contact Us  |  Unsubscribe from all  |  Privacy Policy

© Innovate Healthcare, a TriMed Media brand
Innovate Healthcare