AI

Blackbird backs Heidi Health’s AI platform for overworked doctors

Comment

A black female doctor standing next to female patient and showing her something on digital tablet.
Image Credits: aldomurillo (opens in a new window) / Getty Images

Many doctors are overwhelmed by paperwork, leaving them stretched thin, with less time to see patients. Based in Melbourne with plans to expand around the world, Heidi Health wants to ease the burden of administrative tasks by using AI to turn consultation transcripts into case histories, referral letters, financial forms and other documents. It also builds detailed clinical histories for providers and patients, helping them get more out of each visit.

Heidi Health announced today that it has raised $10 million AUD (about $6.4 million USD) in Series A funding. The round was led by Blackbird Ventures with participation from Hostplus, Vesta, Wormhole Capital, Archangel Ventures, Possible Ventures and Daniel Ventures.

Formerly called Oscer, Heidi is now used by more than 100 general practitioners in about 30 clinics throughout Australia. Heidi was founded in 2021 by vascular surgeon Dr. Thomas Kelly, Waleed Mussa and Yu Liu.

Like many countries around the world, Australia is experiencing a shortage of GPs. Alongside being overworked, physicians also have to do a staggering amount of paperwork. One study found that physicians spend twice as much time on paperwork as they do seeing patients, leading to burnout.

As a doctor, Dr. Kelly says he “lived the pain that we’re trying to solve with Heidi” while working in an outpatient clinic where there were often 60 to 70 patients for just 30 time slots.

“Most of my time as a clinician was spent doing administrative things, not things I learned in medical school,” Dr. Kelly said. “It was filling out forms dealing with billing, payments and claims, creating different referrals and summaries, waiting on hold, just this bureaucracy of a health system to navigate.”

Building “memory banks”

In 2017 he encountered ChatGPT-2 and, along with Mussa and Liu, saw its potential to reduce medical administrative work by performing tasks like creating documentation and finding the latest guidelines.

“There are so many horror stories that I think what we’re building at Heidi could avoid,” said Dr. Kelly. He describes seeing patients who needed a toe or foot amputated because they had a vascular condition, but didn’t get diagnosed in time because of long waiting lists for a consultation. By reducing administrative work, Heidi can shorten wait times, while its AI tools can prompt doctors to check for conditions. The clinical histories it creates can be shared with other providers for context.

Heidi works by first recording consultations. Then it will analyze the transcript, create clinical notes and give doctors prompts like “have you thought of a vascular condition.” It will also relate a patient’s new symptoms to ones mentioned in previous visits, or flag potentially urgent cases. These records are kept as patient histories, building what Dr. Kelly refers to as memory banks for each person. “The direction of the product we want to go in is turning each recording into that context for every future visit,” he says.

Heidi Health co-founders Waleed Mussa, Dr. Tom Kelly and Yu Lui pictured in front of a white wall with plants on the left and right of the photo
Heidi Health co-founders Waleed Mussa, Dr. Tom Kelly and Yu Lui. Image Credits: Heidi Health

One feature Dr. Kelly highlights is My Additions, which lets clinicians interact with transcripts by annotating them while Heidi is recording. This makes sense for things clinicians want to note, but not say to a patient (for example, comments about their appearance). Once a recording is done, clinicians use it to generate paperwork like medical certificates, referral letters to another doctor and anything else that needs a specific format.

On the patient’s side, Heidi can help them get more out of their visit. Before the appointment, clinicians provide patients with a link to a questionnaire that asks them about their health issues, so they don’t need to rush during their exam. This also helps doctors build more comprehensive health history. Dr. Kelly says one of the startup’s plans is to enable patients to keep their own records of all their visits, so they can refer to them or send them to other clinicians.

Heidi also recently launched an AGI (artificial general intelligence) product called Heidi for Clinicians that lets users automate administrative work like patient histories, ward round lists, clinical audits, clinical notes, documents and discharge summaries for billings and processing referrals.

The startup plans to introduce more products centered around its clinical histories for patients. This includes tools that will give doctors context about how symptoms have changed over time, highlighting patients that need further examination, as well as people they haven’t seen in a while.

Heidi can be used off-the-shelf or as a white-label solution. For larger practices and healthcare systems, it can be integrated into practice management software like Epic or Athena for use in things like chat-based consults and telehealth services. As an off-the-shelf product, doctors can sign into Heidi’s website and start recording their consultation from there. Providers that use Heidi range in size from clinics with as few as three or four doctors to as many as 30. It also serves groups with 50 to 250 clinics.

The startup’s target customer for its standalone products is any type of clinician, but especially general practitioners because of how much work they need to do, Dr. Kelly says.

“Historically, you could just walk into a primary care like a GP practice and get a visit. Nowadays, most GP practices have quite significant out-of-pocket costs and sometimes you have to wait a week for an appointment,” he adds. “That’s why we found so much traction, there is this real demand and shortage of GPs.”

Nuanced medicine

Heidi’s founders began training its AI in 2019 while Dr. Kelly was still working as a surgeon. He says the team built its own medical knowledge graph for quality assurance and to prevent hallucinations. They used information from medical professionals and clinicians to predefine relevant symptoms and conditions, and how they relate, and gathered consultations. This data enables Heidi’s algorithm to figure out what questions it should ask patients when taking their histories. Heidi used foundation and open source models like LLaMA before moving onto its own language model for pre-consultation workflows, transcriptions and note generation.

“What we believe is that you can’t learn how to be a great doctor on the open internet. A lot of what’s on the internet is like textbook medicine, but it’s not nuanced medicine,” Dr. Kelly says. “So we take that super intelligence, show it lots of medicine, all these cases, scenarios, things we want it to do. Then we’ll get something unique that only Heidi can build with our data set that we’ve built here.”

Heidi protects patient privacy by asking both patients and doctors if they want to opt-in to including any of their data in its training sets. It also trains and monitors outputs as part of its quality assurance process, with 10,000 tests and checks to make sure it doesn’t contain patients’ personal and medical information.

The startup’s competitors include medical transcription services like Abridge, Nabla, Microsoft-owned Nuance and Suki, all of which use AI in their tools for clinicians. Kelly says most of them focus on creating voice-to-text transcriptions of consults, with a focus on things like clear medical terminology, but Heidi’s competitive advantage is building new models where transcription is less important because it can figure out context on its own.

“We really think the magic is going to be in can you become the Notion workspace for clinicians, that nuanced product that just feels amazing, that has all these little delighters like My Additions and that clinical memory,” he says. “We think that will be the magic, rather than just utilitarian.”

In addition to developing more products and hiring, Heidi’s funding will be used to expand into more clinics in Australia, alongside international markets. Dr. Kelly said Heidi is close to securing a deal with a primary network in Texas and a similar organization in the U.K.

In a prepared statement, Blackbird Ventures general partner Michael Tolo said, “We desperately need a safe path to scale the most scarce resource in our healthcare system—clinicians. Heidi’s AI allows clinicians to spend less time on administrative tasks, and more time on what matters most: to foster enduring relationships with their patients and invest in preventative care.”

Want to invest in startups? Here are 4 ways to get started as a solo GP

More TechCrunch

Jasper Health, a cancer care platform startup, laid off a substantial part of its workforce, TechCrunch has learned.

General Catalyst-backed Jasper Health lays off staff

Live Nation says its Ticketmaster subsidiary was hacked. A hacker claims to be selling 560 million customer records.

Live Nation confirms Ticketmaster was hacked, says personal information stolen in data breach

Featured Article

Inside EV startup Fisker’s collapse: how the company crumbled under its founders’ whims

An autonomous pod. A solid-state battery-powered sports car. An electric pickup truck. A convertible grand tourer EV with up to 600 miles of range. A “fully connected mobility device” for young urban innovators to be built by Foxconn and priced under $30,000. The next Popemobile. Over the past eight years, famed vehicle designer Henrik Fisker…

5 hours ago
Inside EV startup Fisker’s collapse: how the company crumbled under its founders’ whims

Late Friday afternoon, a time window companies usually reserve for unflattering disclosures, AI startup Hugging Face said that its security team earlier this week detected “unauthorized access” to Spaces, Hugging…

Hugging Face says it detected ‘unauthorized access’ to its AI model hosting platform

Featured Article

Hacked, leaked, exposed: Why you should never use stalkerware apps

Using stalkerware is creepy, unethical, potentially illegal, and puts your data and that of your loved ones in danger.

6 hours ago
Hacked, leaked, exposed: Why you should never use stalkerware apps

The design brief was simple: each grind and dry cycle had to be completed before breakfast. Here’s how Mill made it happen.

Mill’s redesigned food waste bin really is faster and quieter than before

Google is embarrassed about its AI Overviews, too. After a deluge of dunks and memes over the past week, which cracked on the poor quality and outright misinformation that arose…

Google admits its AI Overviews need work, but we’re all helping it beta test

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. In…

Startups Weekly: Musk raises $6B for AI and the fintech dominoes are falling

The product, which ZeroMark calls a “fire control system,” has two components: a small computer that has sensors, like lidar and electro-optical, and a motorized buttstock.

a16z-backed ZeroMark wants to give soldiers guns that don’t miss against drones

The RAW Dating App aims to shake up the dating scheme by shedding the fake, TikTok-ified, heavily filtered photos and replacing them with a more genuine, unvarnished experience. The app…

Pitch Deck Teardown: RAW Dating App’s $3M angel deck

Yes, we’re calling it “ThreadsDeck” now. At least that’s the tag many are using to describe the new user interface for Instagram’s X competitor, Threads, which resembles the column-based format…

‘ThreadsDeck’ arrived just in time for the Trump verdict

Japanese crypto exchange DMM Bitcoin confirmed on Friday that it had been the victim of a hack resulting in the theft of 4,502.9 bitcoin, or about $305 million.  According to…

Hackers steal $305M from DMM Bitcoin crypto exchange

This is not a drill! Today marks the final day to secure your early-bird tickets for TechCrunch Disrupt 2024 at a significantly reduced rate. At midnight tonight, May 31, ticket…

Disrupt 2024 early-bird prices end at midnight

Instagram is testing a way for creators to experiment with reels without committing to having them displayed on their profiles, giving the social network a possible edge over TikTok and…

Instagram tests ‘trial reels’ that don’t display to a creator’s followers

U.S. federal regulators have requested more information from Zoox, Amazon’s self-driving unit, as part of an investigation into rear-end crash risks posed by unexpected braking. The National Highway Traffic Safety…

Feds tell Zoox to send more info about autonomous vehicles suddenly braking

You thought the hottest rap battle of the summer was between Kendrick Lamar and Drake. You were wrong. It’s between Canva and an enterprise CIO. At its Canva Create event…

Canva’s rap battle is part of a long legacy of Silicon Valley cringe

Voice cloning startup ElevenLabs introduced a new tool for users to generate sound effects through prompts today after announcing the project back in February.

ElevenLabs debuts AI-powered tool to generate sound effects

We caught up with Antler founder and CEO Magnus Grimeland about the startup scene in Asia, the current tech startup trends in the region and investment approaches during the rise…

VC firm Antler’s CEO says Asia presents ‘biggest opportunity’ in the world for growth

Temu is to face Europe’s strictest rules after being designated as a “very large online platform” under the Digital Services Act (DSA).

Chinese e-commerce marketplace Temu faces stricter EU rules as a ‘very large online platform’

Meta has been banned from launching features on Facebook and Instagram that would have collected data on voters in Spain using the social networks ahead of next month’s European Elections.…

Spain bans Meta from launching election features on Facebook, Instagram over privacy fears

Stripe, the world’s most valuable fintech startup, said on Friday that it will temporarily move to an invite-only model for new account sign-ups in India, calling the move “a tough…

Stripe curbs its India ambitions over regulatory situation

The 2024 election is likely to be the first in which faked audio and video of candidates is a serious factor. As campaigns warm up, voters should be aware: voice…

Voice cloning of political figures is still easy as pie

When Alex Ewing was a kid growing up in Purcell, Oklahoma, he knew how close he was to home based on which billboards he could see out the car window.…

OneScreen.ai brings startup ads to billboards and NYC’s subway

SpaceX’s massive Starship rocket could take to the skies for the fourth time on June 5, with the primary objective of evaluating the second stage’s reusable heat shield as the…

SpaceX sent Starship to orbit — the next launch will try to bring it back

Eric Lefkofsky knows the public listing rodeo well and is about to enter it for a fourth time. The serial entrepreneur, whose net worth is estimated at nearly $4 billion,…

Billionaire Groupon founder Eric Lefkofsky is back with another IPO: AI health tech Tempus

TechCrunch Disrupt showcases cutting-edge technology and innovation, and this year’s edition will not disappoint. Among thousands of insightful breakout session submissions for this year’s Audience Choice program, five breakout sessions…

You’ve spoken! Meet the Disrupt 2024 breakout session audience choice winners

Check Point is the latest security vendor to fix a vulnerability in its technology, which it sells to companies to protect their networks.

Zero-day flaw in Check Point VPNs is ‘extremely easy’ to exploit

Though Spotify never shared official numbers, it’s likely that Car Thing underperformed or was just not worth continued investment in today’s tighter economic market.

Spotify offers Car Thing refunds as it faces lawsuit over bricking the streaming device

The studies, by researchers at MIT, Ben-Gurion University, Cambridge and Northeastern, were independently conducted but complement each other well.

Misinformation works, and a handful of social ‘supersharers’ sent 80% of it in 2020

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Okay, okay…

Tesla shareholder sweepstakes and EV layoffs hit Lucid and Fisker