Posts tagged with health-tech

Nested cross-validation

I'm working on a machine learning cancer classification problem, but we have only a handful of positive cases in the data. Thankfully. But that fact does make my job harder. It causes three main problems: We may not have enough variety to be able to find the true patterns in the data. This is a fundamental blocker, and...
Read more

Not committing confidential data to git

The Guardian report on Biobank data being leaked onto GitHub is either no big deal or a massive screw-up, depending on your point of view. Either way, what I do is have a global gitignore file naming folders for confidential information. I put anything sensitive in there. If I want to push to Git, I have to try really,...
Read more

Human/Health-AI communication loop

Reading: Are AI Tools Ready to Answer Patients’ Questions About Their Medical Care?, JAMA, 6 March 2026. OpenAI says that ChatGPT Health is built “to guide patients to health care professionals for diagnosis and treatment.” Unfortunately it currently under-triages emergency conditions and over-triages non-emergency...
Read more

LLM medical device regulation 🦆

Reading: If a therapy bot walks like a duck and talks like a duck then it is a medically regulated duck, npj Digital Medicine, 5 December 2025. Medical device regulation depends on the claims and intended purpose of the device—amongst other things. In the case of Claude Sonnet, the system prompt suggests it does have an...
Read more

Rust is used for software medical devices

Reading: What does it take to ship Rust in safety-critical?, Rust Blog, 14 January 2026. Rust, the programming language, is already used in safety-critical systems. For example, in IEC 62304 one medical device engineer reports: All of the product code that we deploy to end users and customers is currently in Rust. We do...
Read more

"the real alternative to our present is political, not technological"

What makes AI so compelling is not simply faith in technology but the way it suggests we can improve medicine by leapfrogging the difficult work of structural change to confront disease-causing inequality, corporate interests and oligarchic power. Long read from Dr Eric Reinhart in The Guardian (US) from 9 November 2025.
Read more

"More often than not, our patients won’t even see a doctor”

Reading: "Dr. Bot: Why Doctors Can Fail Us—and How AI Could Save Lives", Charlotte Blease.  It's a book looking at the patient-doctor relationship: where it works, where it lets us down, and where AI might fit in.   One section I want to remember describes how Iora Health in the US (now part of One Medical) uses...
Read more

I'd be impressed by a robot that can clean its own hands

I assume it's a difficult problem because I've not found an example of a humanoid robot that can wash itself. This feels odd, given there are impressive sprinting, back-flipping, dancing robots out there. Robots do have different constraints. They could use walk-in baths, UV or chemical cleaning, disposable gloves (or...
Read more

Making LLMs safer for health care support

This is a hard, perhaps impossible, problem to fix as it stands. Limbic are having a go a it.Reading: The Limbic Layer: Transforming Large Language Models (LLMs) into Clinical Mental Health Experts, PsyArXive Pre-print, 26 August 2025.Limbic have a Class IIa medical device for psychological assessment, and are also...
Read more

Medical LLM pattern matching is brittle

LLMs do well on medical benchmarks, but this nice experiment blows a hole in that.  Reading: Fidelity of Medical Reasoning in Large Language Models, JAMA Network, 8 August 2025. The set up The experiment presents an LLM with a medical scenario and prompts it to pick the correct answer from a set of 5 options. LLMs do...
Read more

“AI for Medical Diagnosis”, week 2: key evaluation metrics

Coursera’s AI for Medicine specialism includes a nice, short, set of videos that explain standard model evaluation metrics. I found it useful, and made a few notes. Interpreting accuracy in terms of probability If accuracy of a model is P(correct), we can break that down as the sum of joint probabilities. P(correct ∩...
Read more

Odds ratios

I’ve been reading an annoying book which uses odds ratio (and hazard ratios). As I don’t use these terms much, I have to keep checking my understanding. Odds ratios: it’s the ratio of two odds! The useful and beautiful The Art of Statistics gives a clear example: Non-bacon eaters have a 6 out of 100 chance of bowel...
Read more

LLMs are almost as good as bespoke clinical diagnosis systems

Reading: Dedicated AI Expert System vs Generative AI With Large Language Model for Clinical Diagnoses, JAMA Network Open, 29 May 2025. I’d assume an expert system for clinical diagnosis, developed over 40 years, would perform better than an off-the-shelf consumer LLM, like ChatGPT. It does! But only just, and the...
Read more

A medical device database

Listening to: Dr Hugh Harvey: What does the future of medical AI regulation look like?, The Healthtech Podcast, 9 May 2025. This podcast introduced me to HaRi (“Harry”). It intends to be a global database of medical devices, with regulation information. The inspiration is to be to medical devices what the British...
Read more

Interviewing patients with an AI medical prompting tool

Reading: A California health tech company is letting AI run medical visits, from intake to diagnosis, Endpoints, 20 March 2025 (via Heathtech Pigeon). “We de­signed it specif­i­cal­ly so that it’s not some sort of alien touch screen. It’s a hu­man ex­pe­ri­ence with the med­ical as­sis­tant,” Samant said. What they’re...
Read more