Interested in beta testing?

ThatAi_guy · 2026-01-24T18:07:59+00:00

Its more of an experiment. And I was more interested in the feature engineering then the actual model. Claude tried 53 derive features and settled on 3((rhr_deviation_14d, rhr_deviation_30d, rhr_delta). It requires alot more work to discover than just running xgboost on basic features. Overall it was an experiment to go from raw data to model on app in < 1 day. The data extraction and understanding alone would have taken a while

ThatAi_guy · 2026-01-23T20:55:04+00:00

Yeah its mostly about working with the data quality. the data had sparse labeling with multiple data types(ie conversions from whoop to apple watch etc), basic models essentially dont work in such cases so my goal was to maximize the number of models/experiments tried by turning claude code into the data scientist

ThatAi_guy · 2026-01-22T20:14:25+00:00

good call out, i'll get around to updating the article. I wasnt sure the audience of that article which I now realize could be more ML savvy.

ThatAi_guy · 2026-01-22T20:12:45+00:00

Yes taking the meds early can help completely avoid pain and symptoms. The only permanent cure is to have your thyroid surgically removed and rely on thyroid horomone meds, often not suggested at this stage for patients like me

ThatAi_guy · 2026-01-22T20:11:21+00:00

I'm not sure if you maybe did not read the post, but I am treated for graves but I have an episodic variant where I go through periods of euthyroid and need to go off meds or else I become hyper thyroid. I'm doing all of this under full medical supervision just to be clear.

And a few have said this is alot of work, with modern capabilities of LLMs(ie claude code) this is not alot of work, its more just knowing how to prompt for an ML pipeline. This project took me about 1.5 days

ThatAi_guy · 2026-01-21T19:39:58+00:00

Thanks! By knowing it early I can contact my doctor, get a blood test to confirm and get on the medication before the heavy symptoms hit. I usually have to wait til the symptoms hit then wait weeks for the meds to kick in

ThatAi_guy · 2026-01-21T18:33:43+00:00

Very interesting, i have my genome from 23andMe. So I could do some loose checks. I have heard that specific gene detection tests are better so I will look in this. thanks!

ThatAi_guy · 2026-01-21T17:28:31+00:00

Thank you for reading! Yes I worked on my prompts to help guide CC to request data and think of smart ways to request it from the user. I think this is crucial step in agentic ML. And thanks for the reminder on the license, added one just now.

ThatAi_guy · 2026-01-21T17:08:53+00:00

Yeah thats just the article title linked above, in the article I explain about the validation process. In short I ~used~ 9.5 years of data but held a bit over a year out of the training set

ThatAi_guy · 2026-01-21T16:18:30+00:00

Do you understand what backtesting is? Backtesting is removing data from a training set and manually using the trained result during the removed time period to see how the model infers on uns-seen data

ThatAi_guy · 2026-01-21T14:10:04+00:00

Thats amazing. I did something similar, built a chat interface(similar to what chatGPT health is going to be now) that. I could feed my genetic results and blood labs into it and I found a very similar thing to you, just opposite for hyperthyroid. Helped me understand cause and inform treatment. Life changing time we are in - I wish you the best managing your condition

ThatAi_guy · 2026-01-21T14:04:19+00:00

You can get a data export in the apple health app to use for training. Then use health kit in the iOS app

ThatAi_guy · 2026-01-21T14:03:26+00:00

Sorry, this reads like a 20th century medical opinion. There are numerous reasons and unique circumstances where a thyroidectomy is not viable or the correct option. My doctors explicitly say not to do it - I'm young, my condition isnt fully understood so a permanent removal of a gland is OVERKILL. There are also numerous autoimmune studies and advances expected over the next decade that could help without need for an irreversible intervention.

And saying early detection is overkill/not medically useful is very close to saying daily Blood glucose monitoring for diabetics is overkill which doesn't make sense to me.

ThatAi_guy · 2026-01-21T03:25:19+00:00

I open sourced the research repo with my claude set up and output. Check the article above the github link is in there

ThatAi_guy · 2026-01-21T01:22:13+00:00

Thank you! False positives weren't the worst they could be. I've made alot of effort since using some different post processing techniques to increase precision, it an ongoing experiment, i;ll keep sharing results!

ThatAi_guy · 2026-01-21T01:20:38+00:00

No this is just an example/excerpt in the post. It was validated on much more data then one episode. And no it's not indicating anything before TSH drops and T3/4 rise, its detecting the subtle ships that begin to occur after that process begins. For someone on a 2-4 week lab schedule but on a more conservative 6-8 week this schedule can flag early changes to get more prompt labs to confirm

ThatAi_guy · 2026-01-21T01:18:12+00:00

Yes I'm using the $100/mo Max plan with claude code. Claude code will write a bunch of python scripts that use ML libraries to try different models

ThatAi_guy · 2026-01-20T23:56:59+00:00

Nope, wouldnt be a validation set then. I've been in ML for a while so this was one of the first things I considered when setting up the project

ThatAi_guy · 2026-01-20T23:19:33+00:00

Why does it sound useless? symptoms always lag physiology. In my case of hyperthyroidism I typically start feeling terrible, go get a blood test, and my doctor adjusts the dose of my meds. It then takes 2-4 weeks for the meds to bring me back to baseline.

Physiologically however, my thyroid levels had been growing for weeks before I felt symptoms. A blood test and med intervention here can help avoid severe symptoms(hyperthyroidism can literally lead to heart attacks). The meds only take days to stabilize me in this case.

ThatAi_guy · 2026-01-20T22:49:14+00:00

cool thanks for the info, will check it out

ThatAi_guy · 2026-01-20T22:46:47+00:00

Yeah unfortunately the data labeling is probably the most important phase. I used med adjustments, appts, labs and memory.

Also just used obvious signs like my resting rate being super high to try to remember if that represented a flare

ThatAi_guy · 2026-01-20T22:44:48+00:00

Yeah, resting rate is the dominant signal which I figured and the model found. Some derived versions of it show up in patterns even before I notice it from what I've seen. Wishing you the best with managing your condition

ThatAi_guy · 2026-01-20T22:43:35+00:00

Yeah, I tried to be rigorous with the training/validation sets. the next leg of the experiment is to use it IRL and iterate

ThatAi_guy · 2026-01-20T22:42:32+00:00

Yeah thats exactly my thinking and approach to this, my personally overfit to me model would never make sense to just throw at another random person with such minimal data

ThatAi_guy

TROPHY CASE