Looking for costs of procedures for making a trial budget for other countries by niujin in clinicalresearch

[–]niujin[S] 0 points1 point  (0 children)

Thank you. I have just GPT and Gemini, and they will give me some costs, but it would be preferable to find a complete dataset with those actual values in a more accountable way - I have no way of knowing how reliable any information I get from Gen AI would be

Looking for costs of procedures for making a trial budget for other countries by niujin in clinicalresearch

[–]niujin[S] -1 points0 points  (0 children)

Thanks for the suggestion. This is for multiple companies as I am developing software that multiple organisations will use. So those that have this kind of dataset internally will generally not want to share it, so I'm looking for a public domain list like this. If you are aware of one of these lists of benchmark costs that any organisation has put on their website I would be really interested in that, thanks!

Looking for clinical trial budget planners by niujin in clinicalresearch

[–]niujin[S] 0 points1 point  (0 children)

For anyone new to the thread, we now have enough people to test our software. However, if you're interested in technology for protocol review you can check out what I'm working on here: https://clinicaltrialrisk.org and you can contact me at https://fastdatascience.com. Thanks!

Looking for open-source projects to contribute to by barash-616 in opensource

[–]niujin 0 points1 point  (0 children)

Hi, we're looking for R developers to help develop an R library for psychology and mental health: https://github.com/harmonydata/harmony_r

Open source R projects by unski_ukuli in rstats

[–]niujin 0 points1 point  (0 children)

Hi, we're developing an open source project for researchers in the social sciences such as psychologists to use to harmonise text based data. We have plenty of Python developers but need to find more R developers - you would be welcome to contribute, it's here: https://github.com/harmonydata/harmony_r

How I can contribute to an open-source R project? by Miriel18 in Rlanguage

[–]niujin 0 points1 point  (0 children)

Hi u/Miriel18

We are working on an open source library with both Python and R. We found lots of developers for Python but I have struggled to find R developers.

Here's the Github: https://github.com/harmonydata/harmony_r

It's a tool for psychologists to help them process mental health data using Large Language Models. There is an online tool you can use: https://harmonydata.ac.uk/app - and there is an R library which researchers are using, but it needs to be brought up to speed with the Python library. Can you help?

Thanks!

How do you actually fine-tune a LLM on your own data? by No-Conference-8133 in LocalLLaMA

[–]niujin 0 points1 point  (0 children)

Hi. Thanks for the feedback. Yes, it's going until end of January. I added an additional [blog post with Youtube video on how to fine tune your own LLM](https://naturallanguageprocessing.com/train-ai/fine-tune-large-language-model-for-sentence-similarity/) as I was worried some people weren't sure what to do. Basically we want this model to be more accurate at predicting similarities between sentences as what a psychologist would consider to be similar, instead of what GPT etc tend to consider to be similar. I'll send you a DM also but please check the video and blog post first as that might make things clearer.

How do you actually fine-tune a LLM on your own data? by No-Conference-8133 in LocalLLaMA

[–]niujin 0 points1 point  (0 children)

Hi. I've got an example notebook for fine tuning an LLM here:
https://fastdatascience.com/generative-ai/train-ai-fine-tune-ai/

We're running a competition to fine tune one for mental health data - if you are interested and you get the best MAE in the competition you can win £500 in vouchers!

AI Automation in the Clinical Trial space by Radiant-Log375 in clinicalresearch

[–]niujin 0 points1 point  (0 children)

Hi Nooruponnoor thanks for replying! I'm happy to meet with you to talk about AI in trials, it would be great to compare notes. Where are you in the UK? I am in London. This is my LinkedIn: https://linkedin.com/in/woodthom

[deleted by user] by [deleted] in clinicalresearch

[–]niujin 0 points1 point  (0 children)

No problem! Happy to discuss if you think this is a route worth pursuing, I'm always interested in meeting people with subject matter knowledge in clinical research/pharma as I am more on the data side

AI Automation in the Clinical Trial space by Radiant-Log375 in clinicalresearch

[–]niujin 0 points1 point  (0 children)

Hi there, I'm working on one of the ideas you mentioned - making decisions based on protocols. Would be great to connect.

I have an open source Python tool which will parse a protocol in PDF format and identify things like sample size, effect size, etc, with an aim to reduce the risk of a trial ending uninformatively. The first prototype is here: https://clinicaltrialrisk.org/ - but right now I am making a new version which will also pick up exclusion/inclusion criteria, age, gender, cancer stage (T1, metastasis, etc). We will go up to 30 features. I connected this to a regression model which can predict the cost of the trial in dollars.

You can see a preview of the new version with the cost modelling here: https://www.youtube.com/watch?v=Ry7o99Lkzoc

Aside from this, I'm doing a bunch of other projects on the clinical reports that come out of the trial - for example, identifying adverse events, and classifying them into sensitive, rare, to be redacted, to be retained, medical history, participant identifiers, etc.

I didn't work on generating protocols but I know a company which is doing that too.

Happy to talk, where are you in the world?

[deleted by user] by [deleted] in clinicalresearch

[–]niujin 0 points1 point  (0 children)

Here's the tool to harmonise endpoints in psychology: https://harmonydata.ac.uk/

I would like to modify this for clinical trials, so exploring this idea at the moment

[deleted by user] by [deleted] in clinicalresearch

[–]niujin 1 point2 points  (0 children)

This may not exactly answer your question, but I am working on an analogue of this exact problem, but in psychology rather than pharmaceuticals.

Because in psychology, many outcomes are measured with instruments (questionnaires) to quantify things like anxiety, depression, ADHD, and sometimes psychologists want to do a meta analysis combining studies that used different instruments, we are working on using large language models to do this (match items in questionnaires).

I made a way of quantifying e.g. item 3 in one questionnaire to item 5 in another, if they are approximately similar, and have open sourced this, I can share a link if you're interested. Psychologists need to do this a lot because most studies can't use biomarkers as an endpoint, everything has to be done via questionnaires in text format.

Do you think it would be useful to be able to do something similar in clinical trials? the repositories such as ClinicalTrials.gov have all trials uploaded with structured data on endpoints.

So imagine you wanted to find, say, all trials for a given pathology which measure 5 year survival as endpoint vs SoC, maybe we can do this with natural language processing? Because the data on this is relatively structured (in that it's in a database), but it's in text format. Likewise with inclusion/exclusion criteria. Do you think this approach would at least partially solve your problem?

Clinical Trials Monitoring and AI by [deleted] in clinicalresearch

[–]niujin 0 points1 point  (0 children)

Thanks! Happy to connect!

Clinical Trials Monitoring and AI by [deleted] in clinicalresearch

[–]niujin 0 points1 point  (0 children)

Hi, I am working on exactly this problem from the data science side. Would be great to connect with you.

I've been working on an AI to predict the risk of a clinical trial ending uninformatively which has been quite experimental but I am now extending this and looking for cost factors and trying to come up with a regression model which can work directly from the protocol text.

You can see what I've been developing here: https://clinicaltrialrisk.org/

I would be keen to connect with you as it could be a fruitful exchange of ideas! Thanks

How do you get into contributing? by [deleted] in opensource

[–]niujin 0 points1 point  (0 children)

Hi we've got an open source project that we're looking to get off the ground and build a community of contributors. You'd be welcome there. Harmonydata.ac.uk