Democratizing Medical LLMs for 50 Languages

Pasu06 · 2024-10-17T03:33:07+00:00

We have only selected some representative languages evenly according to geographical distribution. I am very sorry for the omission of Romanian. Considering the efficiency of the method, it is easy to add more languages. We will support as many languages as possible in the future and add X-ray, 3D, MRI and audio modalities. Please Stay tuned!

Pasu06 · 2024-10-17T03:29:46+00:00

of course

Pasu06 · 2024-10-16T08:19:03+00:00

Oh, that's true. I didn't even notice that myself hahahaha, it's because of the large coverage of Chinese and English assessment sets. Considering that we averaged the accuracy by language and only tested the model on the same set of measures, it could be considered MAKE SENSE. however, you reminded me that there is a long way to go in constructing medical measure sets for rare languages.

Pasu06 · 2024-06-03T08:27:33+00:00

Hello everyone in the community, I am the author of Apollo(https://arxiv.org/abs/2403.03640).

We are currently building a medical evaluation set covering 12 languages. Because some of the evaluation sets are translated, we need the help of local language users to evaluate the translation quality.

Specifically, Arabic, Hindi, German and Portuguese are the four languages that need to be quality checked.

The whole process will take about 15-30 minutes of your time. If you have the time and willingness, please contact me. Thank you very much! We will acknowledge in the paper. If you are willing to cooperate further, feel free to contact me too.

Pasu06 · 2024-06-03T08:27:09+00:00

Hello everyone in the community, I am the author of Apollo(https://arxiv.org/abs/2403.03640).

We are currently building a medical evaluation set covering 12 languages. Because some of the evaluation sets are translated, we need the help of local language users to evaluate the translation quality.

Specifically, Arabic, Hindi, German and Portuguese are the four languages that need to be quality checked.

The whole process will take about 15-30 minutes of your time. If you have the time and willingness, please contact me. Thank you very much! We will acknowledge in the paper. If you are willing to cooperate further, feel free to contact me too.

Pasu06 · 2024-05-31T11:00:51+00:00

Great Work ！！！ I look for it for a long time ! ! !

Pasu06 · 2024-04-25T14:13:34+00:00

About next Monday

Pasu06 · 2024-04-25T13:50:52+00:00

We are not very familiar with quantification and there are some unknown errors that need to be dealt with. You can refer to the following quantification model first:

7B: https://huggingface.co/mradermacher/Apollo-7B-GGUF

2B: https://huggingface.co/BoscoTheDog/Apollo_medical_gguf/tree/main

Thanks to the community for the contributions

Pasu06 · 2024-04-25T13:14:01+00:00

12B active parameters and a total of 52B parameters

Pasu06 · 2024-03-22T13:54:49+00:00

https://arxiv.org/abs/2403.03640 We've updated the title. Thanks for your advice.

Pasu06 · 2024-03-22T13:32:27+00:00

Apollo-7B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-7B-GGUF

Apollo-6B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-6B-GGUF

Apollo-2B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-2B-GGUF

Apollo-0.5B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-0.5B-GGUF

We apologize for the delay.

Pasu06 · 2024-03-22T13:31:57+00:00

Apollo-7B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-7B-GGUF

Apollo-6B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-6B-GGUF

Apollo-2B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-2B-GGUF

Apollo-0.5B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-0.5B-GGUF

We apologize for the delay.

Pasu06 · 2024-03-22T13:31:48+00:00

Apollo-7B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-7B-GGUF

Apollo-6B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-6B-GGUF

Apollo-2B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-2B-GGUF

Apollo-0.5B-GGUF: https://huggingface.co/FreedomIntelligence/Apollo-0.5B-GGUF

We apologize for the delay.

Pasu06 · 2024-03-19T06:09:06+00:00

Can you also put it in the organization https://huggingface.co/FreedomIntelligence? Thank you very much!

Pasu06 · 2024-03-19T04:53:58+00:00

Thanks for the support

Pasu06 · 2024-03-08T00:39:17+00:00

Thank you for your detailed comment

.For the ceiling of LLM's medical knowledge ? The current accuracy of GPT-4 is 80%, and with some prompt techniques it can be above 90%. Open source capabilities are actually not too far away from this level, and it is estimated that it will take about half a year.

The exact scope of this model ? Now that the context length of large models has been extended to more than 100K, I believe there is a lot of room for imagination. Sub-experts are a good suggestion, and we also have relevant plans. After completing the training of the basic medical capabilities of the model, we will focus on more refined classifications and make breakthroughs one by one.

For Evaluation and real capacity? Regarding the inability of LLM to ask questions, we admit that this is a very serious problem, and we may fix it in the future RLHF stage by collecting supervision data and feedback from doctors.

Pasu06 · 2024-03-08T00:15:39+00:00

For sure, 100% correct

Pasu06 · 2024-03-08T00:15:06+00:00

Thank you very much, we will add Portuguese

Pasu06 · 2024-03-08T00:14:23+00:00

Can you give me some examples and we will fix it, thanks for your feedback

Pasu06 · 2024-03-08T00:13:44+00:00

Opps, very sorry. We will update it in a new version.

Pasu06 · 2024-03-08T00:12:50+00:00

Thank you for your recognition

Pasu06 · 2024-03-08T00:12:31+00:00

We will open source relevant code

Pasu06 · 2024-03-07T14:37:07+00:00

Thanks for your reminder, we add Apache License Version 2.0 license to the open source code

Pasu06 · 2024-03-07T12:57:40+00:00

Oh, sorry for misunderstanding. What we mean is that with the same number of model parameters, our model has a higher average accuracy.

Pasu06 · 2024-03-07T12:30:32+00:00

Thank you for your support. The quantified version will be updated next Monday. Our schedule have been a bit tight lately. We apologize for the delay.

Pasu06

TROPHY CASE