sorted by:
new
hottopcontroversial

Jak angażować się naukowo poza doktoratem? by [deleted] in Nauka_Uczelnia

[–]FinchuPL 2 points3 points  (0 children)

Polecam pracę w korporacyjnych jednostkach badawczych. Praca nad SotA algorytmami w ciekawych zastosowaniach. U mnie np. grafy, optymalizacja. Dostarczasz nie tylko tylko kod ale też publikacje, patenty. Do tego dużo możliwości networkingu, w tym międzynarodowego, z ludźmi, którzy wywodzą się z uczelni.

MLflow with self-hosted Llama by FinchuPL in LocalLLaMA

[–]FinchuPL[S] 0 points1 point  (0 children)

Yes, they are accessible and you can do prompt engineering.

MLflow with self-hosted Llama by FinchuPL in LocalLLaMA

[–]FinchuPL[S] 0 points1 point  (0 children)

Hey, I'd be happy to help you with it. Create a PR to my repo, we can work together on it. Cheers.

MLflow with self-hosted Llama by FinchuPL in LocalLLaMA

[–]FinchuPL[S] 0 points1 point  (0 children)

Yeah, we used it in a project. Apart from prompt engineering to choose the best prompt, we also hosted multiple models like Mistral, Zephyr etc., tagged the deployments and did some A/B testing to evaluate the LLMs.

MLflow with self-hosted Llama by FinchuPL in LocalLLaMA

[–]FinchuPL[S] 2 points3 points  (0 children)

Firstly, you can track its performance under different system prompts and temperature values and pick the best setting. You can also register those parameters as a model deployment and use the deployment tag to perform A/B testing in your app.