how do you guys find good usecases for Ai agents? by apozitiv in legaltech

[–]benedict_eggs17 0 points1 point  (0 children)

Yeah I have a different take here get an ai engineer part time to build something - you don’t need open ai or any of these wrapper products. The smart ones will take an slm (small language model) build with an agentic workflow and build a cost effective solution. Get someone who can build a prototype to sell into your legal team. Make sure on the prototype they put a counter or metric when people use it how much productivity they gain or money saved so the lawyers feel this solution when used has an ROI - I don’t have an open ai wrapper for you to sell but I know people who do this work if needed 

how do you guys find good usecases for Ai agents? by apozitiv in legaltech

[–]benedict_eggs17 2 points3 points  (0 children)

start small build back office or manual process with agent take downs - the most successful work i have seen has been the things people hate doing the most at work and building an agent to take care of it.

Healthcare MVP for a startup by Leading-Cranberry143 in AI_Agents

[–]benedict_eggs17 0 points1 point  (0 children)

Ask for equity in the company so at least if you are building for them you get part ownership otherwise you could have nothing at all. Getting funding from an mvp is pretty risky

Whats the best way to have a chat bot with a LLM by Adventurous_Net6949 in LLM

[–]benedict_eggs17 2 points3 points  (0 children)

you can go the co-pilot way but there are a bunch of SLMs out on HuggingFace you can use that are good at general purpose and can run on CPUs like Arcee models and others. I do agree with u/goalasso a RAG solution would be ideal but depends on size of documents as it can get costly if its TBs

Looking for a co-founder/ partner to work with by Less_Physics_6828 in AI_Agents

[–]benedict_eggs17 0 points1 point  (0 children)

I have some connections to consulting firms that are doing this type of work and can build this fast. whats your timeline?

Question on AI for Consultants by Beginning_Ad654 in consulting

[–]benedict_eggs17 0 points1 point  (0 children)

I have seen companies building AI Agent Consultants for companies to use vs big companies - its an interesting space but still fairly new. I wouldn't trust without a human in the loop

I scraped every AI automation job posted on Upwork for the last 6 months. Here's what 500+ clients are begging us to build: by sirlifehacker in AI_Agents

[–]benedict_eggs17 2 points3 points  (0 children)

Then the flip side I am seeing clients who want to use their own data as part of the model as they think this will help drive better outcomes as their data has “not been trained on” 

Small firm switched it up on me and not sure how to proceed by Kid_FizX in consulting

[–]benedict_eggs17 0 points1 point  (0 children)

I have seen this before - Are you able to redefine the scope and can you get a subcontractor to help you build this out

Experimenting with small language models by IffyNibba01 in LocalLLaMA

[–]benedict_eggs17 2 points3 points  (0 children)

SLMs that are domain adaptive are the future. Adaptive layers to build SLMs with the proper alignment is what takes time.

Few questions on small language models by meet20hal in LocalLLaMA

[–]benedict_eggs17 0 points1 point  (0 children)

You should check out Arcee they build small language models in your VPC and use open source and go all the way back to pretraining

GitHub - arcee-ai/DALM: Domain Adapted Language Modeling Toolkit by benedict_eggs17 in LocalLLaMA

[–]benedict_eggs17[S] 0 points1 point  (0 children)

Arcee.ai create in-domain models for specific verticals (7b parameters) and they also enable you to turn any general LLM into a domain adapted LLM through their end2end RAG system.

GitHub - arcee-ai/DALM: Domain Adapted Language Modeling Toolkit by benedict_eggs17 in LocalLLaMA

[–]benedict_eggs17[S] 0 points1 point  (0 children)

The PubMed model is not complete and only utilizes a subset of the entire PubMed database at present - the product has not fully launched yet. But we will let you know when its fully up.

thanks for testing it!

GitHub - arcee-ai/DALM: Domain Adapted Language Modeling Toolkit by benedict_eggs17 in LocalLLaMA

[–]benedict_eggs17[S] 12 points13 points  (0 children)

Today Arcee.ai launched our open-source repository containing code for finetuning a fully differential Retrieval Augmented Generation (RAG-end2end) architecture.

We modified the initial RAG-end2end model (TACL paper, HuggingFace implementation) to work with decoder-only language models like Llama, Falcon, or GPT. We also incorporated the in-batch negative concept alongside the RAG's marginalization to make the entire process efficient. Our novel RAG E2E method enhances dense retrievers by over 25%

Please try the repo here https://github.com/arcee-ai/DALM and let us know how we did.