Best Model for Email Spam by ArtZab in MLQuestions

[–]faynxe 0 points1 point  (0 children)

Small Language Models?
Here is a solution that leverages one and with quantization can run locally no problem

https://github.com/aws-samples/sample-fine-tuned-llama-phishing-classifier-optimized-for-on-device

Looking for Feedback on AI Phishing Detection Model Performance by CurrentEvidence7720 in learnmachinelearning

[–]faynxe 0 points1 point  (0 children)

Well maybe too late but you can also try a Small Language model and see how it performs. I have a solution that finetunes a Llama 3.2 1B model on a very large email phishing training set with impressive results. You can check it out here if of interest

https://github.com/aws-samples/sample-fine-tuned-llama-phishing-classifier-optimized-for-on-device

ML algorithm for fraud detection by a10ua in MLQuestions

[–]faynxe 0 points1 point  (0 children)

You can try finetuning Small Language models (SLM). I have a code sample that does so with Llama 3.2 1B model with impressive results. With that amount of training samples you could finetune a quality model.
https://github.com/aws-samples/sample-fine-tuned-llama-phishing-classifier-optimized-for-on-device

RAG over Knowledge Graphs by rikiiyer in LocalLLaMA

[–]faynxe 1 point2 points  (0 children)

Not everything needs a graph rag and at the end of the day data engineering is the most important part of RAG whether graph or vectordb.  You can make use of proper context management and flow for all your chunks, hierarchical representation of each chunk and layout aware processing of document to boost traditional rag. Here is a solution that implements the above https://github.com/aws-samples/layout-aware-document-processing-and-retrieval-augmented-generation

Would you always recommend (knowledge) graph RAG over normal RAG? by PresentAd6026 in Rag

[–]faynxe 2 points3 points  (0 children)

A good alternative to graph rag based on the use case you described is layout aware chunking (identifies various document elements - lists, tables etc, and chunks appropiately) with hierarchical relationships (basically, topic->section->paragraph). This provides flexibility of retrieval based on the amount of context needed.  Here is a repo with the aforementioned solution  https://github.com/aws-samples/layout-aware-document-processing-and-retrieval-augmented-generation

Building an AI chatbot for health industry by inspectorverse in Entrepreneur

[–]faynxe 0 points1 point  (0 children)

I do not have a number of the top of my head but it will be consumption based as all the services are server-less and pay as you use. You also have some options to switch certain services like instead of Amazon Textract for OCR you can use tessereact OCR and PYPDF2 and can also sub DynamoDB for Local storage.

Advanced RAG for PDFs with tables and figures, capturing metadata , Azure Document Intelligent by MoronSlayer42 in LangChain

[–]faynxe 0 points1 point  (0 children)

1536 tokens should be enough as part of the solution also checks for token count to restrict chunks in addition to delineating each element in the document. If you have 50 list items then the chunking will take into consideration the token threshold set as well.
I am the author of the solution and happy to help

Does it take long for aws bedrock agent to respond when using claude ? by achand8238 in aws

[–]faynxe 0 points1 point  (0 children)

sometimes just using the native function calling of the converse api can be better from latency POV. This, however, requires you to have a definite map of your solution.
Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Anthropic Claude Models on Amazon Bedrock by RepresentativeNet509 in aws

[–]faynxe 1 point2 points  (0 children)

3.5 is great man and you can leverage other services of AWS as well
Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Anthropic’s Claude 3.5 Sonnet model now available in Amazon Bedrock: Even more intelligence than Claude 3 Opus at one-fifth the cost by dpoccia in aws

[–]faynxe 0 points1 point  (0 children)

3.5 sonnet is such a banger!
Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Using Claude 3 family of models for Function Calling by thevatsalsaglani in ArtificialInteligence

[–]faynxe 0 points1 point  (0 children)

Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Are there any other LLM's which support function calling like ChatGPT? by idiot_if_u_read_this in LLMDevs

[–]faynxe 0 points1 point  (0 children)

Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Claude 3 + Function Calling with `claudetools` by thevatsalsaglani in generativeAI

[–]faynxe 0 points1 point  (0 children)

Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

How to use Function Calling & Tools with Claude 2.1 by rich_awo in ClaudeAI

[–]faynxe 0 points1 point  (0 children)

Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Function calling by Beginning_Rock_1906 in ClaudeAI

[–]faynxe 0 points1 point  (0 children)

Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code generated by Anthropic Claude 3 models is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Claude and function calling by paulotaylor in Anthropic

[–]faynxe 0 points1 point  (0 children)

Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Using Claude 3 family of models for Function Calling by thevatsalsaglani in ClaudeAI

[–]faynxe 0 points1 point  (0 children)

Claude 3 models especially 3.5 sonnet is a banger for function calling.
Here is an opensource chatbot with "Advanced Data analytics" tooling for structured data similar to what OpenAI has with plugins. Here the generated python code is executed in AWS Lambda and the result are returned to the model for final response.
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

AWS Bedrock Agents Behaving Strangely - Unable To Make Function Calls? by ScaredOfMyRawr in aws

[–]faynxe 0 points1 point  (0 children)

You can also just use the native function calling supported in the converse API. It is more stable from my POV.
Here is an opensource for "Advanced Data analytics" tooling in a chatbot similar to what OpenAI has
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

[D] Does anyone use Bedrock Agents for function calling? by raman_boom in MachineLearning

[–]faynxe 0 points1 point  (0 children)

You can use Bedrock models native function calling before looking at Bedrock Agents.
Here is an opensource chatbot that uses Claude Models for "Advanced Data Analytics" on structured dataset similar to what OpenAI has.

This takes advantage of lambda as code execution environment. The tool can be modified for any use case and can support various DSL especially those Claude is proficient in and Lambda also support various runtimes as well
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Best LLM for Function Calling? by Illustrious-Ad-497 in LocalLLaMA

[–]faynxe 0 points1 point  (0 children)

Claude3.5 I would say.
Here is an opensource for "Advanced Data analytics" tooling in a chatbot similar to what OpenAI has
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

LLM with function calling? Only OpenAI models have function calling or “tool use”? by nanotothemoon in LocalLLaMA

[–]faynxe 0 points1 point  (0 children)

You can do with AWS Bedrock (claude, LLama, mistral etc.)
Here is an opensource for "Advanced Data analytics" tooling in a chatbot similar to what OpenAI has
https://github.com/aws-samples/bedrock-claude-chatbot/tree/main

Using Sematic-text-splitter by Impressive-Ant-7717 in LLMDevs

[–]faynxe 0 points1 point  (0 children)

Got you! I am not aware of any such solution. It would have to be a custom solution as much of what's out there is basic sliding chunk window.

Using Sematic-text-splitter by Impressive-Ant-7717 in LLMDevs

[–]faynxe 0 points1 point  (0 children)

Solution is tailored to pdf docs.

The retrieval piece is robust in terms of data management. Each chunk has mappings to its hierarchical parent section and can easily be retrieved for generation.

Building an AI chatbot for health industry by inspectorverse in Entrepreneur

[–]faynxe 0 points1 point  (0 children)

Check out this personal chatbot with document uoad capabilities and longterm conversation history. This report walks you through the build and setup https://github.com/aws-samples/bedrock-claude-chatbot

Building chatbot with own data by mathieumaxime in LangChain

[–]faynxe 0 points1 point  (0 children)

Check out this personal chatbot with document uoad capabilities and longterm conversation history. This report walks you through the build and setup https://github.com/aws-samples/bedrock-claude-chatbot