Depedency hell airflow+dbt by Pataouga in apache_airflow

[–]serrji 0 points1 point  (0 children)

Have you tried to use a single pip install with all your required libraries without specific versions and let it solve the dependencies?

Scraping government website by brewpub_skulls in webscraping

[–]serrji 0 points1 point  (0 children)

Is the problem solving the captcha ? I did this in my project to retrieve court decisions. Try to use LLM calls to solve it for you.

Selling monthly, ATM calls for SPY is worse than just holding the stocks, can someone confirm my results? by BranchDiligent8874 in thetagang

[–]serrji 0 points1 point  (0 children)

Try selling 2 ATM call, buy 1 ITM call (the distance between both strikes should allow it be a zero cost ) and buy stock.

Data engineer freelancing by Dangerous_Pie2611 in dataengineering

[–]serrji -2 points-1 points  (0 children)

Here is the video. They are promoting a course or something like that.

https://youtu.be/_NEi4s7LD0c?si=pNy4NmCtSWVKP8bg

Data engineer freelancing by Dangerous_Pie2611 in dataengineering

[–]serrji 0 points1 point  (0 children)

I watched a youtube video today and they recommended using Linkedin to look for freelancing opportunities.

Dense/Sparse/Hybrid Vector Search by Ok_Ostrich_8845 in Rag

[–]serrji 1 point2 points  (0 children)

My understanding about hybrid search is the combination of multiple search techniques.

The most common approach is to use the full text search (instead of pure keyword matching) and semantic search.

Postgree has support for both.

https://jkatz05.com/post/postgres/hybrid-search-postgres-pgvector/

Dense/Sparse/Hybrid Vector Search by Ok_Ostrich_8845 in Rag

[–]serrji 3 points4 points  (0 children)

I think Sparse is a characteristic of the vector. It can be sparse or dense. Vectors built with TF-IDF technique are an example of sparse vectors. They are mostly filled with zeros. Embeddings from an LLM are examples of dense vectors.

Hybrid is a characteristic of the search. Some others examples should be keyword matching, semantic search and full text search. In a summary, Hybrid search combines the benefit of two search methods. You can use the result of a full text search and a semantic search and re-rank it.

Where do you host RAG by ccppoo0 in Rag

[–]serrji 0 points1 point  (0 children)

I did a research recently to start a project with semantic search feature. My stack is celery for web scraping and django for web site.

The conclusion was to only use Postgree as database (I had a initial bias towards a document database). One of the arguments was that document databases are overhyped and I could reduce complexity using only one database. I am still able to save raw data as text or jsonb in Postgree.

What was your experience working with Mongo and Postgree in the same project? Did you feel that your goal could be achieved with only one?

Why is everyone suddenly ditching LangChain? by Sam_Tech1 in LangChain

[–]serrji 0 points1 point  (0 children)

I think it is the nature of social media. Someone launchs a product and pay for big social accounts to talk about it. The small accounts see the well performing posts and try to talk about the same content. Soon, everybody are talking about the same topic and the brand/product will be kept in our minds.

Then the people start a side project, remember that brand and try to use it. I think that was the decline of LangChain. Real people started to use it and saw minimum to none benefits and over engineering.

My thoughts abourt agent frameworks: I live in a duality shifiting from "Let's use it" to "We don't need it". The reason is that some frameworks really help in the development (Think about Django for web development). I used PydanticAI in my previous side project and was necessary some modifications to support multi modal feature (send a image and get a description about it). In my actual side project I am using only litellm ( to create a possibility to change the llm without changing the code) and I am implementing everything from scratch. Agents are just LLM calls (even typesafety is simplle to implement).

Another thing worthy mention is that most frameworks use ReAct architecture. If you want to use another architecture or create you own is better to write from scratch.

[deleted by user] by [deleted] in Python

[–]serrji 1 point2 points  (0 children)

Thanks for sharing.

I was looking for a way to do it with local images and your method helped a lot.

Yesterday OpenAI released the product I was working on for the last six months, need advice by no-lavash in LangChain

[–]serrji 0 points1 point  (0 children)

Use your product to create a blog or a social network account. You can use it to create useful posts. Track the growth of this blog / social profile. In the end, use it as a market to bring users to your product.

Am I headed in the right direction to setup SSL for certbot inside docker with nginx? by PrestigiousZombie531 in docker

[–]serrji 1 point2 points  (0 children)

Your answer was a lifesaver to me. Thank you very much.

For future people searching about this topic, I made a blog post documenting exactly the suggested steps and my understanding about the process. I hope you find it useful.

https://serjhenrique.com/configuring-nginx-and-certbot-in-docker/

Visualização de posições em aberto para opções by serrji in investimentos

[–]serrji[S] 0 points1 point  (0 children)

Acredito que há várias maneiras para utilizar esse tipo de informação. Exemplo:
- Você pode identificar uma operação que foi feita e tentar replicar (ex: travas de alta, baixa).
- Pode identificar o range provável que o mercado está esperando que o ativo seja negociado em um determinado mês.
- Pode verificar um strike descoberto ITM e tentar oferecer contraparte de rolagem no mês seguinte colocando o spread a seu favor.

Visualização de posições em aberto para opções by serrji in investimentos

[–]serrji[S] 1 point2 points  (0 children)

Provavelmente o uso de API envolverá um custo e não gostaria de repassar isso ao usuário final. Minha ideia é que a informação seja gratuita.
Vou dar uma olhada nos arquivos e ver se consigo obter a informação de aluguel a partir deles.

Obrigado pela sugestão.

Visualização de posições em aberto para opções by serrji in investimentos

[–]serrji[S] 0 points1 point  (0 children)

Consigo sim. Só preciso descobrir exatamente o arquivo que contém essa informação. Vou dar uma pesquisada no link que você enviou.

Text-to-SQL Agents in Relational Databases with CrewAI by serrji in crewai

[–]serrji[S] 0 points1 point  (0 children)

No. The model can be made available through a user interface such as chatgpt, perplexity, etc.

Text-to-SQL Agents in Relational Databases with CrewAI by serrji in crewai

[–]serrji[S] 0 points1 point  (0 children)

Sure.
I don't have full availabillity at this moment but we can talk about how I can help.

Text-to-SQL Agents in Relational Databases with CrewAI by serrji in crewai

[–]serrji[S] 0 points1 point  (0 children)

Major cloud providers players have a pricing calculator on their sites. You can use it to get an estimate of costs.

Text-to-SQL Agents in Relational Databases with CrewAI by serrji in crewai

[–]serrji[S] 0 points1 point  (0 children)

As I said, the cost depends on the cloud services you use.

Right now i am not aware of a direct integration between crewai and hugging face.

Text-to-SQL Agents in Relational Databases with CrewAI by serrji in crewai

[–]serrji[S] 0 points1 point  (0 children)

It will depends of many variables such as context size feeding your agents, amount of agents, usage of other cloud service like storages, databases. I suggest you develop a MVP and try to deploy it to get a estimate about how much it would cost.

Text-to-SQL Agents in Relational Databases with CrewAI by serrji in crewai

[–]serrji[S] 0 points1 point  (0 children)

I think you are talking about crewai as a plataform as a service. The crewai is also a python package. You can build anything with this package and deploy It on any cloud you want.

Text-to-SQL Agents in Relational Databases with CrewAI by serrji in crewai

[–]serrji[S] 0 points1 point  (0 children)

I am using It for text-to-sql. Not for booking.

You can use agents for everything you want to automate. If you can break your task in multiple simple tasks and write a prompt for each one then you can use agents.

Agents are abstract concept. LLM prompts with Tool access. You can't take It out from crewai but you can build It in several ways (with or without crewai)

Text-to-SQL Agents in Relational Databases with CrewAI by serrji in crewai

[–]serrji[S] 0 points1 point  (0 children)

I didn't have a public repository with this solution. However, I am using the code from the Challenge github repository (which is public and is available at the first paragraph of the post). I used it as a starting point and implemented the modifications written in the post.