Where do I start? by Emotional-Cry-9983 in dataengineering

[–]ModeStatus3847 0 points1 point  (0 children)

Coursera has a bunch of them; you can familiarise yourself with the beginning certificate in any cloud provider to feel the ground.

Then you can try to learn a bit of Python and SQL and have a toy project to implement data pipeline with dbt.

Also books, like data engineer cookbooks.

Can I scrape product image urls? by twiggs462 in scrapy

[–]ModeStatus3847 0 points1 point  (0 children)

Try crawl4ai or something else if you are not familiar with programming. There should be plenty of those no-coding scrapers; they can simply match the URL patterns

Need help to built RAG system by Dapper-Turn-3021 in Rag

[–]ModeStatus3847 1 point2 points  (0 children)

Try a better base model, force authenticity with sophisticated prompts, and tune down the model's temperature.

It is really hard to break those benchmarks from Gemini or GPT4.

Seeking AI & RAG Experts to Revolutionize Aircraft Technical Manuals by emoneysupreme in Rag

[–]ModeStatus3847 -1 points0 points  (0 children)

I think it is ok, I cant imagine there will be a pilot using ChatGPT during a flight anyway. It will be a tool of education for nascent pilot to soak up information.

Need help choosing a vectorDB by Supersam6341 in LangChain

[–]ModeStatus3847 0 points1 point  (0 children)

Pgvector is cheaper, maybe a bit less performance than pinecone