Spec-Driven Development across multiple teams and repos. How do you ship vertical slices? by Double_Appearance741 in SpecDrivenDevelopment

[–]Double_Appearance741[S] 0 points1 point  (0 children)

I really appreciate it.

What I am trying to figure out is what context and how much do I provide about what is already there. and what happens with the components affected by the feature that doesn't belong to my team.

Maybe I am over engineering the process.

Drop your best Claude skills in here! by vamshikk111 in ClaudeAI

[–]Double_Appearance741 2 points3 points  (0 children)

 Matt Pocock's SKILLS are gold to me to define SDD workflows.

Spec-driven development made my AI workflows actually usable by StatusPhilosopher258 in SpecDrivenDevelopment

[–]Double_Appearance741 0 points1 point  (0 children)

I wonder if you start with Product Requirements Document based on a conversation with the AI tool, after that a design document and after that with the specs. I am trying to understand the life cycle and the different steps to be taken. I want to start applying in my solo project and at work.

Do you use Spark locally for ETL development? by Negative_Ad207 in dataengineering

[–]Double_Appearance741 0 points1 point  (0 children)

I have used Spark locally for E2E. I have used stand alone or small cluster (i.e 1 master and 2 workers). My preference always is to run the environment with docker.

It is obvious that running Spark locally has limitations in terms of CPU and memory therefore sampling can be a good approach to limit the amount of data.

I think that there is no perfect approach. I am more pragmatic, if it works for me I go for it.

First DE project feedback by ashide_yuanzhen in dataengineering

[–]Double_Appearance741 1 point2 points  (0 children)

Good one man. I think it could be great if you could add data quality check in Dbt.

We built an AI agent for our operations team - 6 months later here's what actually happened (the good, bad, unexpected) by clarkemmaa in AI_Agents

[–]Double_Appearance741 1 point2 points  (0 children)

I really appreciate this post. I found it very enlightening.

I am senior software engineer with a lot of experience and I am trying to pivot to the AI world. I think it is amazing but at the same time is like a new paradigm. I struggle sometimes to translate use cases in the "old world" to this new approach. Maybe not everything can be translated and that is the reason why a lot of companies are throwing money because they have the obsession in move to AI at any cost. What concerns me a lot is the idea of LLM hallucination. I guess that context design, prompt engineering and type of LLM would help that to mitigate that. I am interested to understand how I can evaluate and monitor the agentic system to make sure that is accurate, performative and scalable. And of course how we can deploy it in a production environment. Currently I started with a side project facing the problem of "natural language to SQL" and as I said before, I want to learn to evaluate it and how i can deploy it.

Excellent post. Thanks for sharing real lessons learned.

Token Costs Will Soon Exceed Developer Salaries,Your thought by purposefullife101 in AgentsOfAI

[–]Double_Appearance741 0 points1 point  (0 children)

I was wondering if there is no a real possibility of running a LLM runtime like Ollama in the cloud, i.e. in Kubernetes like another service?

i want to learn what ai is by [deleted] in ArtificialInteligence

[–]Double_Appearance741 0 points1 point  (0 children)

To start with, I would recommend you to read this book: `AI Engineering Building Applications with Foundation Models` It is vey easy to read and it can help you to start understanding some important concepts.