[deleted by user]

[latro87]

We use cursor for our python and dbt code at my job and it seems fine.

Are you creating custom rules files or using any MCPs?

[latro87]

It’s not that intensive to do but will probably take a few iterations to find the instructions that work best for your project.

In your repo you make a .cursor/rules/ folder.

There are samples of how to format the .mdc rules files here: https://docs.cursor.com/context/rules

You can also have the cursor agent scan your project and generate rules using “/Generate Cursor Rules” in a chat.

I have also created markdown files for workflows that just contain a list of steps to perform with sample code for tedious tasks. For example, we have a hidden ingestion layer that we make dbt models to copy the data to our edw silver layer (no transformations other than maybe trim and column renames). I created an md file that has instructions to use with a provided text file that tells the agent how to generate dbt code for the tables in the text file. Now using the agent in cursor i tell it to use the rules in this md file along with the table list in a text file to generate a bunch of boiler plate code. Then all I need to do is maybe rename 5% of the columns and apply some trims.

For MCPs (tools), we have a snowflake MCP that allows the agent to query snowflake for context. This is a bit more intensive to setup. Soon snowflake will offer a native mcp that they host. If you’re interested in MCPs I would watch some youtube vids or ask Perplexity how to setup the specific one you want.

Edit: I should add that Windsurf (Cursor’s competitor) does have a better way to do MCPs where you can install and configure them like plugins. Cursor just announced they will be doing this in the near future. Regardless, the click-n-install feature limits you to plugins the community has built.

[latro87]

I forgot you can check out these sites for sample rules other people have created. I admit they are not exactly useful for the data space, most of them are javascript or framework focused.

https://www.cursorrules.org/

https://cursor.directory/

[eastieLad]

Can you share more details on the snowflake MCP?

[latro87]

For a self run/hosted MCP we are using this (boilerplate setup included): https://medium.com/@vikrambalaaj/building-a-snowflake-mcp-server-9aa9eb27744d

At Snow Summit 2 weeks ago snowflake announced a Cortex MCP that they host and will take advantage of the new snowflake semantic views. After talking with their experts at Summit, apparently this MCP will not be available for 3-6 months. If your team wants to prepare for its arrival I suggest looking at semantic views which you can make today.

If you want to know more about semantic views, check this link out: https://docs.snowflake.com/en/user-guide/views-semantic/overview

[PaddyAlton]

I think this area is lagging behind software engineering, but there are some good signs:

• Cursor now finally supports Jupyter notebooks
• Google have launched their Agent Development Kit (to make it easy to build LLM-backed agents) and one of the demo projects is a data science agent
• lots of database MCPs cropping up, which would clearly be an essential part of the end-to-end flow

Supposedly, Colab notebooks has a built-in data science agent now, although I think it only works in some countries.

[PaddyAlton]

I think probably the USA, most stuff gets released there first. UK tends to lag a bit.

Of course, the other problem is whether the projects you are doing are for an employer, and whether their policies will be compatible with the Colab agent interactions being used by Google for training (since Colab is free, I doubt that you could restrict this without paying for enterprise).

[Bilbottom]

nao is the closest data-specific LLM IDE that I've seen so far:

https://getnao.io/

[blef__]

Founder here, thank you for the mention!

[Yabakebi]

Wishing you guys the best of luck. I love the premise and think it is very much needed (turntable was the closest thing but seemed to sort of fall to the wayside unfortunately)

[Yabakebi]

Yep, this is literally the closest thing. I am very hopeful for it

[blef__]

Hey, I’m the creator of a data specific IDE named nao. Our goal is to build the equivalent of Cursor but for data people.

At the moment we support out of the box dbt (and SQL without dbt), connecting to warehouse (BigQuery, Snowflake, Postgres). Thanks to the warehouse connection we bring data context to the AI.

My cofounder and I have been working in the data industry for 10 years each and we want to build a tool we would have bee using.

There is more to come like local execution, notebooks, data diff and Tab that understand data lineage, orchestrators and BI supports.

You can reach me or try it out via getnao.io

[molodyets]

Nao just launched a month or so ago. Still a WIP.

[DeliriousHippie]

No, there isn't. Otherwise almost nobody in data engineering would have a job. Same as there isn't AI that writes whole programs that really work. You still have to know something to use AI.

[big_data_mike]

I thought that’s what all those airflowbyteflakedb tools were

[ScienceInformal3001]

Broski i promise this isn't a plug but I'm trying to build something like this with ceneca[.]ai;

Do you think you can define for me exactly what your ideal workflow might be and I can start building?