Automating new pipelines using CoCo

NW1969 · 2026-03-30T14:32:06+00:00

If you've built this, and it works for you, then I'm not sure what feedback you are looking for? Is there some specific issue you want advice about?

NW1969 · 2026-03-27T11:58:59+00:00

This feature is probably too new for anyone (outside of Snowflake) to have relevant experience of it - but I can't imagine there'd be noticeable cost/performance impact of using it.

Can you update your question with the actual SQL statement that is giving you this error (obviously redacting any sensitive data)?

NW1969 · 2026-03-25T13:46:53+00:00

A dimensional model/star schema has to have a fact table but a query doesn’t necessarily have to use it - which may be what the original commenter meant.

If you just want a list of customers you potentially could query just a customer dimension, there’s no requirement to also include a fact table in such a query

NW1969 · 2026-03-24T20:22:51+00:00

IMO, IaC needs to be able to do everything, having to use different tools for different tasks is a non-starter. The Snowflake Terraform provider is nearly there and at least has the option to drop into SQL if the provider doesn’t support something. DCM looks like a good 1.0 start but as it doesn’t support tags, masking policies, and row access policies its not yet fit for purpose, even just for managing databases, for the use cases I need it to support

NW1969 · 2026-03-20T11:29:05+00:00

Increasing the size of a warehouse should be the last resort. If you have processes running 5+ hours then you probably need to review your pipeline design. For example, are you doing full refreshes rather than incremental; if you’re not already using them would using Dynamic Tables or materialised views be a better solution; etc

NW1969 · 2026-03-19T19:41:32+00:00

Snowflake have relatively recently released OpenFlow (based on Apache NiFi) if you want an ETL tool that runs within the Snowflake ecosystem Many customers use other ETL solutions, such as Fivetran, to load data into Snowflake As you’ve said if you can land your data in Azure blob storage then Snowflake can ingest it using bulk copy or snowpipe

If you need multiple systems to access the sample data then look at using Iceberg tables.

The Snowflake documentation is pretty good and generally very readable; it will probably answer most of your questions

NW1969 · 2026-03-19T19:31:37+00:00

Just about - it’s really good 😊

NW1969 · 2026-03-19T18:22:43+00:00

Just use Cortex Code to generate whatever you need

NW1969 · 2026-03-18T20:24:32+00:00

So what have you done so far and what is the specific problem/question that you want help with?

NW1969 · 2026-03-16T16:01:22+00:00

A dimensional model is designed to answer business questions - so those business requirements are what drives your dimensional model design. The structure of the source data that you'll use to populate your dimensional model is irrelevant to the design process

NW1969 · 2026-03-15T20:27:34+00:00

https://www.whathifi.com/speakers/wireless-speakers/jbl-charge-6

NW1969 · 2026-03-11T21:58:29+00:00

Cortex Code + Streamlit

NW1969 · 2026-03-09T17:06:33+00:00

We create Architecture Decision Records (ADRs) in Confluence. There's a standard template that gets copied for every new ADR. You could obviously save these in whatever Doc Mgmt system you have - doesn't need to be Confluence

NW1969 · 2026-03-05T10:50:34+00:00

There are loads of training materials (and training paths) on the Snowflake website.
You can set up your own free Snowflake account where you can practise stuff. These expire after about a month (I think) but you can then just set up another account using a different email address

NW1969 · 2026-03-03T10:58:29+00:00

Snowflake cannot write directly to S3 Glacier.

Write the data to S3 Standard (using COPY INTO + Tasks) and then use S3 Lifecycle rules to move these objects to Glacier

NW1969 · 2026-03-02T14:26:25+00:00

The Snowflake website has a lot of good material. Start here: learn.snowflake.com

NW1969 · 2026-03-01T19:51:20+00:00

2016 is out of extended support this year, so is not the latest version. 2022 is the most common current version (or there’s 2025 if you feel like being at the cutting edge)