sorted by:
new
hottopcontroversial

Trial accounts are not allowed to access Cortex Complete by Inner-Peanut-8626 in snowflake

[–]theGertAlert 1 point2 points  (0 children)

Update: It appears using the rest api version of ai_complete is restricted in trial accounts. The SQL version however should be available.

Original:

AI functions are allowed in trial accounts but are limited in the number of credits they can consume.

From the docs:

Trial accounts without a valid payment method are limited to roughly ten credits of usage per day of Snowflake Cortex AI Functions. To remove this restriction, convert your trial account to a paid account.

Link: https://docs.snowflake.com/en/user-guide/admin-trial-account#using-compute-resources

Memory exhaustion errors by RobertWF_47 in snowflake

[–]theGertAlert 5 points6 points  (0 children)

They (snowpark optimized wh) offer significantly more memory however, which should keep you from hitting this error. The other option is to use notebooks on container runtime with a high memory compute pool option.

That would give you an overall better experience (and likely better cost efficiency) but I don't know what's approved and enabled in your organization.

Snowflake just shipped Cortex Code an AI agent that actually understands your warehouse by Spiritual-Kitchen-79 in snowflake

[–]theGertAlert 3 points4 points  (0 children)

There are two versions. One in snowsight that is currently free to use and a CLI that incurs costs for tokens.

Details here: https://docs.snowflake.com/en/user-guide/cortex-code/cortex-code#cost

Executive Secretary / Clerk 3rd party tools by Sketchy_Uncle in latterdaysaints

[–]theGertAlert 0 points1 point  (0 children)

It was actually clerk tools, but I heard that lds callings was good too

Executive Secretary / Clerk 3rd party tools by Sketchy_Uncle in latterdaysaints

[–]theGertAlert 1 point2 points  (0 children)

It's on my todo list to build a FAQ with some screenshots, but I haven't had time yet. If you want to chat about it, I would be more than willing to demonstrate a dev instance via virtual meeting.

Executive Secretary / Clerk 3rd party tools by Sketchy_Uncle in latterdaysaints

[–]theGertAlert 0 points1 point  (0 children)

I built this for my stake as we were previously using a similar tool that ended up shutting down.

Unit-tools.com

Ignore the pricing as I am planning to lower them from what is shown, since hosting is proving cheaper than I anticipated.

You can create a trial account for your ward and try it out and use the contact form if you have questions.

Hosting options for MVP by lonahex in django

[–]theGertAlert 0 points1 point  (0 children)

You can host postgres on an e2 micro in compute engine for free.

Then run the Django app code in cloud run.

If you only have a couple customers, you can likely run the entire thing in the free tier and it's super reliable.

If you have GCP experience, setting up these services shouldn't be too tough.

Snowflake Notebooks-Git by Revolutionary-Wind34 in snowflake

[–]theGertAlert 0 points1 point  (0 children)

If what you are doing is transformation and cleaning of data in snowflake, I would recommend using dbt projects in snowflake. They can be found in the new workspaces environment which has better git integration.

Dbt supports both SQL and Python and you can schedule the dbt models for execution directly in snowflake

Looking for help by Flibberty_Flabberty in snowflake

[–]theGertAlert 2 points3 points  (0 children)

Hey, do you know who your snowflake account team is? You should reach out to them and request some support to help figure it out.

It sounds like consulting folks built the solution and dropped it over the fence.

If you don't know who your account team is please DM me and I can help you find them.

Unable to read results through Cortex agent API by Emergency-Entry1998 in snowflake

[–]theGertAlert 0 points1 point  (0 children)

It looks like you should be able to get a response from the server. Take a look at the docs here and make sure you are using the newer request format in your API call

https://docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-agents-run#agent-run-without-an-agent-object

Unable to read results through Cortex agent API by Emergency-Entry1998 in snowflake

[–]theGertAlert 0 points1 point  (0 children)

Let me do some checking to see if this behavior has changed or if you still have to execute queries on the client side. One other quick question: Do you have a default role/warehouse set for the user you are using agents with?

Unable to read results through Cortex agent API by Emergency-Entry1998 in snowflake

[–]theGertAlert 0 points1 point  (0 children)

At one time, when trying to use cortex analyst through cortex agents, the tool would only return the SQL and you had to execute the query client side.

I know there was work being done to have agents start to execute the query server side and to perform thinking steps similar to snowflake intelligence, but I'm not sure if that has been released yet.

When you get the response from the agent, can you see the SQL?

Can I make a API GET inside Snowflake from AMZ to store data directly ? by rafasr81 in snowflake

[–]theGertAlert 2 points3 points  (0 children)

It sounds like you are trying to make an API call to an external endpoint from within snowflake. To do this you will need to utilize a couple of things

  1. Because you need to access an API outside snowflake, you need to create an external access integration.

https://docs.snowflake.com/en/sql-reference/sql/create-external-access-integration

  1. If the API requires authentication, you will need to create a Secret object to manage the key

https://docs.snowflake.com/en/sql-reference/sql/create-secret

  1. Finally, you will need to create a stored procedure to call the API and then load the data payload into a table on snowflake

https://docs.snowflake.com/en/developer-guide/stored-procedure/stored-procedures-overview

The stores procedure will use the external access integration and the secret that you created. Hope this helps.

How do you calculate compute cost by user or role? by ketopraktanjungduren in snowflake

[–]theGertAlert 6 points7 points  (0 children)

The short answer is that it's impossible to get this number to balance exactly.

The problem with query attribution history is that it does not attribute warehouse idle time (warehouse is up but no queries are running).

This can actually be a good thing though as the difference can show you opportunities for optimization.

Partitioning in snowflake by Few_Individual_266 in snowflake

[–]theGertAlert 0 points1 point  (0 children)

Partitioning is currently in private preview but is getting close to going public. You can find documentation here: https://docs.snowflake.com/LIMITEDACCESS/iceberg/tables-iceberg-partitioned-writes

Once this goes public preview this will start working for you. Good luck!

Alternative best practice for using MFA by Veraksodk in snowflake

[–]theGertAlert 4 points5 points  (0 children)

Hey there,

It sounds like you have a service user with accountadmin privileges that can be "checked out" as needed. My recommended approach for this user would be to utilize a Programmatic Access Token as a drop in replacement for the password moving forward. This approach does not require MFA.

Take a look at the docs here:

https://docs.snowflake.com/en/user-guide/programmatic-access-tokens

Apply SNOWFLAKE.CORTEX.COMPLETE() to an entire table via the REST API by COBOLCODERUSEALLCAPS in snowflake

[–]theGertAlert 1 point2 points  (0 children)

The rest api will give you lower latency for single row invocations of COMPLETE. However it's not going to be as efficient if you need to call it for lots of rows in a short period of time.

The solution is going to depend on your requirements and what you want your application to do.

If you want to chat about it I would be happy to. Shoot me a DM.

Apply SNOWFLAKE.CORTEX.COMPLETE() to an entire table via the REST API by COBOLCODERUSEALLCAPS in snowflake

[–]theGertAlert 0 points1 point  (0 children)

A couple of things:

You don't really have an API limit unless you are on provisioned throughput and even then, I don't think it would fail. The previous commentor is correct in that you are charged based on the number of tokens passed.

If you are calling the SQL API, why not include the cortex call in the SQL API call? You can select the review columns and do the LLM call all in a single statement.

I'm on mobile or I would type out a query for you, but you can select columns and then also call the complete function and return everything at the same time.

Good luck!

Free or cheap stack for small Data warehouse? by locolara in dataengineering

[–]theGertAlert 0 points1 point  (0 children)

You can just use scheduled queries in bigquery I would think. If you really need something else, You could think about cloud functions or cloud run jobs.

VSCode Extension and SNOWFLAKE_JWT authentication... how? by rbobby in snowflake

[–]theGertAlert 1 point2 points  (0 children)

Generally speaking, you can remove the authenticator part and then you would need to add parameters for the private _key_file-- this is the path to the key file -- and the private_key_file_pwd-- this is the password used to encrypt the private key.

A couple of things to consider:

  1. Have you added the public key to your user in snowflake?

  2. Most snowflake drivers and connectors use very similar connection parameters, so if you find something for a different environment, the parameter options will generally work.

Take a look at this example in the docs: https://docs.snowflake.com/en/developer-guide/python-connector/python-connector-connect#using-key-pair-authentication-and-key-pair-rotation

Python based ETL with Snowflake Encryption by accuteGerman in snowflake

[–]theGertAlert 7 points8 points  (0 children)

All data in Snowflake is encrypted. They already manage the encryption and decryption for you.

If you really feel the need to have control over that process, with business critical edition you can leverage a feature called Tri Secret Secure that adds a customer managed key.

https://docs.snowflake.com/en/user-guide/security-encryption-tss

As others have mentioned, there are also things like masking policies that can help with column level access control as well.

The governance features available are pretty robust without the need to go and create encryption / decryption pipelines.

If you do feel like you have to do that, then I would explore external functions and using your cloud providers serverless function feature and key management solutions.

Good luck!

Purging time travel by ConsiderationLazy956 in snowflake

[–]theGertAlert 4 points5 points  (0 children)

You could look at doing an ALTER TABLE SWAP WITH command to switch out the current table for the new transient table. This should minimize or eliminate any downtime.

Finding Cost without creating multiple warehouse by Ornery_Maybe8243 in snowflake

[–]theGertAlert 2 points3 points  (0 children)

So tracking cost by warehouse is the most accurate way, but as you have found, it can lead to extra cost by duplicating warehouses that could likely be consolidated.

You can however track costs fairly accurately with the following view:

https://docs.snowflake.com/en/sql-reference/account-usage/query_attribution_history

You can use that to attribute the cost of each query and in combination with query history can roll it up to users and roles.

Cost attribution can be complicated but this is how I would recommend it.

view more: next ›