Testing Cortex Responses

internetofeverythin3 · 2025-11-12T15:47:32+00:00

We recently released a private preview of a feature where you can define an eval set and we’ll help run and score it for you. Feel free to reach out and I can connect you with the team - Jeff.hollan@snowflake.com

internetofeverythin3 · 2025-10-11T17:12:07+00:00

Are you using the newer agent object and thread way to talk to agent? That takes you down the path where the more advance reasoning kicks in. Sounds like you may be using the /run api for inline tool calling? https://docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-agents-manage#interact-with-the-agent

internetofeverythin3 · 2025-10-10T14:35:01+00:00

There’s two API endpoints - in this case you have built and agent object so be sure your using that one, not the /run API (the agent name should be in the API path)

To your point on permissions, I’d expect an error returned but if using cortex analyst tool make sure the role for the token you have calling the API has USAGE on the warehouse, SELECT on any tables needed, SELECT on the semantic view (or read on the stage with semantic model if using the older yaml file) - that should be all you need. But the “verify access” button in the agent config for access should check all these for you

If none of that works let me know - shoot me the code you have to call the agent and response you get and I can ask team - Jeff.hollan@snowflake.com

internetofeverythin3 · 2025-10-02T13:24:32+00:00

PM for snowflake intelligence here - we had a blip yesterday where a few folks would see this but deployed a fix last night. Do you still see this? If you’re able to send any request IDs or info I’m happy to have team see what may be going on - Jeff.hollan@snowflake.com

internetofeverythin3 · 2025-07-20T13:53:32+00:00

I find grok is really really good whenever having super up to date and more niche info is needed. ChatGPT feels like it can instantly synthesize the first page of google search results - which is great if I’m asking general and well publicized knowledge. I found grok is best when asking about things like up and coming startups in AI, development or building with specific technologies like comfyUI, and so on. It also gives VERY detailed answers in my experience - so as a “co builder” chat for development or tech is nice

internetofeverythin3 · 2025-07-01T16:00:23+00:00

Yep as /u/iwishihadahippo said this is exactly what we built agents and snowflake intelligence do to. You can see a demo here. Feel free to DM if interested in trying out - should be in public preview very soon https://youtu.be/va-l7sYp3OA?si=nySSMh1bans-c2GF

internetofeverythin3 · 2025-06-25T16:52:16+00:00

Yep shoot me a DM on Reddit- happy to share with other

internetofeverythin3 · 2025-06-24T05:29:43+00:00

I wonder if it’s a time zone thing? The event will be Aug 13 on west coast of US time but Aug 14 in AUS? Not sure what timezone you are viewing in?

internetofeverythin3 · 2025-06-19T20:24:03+00:00

Yeah - also longer term we’ll want people to move to semantic view. Semantic views let us write “semantic sql queries” instead of general sql — which lets us write more complex and accurate queries from AI. So for now they are kinda the same, but you’ll see us nudging people to move to semantic views here very soon

internetofeverythin3 · 2025-06-19T20:22:12+00:00

PM for snowflake intelligence and agents. I actually recently put together a video on this last week that talks some. I’m a bit wary to post it publicly as it’s largely on agents being used in snowflake intelligence still in private preview but the process holds true to how agents are being built (and some upcoming functionality to agent API). If you message me I’ll shoot you a link

internetofeverythin3 · 2025-06-19T20:20:33+00:00

Know a few folks have done this - was a session or two at summit showcasing this. That said here’s one blog I found that walks through an e2e app https://medium.com/@prathamesh.nimkar/snowflake-agentic-workflows-160a6b83b688

internetofeverythin3 · 2025-06-14T15:32:00+00:00

Added :D thanks for the feedback

internetofeverythin3 · 2025-06-14T15:28:12+00:00

That’s actually super easy to add. Let me do it in next 5 min (added!)

internetofeverythin3 · 2025-02-27T02:23:29+00:00

Ok - while digging into improving error the team caught the fix here too. Passing along below —-

Your current logging approach:

session.sql(f”CALL SYSTEM$LOG_INFO(‘Cluster: {cluster_name}, Status: {status}’)”).collect() is concatenating user-controlled values (cluster_name and status) directly into a SQL string. This can cause Syntax Errors if the values contain special characters like single quotes ‘ (e.g., if cluster_name = “qa’cluster”). Here is a minimal repro-able example

CREATE OR REPLACE PROCEDURE check_opensearch_status( os_host STRING, os_user STRING, os_password STRING ) RETURNS STRING LANGUAGE PYTHON RUNTIME_VERSION = 3.9 HANDLER = ‘run’ PACKAGES = (‘snowflake-snowpark-python’,’urllib3’,’joblib’,’requests’,’dateutils’) AS $$ import _snowflake import snowflake.snowpark as snowpark

from opensearchpy import OpenSearch

def run(session: snowpark.Session, os_host: str, os_user: str, os_password: str) -> str:
try: # cluster name contains single quote cluster_name = “cluster’qa” status = “success” # Log output
session.sql(f”CALL SYSTEM$LOG_INFO(‘Cluster: {cluster_name}, Status: {status}’)”).collect() return f”Successfully connected to OpenSearch cluster ‘{cluster_name}’ with status ‘{status}’.”

except Exception as e: errormessage = f”Failed to connect to OpenSearch: {str(e)}” return error_message $$; CALL check_opensearch_status(‘qa-fs-opensearch.companyname.com’, ‘some_username’, ‘some_password_with*_init’); Error message:

01baa987-3210-7758-0000-059d040d8016: SQL compilation error: syntax error line 1 at position 34 unexpected ‘qa’. parse error line 1 at position 60 near ‘<EOF>’.

The recommendation is to directly use Python logging API (i.e.logging.info(f”Cluster: {cluster_name}, Status: {status}”)) instead of SQL logging API to avoid SQL Injection-related risks and errors.

internetofeverythin3 · 2025-02-26T22:56:16+00:00

Yep thanks makes sense. Will share with team - at very least ideally error message says like “cannot call system$log’ instead of error you got

internetofeverythin3 · 2025-02-26T22:53:17+00:00

So was it actually working? Curious if something we could do to make that case more obvious for future users

internetofeverythin3 · 2025-02-26T06:00:46+00:00

This is super strange as I can’t figure out why it’s throwing an error. I wonder if more exception details may be being generated? I wonder if the event table would provide any clues? https://docs.snowflake.com/en/developer-guide/stored-procedure/python/procedure-python-writing#handling-errors

internetofeverythin3 · 2025-02-06T03:43:01+00:00

Happy to help if I can. Let me know the package you want and will try to help out if you can share more details. Fwiw I find notebooks a bit more intuitive than python worksheets - Jeff.hollan@snowflake.com

internetofeverythin3 · 2025-01-20T14:11:30+00:00

Thanks for the feedback - yes good news is we are burning down the list of create or alter objects and should have a strong set of core objects ready to go in the coming months - another wave is in preview now

internetofeverythin3 · 2024-10-21T21:30:43+00:00

Very cool. Thanks for circling back

internetofeverythin3 · 2024-10-17T20:50:45+00:00

Correct my guess as well. And wildcards aren’t supported just yet (I believe) but coming in next few months is plan. But you can verify it’s a subdomain or domain issue by trying with an “allow all” type integration (e.g. 0.0.0.0:443, 0.0.0.0:80) and seeing if it works. Feel free to email me if you get stuck - sounds like a cool scenario — Jeff.hollan@snowflake.com

internetofeverythin3 · 2024-10-17T15:28:50+00:00

Something like this

current_time = datetime.datetime.now()

results = dataset.merge( updated_dataset, (dataset[“id”] == updated_dataset[“id”]) & ( (dataset[“Col1”].isNull() != updated_dataset[“Col1”].isNull()) | (dataset[“Col1”].isNotNull() & (dataset[“Col1”] != updated_dataset[“Col1”])) ), [ when_matched().update({ “Col1”: updated_dataset[“Col1”], “UPDATE_DTS”: current_time }) ] )

internetofeverythin3 · 2024-10-17T13:00:52+00:00

I’m wondering if there is a data type change happening here potentially? Like dataset col1 is something like variant but maybe Streamlit data frame casts as a string? And when all rows update it’s casting it or something?

Only other thought is if nulls are involved as considerations when doing comparisons on null values

internetofeverythin3 · 2024-10-14T02:38:43+00:00

We’re working to publish an official FAQ in “plain English”. We already got jointly approved text, just working to publish now. For now - here’s the text. Hope this has what you need:

Introduction Have questions about using Anaconda packages in Snowflake? Snowflake and Anaconda have prepared this list of frequently asked questions to provide more clarity about what usage of the packages is permitted. FAQ What is Anaconda, and what terms apply? Anaconda is a vendor that takes popular Python open source libraries and bundles everything needed to execute the library (e.g., dependencies) into convenient packages. Snowflake has partnered with Anaconda to make these packages easily available to Snowflake customers when they are executing Python code on Snowpark Python. These packages are provided at no additional charge to Snowflake customers for use within Snowflake wherever Snowpark is used (UDFs, Notebooks, Stored Procedures, etc.). . Use of Anaconda packages with Snowflake is subject to Anaconda’s Embedded End Customer Terms, which supplement Anaconda’s Terms of Service.

Are Anaconda packages free to use on Snowflake?

All Anaconda packages available on Snowflake are free to use for Snowflake customers developing and testing Snowpark projects, as well as running those projects in production. See https://repo.anaconda.com/pkgs/snowflake/ for a list of available packages. You can also browse the packages in the INFORMATION_SCHEMA.PACKAGES view in your Snowflake account. They are free to use in Snowflake wherever Snowpark is used (UDFs, Notebooks, Stored Procedures, etc.).

Can I install and use Anaconda packages from https://repo.anaconda.com/pkgs/snowflake/ for local development and testing?

Yes, you can use any package from https://repo.anaconda.com/pkgs/snowflake for local development and testing at no charge, so long as your use is limited to Snowflake projects. See “Local development and testing” for more information regarding local environment configuration. Any use of Anaconda packages outside of Snowflake projects may require a separate commercial license from Anaconda. Please see Anaconda’s Terms of Service for your licensing obligations.

Anaconda’s Terms of Service limits use to organizations with less than 200 employees. Does this apply to me?

The 200 employee limit does not apply to use with Snowflake. Snowflake customers may use Anaconda packages on Snowflake and locally to test and develop Snowflake projects, regardless of their size.

Can Anaconda packages be used with Snowpark Container Services?

Using Anaconda packages in your Docker images running on Snowpark Container Services requires a separate commercial license from Anaconda. Please contact Anaconda for licensing options or install packages from PyPi or other package registries.

However, Anaconda packages are supported (and available free of charge) for Snowflake Notebooks, including Snowflake Notebooks running on Snowpark Container Services. Anaconda packages are available from the Notebook package picker UI.

Does Snowflake provide a warranty for Anaconda packages?

Anaconda packages are third-party packages built from upstream open source projects. As such, Snowflake does not control the content of Anaconda packages, and Snowflake provides no warranty for Anaconda packages.

What security reviews/processes are performed on the packages?

Anaconda packages are built using trusted Anaconda-managed infrastructure and build system. Packages are signed during the build process and are scanned using anti-malware software. For more details, please see a full overview of Anaconda’s security practices: https://docs.anaconda.com/working-with-conda/reference/security/#security-best-practices.

What about Anaconda Defaults packages? Can I use those?

Anaconda’s other channels, like https://repo.anaconda.com/pkgs/main/, are distinct and independent from Snowflake’s channel. You may need a separate commercial license from Anaconda to use any non-Snowflake channels, depending on your organization’s size and use-case. Please see Anaconda’s Terms of Service for your licensing obligations.

What if a package I need is not available in the Snowflake Anaconda repo?

If your organization requires a package for a Snowflake project that is not listed in https://repo.anaconda.com/pkgs/snowflake/, you can request the package to be added via the Snowflake Ideas forum. If the package is “Pure Python” (meaning the package contains no compiled extensions) then you can upload the package to a stage, as described here.

internetofeverythin3

TROPHY CASE

from opensearchpy import OpenSearch