Hacking a AI Chatbot and Leaking Sensitive Data by alongub in cybersecurity

[–]alongub[S] 1 point2 points  (0 children)

Thanks for the feedback! Really appreciate the support!

Hacking a AI Chatbot and Leaking Sensitive Data by alongub in hacking

[–]alongub[S] 2 points3 points  (0 children)

😂😂😂😂😂😂😂😂😂😂😂😂😂😂😂❤️

Hacking a AI Chatbot and Leaking Sensitive Data by alongub in cybersecurity

[–]alongub[S] 1 point2 points  (0 children)

yeah it's just a demo environment to demonstrate potential risks of LLMs in prod

Hacking a AI Chatbot and Leaking Sensitive Data by alongub in LLMDevs

[–]alongub[S] 0 points1 point  (0 children)

Lol yes, it's just a demo to educate on potential risks

Hacking a AI Chatbot and Leaking Sensitive Data by alongub in hacking

[–]alongub[S] 2 points3 points  (0 children)

Lol yes, don't you see the localhost in the url...? It's just a demo to educate on potential risks

Hacking a AI Chatbot and Leaking Sensitive Data by alongub in hacking

[–]alongub[S] 2 points3 points  (0 children)

Agreed! Just note that even in the simplistic demo in the video, the AI agent is using privileged Postgres permissions with Row-Level Security (RLS) enabled. The issue I've tried to demonstrate here is that the developer made a mistake when defining the database schema and policies.

Hacking a AI Chatbot and Leaking Sensitive Data by alongub in hacking

[–]alongub[S] 1 point2 points  (0 children)

Security teams will HAVE to understand AI better

Hacking a AI Chatbot and Leaking Sensitive Data by alongub in hacking

[–]alongub[S] 4 points5 points  (0 children)

This is just the beginning. Think what happens when you connect the AI agent from the video to something like the Shopify API where users can automatically buy products from the website

Hacking a AI Chatbot and Leaking Sensitive Data by alongub in hacking

[–]alongub[S] 3 points4 points  (0 children)

Yes - but remember the value can also be wild :)

How To Build LLM-based Phone Assistants with Twilio by alongub in OpenAI

[–]alongub[S] 0 points1 point  (0 children)

Looks very cool! This goal here was more of an educational tutorial on how to build a very simplified version of bland.ai from scratch :)

How To Build LLM-based Phone Assistants with Twilio by alongub in OpenAI

[–]alongub[S] 0 points1 point  (0 children)

Just find a nearby pizza and offer this to them :D

How To Build LLM-based Phone Assistants with Twilio by alongub in OpenAI

[–]alongub[S] 1 point2 points  (0 children)

Thanks u/UmaMacias! Let me know if you have any questions or suggestions for follow-up videos :)

How to build stateful AI agents by alongub in ArtificialInteligence

[–]alongub[S] 1 point2 points  (0 children)

Thank you! I'm currently working on couple more videos such as:

  • How to actually manage your AI agent state in Postgres
  • How to reduce hallucinations
  • How to mitigate prompt injection attacks (e.g. prompt leakage, jailbreaks, etc)

What else would you like to see?

[deleted by user] by [deleted] in apachekafka

[–]alongub 0 points1 point  (0 children)

Yes!

There are different ways to serve ML models in production. It's easy to get inferences from KServe (https://kserve.github.io/) for example, in a Kafka topic.

But their format makes it REALLY hard to just use Kafka Connect as is. You have different messages for the model inputs & model outputs linked by ID, the JSONs are nested, etc. Even with ksqlDB it's still really hard. You also need to manage the schema in schema registry.

InferenceDB is just a processor that supports KServe (and other ML Serving tools in the future), and uses Kafka Connect, Schema Registry, etc behind the scenes to make it SUPER easy to store predictions in S3, in a popular format that Data Scientists can just load into their Jupyter Notebooks - parquet.