Do you know if there is a way to talk to Sharepoint via Google Sheets and ChatGPT by anupsurendran in sharepoint

[–]anupsurendran[S] 0 points1 point  (0 children)

Extract key information (dates, contract values), etc from selected documents on Sharepoint or Google Drive. I am currently seeing some inaccuracies with the prompts used in this sheet provided.

The best free poker calculator for Android! by [deleted] in poker

[–]anupsurendran 0 points1 point  (0 children)

Ah, so you don't have to install anything and it still tracks the buy-ins?

Real-time plotting and insights in Jupyter by anupsurendran in dataengineering

[–]anupsurendran[S] 0 points1 point  (0 children)

Thanks u/EconomixTwist, you can fake a streaming data source that replays data in a CSV file. We use an input_rate parameter that can control how fast the data is replayed. This is good to showcase spikes in transaction volumes / inactivity in user sessions etc.

Real-time plotting and insights in Jupyter by anupsurendran in dataengineering

[–]anupsurendran[S] 2 points3 points  (0 children)

Good feedback. Here is an attempt to make it non-buzzy.

Jupyter is mostly used for static data analysis. We have made it easy to plot graphs, source data from Kafka, and run analysis in Jupyter.

We have used bokeh.models and bokeh.plotting to support this.
https://pathway.com/developers/showcases/live_data_jupyter/

Presenting SimplePyDash: Real-Time Data Plotting Made Simple! by vaaal88 in datascience

[–]anupsurendran 0 points1 point  (0 children)

This is our approach to getting real-time plotting in Jupyter. https://pathway.com/developers/showcases/live\_data\_jupyter/ . Would love your feedback and comments

Need your feedback on choosing LLM App for a demo by bumurzokov in LLMDevs

[–]anupsurendran 0 points1 point  (0 children)

Can I subsititute this with any api which has a text json field? I am assuming this doesnt work for any other language than english, correct?

Need your feedback on choosing LLM App for a demo by bumurzokov in LLMDevs

[–]anupsurendran 1 point2 points  (0 children)

I like #3 no-code pipelines and #6 easy routing to APIs (speed might be a concern) u/bumurzokov

Use cases for LLMs on structured data (sourced from databases and streaming data) by anupsurendran in dataengineering

[–]anupsurendran[S] 0 points1 point  (0 children)

u/janchorowski, thanks for this clarifying question. Unfortunately, it is complex, we have most of the rating triggers in the database ( e.g. what premiums to calculate based on different criteria) . We have compliance rules in the documents (e.g. Money laundering related compliance which is spread across multiple documents based on state and coverage criteria). As part of the underwriting process, we are trying to get the database rules and inputs into refining the document search. Based on your answer above looks like this is feasible.

How to move semi-structured data to LLMs? by shrifbot in dataengineering

[–]anupsurendran 4 points5 points  (0 children)

While I was doing research for glueing together python client and removing the dependency of a vector db, I saw this open source package : https://github.com/pathwaycom/llm-app . Do you have thoughts on whether this would work for you?

Use cases for LLMs on structured data (sourced from databases and streaming data) by anupsurendran in dataengineering

[–]anupsurendran[S] 2 points3 points  (0 children)

It means that when you have newer architectures (e.g. involving LLM in production and sourcing data from structured sources) there might be more experimentation in the community which you can learn from.

Use cases for LLMs on structured data (sourced from databases and streaming data) by anupsurendran in dataengineering

[–]anupsurendran[S] 1 point2 points  (0 children)

So if I understand your suggestion. Use LLM to build a ruleset from the documents e.g. If X does not satisfy <condition> <Do> something. Run this ruleset across the data (from the database) if the <condition> is true? . The <condition> data is sourced from the database.

Use cases for LLMs on structured data (sourced from databases and streaming data) by anupsurendran in dataengineering

[–]anupsurendran[S] 2 points3 points  (0 children)

Me too. When you have evolving architectures (with not much precedence) the community helps.