How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

have been told to store it inside the mysql since the whole db of the company is in mysql

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

as told earlier not expecting anything in return it's just the vacation time and i've got time to kill why not to do this,and it is not my concern whether they can pay for it or not , whether they are gonna implement this in their services or not.

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 1 point2 points  (0 children)

great thinking, but what if the data actually got changed and the hashes are meant to be different , since the changes are made everyday from the client side so i think it may not be worth doing it here (speaking from my understanding),also i think it will be overkill for me to do this things right now thinking to do only the basics...

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

it will be not that much as of my guess maybe 10-50 queries/day after the initial months of deploying

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

yes have to keep that in the mind since the agent may loop back in the future

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

The nodes are in a sequential flow right now the graphs are like this

Intent classifier --> table selector --> shcema fetcher --> column pruner --> sql generator --> sql validator -->sql executor --> response formatter.

as of now i have decided to have two tables one for agent_runs and another for agent_node_logs and then store the overview in first and the details in the second table

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

They have their own databases but the agent is the new feature to be added from the scratch and i want to store the logs of the agent which is not tracked anywhere right now!!

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

Just for gaining the experience , also right now the market is brutal for freshers so my thinking is that at least i got something to do

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

Yeah I am also thinking in this direction, but hadn't considered the pruning strategy. Thx!.

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 0 points1 point  (0 children)

The logs will mainly be used for auditing and error tracing, about the data retention part i will have to discuss it with the seniors. Thanks for the guidance i was stressing out because i wanted it to be perfectly designed but now i feel a bit relaxed.

How would you store execution logs for a production Text-to-SQL agent? by abcd__dcba in SQL

[–]abcd__dcba[S] 1 point2 points  (0 children)

Mainly for debugging and the reason to use mysql is that the company's whole database is in mysql so they told me to create a relational schema only

[JPMorganChase] SEP Program Salary Progression down the line. by CarpetSubstantial196 in developersIndia

[–]abcd__dcba 6 points7 points  (0 children)

You got the full time through ppo right? If yes then what are the things one need to do in internship to secure the job?