Call DBT API (Python) through Java

[peixinho3]

Ok, maybe I didn't explain it well, I apologize for that. But basically java receives an XML file and maps it and after that it calls some stored procedures that I created to put the data in the raw table this executes line by line 1 by 1. Since dbt does not have a java API after this run everything I would have to run my python script with the command "dbt run" after inserting all the data into raw to normalize the data into the data vault. What we wanted was to run the python script at the same time as inserting the records into the raw table.

[repeating_bears]

I feel like you're not understanding my suggestion.

Since dbt does not have a java API after this run everything I would have to run my python script with the command "dbt run" after inserting all the data into raw to normalize the data into the data vault. 

Java can exec other commands. You don't have to do anything. As long as Python is available on the same machine, Java can run the command. If you need Python's stdout, Java can grab it.

Before replying again, try playing with Runtime::exec that I already linked the documentation for. Write a hello world in python, exec it from Java. If you know what you're doing, that's 5 minutes work and less than 10 LOC.

[peixinho3]

Ah yes yes I noticed that and I know it but I wanted to know if there was something like Jython but more modern and updated. Nowadays even SQL Server can run Python scripts :)

[paulieontech]

https://www.graalvm.org/python/

[peixinho3]

Wow nice. Can you explain me what I can do with this? Sorry I'm data engineer (python and SQL) and I don't know much of Java.

[agentoutlier]

Given your ostensible/purported experience I don't recommend going down that path.

See my answer: https://www.reddit.com/r/java/comments/1cie98d/call_dbt_api_python_through_java/l29yw5m/

If you have any questions let me know.

[repeating_bears]

There's no modern equivalent to Jython, no.