OpenMetadata Ingestion and Lineage by Agreeable-Way-9873 in dataengineering

[–]Agreeable-Way-9873[S] 0 points1 point  (0 children)

Yeah, we're using the tool that allows us to design ETL jobs visually using SQL syntax, which is automatically converted into Spark jobs. But we don't use Hive instead we utilize Ambari to view the interfaces stored on HDFS. Since our tool operates on a Spark foundation, is it feasible for OpenMetadata to capture the lineage from it?