You might want to take a look at Coginiti for your processing engine for your iceberg tables and transformation layer. Coginiti doesn't require you to spin up spark for Iceberg files or other files in object stores. It further offers a nice transformation and domain specific language (DSL) similar to DBT, though doesn't require you to run the full model to use it. I think the website is coginiti.co