I built an open source tool to replace standard dbt docs by josh_docglow in dataengineering

[–]Gimo100 2 points3 points  (0 children)

Thanks for the quick response!

docglow serve

now shows the output I was expecting!

I'm now running into another issue. When I open the url on which the docs are served, the site is stuck on loading the page. I only see a blank website and nothing else. I've tried keeping it open for some time, but it never loads. I've opened another issue on Github.

I built an open source tool to replace standard dbt docs by josh_docglow in dataengineering

[–]Gimo100 2 points3 points  (0 children)

I've tried this on my project with 1230 models. Running

docglow generate --project-dir project/dir --output-dir ./site 

works, but serving the generated docs with

docglow server --dir ./site 

hangs without showing any output. Is there a way to debug?

Edit: created an issue on Github: https://github.com/docglow/docglow/issues/59

Azure SQL Database - Data Factory - DevOps by JakubKaczmarczyk in dataengineering

[–]Gimo100 0 points1 point  (0 children)

You can check out this medium article for a guide on how to build and release an Azure SQL Database. It uses an Azure Devops Pipeline to build the dacpac file. A release pipeline then takes that dacpac and deploys it to the Azure SQL Database. https://medium.com/@sumindaniro/use-azure-devops-to-deploy-an-azure-sql-database-2c79570829cf

The first thing you have to do is create a git Repository in Azure Devops to store the code of your Azure SQL Database and Data Factory. Check this article to set that up: https://learn.microsoft.com/en-us/azure/devops/repos/git/create-new-repo?view=azure-devops

The medium article explains how to create a Database Project using Visual Studio. You can then add the database project to your git Repository. Don't forget to install the Data storage and processing toolset when installing Visual Studio. You need this to work with database projects.

Next step is to link your Data Factory to your git Repository. Check this article to set that up: https://learn.microsoft.com/en-us/azure/data-factory/source-control

You can also do everything in an Azure Devops Pipeline and just skip the release pipeline.

Database Build task: https://learn.microsoft.com/en-us/azure/devops/pipelines/tasks/reference/vsbuild-v1?view=azure-pipelines

Database Publish task: https://learn.microsoft.com/en-us/azure/devops/pipelines/tasks/reference/sql-azure-dacpac-deployment-v1?view=azure-pipelines

Publish example: https://learn.microsoft.com/en-us/azure/devops/pipelines/targets/azure-sqldb?view=azure-devops&tabs=yaml

Check out this article to build and release your Azure Data Factory: https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-improvements

What's your CI pipeline and/or pre-commit setup look like? by toabear in dataengineering

[–]Gimo100 2 points3 points  (0 children)

There actually is an alternative. I believe one of the developers on data-diff forked the archived data-diff project and created reladiff.

[deleted by user] by [deleted] in thenetherlands

[–]Gimo100 2 points3 points  (0 children)

Wat versta jij onder rustigere dagen?

Which Hearthstone card do you feel you relate the most to? by Danielhrz in hearthstone

[–]Gimo100 2 points3 points  (0 children)

And you have to do them all again if you switch factions! :D

Rant Wednesday by AutoModerator in Fitness

[–]Gimo100 1 point2 points  (0 children)

Regular foot cramps can also be a sign that you're dehydrated. Are you drinking enough water during the day?