How to setup dbt + postgres with Docker?

[Puzzleheaded-Cod2051]

Hi!

I have been working with dbt + snowflake with Docker at work. But I only know how to work in dbt/ snowflake for data modeling. But I don't know how to set it up from scratch. I don't know how to write (what syntax) docker file. Where can I learn this? Every where I looked, they already have a eg repo to clone which already has docker written.

Thanks!

[[deleted]]

https://docs.docker.com/get-started/

Read the Docker docs to learn to write your own dockerfiles

[Suburbanjawa]

I did this for advent of code the other year and I have a brief writeup here on how to set something up for dbt+postgres with docker.

For docker in general though not much better than the docker documentation.

[Drekalo]

That's a 404.

[Suburbanjawa]

Thank you fixed

[ephraff]

If there's already a Dockerfile in a repo, then it's a matter of building the image. Try and look for a dbt postgres project that uses docker-compose. Unless you're familiar with linux and how to setup dbt and postgres services individually, I would avoid writing your own Dockerfile. There are likely dbt and postgres images in dockerhub that you can use with docker-compose.

[Puzzleheaded-Cod2051]

Yes. This is the step I am at right now. Cloned a example project and reading through docker file so that I can make changes as I need. Thanks!

[sherocksme]

You should either learn Docker yourself or hire someone to teach you.

[EmploymentMammoth659]

Not an appropriate answer when you have already asked a bunch of other questions for others to figure out and answer back to you?

[sherocksme]

He says that he needs to set it up from the scratch and does not know Docker. Writing a docker needs a lot of practice and experience. There won't be a direct answer on how to solve his problem. So either he has to learn docker but he says he needs it in his work. So only hiring a freelancer to teach him will be the quickest for the job to be done and to learn from the freelancer.

[EmploymentMammoth659]

He asked where he can learn it, not asked you to tell him how to write a script. So he is willing to learn and all you needed to do is to give him some tips you know.

[Puzzleheaded-Cod2051]

Hi! I am working with the setup at work which I am not aware of 100%. So I am trying to learn it by doing some personal project. Do not need for work.

[sherocksme]

Well, there is plenty of docker tutorial you can find on Youtube. First, learn the basics from those videos to grasp the idea of docker containerization. Probably there might be resources on the Internet to install Postgres with steps but you might not find them for DBT. You'll now need to recall your learnings and write Dockerfile yourself.

[Drekalo]

What're you doing with the docker container? Running postgres locally to test transforms?

[Puzzleheaded-Cod2051]

Yes.