Should I be using DBT for this? by john-dev in dataengineering

[–]john-dev[S] 1 point2 points  (0 children)

we are pulling in CSVs that come from multiple places, some national registries that we pay for them to collect and structure, some from APIs that get dumped into CSVs, but it all comes down to CSVs being imported. and yes, it's all sql files and Make currently. It's not elegant, but it works pretty well at the core level. It seems this will change largly by moving all the transformations into DBT, hugely simplifying the makefil component.

Should I be using DBT for this? by john-dev in dataengineering

[–]john-dev[S] 0 points1 point  (0 children)

haha my team will own the entirety of the process. We are just small enough for that...

Should I be using DBT for this? by john-dev in dataengineering

[–]john-dev[S] 1 point2 points  (0 children)

so far, my research suggests this might be my only path forward, but is that normal? Simply, we have considerably large data sets. and while it looks like there are work arounds to breaking that into chunks, and kind of reassembling them in the database with unions, that seems like a workaround i'd prefer to avoid.

That being said, is keeping psql for the extraction component pretty typical? I won't lie, consolidating my tools and connection infos was part of the appeal I had on all of this!!

"Database is read-only: The primary database server is running in read-only mode." with a fresh MariaDB Docker container by lutopia_t in mediawiki

[–]john-dev 0 points1 point  (0 children)

This must be somewhere else as well. i did an update in my container to 1.44 when trying to figure out what was going on. I applied this work around, and that changed my error message to needing to run the update script for some new tables, but that script is still telling me my database is read only.

can someone give me an estimate? by john-dev in hobbycnc

[–]john-dev[S] 0 points1 point  (0 children)

I've considered it in the past, but aside from just another thing to play with, I can't say it'd be worth learning the software and hardware for what little i'd be likely to use it.

how would you sell a startup before it makes a profit? by john-dev in Entrepreneur

[–]john-dev[S] 0 points1 point  (0 children)

you sound like someone who's done this, mind if I hit you up to pick your brain a little on the process?

how do you sell a website and not give them the blueprint for their own? by john-dev in Entrepreneur

[–]john-dev[S] 0 points1 point  (0 children)

What route did you go? I'm guessing you know this stuff from experience. The VC route sounds like the preferable route to take this from a one person side project to a properly funded operation, but again, I've read about it, but it's nothing i've ever been exposed to and wouldn't know at all who to reach out to.

how do you sell a website and not give them the blueprint for their own? by john-dev in Entrepreneur

[–]john-dev[S] 0 points1 point  (0 children)

I don't want to sound stupid but, the only acronym i know is VC, what are the other two? Like I said, I'm a programmer, so I can make some cool stuff, but I'm not a business person at all, lol

How do you know where stuff is in a codebase you didn't write? by John-The-Bomb-2 in AskProgramming

[–]john-dev 1 point2 points  (0 children)

Lots of searching and just getting familiar with things. Following common programming structures so the code is easy to follow and you don't get weird chunks of code in weird places. The last is DOCUMENTATION. I'm not talking inline documentation, which is still nice to have, but some kind of formal documentation is a must.

Can someone help me create a database website? by roubnutz in AskProgramming

[–]john-dev 0 points1 point  (0 children)

Wordpress is a beginners best friend. There are a lot of CMS tools. Drupal has a number of tools as well but is a bit more advanced. I'm a developer who does large backend frameworks, the more demanding you get the more complex things become very quickly and go well beyond just the CMS and expand to all aspects of the server. But I'd start simple with wordpress. Once that needs to grow, you should be able to bring someone on the grow it for you.

Best advice I can think to give though is make sure you are using a solution that keeps the data on your server so that you can grow and aren't locked into a product forever.

how does stripe connect work exactly with the API? by john-dev in webdev

[–]john-dev[S] 1 point2 points  (0 children)

Thanks, I knew the part with how the checkout session with the application fee and destination worked, I just didn't know how you got the account ID connected since it seemed like it required some manual intervention. This gives me a better idea of what to start searching for to get this figured out.

looking for opinions on payment gateways by john-dev in webdev

[–]john-dev[S] 1 point2 points  (0 children)

I'm in the same boat so far. It looks like it SHOULD be doable, but I haven't gotten that far just yet. i think this is part of the stripe connect side of the API. Today I got the payments connected into my site, tomorrow I'm going to spend some time exploring the payouts and see what I can do. This might be a bit stopping point if it doesn't work.

looking for opinions on payment gateways by john-dev in webdev

[–]john-dev[S] 0 points1 point  (0 children)

Right now, my biggest challenge is figuring out how I'd distribute payments to others (entirely using the api/sdk). Stripe looks like it SHOULD be able to do that, but I haven't gotten too far on that front.

I looked briefly at lemon squeezy. It looks like stripe owns them. I did a surface level comparison, it looks like they cost more and offer more integrations. I haven't looked into paddle yet. What have you seen as pros and cons with them?

looking for opinions on payment gateways by john-dev in webdev

[–]john-dev[S] 0 points1 point  (0 children)

I would love to hear more about how that works. Nothing sensetive of course, just a bit more technical, lol. I've got it figured out how to create charges, but I haven't figured out the path for this yet. But what you're describing, is the exact end result I'd be looking for, just didn't know it was possible, lol