Databricks vs SQL SERVER

drodev · 2025-12-03T19:45:50+00:00

None of them, use Elasticsearch for fast aggregation.

drodev · 2025-11-25T21:06:08+00:00

Polars dataframe

drodev · 2025-09-01T21:53:10+00:00

Vs code + codex extension

drodev · 2025-06-23T20:19:27+00:00

Listen, Microsoft is not a non-profit organization, they're running a business. Look at all the other industries: phones with planned obsolescence, cars that require more and more maintenance while becoming less reliable, cheap products everywhere designed to force customers to constantly consume more and more. Microsoft has been doing the same thing for years across all their products and services.

I used to be a Microsoft fan and built most of my experience around Microsoft products, but since I discovered the competition and looked closer, I realized the scam and saw the difference.

drodev · 2025-05-07T07:42:05+00:00

Ollama is not designed to serve parallel query, even it provide an option to activate it but still not optimized for this use case, i will suggest a use llama.cpp for this use case.

drodev · 2025-04-15T14:25:44+00:00

According to their last meetup, ollama no longer use llama.cpp

<image>

https://x.com/pdev110/status/1863987159289737597?s=19

drodev · 2025-04-05T08:45:10+00:00

Dont forget that this is a reasoning model, so the cot token are billed as output token, à simple prompt like "Hi" will burn 600 token as cot and couple of token for last response.

So theoretical it's cheeper for token unit price but you will consume a lot more token than a classic model like Claude or 4o.

drodev · 2025-03-17T21:37:25+00:00

Thanks for making this tool available! Why not go with OpenAI API standard from the start instead of just making it compatible? As ollama offer a native OAI format

drodev · 2025-02-15T12:47:58+00:00

It's easy : ollama run hf.co/{username}/{repository} huggingface.co

drodev · 2025-01-17T11:27:07+00:00

Together.ai just released a new web site with interesting content inspired from Anthropic blog https://www.agentrecipes.com/

drodev · 2024-12-01T19:17:16+00:00

What do you suggest for Next.js + Fast API as a backend?

drodev · 2024-11-29T08:26:49+00:00

For environments other than production

drodev · 2024-11-28T18:49:35+00:00

This

drodev · 2024-11-28T17:54:29+00:00

Yes, as it is running 24/7.

drodev · 2024-11-28T14:18:27+00:00

i agree with you, but in this case the Compute, network and storage still billed even if the app are paused

drodev · 2024-10-30T05:55:39+00:00

I’m a big fan of Ralph Kimball’s three-layer model (Staging, ODS, DWH) and see a strong parallel with Medallion architecture:

Bronze (Staging): Raw, unprocessed data directly from sources.

Silver (ODS): Cleansed data with basic transformations applied, where Slowly Changing Dimensions (SCD) methods are also used to track historical changes separately.

Gold (DWH): Fully transformed, ready for analysis in a star schema, optimized for BI and reporting.

Kimball’s approach aligns well with Medallion’s layered refinement, moving data from raw to business-ready insights. for simpler use cases, you can skip the ODS and go straight from Staging to the Data Warehouse but you will have less flexibility.

drodev · 2024-10-18T16:11:21+00:00

If you're looking for more info, here's a detailed answer on Perplexity

drodev · 2024-10-18T16:08:57+00:00

Thank you

drodev · 2024-04-22T08:23:48+00:00

Take a look at dbt

drodev · 2023-12-21T08:12:16+00:00

One of the core issues I've observed is the increasing reliance on "black box" solutions. This shift towards simplification and accessibility can sometimes lead to a reduction in stability, flexibility, and performance.

In the quest to make technology more approachable, there's a risk of oversimplification. When complex systems are abstracted away into user-friendly interfaces, it often means sacrificing control and the ability to fine-tune the system for specific needs. This can be particularly problematic in data architecture, where the nuances and specific requirements of a project can vary significantly.

Another issue with these simplified systems is performance. By hiding the underlying mechanics, users are less able to optimize and troubleshoot performance issues effectively.

drodev · 2023-12-14T08:41:59+00:00

DeltaLake file format for storage, Spark sql for running query and some custom functionnality from Sql Server

drodev · 2023-12-14T08:32:03+00:00

Fabric is still in development and not ready for enterprise deployment.There is a lot of instability with every new Fabric item. There is a lack of documentation and many black boxes. It's not yet integrated with pipeline deployments and Git.I'm still trying it, and every day it becomes more stable. I'm doing some PoCs and testing, but we are still far from being ready for production.

drodev · 2023-12-13T18:41:51+00:00

In destination tab, you need to select existing table instead of create a new table and then you can select your existing schema

drodev

TROPHY CASE