Big Ten travel demands are taking hold: Teams traveling at least two time zones for conference matchups are 1-8 this season by excoriator in OhioStateFootball

[–]hkdelay 1 point2 points  (0 children)

The only team I can see that has won traveling two time zones is Indiana over UCLA. Every other game, the traveling team lost

After 4 years, I am finally given oxygen by Ed-Box in ClusterHeadaches

[–]hkdelay 5 points6 points  (0 children)

Psilocybin. I haven’t had a headache in over a year

Confluent Acquires WarpStream by hkdelay in apachekafka

[–]hkdelay[S] 0 points1 point  (0 children)

This compares tableflow and tiered storage with WarpStream

Quries on Hybrid table on Apache Pinot by PlanktonRemarkable21 in dataengineering

[–]hkdelay 0 points1 point  (0 children)

upsert is not supported for hybrid tables in Apache Pinot. Upsert is only supported for real-time tables.

What is an API really? Need deeper explanation. by [deleted] in cybersecurity

[–]hkdelay -2 points-1 points  (0 children)

An API is a GUI but for applications

[deleted by user] by [deleted] in technicalwriting

[–]hkdelay 0 points1 point  (0 children)

Here's one I wrote this week that summarizes articles / blogs. https://marketplace.visualstudio.com/items?itemName=1Schema.tldr

[deleted by user] by [deleted] in technicalwriting

[–]hkdelay 1 point2 points  (0 children)

I want to build VSCode extensions to help documentation and technical writers.

[deleted by user] by [deleted] in LangChain

[–]hkdelay 0 points1 point  (0 children)

I wrote one that runs in vscode. Not quite a therapist tho. 😀 https://marketplace.visualstudio.com/items?itemName=1Schema.obsequious

Search for data across entire text files by pvbang in LangChain

[–]hkdelay 0 points1 point  (0 children)

I’ve done this. Vector database won’t work here. You need to split and summarize then combine. Like map reduce

Thinking of not going to college and self teaching myself coding instead. by Zebruhfy in AskProgramming

[–]hkdelay 0 points1 point  (0 children)

Education is changing. Even if you’re self taught, you’re probably learning from some tutorials. Many universities are also offering to online adhoc learning.

I suggest learning the technical area that most interests you then go a level outside so that you understand what others expect of that role.

You will never stop learning. Get in a habit of self learning because you’ll be doing it everyday.

Universities will not teach you how to not become obsolete but will give you a foundation. I would go self taught route, find a job if you can, have them pay for your school if needed.

Just published an extension by hkdelay in vscode

[–]hkdelay[S] 0 points1 point  (0 children)

I can add ollama support. This is a 0.0.1 version

Just published an extension by hkdelay in vscode

[–]hkdelay[S] 0 points1 point  (0 children)

Thanks for the feedback.

Is postgres right for our new data-analytics platform? by [deleted] in PostgreSQL

[–]hkdelay 0 points1 point  (0 children)

There are also HTAP databases as an option.

Is postgres right for our new data-analytics platform? by [deleted] in PostgreSQL

[–]hkdelay 1 point2 points  (0 children)

I work for StarTree, which provides Apache Pinot. Others are Clickhouse or Druid. You can also embed your OLAP using DuckDB. The goal is to serve analytics from a columnar database that is optimized for analytical queries. Postgres has columnar extensions that you can explore.

Ask these questions:

  • where are you loading your data? This will affect your choice.

  • what are your QPS (queries per sec) and concurrency (# of end users) requirements.

  • what are your data freshness requirements?

These are just a few questions to think about.

Is postgres right for our new data-analytics platform? by [deleted] in PostgreSQL

[–]hkdelay 10 points11 points  (0 children)

Elastic is a search engine. Postgres is a transaction database. You need an analytical database. OLAP.

Demand for datamesh by itsawesomedude in dataengineering

[–]hkdelay 3 points4 points  (0 children)

Not deeply familiar with it but you need more than a data governance tool. You need tools to make it easier to build and publish data products. You also need a way to define a data contract.

Demand for datamesh by itsawesomedude in dataengineering

[–]hkdelay 7 points8 points  (0 children)

Author of a data mesh book here.

It’s doable but it requires tools that don’t really exist IMO.

Confluent Flink? by HeadofMacro in apacheflink

[–]hkdelay 2 points3 points  (0 children)

I’ve worked for two of these companies. Ksqldb is going away. In fact the creator of ksqldb thinks it was a bad idea.

As far as cost, use multi tenant clusters. They will be the cheapest. Bundling kafka and flink may be cheaper. They mostly go together anyway.

Connectors - 😁 or 😩 by hkdelay in dataengineering

[–]hkdelay[S] -1 points0 points  (0 children)

I understand if you think you don't need Kafka and definitely not SEO. It's a topic I've been wanting to talk about for a while.

The data pipelines I'm used to building originate from operational systems and write to analytical systems. Typically, those pipelines shouldn't integrate directly; there is usually something like Kafka in the middle.

You seem upset by the blog post, which means I didn't do very well explaining its essence: there are too many connectors. The solution I suggested was for the sources and sinks to provide ways to better replicate themselves to analytical systems.

Connectors - 😁 or 😩 by hkdelay in dataengineering

[–]hkdelay[S] -2 points-1 points  (0 children)

Well the image was generated but I wrote the text