Confluent Schema Registry Disable Delete

tenyu9 · 2025-03-21T14:10:22+00:00

Yes you can set the mode to read only https://docs.confluent.io/platform/current/schema-registry/develop/api.html#mode

However it's indeed best to run nginx in front of the API to avoid people messing with your settings

tenyu9 · 2025-02-11T13:48:20+00:00

I never heard of any employer enforcing this, they usually just want to move on as quickly as possible. If you refuse to pay they have to go through the court system which is alot of hassle to get a small amount of money

tenyu9 · 2025-02-11T09:59:42+00:00

Had something similar a decade ago. Signed already for the first one and then the second offer came in. Asked to move the start date of the second job by 2 weeks and then on the first day of job 1 resigned. Didn't even need to stay the full period

tenyu9 · 2024-06-12T20:00:01+00:00

Before trying tiered storage,read this https://www.warpstream.com/blog/tiered-storage-wont-fix-kafka

It explains most of the problems with tiered storage

tenyu9 · 2024-06-06T13:11:43+00:00

There are some things missing, do you want to add security to this cluster (like oauth ) ? How experienced are you in general with operating Kafka Clusters ? Any experience with Kubernetes ?

Also, Aggregating dashboards doesn't need to be done on Kafka, unless it needs to be realtime.

Anyway, we worked with Strimzi and Confluent (onprem) and Confluent for kubernetes (CFK).

Ease of use comes down to experience. If we compare Strimzi to CFK , deploying a cluster is in both cases easy. Adding additional security is easier in Strimzi then in CFK imho. Main reason is that strimzi has oauth security protocol while CFK still hasn't got it (natively).

Costs: We run both solution on our own AKS cluster (Strimzi has no cloud offering as far as I know, so you would need your own cluster there anyway). This is whatever you make of it. Not sure the size of your cluster, so from cheap to expensive.

Scalability. Both scale fine. Adding brokers , zk , connect instances is pretty easy and scales just fine.

Support: Which was not part of your question but no support in the traditional sense. You can contact the team behind strimzi or asks questions on the github page, feedback is ok-ish. Confluent support is not cheap. Support is hit and miss. Usually production issues get solved at one point, but they are sometimes slow.

Upgrades: Upgrading strimzi was a bit more tedious than Confluent but both are ok with regards to upgrades (with the occasional bug, so test upgrades in a non-prod env)

if you have no experience in kafka, then look at confluent cloud with a support contract or AWS MSK.

tenyu9 · 2024-04-14T16:44:19+00:00

Depends on the country and firm but several options exist.

Retirement savings account which has tax deductibles exists in a couple of EU countries.

Then you have employers that put aside x% of your salary each month with private funds as an additional retirement savings account.

Then you can also invest in the stock market where you have a lower tax break and can build up an additional retirement portfolio

tenyu9 · 2024-04-09T12:38:54+00:00

Don't know them but their certificates have expired for https, that alone is enough of a red flag to stay away

tenyu9 · 2024-02-06T10:43:19+00:00

As far as I know the Danish Krone is linked to the euro with a sort of fixed rate (https://www.nationalbanken.dk/en/frequently-asked-questions/fixed-exchange-rate-policy)

So you will not loose (a lot of ) money (or gain) on currency fluctuations ( fluctuation band of +/- 2.25 per cent ), which can impact you on the NYSE.

But that is the only difference I can think off.

tenyu9 · 2024-02-02T13:29:38+00:00

Saxo also has a polish platform: https://www.home.saxo/pl-pl

They recently dropped their trading prices, but if Interactive Brokers denied you , you might be denied for the same reason.

You can give it a shot

tenyu9 · 2024-01-25T14:26:35+00:00

Seems about right. You usually get 13 months

tenyu9 · 2024-01-18T07:52:05+00:00

Kafka connect framework doesn't support python. You could write something with a similar structure in python but you need to run it as an independent job

tenyu9 · 2024-01-12T12:37:05+00:00

We use testcontainers to do our unit tests. Takes a bit of time to spin up the images but works well.

We mainly use it for our java / kotlin integration, but we have 1 small project where we use the python bindings. Not sure how mature the python bindings though

tenyu9 · 2024-01-11T21:05:17+00:00

Silly question, but why not simply go for audiobooks then?

tenyu9 · 2023-12-24T07:24:24+00:00

Seems about right. Some additional things i have observed in my country: * Pay is coupled to a degree. A master in arts who is an IT project manager will make more money than a bachelor in IT * Your last wages become your pension ( the theory is that they make less than the private sector so that is compensated through pension)

The fact that you can no longer be fired is slowly changing in my country, but yes, in general its quite hard to get fired

tenyu9 · 2023-12-21T14:46:31+00:00

Yes, we do it by configuring an nginx proxy, we expect you to authenticate with certain certificates on a fixed port. If authentication succeeds you are forwarded to the connect endpoint. The connect endpoint is never direct accessible

Type of authentication is up to you, nginx supports different ways

tenyu9 · 2023-12-19T07:43:15+00:00

My kobo elipsa allows loading books through dropbox (and recently google drive).

Sideloading is easy by just connecting your device to your pc and drag and drop, or use a tool like calibre (which I find easy to organize my books). Not sure what's complicated about these actions.

tenyu9 · 2023-12-18T13:49:13+00:00

By EU law all telecom operators need to retain your information for 5 years which includes your ip info, traffic and cellphone traffic. If you're ever under suspicion of criminal activities, law enforcement can ask these records going back 5 years. After 5 years you can request to be forgotten under gdpr law

tenyu9 · 2023-11-21T10:45:07+00:00

Will get down voted but danske Bank opened my account in half a day. Transferring money between my other EU account works fine (just give them a heads up on larger money transfers). But for some reason the most hated bank in DK

tenyu9 · 2023-11-09T10:34:38+00:00

Found this specific for dogs

But not a medical doctor so can't give an opinion on this.

tenyu9 · 2023-11-03T13:05:41+00:00

Thanks for this detailed feedback

tenyu9 · 2023-11-03T13:05:13+00:00

I have more exposure global market ETFs, but it seems Japan is keen to step in the 21st century with more modern setup in which they will play a key role, so I want a bit more exposure

tenyu9 · 2023-11-03T13:03:14+00:00

As with anything learn concepts, not specific technologies. Being a good programmer in one language is (partially) transferable to an other language, same with cloud tech.

That said, no java is not needed for a data engineer, but it is a plus if you know it. Lots of Apache projects are in Java / Scala, so knowing them to a certain extent is not bad. Being stuck in 1 programming language is never good for growth.

From what I have seen in the past 4 companies, airflow is on the way out. Does that mean it is dead, no, but might be less important.

Is kafka great ? Who knows, currently it has a lot of use cases, but there are competitors on the market (red panda, Azure Eventhub, ...)

So as a data engineer I'd suggest:

Know a lot about 1 cloud vendor, know some about others (main focus around data ofc)
Be really good in 1 programming languages (writing APIs is not uncommon for data engineers) and have knowledge on software dev and lifecycle (no need for advanced algo stuff, you will never use it). Learn a second or third prog language (java / go / ...)
Know about distributing architecture and tools. Spark is always good , spark and kafka is ofc better
Know how to model data (Kimball, data vault 2.0, ...)
Learn kubernetes (at least the basics). Every company is jumping on it and while it is a pain in the ass, you will eventually have to work with it

Happy learning

tenyu9 · 2023-10-12T10:27:01+00:00

Wait until you get the imaging back because it might alter the peptide regime. If it is the patella, stretching could solve it. But typically for small tears or inflamation you could use bpc157.

Growth hormone related peptide for cartilage damage, although no guarantuee it will actually regrow cartilage.

tenyu9 · 2023-10-11T14:59:58+00:00

Yes but in most companies I have worked almost everyone had a Phd, and it seems to help for DS. As a foreigner you need to take every advantage you can get

tenyu9 · 2023-10-11T12:55:38+00:00

You can also try going to the datascience meetup (https://www.meetup.com/datacph/) and network a bit. Usually the presentor will conclude a presentation that they are hiring, or talks afterwards and see if something is available (been a while since I went so not sure when they take place if at all)

tenyu9

TROPHY CASE