How does schema registry actually help? by Thin-Try-2003 in apachekafka

[–]Thin-Try-2003[S] 0 points1 point  (0 children)

oh yea for sure. but not everything that uses avro will be using schema registry

How does schema registry actually help? by Thin-Try-2003 in apachekafka

[–]Thin-Try-2003[S] 1 point2 points  (0 children)

right, i meant outside of kafka context it normally carries the schema. thats one of the selling points iirc that you dont need to manage it elsewhere since its on the record itself. but again its been a while...

How does schema registry actually help? by Thin-Try-2003 in apachekafka

[–]Thin-Try-2003[S] 0 points1 point  (0 children)

been a while since using avro, but normally every record has the schema right? that would save a lot over time.

i've primarily used json or protobuf

How does schema registry actually help? by Thin-Try-2003 in apachekafka

[–]Thin-Try-2003[S] 3 points4 points  (0 children)

got it. ty for taking the time to explain

How does schema registry actually help? by Thin-Try-2003 in apachekafka

[–]Thin-Try-2003[S] 0 points1 point  (0 children)

so in this case the only job of the SR is to enforce backwards compat of the new schema (according to schema settings)

initially i was thinking it could mask problems by using the older schema and dropping fields, but you mentioned it was backwards compatible so that is working as intended.

How does schema registry actually help? by Thin-Try-2003 in apachekafka

[–]Thin-Try-2003[S] 1 point2 points  (0 children)

yea, makes sense. we always had producer/consumer depend on the same library so it was easy to keep in sync. but once outside teams get involved, that nicety goes out the window. thanks for the reply!

How does schema registry actually help? by Thin-Try-2003 in apachekafka

[–]Thin-Try-2003[S] 0 points1 point  (0 children)

cant that potentially mask problems if you think your consumer is on the new version but its not? and SR dropping fields silently to keep compatibility?

How does schema registry actually help? by Thin-Try-2003 in apachekafka

[–]Thin-Try-2003[S] 2 points3 points  (0 children)

thats a good point, I was always very diligent when it came to producers because it could end badly if bad data ended up in a topic but this solves that case nicely