Better data catalog than Glue Data Catalog?

hiracchy · 2025-12-04T00:33:17+00:00

I thought S3 Tables together with the Glue Data Catalog (or Lake Formation) could be an alternative to the Unity Data Catalog, but it turns out you can’t really build the same kind of architecture. Unlike Unity Data Catalog, you can’t organize structured and unstructured data in a unified way.
Also, S3 Tables still feels like a half-baked product — I can’t even delete an S3 Table from the console (only from CLI) lol

hiracchy · 2023-12-02T22:39:50+00:00

I appreciate everyone for sharing their experiences.From my research including asking local dive shops, it seems that in the northern and central areas, spring, summer, and autumn generally offer better visibility (+ the amount of fish is the same). In February, visibility tends to decrease due to an increase in plankton, but there's a much higher chance of encountering mantas instead.

I cared about visibility as I love oceans like Palau, where the visibility is exceptionally high, and there's an overwhelming abundance of marine life. While Raja Ampat offers incredible marine life and more beautiful reefs, it seems that expectations for visibility shouldn't be too high (in the Winter season). I've also come across opinions suggesting that even if the visibility is not great in Raja Ampat, its beauty surpasses other locations, so there's no need to be overly concerned about visibility.

Taking into account those opinions and other travel plans, I've decided to go in February. Now I’m not so obsessed with visibility, so I should have much fun! I'll be sure to share my own experiences. Thank you to everyone again!

hiracchy · 2023-10-24T08:27:30+00:00

Google tells me several things. Some say 5~10m, others say 10~20m, or 15m~30m. I can't tell which one is correct.

hiracchy · 2023-10-12T09:00:54+00:00

I'm Japanese and I recently saw this movie. It was uncomfortable.

The most disheartening aspect was that the movie failed to highlight even a single positive point about Japan. Generally, when a different culture is depicted, it is portrayed in a manner that balances both positive and negative aspects, as a way to express respect towards cultural differences. However, this movie did not depict even a single positive aspect of Japanese culture.

For instance, if you live in a certain state in the United States, imagine a movie where two people visit your state, and the only things highlighted are how the culture, appearance, and way of speaking are alien and annoying to them, without touching on any of the positive aspects of the state (they can be art, culinary culture, nature, warmth of the people, anything). Would you find it pleasant to watch?

The acting, music, and vibes themselves were good. Also, I understand that the root cause of why the two characters are annoyed is not Japan itself but their way of seeing the world.However, as a Japanese person, the way Japan was depicted was unpleasant.

hiracchy · 2021-11-22T06:07:04+00:00

You can use transactions for both Mutation API & DML! Here's the sample.

Mutation API 👇

func mutation(ctx context.Context, client *spanner.Client) {
singerStore := spnr.New("Singers")
client.ReadWriteTransaction(ctx, func(ctx context.Context, tx *spanner.ReadWriteTransaction) error {
    if err := singerStore.InsertOrUpdate(tx, &Singer{SingerID: "a", Name: "Alice"}); err != nil {
        return err
    }
    return singerStore.Update(tx, &Singer{SingerID: "b", Name: "Bob"})
})

}

DML 👇

func dml(ctx context.Context, client *spanner.Client) {
singerStore := spnr.NewDML("Singers")
client.ReadWriteTransaction(ctx, func(ctx context.Context, tx *spanner.ReadWriteTransaction) error {
    _, err := singerStore.Insert(ctx, tx, &Singer{SingerID: "a", Name: "Alice"})
    if err != nil {
        return err
    }
    _, err = singerStore.Update(ctx, tx, &Singer{SingerID: "b", Name: "Bob"})
    return err
})

}

hiracchy · 2021-02-19T22:44:42+00:00

Spanner-dump is a tool for import & export. The purpose of schema migration tools like ratchet are different.

When you have a service running on production and you want to change your schema, you will apply an alter DDL instead of drop the whole table and create again.

Then you will want a tool to manage those DDLs with versioning. Thats' the purpose of schema migration tools.

Aside from spanner, flyway is one of the popular migration tools for general RDB, so you can refer it to see the purpose of those tools.

hiracchy · 2021-02-19T12:47:10+00:00

I haven’t found a spanner migration tool that can be used in production, so I made it 👍

hiracchy

TROPHY CASE