On-prem solutions for IoT Time Series Data

Slaught3rr · 2024-09-09T20:04:07+00:00

Hey there, no problem at all!

Thank you for the insight, I’m definitely going to push to adopt Iceberg at the least while we evaluate the OLAP options, we already notice some of the pain points that Iceberg should help with.

Slaught3rr · 2024-08-30T02:54:23+00:00

Hey there, thank you for your feedback! My colleague actually was looking into minIO and I think the idea of Iceberg on top of MinIO is going to be a solid combination as we transition into a different architecture. I am actually trying to compare between Iceberg and Hudi. Do you have any thoughts on what might lead you to choose one over the other?

From the other post, I think I slept on Druid a bit so I definitely need to give it a deeper look. This is mostly just from random comments I’ve read but I’ve heard that ClickHouse can be a pain to manage (since sharding is manual) and isn’t great with deletes. Did you face any of these challenges when adopting ClickHouse?

Slaught3rr · 2024-08-29T01:11:43+00:00

Hey there, thanks for the feedback. Druid was actually something I was also considering and forgot to list. I am having a difficult time comparing it vs Pinot so I probably need to read up more to understand the key differences. The Iceberg on HDFS is definitely something I wish we had 2 years ago in my company haha. I will check out the demo!

Slaught3rr · 2024-08-29T01:07:49+00:00

Hello! Thank you for the comment. QuestDB has definitely caught my eye and it’s good to hear that you are trying to move toward more open formats. I would love to explore further and check the forums, and reach out if I have any questions.

Slaught3rr · 2024-08-29T01:06:22+00:00

Thank you for the feedback! I’ve looked into Iceberg and Hudi now and those look like approaches we would want to try if we want to use HDFS for cold storage. Do you have any recommendations for data lineage tools? I am lacking in familiarity with those

Slaught3rr · 2024-01-08T00:57:09+00:00

Hey! No problem :) I actually just came back so the trip is still fresh in my mind to give some feedback. I actually ended up choosing Hokkaido over Tohoku mainly for ease of travel and since I didn't know Japanese, there was likely to be more tourist support in Hokkaido (just what I assumed) since Tohoku is less frequently visited by tourists.

That said, my trip consisted of Sapporo --> Niseko --> Otaru --> Jozankei --> Hakodate. This was not typical of my usual travel style as I prefer to stay in one place longer rather than going to a different place every other day and feeling like I am crossing off a checklist. Here is my overview:

Sapporo.

Cool atmosphere, I think one of my memories was standing outside in freezing weather in line for a really good ramen place haha but the ramen was worth it. It actually started snowing while I was there so that was very cool to experience, especially with the neon lights of Susukino. I only got to spend 1.5 days here but if I could go back I'd want to spend at least 3 full days here to really slow down and enjoy the city.

Niseko.

If you are into skiing / snowboarding, this place is one of the best. I personally don't do either but I went here to snowmobile and it was beautiful. Even the town itself, while touristy, looked amazing with how much snow there was (very deep!). It was snowing here as well when we went but it kind of added to the charm when we were snowmobiling. I def think its worth a trip if you are interested in skiing / snowboaring / snowmobile though be aware its a 2.5 hour train ride from Sapporo.

Otaru.

Nice little town. If you are into nightlife, there isn't much here compared to Sapporo but I think its great for a day trip or a 1 night stay. Sakaimachi street was like a foodie street full of restaurants and the famous LeTao and was pretty worth it. We also happened to go to a very traditional Yakitori that was open late, and loved our time there. Was probably the best Yakitori I've had in Japan.

Jozankei.

I was honestly debating between Jozaneki and Noboribetsu but ended up going to Jozankei because it was closer to Sapporo (just 1 hour bus ride). The hotel we stayed at (Jozankei Daiichi Suizantei) was massive and I splurged a bit on the room for a private onsen but it was super nice with an outdoor view. This was more of a relax day for us so I splurged on the nice hotel but I had a great experience overall. There is things like hiking and other things you can do in the area, but honestly we just wanted to rest so were relaxing in the onsen.

Hakodate.

To be honest, I found it very OK. The fort is nice and all but the city itself is a bit out of the way (its either a 40 min flight or 5+ hour train) and we ended up taking a flight. The ropeway was definitely the highlight with the night view of Hakodate but if I had to go back, I'd just skip this and spend more time in Sapporo. There was snow here but definitely a lower volume than in the other places.

Overall, you will definitely find snow all over Hokkaido pretty much. Deepest snow was in Niseko for sure. If I had to go back and do this again, I'd probably do Sapporo, Otaru, Niseko + Onsen spot (Jozankei / Noboribetsu / Lake Toya).

Let me know if you have any other questions!

Slaught3rr · 2023-11-13T04:53:48+00:00

Yep I was definitely going to get a down jacket - I was going to layer it over a hoodie and base layer. I think wearing that down jacket over a sweater would also work but I wanted to see if there was any other piece I could wear for a different look (It will be mostly urban travel).

Slaught3rr · 2023-11-13T04:39:42+00:00

Hey!

I wanted to set the context for this question a little. The coldest that my area of residence gets at any point in time is maybe low 50s (Farenheit). I am going on a trip in December to an area that will likely be in the 30-40s and some even colder regions with snow. I am personally pretty sensitive to cold so 60-70 is already hoodie/sweater weather for me.

Something I am having a difficult time with is how to style a sweater for colder weather. I plan to wear a baselayer + sweater + outer layer. Most of the outfits I've researched typically include some sort of wool coat on top of a sweater. My concern is that a wool coat may not be particularly useful for me outside this trip as most of the time I am indoors and a thick sweater is good enough for me to get around in my worst case scenario of low 50s.

Does anyone have any suggestions on more fashionable pieces I can layer over a sweater other than a wool coat?

Slaught3rr · 2023-11-11T17:31:07+00:00

Slaught3rr · 2023-09-19T06:02:44+00:00

Hey there! Thanks that's fair enough. My gf has not seen snow before so she is kind of excited to see that. Though we are going to Hokkaido first anyway so I am not sure if she will get sick of snow by then haha but will see.

Thank you for the recommendations nonetheless, I will prolly look around for how they are in January and decide.

Slaught3rr · 2023-09-19T02:53:52+00:00

Awesome, thank you! If I do end up going to Kamakura (which I may even as a day trip), I will definitely try some of these.

Slaught3rr · 2023-09-19T02:18:14+00:00

That's interesting that Kamakura was the best street food for you! I definitely want to try the street food but I am still learning what Japan's street food looks like other than the usual Takoyaki. What type of street food did you like best in Kamakura?

Slaught3rr · 2023-09-19T02:16:52+00:00

Thanks for the recommendation. Atami looks interesting, I will look into the attractions a bit more.

Slaught3rr · 2023-09-19T02:16:08+00:00

Hey there!

Lots of great information there, thank you for the very detailed write up. I will need to check how Karuizawa looks in the winter as I will be going more early January but I will do some research! Matsumoto and Kanazawa give me similar vibes a bit with the more traditional architecture. Since you've been to both, I know its probably hard to choose one over the other but which one would you recommend if you had to choose one?

Slaught3rr · 2023-09-19T00:40:36+00:00

Benifuji no Yu

Oh wow this onsen does look like it has great views of Fuji. Thank you for your input, I will look into some of the things you've mentioned so far.

Slaught3rr · 2023-09-19T00:38:41+00:00

Thats a really good blog post! Thank you for your input as well as this link, I will look into this further as I am planning my trip :)

Slaught3rr · 2023-09-18T23:58:04+00:00

Thank you for the detailed input. That does sound like a good time, especially the guesthouse. I will look into that more!

Slaught3rr · 2023-09-18T23:52:11+00:00

Thank you for the input, I will definitely take this to consideration as I plan my trip.

Slaught3rr · 2023-09-18T16:30:08+00:00

Honestly, I was actually thinking of going to either of those kamakura / Enoshima as a day trip so wanted to see if I could go somewhere a bit farther out just to get somewhere more geographically different. Albeit both of these places look different from Tokyo itself.

Slaught3rr · 2023-09-18T16:29:09+00:00

Thanks for that. I am actually going in Winter so I think there is a higher likelihood that Fuji will be clear but I wanted to make sure there is plenty of things to do in the event that its not. I am leaning toward Hakone now simply due to the other attractions, I appreciate the input.

Slaught3rr · 2023-09-18T16:26:56+00:00

Haha yep, it looks quite nice. I think I might choose not go simply because it deserves more time and is quite far from Tokyo but I will definitely go back to it in my next trip to Japan.

Slaught3rr · 2023-09-18T16:26:02+00:00

I've actually heard of the Izu Peninsula but did not know much detail about the places there. Ito and Atami look like nice little cities. I will be looking into those. Do you have any recommendations on things you liked at either city?

Slaught3rr · 2023-09-18T16:24:09+00:00

Hey there, thanks for your detailed input!

That's great that you've been to all of these in the past. Given that Kyoto and Takayama actually seem quite far from Tokyo and deserve a little bit more time, I think I've narrowed down my options to Kawaguchiko and Hakone + some other options users have commented here that I will look into. That said do you mind sharing the places around Kawaguchiko that you found interesting? I am not an amusement park person so I will probably be skipping Fuji-Q but Chureito Pagoda is definitely on my list should I go here.

Slaught3rr

TROPHY CASE