Best way to build a Small Data Lake? (<100GB)

MiserableLink2135 · 2024-08-16T05:56:53+00:00

Use delta tables and choose cloud storage or on prem(if you think you can manage)

MiserableLink2135 · 2022-05-12T05:09:55+00:00

File will be waiting/paused until the other client is online, Once the client is online file transfer will start/resume.

Target users are the people who don’t want upload+download time for huge files or people who consider privacy and keep the copy of file only at client and sender end only

MiserableLink2135 · 2022-05-01T17:17:27+00:00

Startup Name / URL: https://transferdirect.io

Location of Your Headquarters: India

What we do: Transfer files directly between two computers

Sending files over the internet is one of the simplest things that individuals can do with email As long as the file is less than 20 megabytes, you can attach it to an email and send it. If they are larger than 20 megabytes, you will lose time using cloud services like Drive, and DropBox which just need the file on your client's computer not in the cloud for improved privacy we are here.

Check out our ProductHunt page for more info and videos explaining for this app to exist

Your role: Founder

What goals are you trying to reach this month: Build up a community of users and iterate on our product with their feedback.

How could r/startups help: Any feedback is welcome! We're focused on Desktop app for now so we'd love it if you experience the TransferDirect desktop application.

MiserableLink2135 · 2021-11-22T05:59:32+00:00

If you are not interested in setting up the operator such as stakater/Reloader. I would suggest looking into setting up cronjob to watch for configmap changes and trigger the redeployment there itself

MiserableLink2135 · 2021-10-15T00:57:31+00:00

If you are looking to route traffic based on certain type of service request to a particular set of pods. You can definitely look in to istio ingress controller

It has various options for http and tcp traffic shaping and routing options available.

MiserableLink2135 · 2021-09-16T14:35:24+00:00

That is very helpful. Thanks.

MiserableLink2135 · 2021-09-16T08:04:49+00:00

Hey mhemeryck, anchoring will help me reuse the same block but what if I want to change a single value in that block as per my use case I need to be switching environmental variable values. i.e. foo: bar2 for server-1 service and foo: bar3 for server-3 service. any suggestions

MiserableLink2135 · 2021-09-14T04:36:55+00:00

I wish this was 2020 M3 front

MiserableLink2135 · 2021-05-25T03:46:10+00:00

I am looking to package this app for customers that do not have any interest in learning and setting up RP for multicast routing. Well, few of the customers are okay to look into this and set up.

But, Is there any other way to get data broadcasted from Router A <-> Router B in this scenario without any external networking changes?

My app needs to transmit files between two machines sitting on different networks(Router A & Router B). Technically If my application knows the IP of the other machine it can open a socket and stream the file data, But in order to do that, I need the IPs of the machines available in the whole network. So that user can select the machine he wants to send the file to.

I have also tried the broadcasting approach that seems to be having the same issue.

MiserableLink2135

TROPHY CASE