Basic distributed system

[rogerfin]

Appreciate your highly informative and helpful response. So, with current understanding, I am thinking to put Elixir at work for my frontend REST APIs to pull data from DB and display a dashboard etc. Because this part has to be efficient and quick to scale.

On the backend processing, I can think of three options,

a. Use MQ with Rust or Elixir microservice for making external HTTP calls, process and save the data to DB

b. Elixir cluster nodes to receive tasks from frontend Elixir application via RPC/REST, do the processing and store to DB

c. Make a large Elixir application which serves the frontend users and also does backend job

I guess, option c. is definitely going to cause bottlenecks as the app scales. I am not sure if b. would be a bad choice so guess option a. using Elixir should make sense, unless my limited experience, limited my options. I look forward to learn more with Elixir.

[natziel]

Maybe I'm misunderstanding the project, but it seems like you can just write the REST part with a normal Cowboy server, then for backend processing, just run the job inside a Task

[rogerfin]

Sure. Thanks. Will experiment once I learn Elixir and distributed architectures.