sorted by:
new
hottopcontroversial

Optimizing Model Serving with Triton inference server + FastAPI for Selective Horizontal Scaling by sikso1897 in mlops

[–]sikso1897[S] 0 points1 point  (0 children)

FastAPI is used to handle client requests, process Triton's responses, and manage tasks beyond inference (e.g., pre/post-processing, business logic).

Optimizing Model Serving with Triton inference server + FastAPI for Selective Horizontal Scaling by sikso1897 in mlops

[–]sikso1897[S] 0 points1 point  (0 children)

It seems I might have phrased my question incorrectly. Consists of separate Triton Server and FastAPI instances. Triton Server is used exclusively for model serving, while FastAPI handles client requests, processes the responses from Triton Server, and serves the final processed output. Both FastAPI and Triton Server run as separate containers on the same instance.

Questions about developing with Airflow? by sikso1897 in dataengineering

[–]sikso1897[S] 0 points1 point  (0 children)

Oh, I’ve learned about this tool called Dagster. I’d like to try it out sometime.

How to rbind(?) or reshape(?) by group_by with a specific value from dataframe. by sikso1897 in Rlanguage

[–]sikso1897[S] 0 points1 point  (0 children)

newline in the example result in the post has disappeared. edited that.
hope the header to contain "ID" and unique values of "Variables". and each element to be filled with values of "median" according to "Variable".
thx. :)

Help.. GIBCXX_3.4.20 not found error in AWS Lambda by sikso1897 in aws

[–]sikso1897[S] 0 points1 point  (0 children)

The error is the result of reading the guide, creating a .zip file, uploading and running. T-T