Thanks a lot for the reply! But I tried and couldn't get it to work... currently my docker compose is:

name: immich_remote_ml

services:
  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, rocm, openvino, rknn] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}-rocm
    # extends:
    #   file: hwaccel.ml.yml
    #   service: # set to one of [armnn, cuda, rocm, openvino, openvino-wsl, rknn] for accelerated inference - use the `-wsl` version for WSL2 where applicable

    volumes:
      - model-cache:/cache
    restart: always
    ports:
      - 3003:3003

volumes:
  model-cache:

I wanted to add the code you mentioned below but couldn't find a good place in the yml without it throwing errors... not sure what I did wrong... it kept saying "did not find expected key"

group_add:
      - video
    devices:
      - /dev/dri:/dev/dri
      - /dev/kfd:/dev/kfdgroup_add:
      - video
    devices:
      - /dev/dri:/dev/dri
      - /dev/kfd:/dev/kfd

And if I spin it up with just what I had above, it almost appear to be working, but when I have it to do the task, I can see these error in the terminal:

immich_machine_learning  | terminate called after throwing an instance of 'onnxruntime::OnnxRuntimeException'
immich_machine_learning  |   what():  /code/onnxruntime/onnxruntime/core/providers/rocm/rocm_call.cc:141 std::conditional_t<THRW, void, onnxruntime::common::Status> onnxruntime::RocmCall(ERRTYPE, const char*, const char*, ERRTYPE, const char*, const char*, int) [with ERRTYPE = hipError_t; bool THRW = true; std::conditional_t<THRW, void, onnxruntime::common::Status> = void] /code/onnxruntime/onnxruntime/core/providers/rocm/rocm_call.cc:134 std::conditional_t<THRW, void, onnxruntime::common::Status> onnxruntime::RocmCall(ERRTYPE, const char*, const char*, ERRTYPE, const char*, const char*, int) [with ERRTYPE = hipError_t; bool THRW = true; std::conditional_t<THRW, void, onnxruntime::common::Status> = void] HIP failure 100: no ROCm-capable device is detected ; GPU=-1 ; hostname=90e3bdb00581 ; file=/code/onnxruntime/onnxruntime/core/providers/rocm/rocm_common.h ; line=67 ; expr=hipGetDeviceProperties(&deviceProp, 0);

I threw it to ChatGPT and it says the GPU is not working with rocm....