- Use golang:1.23-bookworm as builder
- Use debian:bookworm-slim as runtime
- Use github.com/yalue/onnxruntime_go for ONNX inference
- Use github.com/sugarme/tokenizer for tokenization
- Download ONNX Runtime v1.27.0 shared library
- Download model.onnx and model.onnx_data from onnx-community
- Support API_SECRET environment variable for authentication
- Final image size: ~266 MB
Generated by Mistral Vibe.
Co-Authored-By: Mistral Vibe <vibe@mistral.ai>
