error loading model with onnxruntime-genai 0.4.0
#5
by
Shir2
- opened
which minimal version are required?
I have onnxruntime-genai 0.4.0 onnxruntime-gpu 1.19.2
try to load onnx/model_q4.onnx
I added genai_config.json to define max_length
and still got error Unrecognized attribute: softcap for operator GroupQueryAttention
Edit:
it show the same error for every models in this ripository
You should upgrade your onnxruntime version :)