Fix: move inputs to model device in inference example to avoid "same device" error (#3)

- Fix: move inputs to model device in inference example to avoid "same device" error (4b7f02d89f665c18ba33f62aabe6396d83e567b9)


Co-authored-by: Lim Seong Geun <[email protected]>

README.md

@@ -116,6 +116,7 @@ inputs = processor.apply_chat_template(
     return_dict=True,
     return_tensors="pt"
 )
+inputs = inputs.to(model.device)
 
 # Inference: Generation of the output
 generated_ids = model.generate(**inputs, max_new_tokens=128)