Ryan Rozanitis

ryan-rozanitis-bd's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in solidrust/dolphin-2.8-mistral-7b-v02-AWQ 7 months ago

Performed my own Quantization, now encounter an error while running inference with vllm.

1

#1 opened 7 months ago by

ryan-rozanitis-bd

New activity in dphn/dolphin-2.8-mistral-7b-v02 7 months ago

Finetune and Quantize with AWQ

#13 opened 7 months ago by

ryan-rozanitis-bd