Spaces:

Ahmadzei
/

RAG

Runtime error

added 3 more tables for large emb model

5fa1a76 over 1 year ago

130 Bytes

	But for BLOOM inference -
	which is a very large model - dynamic batching is essential to provide a decent experience for everyone.