The fastest LLM inference on Bittensor

Llama 3.170bMeta

Tokens/s (Average):

80

Tokens/s (Max):

120

Knowledge Cutoff:

2023/12

Inference:

Subnet 19