Cysic (@cysic_xyz): 1/ A tokens-per-second number means very little without the setup behind it.
Estimated coin impact
Scores are not price-change percentages. High impact means a score of +70 or more, or -70 or less.
Impact unavailable
1/ A tokens-per-second number means very little without the setup behind it. Which GPU? Which model? What quantization? What serving engine? What context length and concurrency? Introducing InferBench, an open benchmarking platform for LLM inference from Cysic AI.