Efficiency

Benchmark

Latency, throughput and memory of one prompt.