llmperf

fix: subsequent requests cannot be sent until 'num_concurrent_requests' requests have all finished in non-block mode (#59)

improve benchmark tput by moving prompt preparation outside of loop (#54)

Fix decoding throughput computation (#45)

Fix Installation instructions in README.md (#26)

Fix typos and add caveats (#27)