Show HN: Tensward – Local AI inference optimisation

Tensward is an Apache-2.0 tool that measures how your LLM is served on your own machine by starting its own copy of vLLM or llama.cpp on a local port, sending a realistic workload, and reading engine and GPU metrics. It offers one flag change at a time, measures it, compares answers before and after, and keeps the change only if it is faster and the answers pass your check; it never stops or reconfigures your running server. It supports NVIDIA and Apple Silicon hardware, and the post includes two L4 case studies showing gains such as +40% requests/s and first word −47% on llama.cpp, and first word 19 s → 0.30 s on vLLM.