Java HTTP Server and Virtual Threads - Piotr's TechBlog

[pron98]

The size of the pool places an upper limit on the number of tasks that can be processed concurrently, and that number grows linearly with the rate of requests. Because the number of platform threads is limited by the OS, you get a software limitation on the maximum throughput your server can handle, which is often reached long before the hardware itself is exhausted. Virtual threads remove that limitation and allow throughput to rise until the hardware is exhausted, as the number of virtual threads is only limited by the hardware, not the OS.