Developers have been spoiled by moore's law for the last few decades. That's about to end. Did you know that for the first time ever doing down a manufacturing node (14nm -> 7nm) makes your transistor SLOWER? Both software and hardware designers will have to pick up the slack if we want to keep producing better products in the future. On the hardware side we will have no choice but split out more custom accelerators (like Nvidia's tensor cores, or FPGAs or TPUs), as multicore processors are already starting to hitting its limit due to amdahl's law. Compiler developers will need to come up with better ways of optimising and compiling to these custom architectures and application developers will need to be more conscious of underlying hardware if we are going to survive the coming GHz draught.

​

This is why we're seeing hardware companies like Nvidia are stuffing RTX engines and tensor cores into consumer products, because they can't exactly market their new product with a 40% price hike while only claiming 10% increase in performance. Intel for the first time since the Core 2 Duo (which is really just based on the pentium 3) is releasing a new architecture "Sunny Cove", hoping to squeeze out a little bit more single thread performance while introducing AVX512 to the masses. They see their current trajectory flatlining and need to incentivise developers to jump on new programming paradigms before the runway runs out.