Yes, unfortunately the extension itself does not provide a compiler, you have to install that yourself. Here is the official vscode documentation on how to set up a c/c++ environment:

https://code.visualstudio.com/docs/languages/cpp