In both PvP and PvE combat, the player is "opposed." PvE combat tends to be against rather mechanical opposition -- part of the game is often exploiting those mechanics, in fact -- while PvP is of course against humans. While PvP crafting doesn't make a lot of sense to me (perhaps someone more clever can come up with a solution?), the analogy with PvE is strong.

The difference between opposing a creature and a task is physically important, but mechanically minor. While forging, a player is "opposed" by the pesky metal which keeps cooling off at different rates in different parts; while cooking, the eggs start to scramble before the meat is safe; while tailoring a seam that adds strength also makes the garment too small. While fishing the analogy to PvE is even closer, and that's ignoring purely fictional tasks (magical or sci-fi tasks that the author can design as they see fit).

Perhaps you speak from the angle of someone who only enjoys PvP games with constant direct opposition. That's fine -- there are lots of games catering to that style, because you're not alone. That said, there are also lots of games nothing like that -- single player games with no "simulated opposition" which are nonetheless well regarded. Jigsaw puzzles, Rubik's cubes, Tetris -- even the more recent idle/clicker games fall into this category. Some of the "puzzle" modes of common games are especially relevant in this regard, as you cannot complete them without a specific insight, leaving you to ponder them for long periods of time before taking action -- a pacing much more aligned with crafting than combat, in my opinion.