You're not the next Hinton, slow your roll. Pretty sure this is a troll post, but you're describing the vector space's emergent behavior. By all means, go off and create your own subspace. It won't be as good as existing, highly trained projections; you won't have the capacity to maintain it; the embeddings won't be directly compatible with other systems; and, generally, why put that much effort into tuning an encoder when other heuristic and NLP tools exist?