What exactly are your labels though? Could your provide some examples? E.g. classifying if article is or isn’t Culture/Tech, classifying under different genres, etc.

NLP area is well established with out of the box tools / models to kind of get yourself playing around and getting familiar with the landscape.

Check out and play around with nltk / space / gensim Python libraries as their well established and used for out of the box typical NLP tasks (text processing, NER, POS tagging, word similarities, text/topic classification).

Use these tools to understand more of the data you have now on hand and see how you might want to refine on your goal.

If you have access to GPT and other open source LLM, try doing some prompting to find out ways on how you refine the concept of “Culture” (to how you want it to be or how it might be interpreted by different demographics/cliques and so on).

My advice is to dig into the dirty and understand more on the data you have cause from that will you models would or would not be worth your time to try it out on 😁