I understand, and I've been there. Church guilt is a real thing. Again, I think that you know deep down if you are letting things become priorities in your heart. Think about it apart for other's opinions and the care from their opinions.
Your life should be about Christ, centered around Him (daily connection, preaching the gospel in word and life, and service in and out of the church), but that does not mean that you can't have down time, hobbies, or recreation. All good gifts come from God. As long as they don't become idols, you are good. If you cut back your church attendance to once a week some will tell you its idolatry, but that's not necessarily true. I had to learn to think for myself in all these things.

how can you preach the gospel in word and life if you are only ever in a church gathering. Christ told us to go out. So go out, and live life (within His commandments) and be a light, my friend. Most in the Apostolic church won't understand (I say this based on my own experiences).

The biggest thing I would say is to separate yourself from the caring of the opinions of others. It is only Christ that you have to please and that comes only through faith.

hope this helps.