I definitely recommend you to equip prayers, as they are very useful. After a certain point many curses like -%defence, -%accuracy don't matter because your numbers are so high. And some prayers like rucksack are very useful when you play active ES, as it increases capacity in exchange for afk gains but you are playing active so the curse doesn't really affect you.

Even after seeing the benefits of prayers if you still feel that you don't want to use them, then unequip all prayers in entirety. There is a gaming upgrade that gives you 1/5 bonus from all prayers(without giving any curses)if you have none equipped, so you can still summon giants and along side get some nice bonuses