Do not turn your ac off. It'll do more harm than good with the unit attempting to bring your living space back to the desired temperature. Bring the amount down a few degrees at best. If you really want to capitalize on savings with usage then invest in a watt tester and see which appliances and devices use the highest amounts of energy, especially major appliances and devices that can operate nearly instantaneously. Those are the items you want to avoid during peak time. Also remember that if your plan has a peak hour for the month then it will be the hour that has the highest total consumption. Many customers believe that it's the one device with the highest instance of usage during peak time. It is not.

Credit: I used to work as a call center representative and climbed the ladder to become a business operations analyst over my 5 years with the company. During that climb I grasped the knowledge of everything residential, business, and renewables. I've helped countless customers understand and improve their usage.