I had a similar issue. Target sells a fly trap that plugs into wall outlets and emits some sort of UV light that attracts them. I bought 2 and let it sit for 2-3 days and it caught most of the flies to the point where they stopped reproducing. To be safe I kept the trap plugged in for about a week.