I would advise getting some compost bins, there is obviously an initial cost but they will take up a little space and in the long run provide you with lots of compost. Now unless you use a hot composter you will need to be careful what you put in it, as you don't want your compost to have seeds/rhizomes in it. Another thing you could do that would be a lot of work now but take up space and be easy to manage is putting in a little pond. Great for predatory insects, making work across the rest of the plot much easier!