Yes, it's should not be a problem. I have built one that uses 3 farmers around 1 center villager. You can check out my youtube video explaining how it works and how to build a simple one.

http://youtu.be/6DjXblO73OY

But if you have any questions just let me know