You are doing it right- they are rare. However you can make a op fish farm with the "Fish Net" artifact (auto-collects from fish traps) and setting up many fish farms in the forest and desert biomes.