It's implied in the previous season that the Silents are on several planets, harassing several different species at different points in time.

Can you cite your references, please? I admit that since I have not been impressed with Moff's era that I haven't watched most of the episodes more than twice. So, if it was there, I just want to know.