IPFS System Requirements?

Hm, are you running version older than v0.4.12? Try upgrading to v0.4.13.

Older versions were missing connection closing logic, which is known to cause problems you described: