Internet connection extremely slow when IPFS is running

Help
1

Is it possible that my ISP capped maximum number of connections that can be open at the same time?
Note: My internet connection is slow even when IPFS shows no bandwidth usage.
It gets really bad when my node connects to 30-50+ peers.