Error when initializing ipfs-core with Ed25519 Peer Id

When initializing ipfs-core (js-ipfs) with an Ed25519 PeerId (created with @libp2p/peer-id-factory and @libp2p/crypto) I am unable to connect to a node process from the browser using circuit swarm addresses or with swarm.connect (I receive an encryption error from swarm.connect).

I am trying to use a seeded private key to initialize IPFS, but even when using createEd25519PeerId I am seeing these errors. The connection works fine if I use a default peer id.