Sitecore.XConnect.XdbCollectionUnavailableException, urgh!

So I had a bit of a head scratcher today trying to setup a clean instance of XC9, something I've done many times since it was released back in January. Everything went fine during the installation, but...