Whether or not VAT is payable is independent of what currency is used to bill in. If you're using a VPS in the UK then there's almost certainly VAT payable by the vendor.
If they are in another EU country, and you're VAT registered, and they have your VAT number they can zero-rate the transaction.