I think if you use Al-Azif's DNS method, you will then do the following:
On your PS4 go to Settings > Network > Setup Network to setup a network. Set up a network using the custom settings and connect to your internet as normal but when you get to DNS Settings select Manual and set the Primary...