At the cave again today. So I took the opportunity to figure out how to get Steam to work over a VPN.

It took a while, but I eventually found some hidden settings. We can start Steam on the guest with the following command:

Steam.exe -console +connect_remote [IP:Port]

Works a treat so yay me.! Im posting this solution on all the forums as no-one has seemed to give a solution.