I decided to add a better regulator inside the case. The design I'm following was drawn up by 6L6 on the Art of Sound Forum. Although I've not tried it before, I decided to have a go at making a PCB.
If you are interested in how this is done check out my "Making a PCB" Project.