The Principle of Virtual Work, Counterfactuals, and the Avoidance of Physics