It is shown that when in a higher order variational principle one fixes fields at the boundary leaving the field derivatives unconstrained, then the variational principle (in particular the solution space) is not invariant with respect to the addition of boundary terms to the action, as it happens instead when the correct procedure is applied. Examples are considered to show how leaving derivatives of fields unconstrained affects the physical interpretation of the model. This is justified in particular...