Breaking the symmetry of momentum conservation using evanescent acoustic fields