It's an employment at will. The company can change their minds anytime, and so can we.

True. If you keep company A waiting, they may feel nervous/troublesome and just withdraw from the hiring. So grasp the sure thing first then pursue other options.