Colonia del Sacramento is just 1 hour 15 minutes from Buenos Aires away. I took the Ferry Busquebus from Puerto Madero. Like on an airplane, you had to be there earlier and check-in, go through security and immigration.
In Colonia, it's only a short walk to the historic town.