Are you seeing any actual damage to the plants/ flowers? In general ants are not plant eaters. You can check the plant closely. Sometimes if ants are coming to it, it is because there are aphids on it. The aphids secrete a sweet sticky substance called honeydew which the ants like.
If the ants aren't doing any damage, there's no reason to worry about them. If you really want to get rid of them, make a circle of some kind of powdery substance all the way around the plant at least 1/4" deep and maybe an inch wide - chalk, baking powder, talcum, etc. They can't walk over it, it clogs their spiracles.