Dish soap - this is a very tricky area. Dish "soap" is almost always detergent which kills plant cells. To be safe, use only real soap for making plant sprays unless you are making herbicide.
Rinsing like Gary350 advised probably makes it safer, but if you miss the timing and leave on too long, or if direct sun hits the plant, there might be unfortunate consequences.
Learning never ends because we can share what we've learned. And in sharing our collective experiences, we gain deeper understanding of what we learned.