Trim the greyish brown stems off, the lighter brown is new growth, so their trying. I would wait until fall to try and move them to another area. Add a banana peel to the ground next to them (just dig it in gently), use either compost tea or a liquid fish emulsion to fertilize them. They probably need the fertilizer. Normally you do that once a month when they are blooming. They don't look wonderful, but they don't look all that bad. They just need a little TLC.

Good luck