They're usually harmless. They CAN pinch and bite. I can't see your pictures very well once magged up, but I int see really large pincers on the back end.
They're likely after the moisture in the pot. And they likely won't bother you as long as you don't handle them. They can become unsightly in the fall. We had some one year. We just swept them up and dumped them down the toilet.
USDA Zone 7b/ Sunset Zone 31