I wouldn't think bees could hurt anything by taking a little pollen.
This was the first year I tried to plant corn. We did 7 rows, each about 10 feet long (our plot is 20x20, so it was about a 4th of the garden). My 2 big problems were japanese beetles tearing up the leaves and the pollen tassels before there was pollen ready to fall off them, and deer eating the silks and top half of many of the ears. We've picked a couple dozen after trying to guess when they might be ready. We figured that without silks intact, they'd never really mature much more anyway. About half of what we picked was worth cooking and eating, although we had to cut some ears to remove what was chewed on.