I basically also feed the black oil sunflower seeds and niger/ thistle seed. In winter some suet and in summer some dried mealworms. And I grow lots of things with seeds and berries that birds like. We have shrubs and trees, a big pond, a little (artificial) pond and a birdbath. We always have lots of birds around.
If you like the goldfinches, it is worth it to invest in an upside down feeder:
It has the perches above the feeder holes instead of the other way around. Goldfinches can hang upside down like that to feed and house finches can't. Otherwise the house finches mob the feeder and you won't see very many goldfinches