You may as well take them off the vine. Leave the stems on the pumpkins. The scar tends to get moldy sometimes if the stem is removed. Next year consider planting a bit earlier.
Gardening at 5000 feet elevation, zone 4/5 Northern Utah, Frost free from May 25 to September 8 +/-