Yes, absolutely! The only thing I would be careful about, unless you are really good at getting your compost pile to heat up well, is weed seeds. Be sure to pull your weeds before they go to seed (which is good advice anyway!). If necessary, if a weed has seed heads, you can bag that part up, then cut it off and trash it, then compost the rest.
The oxalic acid and oxalates in rhubarb leaves are organic and break down in the composting process.