To start with , it always helps to tell us where you are located . There are hardly any garden questions that can be discussed without reference to location / climate etc. Also it would help to know what you want to grow in those containers . Different plants benefit from different types of soil .
But in a general way, I would say don't put any of your clay soil in it. Way too heavy, compacts down and turns into a brick in a container and hard to get it to mix well with the other ingredients.
And don't put rocks or anything at the bottom "for drainage . " People did that for years , but it always was a myth . Having distinct layers of soil then gravel creates a barrier that the water won't cross until the soil is completely saturated . Just fill your container with good potting mix .
Good potting mix would be the compost, the peat moss (or coconut coir ) and some mineral ingredient to help keep it loose, light , fluffy, and well draining (all qualities you need for potting mix , which otherwise tends to compact ). This could be perlite , decomposed granite , crushed lava rock , coarse sand , etc.
Welcome to the Forum !