For containers, garden soil and compost are a bit heavy and dense and moisture holding, to use by themselves. The clivia, like most plants other than bog plants, likes well drained soil.
Your garden soil and compost could be an ingredient in home made potting soil, with other additives like vermiculite or perlite, for drainage. The trouble with garden soil and compost for indoor containers is that there's a very good chance of bringing some bugs. You can take care of that by baking it, which I have done and works well, but smells nasty while it's going on and kills a lot of the beneficials too.
Top $ bread made a very detailed post about making home made potting soil here: