There's nothing wrong with your rose bush. That's what happens as they mature. The cane on the base will get thicker with time, it's providing support for the upper structure.
DO NOT bury it deeper, you will probably kill it. The bud graft on the bottom needs to be open to the sunlight.
It's good looking plant and going strong for such a young one.
I'd rather be gardening!