I say limit actual handling to just baths but definitely interact with him daily. Clean his cage, give him treats from your hand, let him see you and after a few days, maybe work in some petting if he seems to be calm. Let him get used to you and your hand as a non threat. Never force yourself onto the beardie. Once they understand you are a buddy and offer new and exciting things, they will love to come out and sit on you and even come to see you as "the protector" when things get scary. My little 10 week old girl, Harley had a little fall from jumping from the couch to her cage table and you would imagine at 10 weeks old, she would have bolted after hitting the floor but nope. She just stared up at me with the look of "what are you waiting for!? pick me up!!" After that, she just sat on me not wanting to do any exploring but instead eating a few greens from my hand and then climbing up my chest and under my neck and stretching out haha. Key is to interact daily with them.