Sorry to hear. I know it hurts when they seem to reject you, but it could be environmental & nothing to do with you personally. This is Chroma, right? I seem to remember that you have a dog & cat around the house? It could be that he's freaked out by that if everyone's out at once. We have no other pets/kids, but sometimes my guys will hang out with my wife & I when we take them out (separately), and sometimes they're off like a shot to go hide somewhere. Other times they'll be napping on one of us and suddenly decide that it's better to burrow into the couch cushions. Then there's the stink-eye-for-no-reason days...
Beardies are strange creatures, but it might be that he's still young & finding his place in your world. They get hormones, sheds, cranky moods, but I'd definitely not take it personally. With my new one (a rescue), I have had to try to bond with him since I got him as a juvenile vs. my 1st, who I raised from ~ 2 weeks old. When he runs away, I follow at a distance & just hang with him wherever he goes. I don't try to pick him up or take him from his hiding spot, just sit/lie there in full view so he knows I'm not trying to eat him. Slowly, he's coming around, so I'd just recommend patience. He'll come around!