I'm betting he's reacting to your perfume .... he doesn't like the scent ....
Try handling him perfume free and I'm betting he'll respond lots different to now.
Of cause it may also be that your boyfriend exudes confidence when he picks up your beardie and is himself calm and relaxed and gives the beardie good body support where you are anxious, stressed worried and maybe don't support the beardie properly so it feels less relaxed / secure when you pick It up.
Watch very closely how your boyfriend approaches the beardie and picks it up. And off cause no perfume.
My favour bonding / taming trick for lizards is to offer some of their fav food as a treat/bribe when you want to pick them up or (if wild) pet them. Works wonders, they soon learn you are the giver of yummy stuff and soon they will be very relaxed when you pick them up ---- I've done this with wild skinks ....
I place my open upturned hand where the lizard can see it just outside it's personal space (a few inches usually) with a worm or disabled bug on it.
Wait for the lizard to come over and claim the bribe.
Repeat a few times and each day.
Soon I've a lizard who will come straight over and take the treat and loiter on my hand, I've been known to handsurf wild skinks and if I do it slow and gentle they seem to enjoy it because they stay and just look around, even look under the airborn hand (oo.... how did I get here ??) and when I put my hand back down they don't run away, they calmly crawl off after a while and if I offer another treat they come right back.
My wife refers to me "the lizard whisperer" as do most the kids in my street.