It definitely sounds like this guy has some adjusting to do. I'm assuming he didn't receive a lot of human interaction at his old home? Good new is with time and lots of patience you can have a really good companion in him.
Just move very slow. You want to show him you are no threat to him and slowly earn his trust. Chances are when he first let you hold him he was in a new home with a new owner and too focused on all of that to care. Now that he's more settled in your seeing the aggressive side.
Continue talking to him once in awhile throughout the day. Also make sure the traffic (other animals and family members) walking past his cage throughout the day is at a minimum for now. At least once a day you can simply stick your hand in his cage without actually touching him just for him to see. leave it there for a few minutes unless he freaks out, than do not remove your hand until he calms down (you don't want to reinforce that behavior). Do this for a week or two, or whenever you believe he is comfortable with it, than bump it up a notch and begin petting him. You will want to do this a few times a day until he's completely comfortable with it as well. *side note* never approach him from above, always allow him to see you coming.
Once you can successfully do all of this you can begin picking him up in his enclosure for a few minutes until you believe he's comfortable enough to be taking out. Another thing you can do is to take him out when he's sleepy (right before lights out) when's he's in a calmer state and try to bond with him than. You can also use feeding time as bonding time. Allow him to see you placing his insects in his Viv so that he will begin to see you as the "hand that feeds him"
Stay patient and don't give up. Your guy will eventually come around in time. Keep us updated and let us know when you begin to see improvements. Wishing you the best