What age is he? If he’s young he might just be maturing adgrowing through his destructive teenage years. Rabbits can be cuddly when they are young, but as they get older they stop wanting to be handled altogether. This might be the case with your bunny, in generall rabbits do not like to be picked up at all(they are prey animals, and being away from the ground makes them feel insecure)
You can give a rabbit all the toys in the world, but they will still want time outside of their enclosure to run around and investigate. (Think about being in your bedroom all day, you’d want to get out into the rest of the house at some point to explore/get a bit of stimulation) Try giving him his toys on rotation as well, so it’s like he’s always getting new toys, to try keep them interestin.
My pair figured out how to get out of their pen a while ago, and proceeded to do it as often as possible but when they got out they’d just go sleep on the couch-they just liked the idea of being out.