Hmmmm. Well what first came to my mind is that if its possible that he’s perhaps a bit older than you were told then he might be beginning to hit puberty, which causes attitude changes and means he needs to be neutered. 3 months would be a little bit early for puberty but its possible. Are his letterbox habits changing? Has he been humping anything? If so then it’s time to talk to your vet about getting him neutered (although you won’t be able to get it done until he is 4 months).
Also, often baby rabbits will tolerate being held a lot, but as they get older they no longer put up with it; this doesn’t mean that he doesn’t like you, just that he doesn’t want to be held. Rabbits are prey animals so being held is an uncomfortable feeling for them. So what I’m saying is I think it’s most likely that he’s just getting older and doesn’t want to cuddle so much.
You can still enjoy socialising with him by petting him, sitting on the floor with him, etc. don’t force him to cuddle because this will make him distrust you.
As for the breed, without any pictures that’s pretty hard, haha! Either describe him or post some piccies 