You can put old newspapers on the floor and make like a “bridge” to the lounge, rabbits are reluctant to go out on slippery surfaces because they can’t escape quick enough if sth scary should happen. If he likes that you could replace the newspaper with some ragrugs etc to make a more permanent “bridge”.
It’s not surprising he wants to hide in his cage or near it, it’s huis safe place, but you can provide him with an additional safe place, f ex an upside down cardboard box with doors cut in it placed at a distance from the cage. They like to have hidey-places like that. It often makes them braver, when they know they have safe places to run to if the need to.
I’ve a memory of having read here a long time ago about bunnies that hate the scent of raw/cooking meat. I don’t know if that may be what your bun reacts to. Blood meal is after all used in gardens as a rabbit- and-deer-deterrent. It would make sense that they are afraid of the scent of blood/meat. If you are vegan, this would not apply though. Obviously =/