With a bigger breed of rabbit it is more dangerous bonding as usually during the first bits of bonding there can be fights or even the usual chasing and nipping can be much more dangerous for the smart bun since the bigger bun over powers them
So I’d say it isn’t the best idea, however that being said, I myself have a lion head (male) and an angora cross (female) who are happily bonded and my female is about twice (little less) as big as my male
But they were mostly just indifferent with each other, though I think my male was especially stressed when my female took to humping him to show her dominace.
So I think it really depends on the rabbits. Although I feel like it can be a lot more dangerous, and if they ever have a falling out (which I hear can happen) the smaller bun would be in danger especially if that happened when you were gone.
But I don’t think size matters in the way that the buns will decide to hate each other souly on size.