Tip of the ear is not the most typical place for a mite-infestation to first appear. It more commonly manifests first between the shoulder blades and/or at the base of the tail. I think you could just keep an eye on this for now. If it spreads, if you see increasing amounts of skin flakes, if scabs (skin colored, difficult to see but easily felt) form and/or he starts scratching and biting at the ear, I’d suspect mites.
What’s more worrisome is that he wont let you touch his ear. (Or him). Hopefully he’s just annoyed with you and will calm down in a little while. It’d be good if you could examine his ear -feel for a lump at the base, look if it’s “dirty” inside. It can however be difficult to differentiate between a pain response and general annoyance. You could start by feeling his right ear base and see if he reacts differently when you then feel the left ear.
The reason I asked whether he’s a lop is that ear infections are a huge lot more common in lops than in up-eared rabbits.