It is important to keep up the medication in order to eradicate the bacteria. It’s great that you’re seeing such great improvement already, but you want to make sure that all bacteria are gone before you stop the antibiotics. 2 weeks is not long, many buns need much longer courses of antibiotics.
The risk with stopping the meds too soon is that the bacteria that havent succumbed to the abx yet, will start to multiply once the abx is out of the system. Then you get a flare-up and have to start all over.
You can give your bun a probiotic if you are worried. There are beneficial bacteria and yeasts that are resistant to antibiotics. It’s still advised to give the daily probiotics a couple of hours before or after the antibiotics.
Penicillin must always be given as injections, never by mouth, just because it’s so hard on the rabbit gut microbiota -if, and that is if – it gets into direct contact with the gut. By giving it as injections it doesnt come into direct contact with the inside of the GI tract.