Try the bowl. My bunnies prefer the bowl tot he bottle, and only rarely knock it over. And then its usually only during a crazy binky ;P Just make sure it is a nice heavy ceramic one

Zoe used to do the same thing, I was always scared she was gonna hurt or damage her teeth by doing that. I used to think it was because too little water would come out, and maybe it was cuz I switched her to a bowl and she gulped down water like if she had never drank water before. I got her a heavy ceramic bowl but she would get stuff in there when she would hop around so i got her a bowl that you can hang from the cage. Its perfect cuz she cant spill it or get little floaties in there. =) Oh and she drank water from a waterbottle since I got her and there was no problem with the transition she loved it. I think the water bottle might get them annoyed and thats why they yank on it and bite it.

My rabbits love their bottle more than their bowls, they have both. I like using bottles but they can be noisy. Biting at the spout means he is not getting as much water as he wants. Try a very large bottle and wire the spout in place. Also, avoid the ones with a spring inside the spout — those can be hard to push in for some rabbits and frustrate their drinking attempts. Plain ball-in-spout mechanisms are better.
If you want to go with a bowl, get one that attaches securely to the cage so there will be no knocking over.