Hi, SassyGirl! Welcome to you and your new bun!
I actually work in the theatre! Yay to you! (And I understand the budget-concerns…)
Look for a feed-store for hay. All of my buns are adults, so I don’t really know whetner your baby should be getting alfalfa or some other type (look at the info section of this website), but call your local feedstores, and they will be SIGNIFICANTLY cheaper than a petstore. Just look through your hay as you dole it out and make sure it is of good quality. If you see any mold, go to a different store.
I git litter (wood-stove pellets) for $6/ 40 lb from an OSH hardware store. Much cheaper than actual “rabbit litter.”
I don’t have a cheap solution to pellets. A lot of people on this forum use Oxbow. Mine are Kaytee–Timothy-based. The only place I’ve seen either is the petstore. But, as always, if you buy the bigger quantities, the price per pound, of course, is cheaper…