The biggest concern might be the lighting. If you don’t have sunny enough windows, the plants might not thrive. I tried this and then had to move my plants outside because they were all dying. Most herbs and veggies need more light than common houseplants. If you have lots of sun or artificial light, this may not be a problem, but know that being able to keep, say, a philodendron or African violet happy doesn’t mean kale or lettuce will be happy in the same spot (personal experience, lol)
Two more ideas:
-if you put the top bit of a carrot you have eaten in the ground, it will often sprout new leaves, quicker than growing from seed. It’s easy and my rabbit loves this.
-if you buy organic soil from a garden center or something, and bring it inside, you might want to do something to kill pests first. I learned this the hard way and my apartment was infested with fungus gnats for a while. Freezing or baking the soil first will help, although it’s a pain.