Is my milk supply drying up? do i have to stop feeding?

no don't stop nursing. this is normal and happens a lot. you have to give your body time to adjust and maybe ask her doctor to see if she's ready for a little rice cereal or something. the same thing happened to me with all four of my kids and it really is frustrating but it will p. good luck.