I want to start planting colorful shrubs and flower in my yard. When and where do I start?

I moved into this house last year. I watched different flowers sprout up last spring/summer. I want to add to what the previous owners did and don't know when and where to start. Oh and by the way I am on the East Coast.