What to keep ? What not to keep?

Do you every wounder how your home gets so full of items that you think (Why did I buy that?) I want to lighten the load and make my home more inviting and of course more room and with that less cleaning time. I am looking for ways to organize, what to keep and what to pitch. I have loaded a few pictures on my main header of my home inside. My taste over the years has been all over the place but now I am looking for a more primitive colonial.
As I read all the blogs I see so many homes I wish mine looked like but not sure how to get my home in that shape. Of course I have to work on a very limited budget so I am looking for easy low cost ways.
Any suggestions?