For most workers, the perfect time to retire, the moment when it seems just right, depends on lots of things ranging from health and family situation to the stock market.