How old is too old to go to med school?

I am 32. It will take a year to get pre-reqs done and then I would apply. I would graduate and finish residency around the age of 40. Should this deter me? I know that most people enroll when they are about 27. But I heard that there are a lot of career changers who are being accepted.