Improvement at anything is based on thousands of tiny failures, and the magnitude of your success is based on how many times you've failed at something.
I don't think your twenties are for fitness, but when I got to my thirties I started to get fit.
