Experts have revealed that certain health issues like obesity and heart disease, as well as normal aging, can cause penis size to shrink over time, along with difficulties maintaining an erection. Experts have revealed that certain health issues like obesity and heart disease, as well as normal aging, can cause penis size to shrink over time, along with difficulties maintaining an erection.