Ginkgo incorrectly pruned?

We have a 25 +yr. old ginko in our yard that was pruned in March 2006. One or two large limbs were removed, along with smaller limbs overall. Coincidentally (or not), the leaves on the tree did not “bloom” during the last 2 months as all the other ginkos in the neighborhood did. The “fuzzy caterpillar-like buds” just fell off instead of turning into leaves. Could our tree have been pruned incorrectly or too severely? Could it possibly be infected or diseased? Any information you could provide would be helpful. We enjoy this tree and would hate to see it die.
Topic by Diana Pap Rocki