If the shrinking is in the upper part near the axilla (armpit) then there is a need to think of Cancer. However, it is advised to get an examination done by a doctor every year for breast cancer.
Also see how to examine you own breasts for detecting cancer: http://drkhalidmunir.googlepages.com