Is your doctor using the growth chart for breastfed infants? There is a different CDC chart and they address the difference in the womanly art of BFing.
This is exactly what I was going to ask, make sure they are using the chart for BF babies, as the charts are different.