Breast cancer (BC) intrinsic subtype classification is based on the expression of estrogen receptor (ER), progesterone receptor (PR), human epidermal growth factor receptor 2 (HER2), and proliferation marker Ki-67. The expression of these markers depends on both the genetic background of the cancer cells and the surrounding tumor microenvironment. In this study, we explore macrophage traits in cancer cells and intra-tumoral M2-macrophage infiltration (MI) in relation to intrinsic subtypes in non-metastatic invasive BC treated with breast conserving surgery, with and without postoperative radiotherapy (RT). Immunostaining of M2-macrophage-specific antigen CD163 in cancer cells and MI were evaluated, together with ER, PR, HER2, and Ki-67-expression in cancer cells. The tumors were classified into intrinsic subtypes according to the ESMO guidelines. The immunostaining of these markers, MI, and clinical data were analyzed in relation to ipsilateral local recurrence (ILR) as well as recurrence-free (RFS) and disease-free specific (DFS) survival. BC intrinsic subtypes are associated with T-stage, Nottingham Histologic Grade (NHG), and MI. Macrophage phenotype in cancer cells is significantly associated with NHG3-tumors. Significant differences in macrophage infiltration were observed among the intrinsic subtypes of pT1-T2 stage BC. Shorter RFS was observed in luminal B HER2neg tumors after RT, suggesting that this phenotype may be more resistant to irradiation. Ki-67-expression was significantly higher in NHG3 and CD163-positive tumors, as well as those with moderate and high MI. Cancer cell ER expression is inversely related to MI and thus might affect the clinical staging and assessment of BC.