People frequently attribute adverse symptoms to particular buildings when exposure to pollutants is low, within nonhazardous levels. Our aim was to characterize building-related intolerance (BRI) in the general population. Data were derived from two population-based questionnaire surveys, the Vasterbotten and osterbotten Environmental Health Study. We identified cases of BRI if respondents reported symptoms emerging from residing in certain buildings, when most other people had none. The questionnaires covered lifestyle factors, perceived general health, BRI duration and symptom frequency, the emotional and behavioral impact of BRI, coping strategies, and physician-diagnosed diseases. From the total of 4941 participants, we formed two case groups, 275 (5.6%) fulfilled criteria for self-reported BRI, and 123 (2.5%) for BRI with wide-ranging symptoms. Individuals in both case groups were significantly more often female, single, and perceived their general health as poorer than the referents, i.e., those reporting no BRI symptoms. The mean duration of BRI was 12 years. In both case groups, avoidance behavior was found in over 60%, and nearly half of the sample had sought medical care. BRI with wide-ranging symptoms was associated with elevated odds for all studied comorbidities (somatic and psychiatric diseases and functional somatic syndromes). The perceived health of individuals with BRI is poorer and comorbidities are more frequent than among referents. BRI seems to be similar to other environmental intolerances and shares features with functional somatic syndromes.