Sudden and unexpected changes in the auditory and visual channel are known to capture attention. This attention capture has been shown to negatively impact performance in an ongoing task (i.e., deviance distraction). In three experiments we examined if deviant stimuli presented in a different modality than astandard stimuli caused distraction in a visual categorization task, using a multi-sensory oddball task. In two experiments a deviant sound was presented (20 % of trials) against 80 % vibrotactile standard trials. In one the standard was omitted on deviating sound trials, while in the other the standard and deviants were presented simultaneously. In the third experiment the standard vibration was omitted in 20 % of the trials without any presentation of a deviant sound. Results showed distraction by deviating sounds (p < .05), but not when standard vibrations were presented simultaneously (p >.05). Interestingly, the omission of a standard vibration showed distraction (p < .05). In conclusion, deviance distraction might be bound to within rather than between modalities.