The idea that bacterial toxins are not only killers but also execute more sophisticated roles during bacteria-host interactions by acting as negotiators has been highlighted in the past decades. Depending on the toxin, its cellular target and mode of action, the final regulatory outcome can be different. In this review, we have focused on two families of bacterial toxins: genotoxins and pore-forming toxins, which have different modes of action but share the ability to modulate the host's immune responses, independently of their capacity to directly kill immune cells. We have addressed their immuno-suppressive effects with the perspective that these may help bacteria to avoid clearance by the host's immune response and, concomitantly, limit detrimental immunopathology. These are optimal conditions for the establishment of a persistent infection, eventually promoting asymptomatic carriers. This immunomodulatory effect can be achieved with different strategies such as suppression of pro-inflammatory cytokines, re-polarization of the immune response from a pro-inflammatory to a tolerogenic state, and bacterial fitness modulation to favour tissue colonization while preventing bacteraemia. An imbalance in each of those effects can lead to disease due to either uncontrolled bacterial proliferation/invasion, immunopathology, or both.