Within the framework of a Hamiltonian approach, we study mode coupling and stability of nonlinearly interacting modified convective cells in a nonuniform dusty magnetoplasma. Expressions for the coupling coefficients and a stability criterion for the stationary solutions are presented. This is a necessary prerequisite for understanding the nonlinear dynamics of convective cells in a dusty magnetoplasma with a strongly nonuniform background.