The drive pulleys have edges so i'd guess the belts couldn't run right off. But if the tensioner pulleys were not square on, they could drive them off the cam pulleys to a degree, and there'd def be friction there, prob causing faster wear on the belts -- depending on how much the tensioners were off kilter.
__________________
..
~
|