Do I have to pay the suspended employee?

That depends on what your employment agreement says, though in some situations you will have to provide pay. For example, if you have the right to place your employees on administrative leave as a disciplinary measure, this may be paid or unpaid. However, if the employee is the subject of an investigation, we always recommend putting them on paid administrative leave.