This is actually first in the order of things you must do to better your credit score. Paying off old debts may not make an immediate change in your credit score, but it can help. This means that even when you pay a debt off in full that the mark will not be removed for your credit report. his is actually first in the order of things you must do to better your credit score. Get tips on how to raise your credit score and manage credit responsibly, including paying bills on time, paying off debt, and managing credit history. For more information you can refer this link.