Taking on debt to start your business should be a last resort and only used after careful consideration. You must be confident that you can pay back in full any money you borrow for your business.