Now that inputs might have accompanied outputs to be added to the sweep tx, we add them to the sweep transaction first, and account for it when calculating the change amount.