How to remove fields on Checkout Complete page ?

If you have made changes to the field set, then you will need to do a  Refresh from the Payment Form Builder in order for that to reflect.
The other way you can do this from Payment Form builder. Simply remove fields from the page and save.