It depends on they type of installation you are doing.
If you cancel a new install the installer will delete the entire install folder, with the partial install. It will warn you of this before you do it. We do not have the capability to pause and resume installs yet.
If you are doing an update or scenery add, it will simply stop downloading any more files.