Can I cancel or remove a recording?

Yes. Every row has a cancel button (the X) while it is queued or running, and "Remove from the list" once it is done, failed or cancelled. Removing a row only clears it from the Listen list: the transcript already saved to the Codex stays there until you delete it in the Codex. Your original file is never deleted.