I imported the wrong file. How do I remove it?

Delete the book from the Library like any other book. Your original file on disk is never touched — the import works on a copy.