The page numbers in my answer key do not match the book anymore.

The answer key names the pages of the paperback as it is when you export it. If you add or remove pages or designs, or turn single-sided pages or front pages on or off, export the KDP interior and the answer key again together.