AxCrypt uses the standard Windows Installer technology for install and uninstall. There should be no specific issues with that. You can install/uninstall the software as normal.
Before uninstalling the software, just delete your AxCrypt Local Contents by clicking the menu item File | Options | Clear All Settings and Exit from the AxCrypt app.
AxCrypt app is required to open/decrypt the encrypted files.
You uninstall AxCrypt like you uninstall essentially all Windows software. Via the Programs and Features control panel applet.