Windows Task Manager allows you to set priority of running application however it is not built to remember priority once it is closed but with Priority Saver you can.
This application adds an extra menu item just at the end of the menu where you set priority of the running application. So next time you launch the same application it sets it automatically for you.
If you are using this for corporate use, you should get a license for it.
Download: Priority Saver