The Add File/Category links are only shown if permission is granted. Hiding these will not necessarely prevent the user from creating categories, as they can do it through the backend. So if you set permissions right, the links will disappear.
However, I understand that it some cases it might be confusing to have the Add… Option on frontend and its easier to “mess” arround with categories. Will add an option