The Delete option is grey out because RSS folder is a default system folder in Outlook client. It cannot be deleted just like you cannot delete Outbox or Draft folder.
The available option is to use MFCMapi tool.
You can refer to the reply of our MVP in this thread to Hide or Delete Outlook's Default Folders: Outlook Navigation Pane
