I tried searching for topics related to this within the forums, but it keeps on throwing up an error. So please excuse me if this has been covered extensively already.
I found some old threads and info relating to the robots.txt file and how it is blocking a lot of information that is of benefit to search. These blocked resources can help my client's SEO, so I want to update the robots.txt file and replace the old / generic one.
Is this doable? I am not familiar with DNN and don't want to break anything. But if I can fix this, it will really help with their site optimisation.
I read this thread on GitHub where a bunch of guys (I'm assuming people involved with DNN) were discussing making it an option, but no resolution was stated in the thread (below). Can anyone advise? Help?
Am I going to break anything by re-uploading a different robots.txt file? If not, do I simply upload it under Tools -> Upload File? And how do I remove the old one?
Lots of questions. Apologies for my "noob-ness"... this is my first time working with DNN.