Products

Solutions

Learn More

Partners

Community

Blog

About

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeUsing DNN Platf...Using DNN Platf...Performance and...Performance and...Can I update the robots.txt file?Can I update the robots.txt file?
Previous
 
Next
New Post
1/9/2019 8:02 AM
 

Hi Guys

I tried searching for topics related to this within the forums, but it keeps on throwing up an error. So please excuse me if this has been covered extensively already. 

I found some old threads and info relating to the robots.txt file and how it is blocking a lot of information that is of benefit to search. These blocked resources can help my client's SEO, so I want to update the robots.txt file and replace the old / generic one.

Is this doable? I am not familiar with DNN and don't want to break anything. But if I can fix this, it will really help with their site optimisation. 

I read this thread on GitHub where a bunch of guys (I'm assuming people involved with DNN) were discussing making it an option, but no resolution was stated in the thread (below). Can anyone advise? Help? 

https://github.com/dnnsoftware/Dnn.Platform/issues/2045

Am I going to break anything by re-uploading a different robots.txt file? If not, do I simply upload it  under Tools -> Upload File? And how do I remove the old one?

Lots of questions. Apologies for my "noob-ness"... this is my first time working with DNN.

 
New Post
1/9/2019 9:31 AM
 

Katherine, yes, it is okay to edit directly. DNN does not manage the file in any way. Remove or comment out what you don't need. We edit or replace it regularly depending on the specific needs. I do recommend renaming the original as robots-orig.txt for reference. We usually edit it right on the server or through FTP. I've never uploaded/replaced it via File Manage, but that should work too. Cheers!


- Accuraty / Jeremy
 
New Post
1/9/2019 9:42 AM
 

Welcome to the DNN Community Katherine! We're happy to have you.

 
New Post
1/9/2019 1:14 PM
 
Jeremy's response is spot on. I'd also suggest taking some queues from the robots.txt file here on dnnsoftware.com itself. This website has been pretty battle-tested over the years and the resulting robots.txt file is great, especially for a high-volume website.

http://dnnsoftware.com/robots.txt

Will Strohl

Upendo Ventures Upendo Ventures
DNN experts since 2003
Official provider of the Hotcakes Commerce Cloud and SLA support
 
New Post
1/10/2019 12:11 AM
 

Hi Jeremy

Thanks for your reply. You have been a great help. I don't have FTP access at this stage so won't be able to view and edit the file directly, so I will make the changes in a text editor and send to the developers. Or maybe upload it. Haha... I'm not averse to experimentation, but the client might be ;)

Thanks again, appreciate it.

 
Previous
 
Next
HomeHomeUsing DNN Platf...Using DNN Platf...Performance and...Performance and...Can I update the robots.txt file?Can I update the robots.txt file?


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out