Products

Evoq Content Overview Content Creation Workflow Asset Management Mobile Responsive Personalization Content Analytics SEO Integrations Security Website PerformanceEvoq Engage Overview Community Management  Dashboard  Analytics  Member Profile Gamification Advocate Marketing Community Engagement  Ideas  Answers  Discussions  Groups  Wikis  Events Mobile ReadyDNN Support PackagesEvoq: CMS FeaturesEvoq OnDemandCompare DNN's CMS Products

Solutions

Content Management SystemMulti-Channel PublishingDigital MarketingOnline Community ManagementIntranet Software SolutionOur CustomersPrime

Resources

Test DrivesSchedule A DemoDocumentation CenterWebinarsWhite PapersProduct ManualsRequest PricingData SheetsCase StudiesEvoq Preferred Products Content Management Ecommerce Forms Identity Management and Authentication Site Management Social Themes

Partners

DNN Partners Partner Directory Become a DNN Partner Partner Program Overview  Hosting  Implementation  ISV  Training  Competencies

Community

Participate Ask a Question Forums Community Showcase DNN MVP  Program Overview  Lifetime MVPs  Honorary MVPs Subscribe to DNN Digest Advisory Groups  Awareness Advisory Group  Developer Advisory Group  Partner Advisory Group  Technology Advisory GroupLearn Documentation Wiki Community Blog Video Library Project History Development RoadmapDownload DNN Store Language Packs Manuals Nightly BuildsSecurity Policies Security Center

About

News Press Releases News Coverage Press KitCareersContact DNN

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen
HomeHomeUsing DNN Platf...Using DNN Platf...Performance and...Performance and...Can I update the robots.txt file?Can I update the robots.txt file?
Previous
 
Next
New Post
1/9/2019 8:02 AM
 
Katherine Stott


Joined: 1/9/2019
Posts: 4

Hi Guys

I tried searching for topics related to this within the forums, but it keeps on throwing up an error. So please excuse me if this has been covered extensively already. 

I found some old threads and info relating to the robots.txt file and how it is blocking a lot of information that is of benefit to search. These blocked resources can help my client's SEO, so I want to update the robots.txt file and replace the old / generic one.

Is this doable? I am not familiar with DNN and don't want to break anything. But if I can fix this, it will really help with their site optimisation. 

I read this thread on GitHub where a bunch of guys (I'm assuming people involved with DNN) were discussing making it an option, but no resolution was stated in the thread (below). Can anyone advise? Help? 

https://github.com/dnnsoftware/Dnn.Platform/issues/2045

Am I going to break anything by re-uploading a different robots.txt file? If not, do I simply upload it  under Tools -> Upload File? And how do I remove the old one?

Lots of questions. Apologies for my "noob-ness"... this is my first time working with DNN.
 
New Post
1/9/2019 9:31 AM
 
Jeremy Farrance


www.accuraty.com
Joined: 9/21/2005
Posts: 136

Katherine, yes, it is okay to edit directly. DNN does not manage the file in any way. Remove or comment out what you don't need. We edit or replace it regularly depending on the specific needs. I do recommend renaming the original as robots-orig.txt for reference. We usually edit it right on the server or through FTP. I've never uploaded/replaced it via File Manage, but that should work too. Cheers!

- Accuraty / Jeremy
 
New Post
1/9/2019 9:42 AM
 
Clint Patterson


Joined: 5/26/2009
Posts: 366

Welcome to the DNN Community Katherine! We're happy to have you.
 
New Post
1/9/2019 1:14 PM
 
Will Strohl


Will Strohl's Avatar

Will Strohl's Avatar

Will Strohl's Avatar

Will Strohl's Avatar

Will Strohl's Avatar

Will Strohl's Avatar

https://upendoventures.com
Joined: 3/1/2005
Posts: 2884
Jeremy's response is spot on. I'd also suggest taking some queues from the robots.txt file here on dnnsoftware.com itself. This website has been pretty battle-tested over the years and the resulting robots.txt file is great, especially for a high-volume website.

http://dnnsoftware.com/robots.txt
Will Strohl

Upendo Ventures Upendo Ventures
DNN experts since 2003
Official provider of the Hotcakes Commerce Cloud and SLA support
 
New Post
1/10/2019 12:11 AM
 
Katherine Stott


Joined: 1/9/2019
Posts: 4

Hi Jeremy

Thanks for your reply. You have been a great help. I don't have FTP access at this stage so won't be able to view and edit the file directly, so I will make the changes in a text editor and send to the developers. Or maybe upload it. Haha... I'm not averse to experimentation, but the client might be ;)

Thanks again, appreciate it.
 
 Page 1 of 2
12Next 
Previous
 
Next
HomeHomeUsing DNN Platf...Using DNN Platf...Performance and...Performance and...Can I update the robots.txt file?Can I update the robots.txt file?


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out