Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeDNN Open Source...DNN Open Source...Provider and Extension ForumsProvider and Extension ForumsAuthenticationAuthenticationAD authentication on public portal preventing search engine indexingAD authentication on public portal preventing search engine indexing
Previous
 
Next
New Post
2/27/2012 2:27 PM
 
We have been attempting to add Active Directory authentication to our site to provide access on our public site to an intranet area for our users inside the domain.

Originally set up on DNN 5.1.2 (AD 5.0.2) we did successfully get it working (with some exceptions, like older AD accounts had trouble logging in for some reason and auto-login seemed inconsistent and browser specific, but functional)

The problem was the site's inability to be indexed by Google, fetch as googlebot in the webmaster's tools revealed a 302 redirect error and the site has been dropped...

Searches revealed a known issue with the version, and the update advertised a fix for the problem.

So, we've updated to DNN 6.1.3 (latest version, afaik) and installed the AD provider 5.0.3. We're getting green lights down the board for our authentication settings and domain users are able to log in as expected (even the auto-login seems more reliable).

The problem is that fetch as googlebot is _still_ returning a 302 redirect...

I have looked through all the forums and the support material, but can find no hints about what the problem is. As this is an issue that was mentioned in the update notes for the provider as something that is fixed, I expect that it is something in my configuration, but have had no luck figuring it out.

I see an "Allowed Search Bots" field in the settings and as this looks very promising, I've played with various entries here (Googlebot, google bot, Google...) but no effect, and very few leads found through searches for appropriate entries for this setting.

Anyone know what I might be missing? Would greatly appreciate any advice...

thanks in advance,

aye-jay

DNN 6.1.3
Forest and domain functional level - 2003 Windows Server
2005 SQL Server Standard
Windows Server 2003 (SP 2)

 
New Post
2/27/2012 3:47 PM
 
Allowed Search bots is where you want to enter it. I'll admit I haven't played around with it a whole lot myself trying different bots but the best thing to do is to look in your IIS logs and and see what the user agent for googlebot is. Then put that in the Allowed Search Bots listing.
 
New Post
2/27/2012 6:00 PM
 
A follow up to my previous post. I just had a moment to look at the code and actually simply typing Googlebot in "should" work. Evidently it isn't and it's not something I could test against on my dev system and my systems don't get hit enough to account for every possible search engine. However I did find a site that allows you to spoof a search crawler so I'll attempt to do some more testing on my dev system at home (that I should be able to open up to the internet). I won't be able to look at it until later in the week but I'll see what I can find out.
 
New Post
2/27/2012 6:45 PM
 

Thanks for the quick replies Mike, I have been wading through  log files looking for bots' user agent names...

 fwiw, here is the list as it stands, I've played with order and spaces quite a bit, to no avail...

 Google,Google bot,gsa-crawler,MS Search 5.0 Robot,MSN Bot,Slurp,Googlebot

 
New Post
3/1/2012 10:13 PM
 
I'm not sure what to say here. I found an extension for Firefox that allows you to impersonate different user agents so I installed Firefox on my dev system (yuck). When stepping through the code if it found the user agent I was impersonating with (i.e. Googlebot) it exited the procedure that initiates the authentication and just displayed the page.

When you say Webmaster's Tools, what are you talking about? Are you talking about the Google Webmaster Tools?
 
Previous
 
Next
HomeHomeDNN Open Source...DNN Open Source...Provider and Extension ForumsProvider and Extension ForumsAuthenticationAuthenticationAD authentication on public portal preventing search engine indexingAD authentication on public portal preventing search engine indexing


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.

Copyright 2014 by DNN Corp Terms of Use Privacy
Request
a Demo
See Evoq Live
Latest Blog
How to Make Advocate Marketing Work for You
Read It
Watch the Replay
Top 5 Reasons to Consider a Branded Online Community
Watch