Robots.txt for parent portal on a subdomain (multiple portal site)
Last Post 09/13/2010 6:05 PM by Joseph Craig. 7 Replies.
Author Messages
Vincent
Posts:10


--
03/31/2010 6:03 PM  
Hi DNN creative team,

I've split my company's site into multiple portals on subdomains.

So I've done the equivalent of splitting example.com onto:
http://sub.example.com
http://subdomain.example.com

How do I get a robots.txt file for the portals on subdomains? eg. http://sub.example.com/robots.txt

Thanks in advance.
Déclic Vidéo FX
Nuke Pro
Nuke Pro
Posts:93


--
04/01/2010 3:05 PM  
+1
I have the same problem/question.... Where do I put robots.txt, in Portals/1/ ???
DV FX
Déclic Vidéo FX - http://declic-video-fx.com
Joseph Craig
DNN MVP
Posts:11667


--
04/03/2010 10:00 AM  
The robots.txt file should go in the portal's root directory.  So, yes.  Put it in Portals/N.

Joe Craig, Patapsco Research Group
Complete DNN Support
Déclic Vidéo FX
Nuke Pro
Nuke Pro
Posts:93


--
04/03/2010 10:23 AM  
Hello Joe,

Thanks for the answer. But in such case, why do I have the MAIN portal robots.txt file when I try to do http://parent-portal.com/robots.txt ???
I mean that http://parent-portal.com/robots.txt is not showing the robots.txt file located in Portals/N

Why ? Is the search engine able to recognize this ?
DV FX
Déclic Vidéo FX - http://declic-video-fx.com
Joseph Craig
DNN MVP
Posts:11667


--
04/04/2010 11:11 AM  
Hmmm.  Perhaps I am wrong?

Joe Craig, Patapsco Research Group
Complete DNN Support
Vincent
Posts:10


--
04/05/2010 7:26 PM  
Placing it in the portal's root directory would be the most intuitive option.

Unfortunately, IIS throws a 404 error when I try that. It appears IIS looks in the DNN root directory regardless of which portal the request is referring to.
johnmk777
Nuke Ace
Nuke Ace
Posts:45


--
09/13/2010 9:47 AM  
Has anyone figured out this issue?  I would really like to exclude an entire parent portal on one of my installations since I use it as a development site.

Much of the content is the same, and I don't want to get hit with duplicate content.  However, I can't seem to find an answer anywhere on how to exclude an entire portal from robot indexing.


Joseph Craig
DNN MVP
Posts:11667


--
09/13/2010 6:05 PM  
You should put the robots.txt file in the portal root for the portal you wish to exclude.

Joe Craig, Patapsco Research Group
Complete DNN Support


---