Learn DNN / DotNetNuke

You need to Register for free and Login to post a message in the forum.

Forum

Forums
Search Forum
Advanced SearchTopicsPosts

Forums > DotNetNuke® > DotNetNuke® Questions

Robots.Txt File

Last Post 04/02/2013 2:49 PM by Dan Glanton. 4 Replies.

Sort:

Check this box to subscribe to this topic.	Prev Next
You are not authorized to post a reply.

Author

Messages

Dan Glanton

Nuke Pro
Posts:94

04/01/2013 12:52 PM
The code below is an example of my robots.txt that I am begining to create: User-agent: * Disallow: /js/ Disallow: /remiadmin.aspx Does this look alright and what other things should I add?

Joseph Craig
DNN MVP
Posts:11667

04/02/2013 8:47 AM
Browsing to this address will show you what dotnetnuke.com is using ... http://www.dotnetnuke.com/robots.txt

Joe Craig, Patapsco Research Group Complete DNN Support

Dan Glanton

Nuke Pro
Posts:94

04/02/2013 10:59 AM
No pressure or anything, but could I copy and paste this robots.txt and remove a couple of lines where I don't have any directories? It doesn't hurt to have a directory on the dissallow list that you may not actually have? Thanks for this example, it is a very nice example and of course a good example of a dnn robots.txt file which is more of what I need.

Joseph Craig
DNN MVP
Posts:11667

04/02/2013 1:18 PM
Yes, copy and modify and use as you need. I don't think that there is any problem if there are directories listed that you don't have. Those branches will never be used because the bots will never try to go there.

Joe Craig, Patapsco Research Group Complete DNN Support

Dan Glanton

Nuke Pro
Posts:94

04/02/2013 2:49 PM
Awesome! Thanks for your help.

You are not authorized to post a reply.

Forums > DotNetNuke® > DotNetNuke® Questions

Latest Forum Posts

Can you Run Xcode in Linux? by Aman Singh

Can you Run Xcode in Linux?

Can you Run Xcode in Linux? by Aman Singh

Can you Run Xcode in Linux?

Billed for subscription that was canceled by Ryan

I was just billed for a subscription that was canc eled / inactivetive how do I get a refund for th

Meta Title and Meta Description are not showing properly by DNN User

Hi, On my site the meta title and meta descriptions are not showing properly. It's showing the m

Search is not functioning properly by DNN User

Site: https://www.prv-engineering.co.uk/search If I search any item only the 1st option under sea

Search is not functioning properly by DNN User

Site: https://www.prv-engineering.co.uk/search If I search any item only the 1st option under sea

DNN Platform import site optio by Melanie Weaver

Is it possible to import site template in DNN Platform 8.0? We have internal Evoq Content 8.1 tha

Events Module for DNN V5? by Tugboat

Would anyone have a download link for the version 5.0.3 Events Module? Thanks!

"Ghost" TabID Number? by Tugboat

Hi! I have a portal instance with multiple child portals and on one of the child portals, there i

RE: DNN Load Testing by ayman sharkawy

Hi. Have you already implemented a site using the DNN . And how the performance of the site and its

Publish All Pages by NSUOK

I'm using DNN Evoq Content Basic 8.2.0. When I make the HTML Pro module display on all pages, I h

Simpler profile needed in 9.2.2 by Donald

We are upgrading a DNN 4.8.4 site to DNN 9.2.2. On 4.8.4, the top bar shows the user’s name. If yo

How to link from dnnmodal popup to web site page? by Donald

Hello all. I am using a dnnmodal.show popup. The popup works correctly, showing the content that I

RE: Document Collaboration by Nick Davern

That feature would be super beneficial for our needs as well! Does anyone have an update as to if th

RE: DNN 9.2, how to set default theme? by Andy Stephenson DNN Creative

you do that under "Manage/Themes". Note the highlight blue border around the default container and d

DNN 9.2, how to set default theme? by Donald

Please disregard, found Manage Themes I cannot find how to set a default portal theme in DNN 9.2

RE: Looking for DataSprings Dynamic Forms by Andy Stephenson DNN Creative

Your best chance would be to contact Chad Nash @ http://www.datasprings.com/

Looking for DataSprings Dynamic Forms by Jakir HM

Looking for DataSprings Dynamic Forms 3.4 for DNN 4.x 5.x for my site (https://themasters2018s.com/)

RE: Help with Cycle Image Carousel not displaying images by peter

I had the same problem with the Will Strohl Content Slider after upgrading to DNN 9.1 The above an

RE: Object reference not set to an instance of an object by Andy Stephenson DNN Creative

Check this one might be useful: http://www.dnnsoftware.com/answers/im-tryin-to-move-my-site-to-pr

Used
By

Testimonials

| The SoloCoder Podcast | Google | Privacy Statement | Terms Of Use