You need to Register for free and Login to post a message in the forum.

Forum

Forums > Users Lounge > DNN Creative Articles
Subject: Google Sitemaps Interview - Extra Tips
Prev Next
You are not authorized to post a reply.

Author Messages
Lee Sykes
DNN Creative Staff
Nuke Master VI
Nuke Master VI
Posts:6364
02 Nov 2005 4:00 AM  
URL Filters:

Following the Google Sitemaps MP3 Interview with John Mueller, I wanted to share with you a quick tip for using the GSiteCrawler software with DotNetNuke.

Make sure you listen to the full interview for tips on preparing your Google sitemaps. Following one of the tips, here's a filter list that I have created so far to remove links that Google does not require.

This filter list is currently used when crawling the DNN Creative website. It is particulalrly used to extract certain links such as the register / login / terms / privacy links on each page, plus extra links that are created and not relevant for Google if you are using Scott McCulloch's News Articles Module and ActiveModules Active Forums module.

Here is a list of the filters that I currently use in GSiteCrawler:
(in the ban URL tab)
(you will notice that some of these filters include the defaults that come with GSiteCrawler, I have left these on so that you can easily compare)

/_vti_bin/
/afsort/
/Categories/
/CategoryID/
/CategoryView/
/login
/NewsListing/
/PostComment
/privacy
/profile/
/register
/Search/
/sendemail/
/Syndication/
/terms
?
fsforum/
http://johannesmueller.com/_private

Hope this is useful
Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
Lee Sykes
DNN Creative Staff
Nuke Master VI
Nuke Master VI
Posts:6364
02 Nov 2005 4:14 AM  
Date Metatags:

If you are using the Date Metatags with your DotNetNuke portal (as suggested in the interview).

When you make any content updates to a page and you have added the Date Metatag to the page, make sure you also update the Date Metatag, otherwise Google will not re-index your updated page....
Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
Lee Sykes
DNN Creative Staff
Nuke Master VI
Nuke Master VI
Posts:6364
16 Nov 2005 8:15 AM  
Database Size:

Keep an eye on the size of the database that GSiteCrawler creates. - I was unaware for quite a while of just how big the database had grown. - It had reached a whole 1GB in size!

Quick solution:

Go to File and Compress Database

This reduced the 1GB file to just 2MB! - Quite a difference...

When GSiteCrawler compresses the database it also creates a .bak backup file of the original database, so if you need to free up the disk space of this large backup file (eg. in this case it was 1GB) - check that the database has been compressed without creating any errors (eg. that GSiteCrawler still operates correctly) and then re-click on:

File / Compress Database

This will then create a .bak file of the small 2MB file and delete the 1GB file.
Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
You are not authorized to post a reply.
Forums > Users Lounge > DNN Creative Articles > Google Sitemaps Interview - Extra Tips


ActiveForums 3.7

Latest Forum Posts

RE: sql script - modify data in a column by Sh@wn
Thank you Mark! I have used this script:ALTER TABLE dbo.C5SLLC_FormData ALTER COLUMN FormData NVARCH...
RE: sql script - modify data in a column by MarkXA
Assuming you're on SQL 2005 or 2008, it sounds like you need to convert the ntext column to nvarchar...
RE: Dl all DNN Videos by greet@fashionchannel21.com
Hello. First of all I need to say that I'm really happy with all the information that I have found o...
RE: sql script - modify data in a column by Sh@wn
this is the error: 'The data types ntext and varchar are incompatible in the equal to operator er...
RE: sql script - modify data in a column by jncraig
What is the error?
sql script - modify data in a column by Sh@wn
hello, I have successfully changed an ModuleID Column with this script: Update dbo.C5SLLC_FormDa...
RE: css class styles by jncraig
I'm afraid that I don't have anything helpful to offer here.
RE: linking to an external resource by jncraig
I think that, as you have discovered, the framework doesn't include that option. One thing that y...
RE: Implementing ISearchable by originator
Hello, Just assign GUID property as follows: SearchItemInfo si = new SearchItemInfo(...) .....
DotNetNuke Nucleus Skin Designer Tutorial - Issue 60 by leesykes
Add any comments or questions regarding the DotNetNuke Nucleus Skin Designer Tutorial from Issue 60
How to use Papayas Auto Upgrade for DotNetNuke - Issue 60 by leesykes
Add any comments or questions regarding the How to use Papayas Auto Upgrade for DotNetNuke tutori...
How to Setup and Use the DotNetNuke Survey Module - Issue 60 by leesykes
Add any comments or questions regarding the How to Setup and Use the DotNetNuke Survey Module tut...
Creating an Events Calendar for DNN using DotNetMushroom RAD - Issue 60 by leesykes
Add any comments or questions regarding the Creating an Events Calendar for DotNetNuke using DotNetM...
RE: Dl all DNN Videos by leesykes
Hello,No I'm afraid there isn't. But you can download all the videos from each issue by visiting eac...
RE: css class styles by cyborama
anyone have anymore insight on this issue with applying contextual background color to the telerik e...
linking to an external resource by cyborama
Hello Lee and Joe, Seems like it should be a no brainer but I am trying to link one of my menu it...
RE: Setting Page Skin by jncraig
The ribbon bar and controls are shown only to users who are logged into your site and given administ...
RE: Changing BG color of solpart sub sub menu ???? by jncraig
You will need to identify the classes assigned to those items and adjust the styles applied to them....
RE: Registered Users by jncraig
As I understand your question, yes.
RE: Admin--> Google Analytics page blank by jncraig
Make sure that you are not in Layout mode.If you are in View Mode or Edit Mode, you might want to ch...
DotNetNuke Modules
RSS Feeds