You need to Register for free and Login to post a message in the forum.

Forum

Forums > Users Lounge > DNN Creative Articles
Subject: Google Sitemaps Interview - Extra Tips
Prev Next
You are not authorized to post a reply.

Author Messages
Lee Sykes
DNN Creative Staff
Nuke Master V
Nuke Master V
Posts:5283
02 Nov 2005 4:00 AM  
URL Filters:

Following the Google Sitemaps MP3 Interview with John Mueller, I wanted to share with you a quick tip for using the GSiteCrawler software with DotNetNuke.

Make sure you listen to the full interview for tips on preparing your Google sitemaps. Following one of the tips, here's a filter list that I have created so far to remove links that Google does not require.

This filter list is currently used when crawling the DNN Creative website. It is particulalrly used to extract certain links such as the register / login / terms / privacy links on each page, plus extra links that are created and not relevant for Google if you are using Scott McCulloch's News Articles Module and ActiveModules Active Forums module.

Here is a list of the filters that I currently use in GSiteCrawler:
(in the ban URL tab)
(you will notice that some of these filters include the defaults that come with GSiteCrawler, I have left these on so that you can easily compare)

/_vti_bin/
/afsort/
/Categories/
/CategoryID/
/CategoryView/
/login
/NewsListing/
/PostComment
/privacy
/profile/
/register
/Search/
/sendemail/
/Syndication/
/terms
?
fsforum/
http://johannesmueller.com/_private

Hope this is useful
Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
Lee Sykes
DNN Creative Staff
Nuke Master V
Nuke Master V
Posts:5283
02 Nov 2005 4:14 AM  
Date Metatags:

If you are using the Date Metatags with your DotNetNuke portal (as suggested in the interview).

When you make any content updates to a page and you have added the Date Metatag to the page, make sure you also update the Date Metatag, otherwise Google will not re-index your updated page....
Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
Lee Sykes
DNN Creative Staff
Nuke Master V
Nuke Master V
Posts:5283
16 Nov 2005 8:15 AM  
Database Size:

Keep an eye on the size of the database that GSiteCrawler creates. - I was unaware for quite a while of just how big the database had grown. - It had reached a whole 1GB in size!

Quick solution:

Go to File and Compress Database

This reduced the 1GB file to just 2MB! - Quite a difference...

When GSiteCrawler compresses the database it also creates a .bak backup file of the original database, so if you need to free up the disk space of this large backup file (eg. in this case it was 1GB) - check that the database has been compressed without creating any errors (eg. that GSiteCrawler still operates correctly) and then re-click on:

File / Compress Database

This will then create a .bak file of the small 2MB file and delete the 1GB file.
Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
You are not authorized to post a reply.
Forums > Users Lounge > DNN Creative Articles > Google Sitemaps Interview - Extra Tips


ActiveForums 3.7

Latest Forum Posts

RE: How to close a website while you are working on it by mcmanta
Hey JoeThanks for the quick reply I will give that a try.best regardsTom
RE: DataSprings / Aweber by ollep
Good Morning - and Thanks Lee! I did send the upload error message to DataSprings as well, but ...
RE: Google Verification Code Question by BCRose
I found the solution. If anyone else wants to know this information you must go to your home page ...
Google Verification Code Question by BCRose
Where do I place the Google verification code?I have been searching this site but cannot find any re...
RE: Home Page Login Question by BCRose
Thanks Lee...I have been watching the videos. Lot's to learn here.
RE: Home Page Login Question by jncraig
Start with:Setup Preparations for SkinningIntroduction to SkinningThen move on to some of the other ...
RE: How to close a website while you are working on it by jncraig
One way would be to assign two URLs -- a public URL and a private URL. Some hosting services provid...
RE: How to do links? by jncraig
There is a links module. If it has not been installed (and many modules are not installed by defaul...
RE: How to install DotNetNuke to Windows 7 - Issue 51 by jncraig
You need to purchase a subscription to DNNCreative Magazine.
RE: How to install DotNetNuke to Windows 7 - Issue 51 by jeihouni
hi,how can i download this video?is it free or i should pay for that?
RE: Enhancing the OWS Login Module and Building a Twitter Module - Issue 54 by bizcomit
How can I change the module/config to log-in using Enter Key ?
RE: DataSprings / Aweber by leesykes
Hello,When I created the tutorial for Aweber, the code they provided was placed within Form tags. An...
How to do links? by Guy..L
I'm setting up a website using DNN 5.2.4.  I'm confused by the many different ways I could set up na...
How to close a website while you are working on it by mcmanta
Hello All I would like to know if there is an easy way to close my DNN website while I'm working on ...
RE: DataSprings / Aweber by ollep
Hi Again Have now tried uploading the DataSprings Dynamic Forms Module (3.3) on 2 different sit...
RE: DataSprings / Aweber by ollep
Good Sunday Morning to you all!!! (Or to all "nutty" people that can't leave the computer alone e...
DataSprings / Aweber by ollep
Just jumping to another thread as the   le seemed wrong.Hi again Lee!! Just started reading ...
RE: PowerDNN Review by Declic Video FX
Hello, +1, I am also very happy !! I *was* hosted with WebHost4Life since many years with MS V...
RE: WebHost4Life by Declic Video FX
Same for me Richard.... I am (was?) hosted with WebHost4Life since many years with MS VPS account...
RE: Home Page Login Question by BCRose
Thanks for the quick reply. Sorry for being a dummy but where do I edit a skin at? Or the style sh...
AppTheory
RSS Feeds