You need to Register for free and Login to post a message in the forum.

Forum

Subject: Google Sitemaps Interview - Extra Tips
Prev Next
You are not authorized to post a reply.

Author Messages
Lee Sykes
DNN Creative Staff
Nuke Master V
Nuke Master V
Posts:5287


02 Nov 2005 4:00 AM  
URL Filters:

Following the Google Sitemaps MP3 Interview with John Mueller, I wanted to share with you a quick tip for using the GSiteCrawler software with DotNetNuke.

Make sure you listen to the full interview for tips on preparing your Google sitemaps. Following one of the tips, here's a filter list that I have created so far to remove links that Google does not require.

This filter list is currently used when crawling the DNN Creative website. It is particulalrly used to extract certain links such as the register / login / terms / privacy links on each page, plus extra links that are created and not relevant for Google if you are using Scott McCulloch's News Articles Module and ActiveModules Active Forums module.

Here is a list of the filters that I currently use in GSiteCrawler:
(in the ban URL tab)
(you will notice that some of these filters include the defaults that come with GSiteCrawler, I have left these on so that you can easily compare)

/_vti_bin/
/afsort/
/Categories/
/CategoryID/
/CategoryView/
/login
/NewsListing/
/PostComment
/privacy
/profile/
/register
/Search/
/sendemail/
/Syndication/
/terms
?
fsforum/
http://johannesmueller.com/_private

Hope this is useful

Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
Lee Sykes
DNN Creative Staff
Nuke Master V
Nuke Master V
Posts:5287


02 Nov 2005 4:14 AM  
Date Metatags:

If you are using the Date Metatags with your DotNetNuke portal (as suggested in the interview).

When you make any content updates to a page and you have added the Date Metatag to the page, make sure you also update the Date Metatag, otherwise Google will not re-index your updated page....


Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
Lee Sykes
DNN Creative Staff
Nuke Master V
Nuke Master V
Posts:5287


16 Nov 2005 8:15 AM  
Database Size:

Keep an eye on the size of the database that GSiteCrawler creates. - I was unaware for quite a while of just how big the database had grown. - It had reached a whole 1GB in size!

Quick solution:

Go to File and Compress Database

This reduced the 1GB file to just 2MB! - Quite a difference...

When GSiteCrawler compresses the database it also creates a .bak backup file of the original database, so if you need to free up the disk space of this large backup file (eg. in this case it was 1GB) - check that the database has been compressed without creating any errors (eg. that GSiteCrawler still operates correctly) and then re-click on:

File / Compress Database

This will then create a .bak file of the small 2MB file and delete the 1GB file.

Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
You are not authorized to post a reply.
Forums > Users Lounge > DNN Creative Articles > Google Sitemaps Interview - Extra Tips



ActiveForums 3.7

Latest Forum Posts

Non Standard Port with DNN 5+ by thejudge
Hello Some time back we started tinkering with DNN v5, however we couldn't get it to work when tr...
RE: Community Edition Question by idesofmarch
Thanks a million! This is my first project in dotnetnuke. I've always done Joomla or Drupal. But I d...
Flash in the HTML Module-Source Code by robmacker
Here is the source Flash files for the implementation question i have below. Thank you for lookin...
Windows 7 Install gone wrong by RichardSletcher
Hi I have just attempted to install DNN 5.2 on Windows 7 Pro. I followed you video tutorial but I n...
RE: Module Advanced Setting by jncraig
The module contents is distinct and separate from the Module's container on a particular page. Wh...
RE: Community Edition Question by jncraig
The UDT Module has a new name: Form and List. Look for that. If it is not installed, it shoul...
DataSpring Opt In Module - Scheduler Question by wynnjon
Hey-I was wondering if anything special had to be done to keep the site alive so that the scheduler ...
RE: the now content not showing and still showing the old one by jncraig
You probably can't. Your browser is caching the old flash file, and CRTL-F5 forces a reload. If yo...
RE: Nav Menu v2 for DotNetNuke v5 - Issue 52 by jncraig
Here is a nice little blog entry on the subject.(Basically, though, this gives you a nice and clean ...
RE: Flash in the HTML Module by robmacker
OK, so i commented out my AC_RunActiveContent.js file and my HTML module runs the same -- telling me...
RE: Flash in the HTML Module by mcmanta
I had the same problem before. I noticed I had some HTML tags from some error text I copied. I was a...
RE: Creating Portals before setting the host by cyborama
Thanks for the reply Joe, The way my hosting company does things they don't have per say host hea...
RE: Flash in the HTML Module by robmacker
Wow, why does the forum format my question to make it basically unreadable?? I certainly did not typ...
Flash in the HTML Module by robmacker
Hello members! I have a simple flash application that was written for an HTML page and i'm trying...
Send email with Dynamic Forms Results by jesp17
Hello, Is there a way to automatically generate a report with all form results and then send this r...
Community Edition Question by idesofmarch
I'm learning a lot just browsing around here. Wish I could delete my question below. Oh well. Wher...
RE: DNN Site crashed after module install by mcmanta
I found a work around. Looks like the module replaces the Telerik.Web.UI located in the bin folder o...
RE: iHostASP by chandirika
Hi,I am reselling account with this http://www.goresellers.com/ site ,for my web site's web hosting...
the now content not showing and still showing the old one by wael_e
after i uploading the new contenct in my website and i uploading static html page have introdaction ...
RE: Regular Expression by jumatthey
Hi, Thank you very much Mark. It is indeed a name I am checking. Thank you for your help, very mu...
DotNetNuke Modules
RSS Feeds