You need to Register for free and Login to post a message in the forum.

Forum

Subject: Google Sitemaps Interview - Extra Tips
Prev Next
You are not authorized to post a reply.

Author Messages
leesykes
DNN Creative Staff
Nuke Master III
Nuke Master III
Posts:3960


02 Nov 2005 4:00 AM  
URL Filters:

Following the Google Sitemaps MP3 Interview with John Mueller, I wanted to share with you a quick tip for using the GSiteCrawler software with DotNetNuke.

Make sure you listen to the full interview for tips on preparing your Google sitemaps. Following one of the tips, here's a filter list that I have created so far to remove links that Google does not require.

This filter list is currently used when crawling the DNN Creative website. It is particulalrly used to extract certain links such as the register / login / terms / privacy links on each page, plus extra links that are created and not relevant for Google if you are using Scott McCulloch's News Articles Module and ActiveModules Active Forums module.

Here is a list of the filters that I currently use in GSiteCrawler:
(in the ban URL tab)
(you will notice that some of these filters include the defaults that come with GSiteCrawler, I have left these on so that you can easily compare)

/_vti_bin/
/afsort/
/Categories/
/CategoryID/
/CategoryView/
/login
/NewsListing/
/PostComment
/privacy
/profile/
/register
/Search/
/sendemail/
/Syndication/
/terms
?
fsforum/
http://johannesmueller.com/_private

Hope this is useful

Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
leesykes
DNN Creative Staff
Nuke Master III
Nuke Master III
Posts:3960


02 Nov 2005 4:14 AM  
Date Metatags:

If you are using the Date Metatags with your DotNetNuke portal (as suggested in the interview).

When you make any content updates to a page and you have added the Date Metatag to the page, make sure you also update the Date Metatag, otherwise Google will not re-index your updated page....


Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
leesykes
DNN Creative Staff
Nuke Master III
Nuke Master III
Posts:3960


16 Nov 2005 8:15 AM  
Database Size:

Keep an eye on the size of the database that GSiteCrawler creates. - I was unaware for quite a while of just how big the database had grown. - It had reached a whole 1GB in size!

Quick solution:

Go to File and Compress Database

This reduced the 1GB file to just 2MB! - Quite a difference...

When GSiteCrawler compresses the database it also creates a .bak backup file of the original database, so if you need to free up the disk space of this large backup file (eg. in this case it was 1GB) - check that the database has been compressed without creating any errors (eg. that GSiteCrawler still operates correctly) and then re-click on:

File / Compress Database

This will then create a .bak file of the small 2MB file and delete the 1GB file.

Lee Sykes
Site Administrator
Subscribe to the website : DotNetNuke Video Tutorials : The Skinning Toolkit : DotNetNuke Podcasts

Twitter: www.twitter.com/leesykes

Lee Sykes's Facebook Profile
You are not authorized to post a reply.
Forums > Users Lounge > DNN Creative Articles > Google Sitemaps Interview - Extra Tips



ActiveForums 3.7

Latest Forum Posts

Background colour by petecarrick
Hi,Sorry if this is a real dumb question, I've been experimenting with the Vortex skin and I have ch...
RE: Horizontal menu vertical borders by petecarrick
That worked perfectly, thanks very much Lee.Pete
Change Login Page by edeakin
Hey guys it’s me again. Great work on session 46 keep up the great work! I want to be able to add m...
RE: Module Wrapper & Tab Aggregator?? by gbrown
Found the Ajax Module Wrapper from Gumbosoft. Bought it and tried it - it works inside of Tab Aggreg...
Module Wrapper & Tab Aggregator?? by gbrown
Has anybody tried to place a Module Wrapper module from ZLDNN inside a Tab Aggregator module from DN...
RE: SWF Tutorial Conversion by raymueller
Thanks and I will continue to research. Each of the applications pick up the introduction (~ 20-25 s...
RE: Please do review by leesykes
There are a couple of things that you could look at:Initial page load time of the sites was slow, t...
RE: Module Development - Settings Page by leesykes
thanks for letting us know the solution and if there's anything else we can help out with please let...
RE: SWF Tutorial Conversion by leesykes
not sure, its not something I have tried, the swf should convert, perhaps its worth googling around ...
RE: not been able to download videos by leesykes
Normal 0 unctuationKerning/> false false false oNotPromoteQF/> ...
RE: Styling the main menu by leesykes
When you add code to your skin.css file, make sure you press CTRL+F5 to reload the page and reload t...
RE: Horizontal menu vertical borders by leesykes
To find the id of the menu item, use the web developers toolbar for Firefox, go to information menu...
RE: Module Development - Settings Page by HMDevelopment
Hello Lee. No thanks -- I have still earned value from this site. I did quite a few 'video' tutor...
RE: Can I modify the Default Events module only for a Portal? by jncraig
If you create a skin for your site, it will apply only to your site.  Also, portal.css applies only ...
RE: How to prevent auser from multiple login. by jncraig
I'm not aware of a way to do that.
RE: Display main menu and sub menus in different locations by jncraig
I would recommend that you study our tutorials regarding skin development as a good start.The exact ...
SWF Tutorial Conversion by raymueller
I have been trying to convert some of the older SWF tutorials to a format that I can load on my Zune...
SWF Tutorial Conversion by raymueller
I have been trying to convert some of the older SWF tutorials to a format that I can load on my Zune...
Can I modify the Default Events module only for a Portal? by pmanyara
Dear Colleagues,I manage a site, which is a portal in a larger dotnetnuke environment with several p...
RE: Styling the main menu by knuterik
Lee, Your test code for the partners menu item works fine now. I don't know why it didn't work th...
Free DotNetNuke Podcasts
RSS Feeds