Work at Home Moms Internet Marketing & Networking

 

 

Internet Search Engine Information

FREE E-Book

FREE - "How to Start a Profitable Online Business from Scratch" Even with zero experience and only a few spare hours a week!

Getting Started

> >
> Free Newsletter
> Free eCourses
> Getting Started
> Build a Website
> Site Build It
> Business Ideas
> Write & Sell eBooks
> Affiliate Marketing
> SEO & Traffic
> Ezines & Newsletters
> Blogging & RSS
> Social Networking
> Press Release & Publicity
> Writing & Copywriting
> Online Auctions
> Online Business Articles
> Direct Sales Center
> Direct Sales Articles
> Work at Home & Jobs
> Service Business Articles
> Small Business Bookkeeping

Our Services & Products:

> Easy Website Builder - Free Trial
>

Cheap Domains & Hosting

> Content for Your Websites
> Free Newsletter
> Free eCourses
> Money-Making eBook

  

Directories

> Work at Home Blog
> Direct Sales Center
> Internet Marketing Tools
> Business Opportunities & Classified Ads
> Breast Cancer Awareness

  

Just for Moms

> Time Management & Organization
> Health & Wellbeing
> Money & Savings
> Parenting & Family
> Diet & Fitness
> Cooking & Recipes
   

 

Search Engine& Web Building Information > Techie Stuff > Create Robots Txt

Create Robots Txt

A robots txt is a text file uploaded to your website server to keep compliant search engine robots from indexing particular pages of your website. Create a robots txt file like this

User-agent: Search Engine Robot Name
Disallow: File or Directory

Ex.

User-agent: Googlebot
Disallow: /adcampaign1.html

or

User-agent: *
Disallow: /adcampaign1.html

The * is used to cover all compliant search engine robots.

Common Robot Names

Search engine robots follow links throughout the Internet to crawl through all the websites on the world wide web. Here's a list of top search engine robot names:

 

Google:

googlebot

Ask Jeeves:

Teoma

Alta Vista / Yahoo / All the Web / Inktomi

Slurp

Check Your Robots txt on Search Engine World's Robots.txt ValidatorCheck Your Robots txt on Search Engine World's Robots.txt Validator

Or Use This Free Robots.txt Generator

 

More Search Engine Information: Highly Recommended! 

Check > John Reese's Traffic Secrets 2.0 course is a must have for anyone serious about driving traffic to their website.  Learn more about this fantastic resource by clicking here.

 

 

 

 

 

 

As Seen On:

 

 

 

 

 

 

 

 

 

 

 

Moms Helping You Build a Better Online Business

How to Build a Website | How to Start an Internet Business | Stay at Home Mom Business Ideas | Learn Internet Marketing | Affiliate Marketing | SEO
Write & Sell eBooks
| Ezine Publishing & Email Marketing | Blogging & RSS Resources | Social Networking Resources | Press Release Writing & Free Publicity
Online Auction Resources | General Internet Marketing Articles | Free Webmaster Tools  | Wellness Center | Small Business Grants | Writing for the Internet
Mom Business Success Stories | Internet Marketing Articles Direct Sales Articles | Service Business Articles | John Reese
 Traffic Secrets | Reese Report | Avoid Bankruptcy | Credit Repair | Public Domain | Retirement Planning
Get Rich Quick Schemes | Word of Mouth Marketing | Stop Spam | Recommended Mom Sites

Biz Ideas: Sell Products | Sell Services | Sell E-Products | Theme Sites | Sell eBooks

Internet Marketing Newsletter | Archives


Press Releases | About Us | Contact & Support | Policies & Disclaimer | Site Map

Copyright © Internet Based Moms 2002 - 2011. All rights reserved.