genealogytrails.com

Genealogy Trails History Group - Start your free family research here
Free Family History and Genealogy Records to Find Ancestors wherever their trails lead
Alexa stats for genealogytrails.com

Site Seo for genealogytrails.com

Tag :
H1	H2	H3	H4	H5
0	0	0	0	0
Image :
There are 13 images on this website and 13 images have alt attributes
Frame :
There are 0 embed on this website.
Flash :
There are 0 flash on this website.
Size :
28,457 characters
Meta Description :
Yes
Meta Keyword :
Yes
Magestic Backlinks for genealogytrails.com

About genealogytrails.com

Domain	genealogytrails.com
MD5	c574bad0347002e862b09ebec8fd8da4
Keywords	Genealogy, records, free family history,Family Research, free Vital Records, data transcriptions, Census records, Biographies from history books, obituaries, newspapers
Charset	US-ASCII
Page Speed	Check now
Web server	Apache
IP Address	192.249.114.120
# For domain: http://genealogytrails.com/
# All robots will spider the domain

User-agent: 008
User-agent: 123People
User-Agent: 360Spider
User-agent: A6-Indexer/1.0
User-agent: abot
User-agent: AboutUs
User-Agent: ADmantX
User-Agent: AhrefsBot
User-agent: AhrefsBot
User-agent: AhrefsBot/2.0
User-agent: AhrefsBot/4.0
User-agent: Alexibot
User-agent: Amfibi
User-agent: Ancestry.com
User-agent: Ancestrybot
User-agent: Aqua_Products
User-Agent: Arachni
User-agent: archive.org_bot
User-agent: asterias
User-agent: AsyncHttpClient
User-agent: b2w/0.1
User-agent: BackDoorBot
User-agent: BackDoorBot/1.0
User-agent: Baiduspider
User-agent: Baiduspider/2.0
User-agent: BecomeBot
User-agent: Birubot
User-agent: Bixo Labs
User-agent: Black Hole
User-agent: Black.Hole
User-agent: BlackWidow
User-Agent: Blexbot
User-agent: BlowFish
User-agent: BlowFish/1.0
User-agent: Bookmark search tool
User-agent: Bot mailto:[email protected]
User-agent: BotALot
User-agent: BotRightHere
User-agent: BuiltBotTough
User-agent: Bullseye
User-agent: Bullseye/1.0
User-agent: BunnySlippers
User-Agent: Buzzbot
User-agent: BuzzRanking
User-agent: Cazoodle
User-agent: Cegbfeieh
User-agent: CheeseBot
User-agent: CherryPicker
User-agent: CherryPickerElite/1.0
User-agent: CherryPickerSE/1.0
User-agent: ChinaClaw
User-agent: Copernic
User-agent: CopyRightCheck
User-agent: cosmos
User-agent: craftbot
User-Agent: CRAZYWEBCRAWLER
User-agent: Crescent
User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
User-agent: curl
User-agent: Cydral
User-agent: DepSpid
User-agent: DISCo
User-agent: DISCo Pump 3.0
User-agent: DISCo Pump 3.2
User-agent: discobot
User-agent: DISCoFinder
User-agent: DittoSpyder
User-Agent: DomainCrawler
User-agent: dotbot
User-agent: DotNet
User-agent: Download Demon
User-agent: Download Demon/3.2.0.8
User-agent: Download Demon/3.5.0.11
User-agent: eCatch
User-agent: eCatch/3.0
User-agent: EirGrabber
User-agent: EmailCollector
User-agent: EmailSiphon
User-agent: EmailWolf
User-agent: embed.ly
User-agent: Enaball
User-agent: Envolk
User-agent: EroCrawler
User-agent: Exabot
User-agent: Exooba
User-agent: Express WebPictures
User-agent: ExtractorPro
User-agent: EyeNetIE
User-Agent: Ezooms
User-agent: Ezooms
User-agent: FairAd Client
User-agent: Favorstar
User-agent: findestars
User-agent: Flaming AttackBot
User-agent: FlashGet
User-agent: FlashGet WebWasher 3.2
User-agent: Foobot
User-agent: Gaisbot
User-Agent: GetIntent
User-agent: GetRight
User-agent: GetRight/2.11
User-agent: GetRight/3.1
User-agent: GetRight/3.2
User-agent: GetRight/3.3
User-agent: GetRight/3.3.3
User-agent: GetRight/3.3.4
User-agent: GetRight/4.0.0
User-agent: GetRight/4.1.0
User-agent: GetRight/4.1.1
User-agent: GetRight/4.1.2
User-agent: GetRight/4.2
User-agent: GetRight/4.2b (Portuguxeas)
User-agent: GetRight/4.2c
User-agent: GetRight/4.3
User-agent: GetRight/4.5
User-agent: GetRight/4.5a
User-agent: GetRight/4.5b
User-agent: GetRight/4.5b1
User-agent: GetRight/4.5b2
User-agent: GetRight/4.5b3
User-agent: GetRight/4.5b6
User-agent: GetRight/4.5b7
User-agent: GetRight/4.5c
User-agent: GetRight/4.5d
User-agent: GetRight/4.5e
User-agent: GetRight/5.0beta1
User-agent: GetRight/5.0beta2
User-agent: GetWeb!
User-agent: Girafa
User-agent: Go-Ahead-Got-It
User-agent: Go!Zilla
User-agent: Go!Zilla (www.gozilla.com)
User-agent: Go!Zilla 3.3 (www.gozilla.com)
User-agent: Go!Zilla 3.5 (www.gozilla.com)
User-agent: GrabNet
User-agent: Grafula
User-Agent: GrapeshotCrawler
User-agent: Harvest
User-agent: Harvest/1.5
User-agent: hloader
User-agent: HMView
User-agent: httplib
User-agent: HTTrack
User-agent: HTTrack [NC,OR]
User-agent: HTTrack 3.0
User-agent: Huaweisymantecspider
User-agent: humanlinks
User-agent: ia_archiver
User-agent: ia_archiver-web.archive.org
User-agent: iarchives
User-Agent: ias_crawler
User-agent: ichiro
User-agent: Image Stripper
User-agent: Image Sucker
User-agent: Indy Library
User-agent: Indy Library [NC,OR]
User-agent: InfoNaviRobot
User-agent: InterGET
User-agent: Internet Ninja
User-agent: Internet Ninja 4.0
User-agent: Internet Ninja 5.0
User-agent: Internet Ninja 6.0
User-agent: Iron33/1.0.2
User-agent: ISC Systems iRc Search 2.1
User-Agent: James Bot
User-agent: Java/1.4.1_04
User-agent: JennyBot
User-agent: JetCar
User-agent: JOC Web Spider
User-agent: juxysywxjlqn5ptro5vaybfhkgldikrxv
User-agent: Kenjin Spider
User-agent: Kenjin.Spider
User-agent: Keyword Density/0.9
User-agent: Keyword.Density
User-agent: Kincrawler
User-agent: Kincrawler.com
User-agent: kosmix
User-agent: KosmosSpider
User-agent: larbin
User-agent: larbin ([email protected])
User-agent: larbin [email protected]
User-agent: larbin_2.6.2 ([email protected])
User-agent: larbin_2.6.2 ([email protected])
User-agent: larbin_2.6.2 (listonATccDOTgatechDOTedu)
User-agent: larbin_2.6.2 ([email protected])
User-agent: larbin_2.6.2 [email protected]
User-agent: larbin_2.6.2 [email protected]
User-agent: larbin_2.6.2 [email protected]
User-agent: larbin_2.6.2 listonATccDOTgatechDOTedu
User-agent: larbin_2.6.2 [email protected]
User-agent: LeechFTP
User-agent: LexiBot
User-agent: LexxeBot
User-agent: libWeb/clsHTTP
User-Agent: linkdexbot
User-agent: LinkextractorPro
User-agent: LinkScan/8.1a Unix
User-agent: LinkWalker
User-agent: LNSpiderguy
User-Agent: ltx71
User-agent: lwp-trivial
User-agent: lwp-trivial/1.34
User-agent: Mass Downloader
User-agent: Mass Downloader/2.2
User-agent: Mata Hari
User-agent: Mata.Hari
User-Agent: MaxPointCrawler
User-Agent: Mechanize
User-agent: Megaglobe
User-agent: Microsoft-WebDAV-MiniRedir/5.1.2600
User-agent: Microsoft URL Control
User-agent: Microsoft URL Control - 5.01.4511
User-agent: Microsoft URL Control - 6.00.8169
User-agent: Microsoft URL Control � 5.01.4511
User-agent: Microsoft URL Control � 6.00.8169
User-agent: Microsoft.URL
User-agent: MIDown tool
User-agent: MIIxpc
User-agent: MIIxpc/4.2
User-agent: Mirago
User-agent: Mister PiX
User-agent: Mister Pix II 2.01
User-agent: Mister Pix II 2.02a
User-agent: Mister PiX version.dll
User-agent: Mister.PiX
User-agent: MJ12bot
User-Agent: MJ12bot
User-agent: MLBot
User-agent: moget
User-agent: moget/2.1
User-agent: Mozilla crawl/5.0 (compatible; frt/1.13.2 +http://www..com)
User-agent: mozilla/4
User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 2000)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 95)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 98)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows ME)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows XP)
User-agent: Mozilla/4.0+(compatible;+Win32;+WinHttp.WinHttpRequest.5)
User-agent: mozilla/5
User-agent: Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com
User-agent: Mozilla/5.0 (compatible; OsO; http://oso.octopodus.com/abot.html)
User-agent: Mozilla/5.0 (compatible; YandexBot/3.0)
User-agent: MSIECrawler
User-agent: msnbot-media
User-agent: MSR-ISRCCrawler
User-agent: MyFamilyBot
User-agent: MyOnID
User-agent: Navroad
User-agent: NearSite
User-agent: NerdyBot
User-agent: Net Vampire
User-agent: Net Vampire/3.0
User-agent: NetAnts
User-agent: NetAnts/1.10
User-agent: NetAnts/1.23
User-agent: NetAnts/1.24
User-agent: NetAnts/1.25
User-agent: NetMechanic
User-agent: NetSpider
User-agent: NetZIP
User-agent: NetZip-Downloader/1.0.62 (Win32; Dec 7 1998)
User-agent: NetZip Downloader 1.0 Win32(Nov 12 1998)
User-agent: NetZippy+(http://www.innerprise.net/usp-spider.asp)
User-agent: Nextthing
User-agent: NICErsPRO
User-Agent: Nikto
User-agent: NPbot
User-agent: Nutch
User-agent: octopodus
User-agent: Octopus
User-agent: Offline Explorer
User-agent: Offline Explorer/1.2
User-agent: Offline Explorer/1.4
User-agent: Offline Explorer/1.6
User-agent: Offline Explorer/1.7
User-agent: Offline Explorer/1.9
User-agent: Offline Explorer/2.0
User-agent: Offline Explorer/2.1
User-agent: Offline Explorer/2.3
User-agent: Offline Explorer/2.4
User-agent: Offline Explorer/2.5
User-agent: Offline Navigator
User-agent: Offline.Explorer
User-agent: oidiagcErgcwEdjjiqsyngksesvsksfevir
User-agent: OneRiot
User-agent: Openbot
User-agent: Openfind
User-agent: Openfind data gathere
User-agent: Openfind data gatherer
User-agent: OpenindexSpider
User-agent: Oracle Ultra Search
User-agent: page-store
User-agent: PageGrabber
User-agent: Papa Foto
User-agent: pavuk
User-agent: pcBrowser
User-agent: peekyou
User-agent: PerMan
User-agent: Pipl
User-agent: ProPowerBot/2.14
User-agent: ProWebWalker
User-Agent: proximic
User-agent: psbot
User-agent: Python-urllib
User-agent: Qirina Hurdler
User-agent: QueryN Metasearch
User-agent: QueryN.Metasearch
User-Agent: Qwantify
User-agent: Radiation Retriever 1.1
User-agent: rapleaf
User-agent: RealDownload
User-agent: RealDownload/4.0.0.40
User-agent: RealDownload/4.0.0.41
User-agent: RealDownload/4.0.0.42
User-agent: REAP-crawler
User-agent: ReGet
User-agent: RepoMonkey
User-agent: RepoMonkey Bait & Tackle/v1.01
User-agent: RMA
User-Agent: RU_Bot
User-agent: Ruby
User-agent: ScoutJet
User-Agent: scrapy-redis
User-Agent: scrapy
User-agent: Searchles
User-agent: Searchme
User-agent: searchpreview
User-Agent: SemrushBot
User-Agent: SEOkicks
User-Agent: seoscanner
User-Agent: SISTRIX
User-Agent: SiteExplorer
User-agent: SiteSnagger
User-agent: Slurp
User-agent: SlySearch
User-agent: SmartDownload
User-agent: SmartDownload/1.2.76 (Win32; Apr 1 1999)
User-agent: SmartDownload/1.2.77 (Win32; Aug 17 1999)
User-agent: SmartDownload/1.2.77 (Win32; Feb 1 2000)
User-agent: SmartDownload/1.2.77 (Win32; Jun 19 2001)
User-agent: SMBot
User-agent: snitch
User-agent: sogou spider
User-agent: Sosospider
User-agent: SpankBot
User-agent: spanner
User-agent: Speedy
User-agent: spider26.yandex.ru
User-agent: spock
User-Agent: SQLmap
User-agent: Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux
User-agent: SuperBot
User-agent: SuperBot/3.0 (Win32)
User-agent: SuperBot/3.1 (Win32)
User-agent: SuperHTTP
User-agent: SuperHTTP/1.0
User-Agent: SurdotlyBot
User-agent: Surfbot
User-agent: suzuran
User-agent: Synoo
User-agent: Szukacz/1.4
User-agent: tAkeOut
User-agent: Teleport
User-agent: Teleport Pro
User-agent: Teleport Pro/1.29
User-agent: Teleport Pro/1.29.1590
User-agent: Teleport Pro/1.29.1634
User-agent: Teleport Pro/1.29.1718
User-agent: Teleport Pro/1.29.1820
User-agent: Teleport Pro/1.29.1847
User-agent: TeleportPro
User-agent: Telesoft
User-agent: Teoma
User-Agent: TestiTest1
User-agent: The Intraformant
User-agent: The.Intraformant
User-agent: TheNomad
User-agent: TightTwatBot
User-agent: Titan
User-agent: toCrawl/UrlDispatcher
User-Agent: Trident/5.0
User-agent: Trovatore
User-agent: True_Robot
User-agent: True_Robot/1.0
User-agent: turingos
User-agent: TurnitinBot
User-agent: TurnitinBot/1.5
User-agent: tweepz
User-agent: TweetmemeBot
User-agent: TweetmemeBot/4.0
User-agent: twiceler
User-agent: UnwindFetchor
User-Agent: UptimeRobot
User-agent: URL Control
User-agent: URL_Spider_Pro
User-agent: URLy Warning
User-agent: URLy.Warning
User-agent: User-agent: LPbot
User-agent: VCI
User-agent: VCI WebViewer VCI WebViewer Win32
User-Agent: Vega
User-agent: VoidEYE
User-agent: VoilaBot
User-agent: voyager-hc/1.0
User-agent: Web Image Collector
User-agent: Web Sucker
User-agent: Web.Imge.Collector
User-agent: WebAuto
User-agent: WebAuto/3.40 (Win98; I)
User-agent: WebBandit
User-agent: WebBandit/3.50
User-agent: WebCapture 2.0
User-agent: WebCopier
User-agent: WebCopier v.2.2
User-agent: WebCopier v2.5
User-agent: WebCopier v2.6
User-agent: WebCopier v2.7a
User-agent: WebCopier v2.8
User-agent: WebCopier v3.0
User-agent: WebCopier v3.0.1
User-agent: WebCopier v3.2
User-agent: WebCopier v3.2a
User-agent: WebEMailExtrac.
User-agent: WebEnhancer
User-agent: WebFetch
User-agent: webfetch/2.1.0
User-agent: WebGo IS
User-agent: WebLeacher
User-agent: WebmasterWorldForumBot
User-agent: WebReaper
User-agent: WebReaper [[email protected]]
User-agent: WebReaper [[email protected]]
User-agent: WebReaper v9.1 � www.otway.com/webreaper
User-agent: WebReaper v9.7 � www.webreaper.net
User-agent: WebReaper v9.8 � www.webreaper.net
User-agent: WebReaper vWebReaper v7.3 � www,otway.com/webreaper
User-agent: WebSauger
User-agent: WebSauger 1.20b
User-agent: WebSauger 1.20j
User-agent: WebSauger 1.20k
User-agent: Website eXtractor
User-agent: Website eXtractor (http://www.asona.org)
User-agent: Website Quester
User-agent: Website Quester � www.asona.org
User-agent: Website Quester � www.esalesbiz.com/extra/
User-agent: Website.Quester
User-agent: Webster Pro
User-agent: Webster.Pro
User-agent: WebStripper
User-agent: WebStripper/2.03
User-agent: WebStripper/2.10
User-agent: WebStripper/2.12
User-agent: WebStripper/2.13
User-agent: WebStripper/2.15
User-agent: WebStripper/2.16
User-agent: WebStripper/2.19
User-agent: WebWhacker
User-agent: WebZip
User-agent: WebZIP/2.75 (http://www.spidersoft.com)
User-agent: WebZIP/3.65 (http://www.spidersoft.com)
User-agent: WebZIP/3.80 (http://www.spidersoft.com)
User-agent: WebZip/4.0
User-agent: WebZIP/4.0 (http://www.spidersoft.com)
User-agent: WebZIP/4.1 (http://www.spidersoft.com)
User-agent: WebZIP/4.21
User-agent: WebZIP/4.21 (http://www.spidersoft.com)
User-agent: WebZIP/5.0
User-agent: WebZIP/5.0 (http://www.spidersoft.com)
User-agent: WebZIP/5.0 PR1 (http://www.spidersoft.com)
User-agent: Wget
User-Agent: Wget
User-agent: Wget/1.5.2
User-agent: Wget/1.5.3
User-agent: Wget/1.6
User-agent: Wget/1.7
User-agent: Wget/1.8
User-agent: Wget/1.8.1
User-agent: Wget/1.8.1+cvs
User-agent: Wget/1.8.2
User-agent: Wget/1.9-beta
User-agent: Widow
User-agent: WikiDo
User-agent: wink
User-Agent: wpscan
User-agent: WWW-Collector-E
User-agent: WWWOFFLE
User-agent: Xaldon WebSpider
User-agent: Xaldon WebSpider 2.5.b3
User-Agent: XoviBot
User-agent: Yandex
User-agent: Yandex/1.01.001 (compatible; Win16; I)
User-agent: YandexBot/3.0
User-agent: YandexImages/3.0
User-agent: YandexImages/3.0
User-agent: YandexWebmaster/2.0
User-agent: Yasni
User-Agent: YFF35
User-agent: YioopBot
User-agent: yoname
User-agent: yourtraces
User-agent: ZanranCrawler
User-agent: zermelo
User-agent: Zeus
User-agent: Zeus 11389 Webster Pro V2.9 Win32
User-agent: Zeus 11652 Webster Pro V2.9 Win32
User-agent: Zeus 18018 Webster Pro V2.9 Win32
User-agent: Zeus 26378 Webster Pro V2.9 Win32
User-agent: Zeus 30747 Webster Pro V2.9 Win32
User-agent: Zeus 32297 Webster Pro V2.9 Win32
User-agent: Zeus 39206 Webster Pro V2.9 Win32
User-agent: Zeus 41641 Webster Pro V2.9 Win32
User-agent: Zeus 44238 Webster Pro V2.9 Win32
User-agent: Zeus 51070 Webster Pro V2.9 Win32
User-agent: Zeus 51674 Webster Pro V2.9 Win32
User-agent: Zeus 51837 Webster Pro V2.9 Win32
User-agent: Zeus 63567 Webster Pro V2.9 Win32
User-agent: Zeus 6694 Webster Pro V2.9 Win32
User-agent: Zeus 71129 Webster Pro V2.9 Win32
User-agent: Zeus 82016 Webster Pro V2.9 Win32
User-agent: Zeus 82900 Webster Pro V2.9 Win32
User-agent: Zeus 84842 Webster Pro V2.9 Win32
User-agent: Zeus 90872 Webster Pro V2.9 Win32
User-agent: Zeus 94934 Webster Pro V2.9 Win32
User-agent: Zeus 95245 Webster Pro V2.9 Win32
User-agent: Zeus 95351 Webster Pro V2.9 Win32
User-agent: Zeus 97371 Webster Pro V2.9 Win32
User-agent: Zeus Link Scout
User-agent: zoominfo
Disallow: /

User-agent: https://www.kincrawler.com/yp/bot.php
Disallow: /
User-agent: Kin Crawler
Disallow: /
User-agent: proximic
Disallow: /
User-agent: Baiduspider
Disallow: /
User-agent: Gluten Free Crawler/1.0
Disallow:/
User-agent: sogou spider
Disallow: /
User-agent: YoudaoBot
Disallow: /
User-agent: SiteExplorer
Disallow: /
User-agent: 360Spider
Disallow: /
User-agent: cognitiveseo
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: rogerbot
Disallow: /
User-agent: Scrapy
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: SMTBot
Disallow: /
User-agent: spbot
Disallow: /
User-agent: vebidoobot
Disallow: /
User-agent: YisouSpider
Disallow: /
User-agent: ZoomBot
Disallow: /
User-agent: MegaIndex.ru
Disallow: /
User-agent: aiHitBot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: BOT
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: CheckMarkNetwork
Disallow: /
User-agent: Cliqzbot
Disallow: /
User-agent: coccocbot-web
Disallow: /
User-agent: DeuSu
Disallow: /
User-agent: DomainStatsBot
Disallow: /
User-agent: DotBot
Disallow: /
User-agent: eCairn-Grabber
Disallow: /
User-agent: Exabot
Disallow: /
User-agent: FatBot
Disallow: /
User-agent: GrapeshotCrawler
Disallow: /
User-agent: HaosouSpider
Disallow: /
User-agent: linkdexbot
Disallow: /
User-agent: ltx71
Disallow: /
User-agent: memoryBot
Disallow: /
User-agent: psbot
Disallow: /
User-agent: roboto
Disallow: /
User-agent: SecurityResearch.bot
Disallow: /
User-agent: SEOkicks-Robot
Disallow: /
User-agent: SurdotlyBot
Disallow: /
User-agent: WBSearchBot
Disallow: /
User-agent: Wotbox
Disallow: /
User-agent: yoozBot-2.2
Disallow: /
User-agent: YioopBot
Disallow: /
User-agent: TweetmemeBot/4.0
Disallow: /
User-agent: MJ12Bot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: SEMrushBot
Disallow: /
User-agent: DotBot
Disallow: /
User-agent: MauiBot
Disallow: /
User-agent: SeznamBot
Disallow: /
User-agent: TinEye-bot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: SEOkicks-Robot
Disallow: /
User-agent: Yeti
Disallow: /
User-agent: TurnitinBot
Disallow: /
User-agent: Baidu
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: Twitterbot
Disallow: /

#Disallow directory
User-agent: *
Disallow: /cgi-bin/
Disallow: /graphics/
Disallow: /images/
Disallow: /wp-

# Directories
Disallow: /includes/
Disallow: /misc/
Disallow: /modules/
Disallow: /profiles/
Disallow: /scripts/
Disallow: /themes/
# Files
Disallow: /CHANGELOG.txt
Disallow: /cron.php
Disallow: /INSTALL.mysql.txt
Disallow: /INSTALL.pgsql.txt
Disallow: /INSTALL.sqlite.txt
Disallow: /install.php
Disallow: /INSTALL.txt
Disallow: /LICENSE.txt
Disallow: /MAINTAINERS.txt
Disallow: /update.php
Disallow: /UPGRADE.txt
Disallow: /xmlrpc.php
Disallow: /jail.html
# Paths (clean URLs)
Disallow: /admin/
Disallow: /comment/reply/
Disallow: /filter/tips/
Disallow: /node/add/
Disallow: /search/
Disallow: /user/register/
Disallow: /user/password/
Disallow: /user/login/
Disallow: /user/logout/
# Paths (no clean URLs)
Disallow: /?q=admin/
Disallow: /?q=comment/reply/
Disallow: /?q=filter/tips/
Disallow: /?q=node/add/
Disallow: /?q=search/
Disallow: /?q=user/password/
Disallow: /?q=user/register/
Disallow: /?q=user/login/
Disallow: /?q=user/logout/