Search Engine Optimization (Joomla! SEO) in Joomla! 3.x • Re: SEO website crawlers seeing links to articles

Hello!

If you want to make the crawlers stop to go in these pages, so yes this is a way to make it, problem they found these links from your sitemap or some page that gives links without the Friendly URL.



the correct robots.txt file should be:



User-agent: *

Disallow: /http://ift.tt/1yN7ipB

Disallow: /http://ift.tt/1I9LJcI

Disallow: /http://ift.tt/1yN7ipD

Disallow: /http://ift.tt/1I9LJsZ

Disallow: /index.php/91-blog

Disallow: /http://ift.tt/1I9LJt5

Disallow: /http://ift.tt/1yN7jK8

Disallow: /http://ift.tt/1I9LJt7

Disallow: /http://ift.tt/1I9LL4a

Disallow: /http://ift.tt/1yN7jKd

Disallow: /http://ift.tt/1I9LJtb





-------------------

PandoraFlora Team

http://ift.tt/15HQx7a

Statistics: Posted by PandoraFlora — Thu Feb 05, 2015 4:54 pm

---

via Joomla! http://ift.tt/1KiYCif