User-agent: * Disallow: /inc/ Disallow: /acuerdos/ Disallow: /paso* #facebook crawler User-agent: facebookexternalhit Disallow: #facebook crawler 1.1 User-agent: facebookexternalhit/1.1 Disallow: