# All robots will spider the domain User-agent: * Disallow: # Disallow directories User-agent: * Disallow: /galleries/ User-agent: * Disallow: /images/ User-agent: * Disallow: /media/ User-agent: * Disallow: /etc/ User-agent: * Disallow: /image/