User-agent: * Disallow: /internal/ # ftp directory Disallow: /sites/ temp folder for in development sites Disallow: /bin/ programs Disallow: /includes/ programs Disallow: /ironroad/ programs Disallow: /webtrends/ programs Disallow: /lib/ programs