User-agent: * Disallow: /registerlink.asp Disallow: /registerdownload.asp Disallow: /test.html