User-agent: *
Disallow: /termsofuse.php
Disallow: /privacy.php
Disallow: /register.php

User-agent: Mediapartners-Google*
Disallow: