User-agent: * Disallow: /courses/ Disallow: /pub/ Disallow: /uploads/