User-agent: * Disallow: Disallow: /api/* Disallow: /admin-panel/* Disallow: /testemail Disallow: /testsms