Laravel apps expose internal routes (/storage, /telescope, /horizon, /vendor) that should never be indexed. This generator creates optimized rules for Laravel projects — keeping your public pages crawlable while hiding framework internals.
Laravel serves debug tools (Telescope, Horizon), storage links, and vendor assets that should not appear in search results. A proper robots.txt prevents this and focuses crawl budget on your actual content.
Try It Now — Free, No Sign-up
Open the tool and get started instantly. No sign-up, no installation needed.
Open Robots.txt Generator Now100% browser-based • No upload to server • No sign-up required
How to Generate Robots.txt for Laravel Applications
- Select All bots (*) as user agent
- Add Disallow: /storage/, /vendor/, /telescope, /horizon
- Add Disallow for auth routes: /login, /register, /password
- Add Disallow: /admin (if you have admin panel)
- Add sitemap URL
- Save as public/robots.txt in your Laravel project
Pro Tips
- In Laravel, robots.txt goes in the /public folder
- Block /storage/logs/ to prevent log file exposure
- If using Laravel Nova, block /nova
- You can also generate robots.txt dynamically via a Laravel route
Frequently Asked Questions
Where does robots.txt go in Laravel?
In the /public folder — same as index.php. Laravel serves all files from /public as the web root.
Should I block /storage in robots.txt?
Yes. /storage contains uploaded files, logs, and cache. Block /storage/logs/ and /storage/framework/ at minimum. Allow /storage/app/public/ if you serve user uploads from there.
Can I generate robots.txt dynamically in Laravel?
Yes. Create a route that returns a Response with content-type text/plain. Useful for environment-specific rules (block everything on staging).
Related Tools & Guides
Ready to Use Robots.txt Generator?
Free, instant, and 100% private. No sign-up needed.
Open Robots.txt Generator