FM / robots-txt

/home/techb158/ileadtechnology.com/vendor/spatie/robots-txt/

/home/techb158/ileadtechnology.com/vendor/spatie/robots-txt

Name	Size	Mode	Actions
src/	-	0755	rm
.styleci.yml	66	0644	edit dl rm
CHANGELOG.md	653	0644	edit dl rm
composer.json	979	0644	edit dl rm
CONTRIBUTING.md	2969	0644	edit dl rm
LICENSE.md	1090	0644	edit dl rm
README.md	2812	0644	edit dl rm

Edit: /home/techb158/ileadtechnology.com/vendor/spatie/robots-txt/CHANGELOG.md (653B)

# Changelog All notable changes to `robots-txt` will be documented in this file ## 1.0.7 - 2020-04-29 - fix find robots meta tag line if minified code (#23) ## 1.0.6 - 2020-04-07 - fix headers checking (nofollow, noindex) for custom userAgent (#21) ## 1.0.5 - 2019-08-08 - improvements around handling of wildcards, end-of-string, query string ## 1.0.4 - 2019-08-07 - improve readability ## 1.0.3 - 2019-03-11 - fix parsing robotstxt urls with keywords (#14) ## 1.0.2 - 2019-01-11 - make robots.txt check case insensitive ## 1.0.1 - 2018-05-07 - prevent exception if the domain has no robots.txt ## 1.0.0 - 2018-05-07 - initial release