All Versions
Latest Version
Avg Release Cycle
114 days
Latest Release
1651 days ago

Changelog History

  • v0.3.0 Changes

    August 17, 2019

    ๐Ÿ‘Œ Improved support for in-page Robots configuration (#7)
    โž• Added fragment support for crawl data (#7)
    โž• Added support for request timeouts (#7)
    โž• Added support for max pages to crawl (#7)
    Obey no-follow on anchors (#7)
    ๐Ÿ›  Various other minor tweaks and fixes (#7)

  • v0.2.0 Changes

    March 15, 2019

    Replaced crawl contents stream with a string, allowing easier access to contents.

  • v0.1.0 Changes

    January 01, 2019

    ๐ŸŽ‰ Initial release with core functionality