- feat(crawl): callback to run when link is found ([13](https://github.com/madeindjs/spider/pull/13) thanks to [j-mendez](https://github.com/j-mendez))
1.2.0
- Add User Agent configuration ([5](https://github.com/madeindjs/spider/pull/5) thanks to [Dragnucs](https://github.com/Dragnucs)) - Add polite delay ([6](https://github.com/madeindjs/spider/pull/6) thanks to [Dragnucs](https://github.com/Dragnucs) )
1.1.3
- Handle page get errors ([4](https://github.com/madeindjs/spider/pull/4) thanks to [Dragnucs](https://github.com/Dragnucs)) - Fix link resolution ([3](https://github.com/madeindjs/spider/pull/3) thanks to [Dragnucs](https://github.com/Dragnucs))