- Add User Agent configuration ([5](https://github.com/madeindjs/spider/pull/5) thanks to [Dragnucs](https://github.com/Dragnucs)) - Add polite delay ([6](https://github.com/madeindjs/spider/pull/6) thanks to [Dragnucs](https://github.com/Dragnucs) )
1.1.3
- Handle page get errors ([4](https://github.com/madeindjs/spider/pull/4) thanks to [Dragnucs](https://github.com/Dragnucs)) - Fix link resolution ([3](https://github.com/madeindjs/spider/pull/3) thanks to [Dragnucs](https://github.com/Dragnucs))