Lightnovel-crawler

- New sources:
- `https://rewayat.club`
- `http://boxnovel.org` with search capability. Sakari Saastamoinen
- `https://www.worldnovel.online/`
- Remove sources:
- `https://www.flying-lines.com`: Obfuscated content
- `https://novelsrock.com`: 404 - Not Found
- Fix sources:
- Remove all prettify
- [royalroad] Clean contents
- [royalroad] Fix search
- [test] Update www.tiknovel.com input
- Replace download links for windows and linux standalone
- [.travis.yml] check syntax before running script
- [crawler] Fix removing the next <br> tags
- [test bot] reverse format, update inputs and tests
- Enable specifying text direction in crawler
- Fix binders/web.py
- Use GITHUB_TOKEN instead of password for posting issue from test bot

- New source: <http://tiknovel.com>
- [listnovel] fix title parsing
- [novelfull] Fix get chapter list on non-paginated links
- [.appveyor] add --no-cache-dir to install
- [test/post_github] Fix strftime format specs

- **Breaking Change**
- Move folder `src/spiders` to `src/sources`
- Auto import all spiders in `src/source/__init__.py`
- To add new source, no need to update `__init__.py` file from now on, just provide `base_url` property to the subclass of the `Crawler` you have created. It can be a string or an array of strings. See existing sources in `src/sources/` folder for example.
- [sources/_template.py] -> update comments
- New sources:
- `tomotranslations.com`
- `https://4scanlation.com/`
- `http://www.tiknovel.com/`
- `https://listnovel.com`
- `https://www.wuxialeague.com/`
- `http://liberspark.com`
- `https://webnovelindonesia.com`
- Disabled or removed sources:
- `https://myoniyonitranslations.com/`
- `https://www.jieruihao.cn/`
- Feature updates:
- [console] by default only generate epub format
- 283 Feature request: Adding Chapter Count To Volume
- Bug fixes:
- fix gravitytales parsing bug 282 diogenes895
- fix content select for wuxiasite diogenes895
- [webnovel.com] Chapters in "Table of Contents" isn't numbered
- [gravitytales] fix content formatting
- [wuxiasite] keep old style chapter content recognizer, just in case
- [translateindo] remove unwanter characters from author name
- [worldnovelonline] Disable search cause it takes too long to respond
- [wuxiaco] update base url
- [test bot] Ignore HTTPError (do not report them to issues)
- [test-bot] define output formats manually
- Updates to test bot
- [test] change how to process errors
- Add or update more inputs in test_inputs.py
- [test bot] from requests import ConnectionError
- [setup_pyi.py] Use hidden import spec for src/sources
- Create scripts folder for publish scripts
- [crawler.py] Add `verify=False` and `timeout=2.5 minutes` for `get_response`
- [requirements.txt] Bump version: beautifulsoup4, js2py

- New sources:
- <https://www.aixdzs.com>
- <https://webnovelonline.com>
- Fixed or updated sources:
- [mtled-novels] Add support for login
- [webnovel] Remove pirate text
- [creativenovels] clean up nag spans and style tagbarf tidux
- [wuxiacom] ul-tags used for dialogue removed by crawler
- [wuxiacom] dialogue missing line breaks
- [zenithnovels] fix chapter list ordering
- [qidiancom] fix: get volume list from ajax call
- Bots:
- [test] Refactoring
- [test] Changed test inputs for some sources
- [console] fix: some arguments are not showing in help
- [console] Add two more argument options:
- `--filename NAME`: Set the output file name
- `--filename-only`: Skip appending chapter range with file name
- Testing: Update .travis.yml, .appveyor.yml to support for python 3.8
- Raise error if response status code is not 200 in crawler.py
- Remove useless logging from novel-info in most crawlers
- Raise a ConnectionError on improper html document
- Update chapter and volume title: do not set default title unless empty

- New sources:
- https://novelringan.com/ #252 yudilee
- https://wuxiaworld.site/ #251 yudilee
- https://kiss-novel.com/ #240 yudilee
- Updated sources:
- [readln] Do not display unncessary exceptions
- [creativenovels] Extract the security key for chapter list
- [kisslightnovels] Remove badge from title
- [babelnovel] Do not display limited free chapters in for now
- [webnovel] Fix content formatting
- [readnovelfull] Parse old style chapter content
- [babelnovel] Ignore error if no cssUrl is available
- Remove sources:
- [jieruihao] Site no longer available
- Add tests for kiss-novel and machine-translation

- New sources:
- <https://ranobelib.me/> juh9870
- <https://www.flying-lines.com/>
- Fix Heroku:
- Added Calibre ebook and node buildpack NNTin
- Added required package.json
- Fix: mkdir threw error when already exists
- Bot updates:
- [console] Enable output choice and use list instead of confirm
- [discord] Enable multiple format choosing
- Fix sources:
- [babelnovel] Recognize limited free novel chapters
- [webnovel] Hide locked chapters and fix chapter download
- [babelnovel] Fix issue with url yudilee
- [readnovelfull.com] Fix get chapter body yudilee
- [worldnovelonline] Get chapter list in chunk of 100 yudilee
- [creativenovels ] fix chapter listing tidux
- [machinetransorg] minor fix yudilee
- Refactoring:
- Split bot/console.py into multiple parts
- Rename method: bind_books -> generate_books
- Fix `cfscrape` yudilee
- Fix test.py