Scrapeghost

* move to supporting Python 3.11 and 3.12
* move to `openai` 1.0
* move to `pydantic` 2.0
* add support for November 2023 model upgrades

* Improve type annotations and remove some ignored errors.
* Support for new OpenAI models announced June 13th 2023.
* Improved support for model fallbacks. Now if a request has 6k tokens and the model list looks like `['gpt-3.5-turbo', 'gpt-3.5-turbo-16k']`, the 16k model will be used automatically since the default 4k model will not be able to handle the request.

* Restore `PaginatedSchemaScraper` and add documentation for pagination.
* Documentation improvements.

Changelog

* Deactivate `HallucinationCheck` by default, it is overly aggressive and needs more work to be useful without raising false positives.
* Bugfix for postprocessors parameter behavior not overriding defaults.

Changelog

Next

* Fix bug with JSON nudging.
* Improve `HallucinationCheck` to handle more cases.