Airbyte

🚀 New Features

_This release adds new metadata fields to all streams, including a unique record ID (`_airbyte_raw_id`) and timestamp (`_airbyte_extracted_at`). This release also adds a feature to auto-add new columns if they are missing from cache tables._

- Add new [internal Airbyte columns](https://airbytehq.github.io/PyAirbyte/airbyte/records.html#airbyte-managed-metadata-columns), aligned with Airbyte Destinations "v2" (144)
- [Auto-add missing columns](https://airbytehq.github.io/PyAirbyte/airbyte/records.html#schema-evolution) to Cache tables (144)
- New `StreamRecord` class and public `records` module (166)

📖 Documentation Updates

- Several new topics added to [reference docs](https://airbytehq.github.io/PyAirbyte/airbyte/records.html) (#144, 170):
- Schema Evolution
- Table and Field Name Normalization
- Airbyte-Managed Metadata Columns

🚀 New Features

- Adapt BigQuery classes to be able to use default credentials (157) - _**Thanks, 4sushi!**_

🐛 Fixes

- Resolve issue where case-sensitive column pruning removes real columns (161)

⚙️ Under the Hood

- Refactor: `Source.get_records()` and `Source.read()` now use a shared code path for record parsing and name normalization (161)
- Refactor: Internal batch files (JSONL) now pre-normalize top-level property names (161)

🐛 Fixes

- Fix cases where tables are incorrectly reported as missing in the Postgres cache during `read()` (149) - _**Thanks, tinomerl!**_
- Improved progress updates, including printing list of streams that have been read (147)

⚙️ Under the Hood

- Pin `orjson` to last stable version (152)

🐛 Fixes

- Resolve issue where `read()` would fail if it received unexpected/undeclared top-level properties from a source (131)

⚙️ Under the Hood

- Bump `airbyte-cdk` dependency to latest version (137)

✨ New Features

- Add `Source.confic_spec` property and `Source.print_config_spec()` method to get and/or print any connector's configuration spec (80) - _**Thanks, tinomerl!**_
- Allow incremental refresh in combination with the `REPLACE` write strategy (136)
- Always pre-validate source config, with more clear messaging of validation failures (134)

⚙️ Under the hood

- Add logging for config validation, connector checks, and successful installs (135)
- Corrected Colab notebook name detection (132)