Pgmonkey

This release ensures greater compatibility across environments, offering a more stable experience for developers utilizing various Python and PostgreSQL configurations.

Thank you for your continued support! With every release, pgmonkey becomes more robust, and we’re committed to making database management simpler for you. Happy coding!

This release of pgmonkey addresses a critical packaging fix to prevent potential namespace collisions with other Python packages that might also use the names `cli` or `tests` at the top level. Previously, `cli` and `tests` existed as separate top-level directories, which could cause import conflicts if other installed packages used the same module names. By moving these directories under the `pgmonkey` namespace, pgmonkey ensures safer, more predictable imports and future compatibility.

🔧 **Fixes & Improvements**:

- **Resolved Top-Level Collisions**
Moved the `cli` and `tests` directories under `pgmonkey`, so they’re now `pgmonkey.cli` and `pgmonkey.tests`. This prevents import issues with other packages named `cli` or `tests`.

- **Refactored CLI Entry Points**
Updated console script references to point to the new location (`pgmonkey.cli.cli:main`) to maintain a working `pgmonkey` command-line interface.

- **Ensured Backward Compatibility**
Verified that existing functionality—including CSV import/export, configuration handling, and connection management—continues to work seamlessly after the restructuring.

💡 **How to Upgrade**:
To upgrade to the latest version, run:

bash
pip install pgmonkey --upgrade


Thank you for your continued support of pgmonkey! If you encounter any issues or have suggestions, please open an issue on our GitHub page. Your feedback is essential as we strive to make pgmonkey the best PostgreSQL management tool for your needs.

This release of **pgmonkey** significantly enhances **CSV import reliability**, addressing **edge cases** related to **empty columns, single-column files, and structured data gaps**. Version **1.1.7** ensures more **robust data ingestion**, improved **error handling**, and better **column alignment** for **seamless PostgreSQL integration**.

---

🔧 **Improvements & Fixes**

✅ **Enhanced Handling of Empty Columns & Gaps:**
- Automatically **detects and removes empty columns** in CSV headers.
- Ensures **only valid columns** are imported, preventing schema mismatches.
- Properly handles **files with multiple empty columns** (beginning, middle, or end).

✅ **Improved Single-Column CSV Support:**
- Correctly identifies **single-column files** and **ignores delimiter-based parsing**.
- Prevents `"TypeError: 'delimiter' must be a 1-character string"` when importing single-column CSVs.
- **Supports automatic header detection**, even when empty lines precede the data.

✅ **Better Row Length Validation:**
- Ensures **column counts match between headers and data rows**.
- Prevents `"Row length mismatch: Expected X columns, got Y"` errors by dynamically aligning rows with headers.
- Allows **graceful skipping of trailing empty values** that previously caused import failures.

✅ **Optimized COPY Performance for Large Datasets:**
- Successfully tested with **12.7 million-row datasets** (NYC Taxi Data).
- Achieved peak import speeds of **134,000+ rows per second** using PostgreSQL’s `COPY` command.
- **Minimized memory overhead** while ensuring **efficient bulk ingestion**.

---

💡 **How to Upgrade**

To upgrade to the latest version, run:
bash
pip install pgmonkey --upgrade


Thank you for your continued support of **pgmonkey**! If you encounter any issues or have suggestions, please open an issue on our [[GitHub page](https://github.com/RexBytes/pgmonkey)](https://github.com/RexBytes/pgmonkey). Your feedback helps us make **pgmonkey** the best PostgreSQL management tool for your needs! 🚀🔥

This release of `pgmonkey` focuses on robust CSV import enhancements, addressing edge cases in large and complex datasets. Version 1.1.6 introduces improvements in handling field sizes, better support for multi-gigabyte CSV files, and more user-friendly error handling to ensure seamless integration with PostgreSQL.

---

🔧 **Improvements:**

1. **Improved Field Size Handling:**
- Dynamically increased CSV field size limits, allowing for smooth processing of datasets with extremely large fields.
- Eliminates import failures caused by exceeding default field size restrictions.

2. **Graceful Handling of Header Mismatches:**
- Enhanced validation to ensure that CSV headers match database table definitions.
- Provides clear, actionable error messages to help users resolve mismatched columns effectively.

3. **Automatic Import Configuration Creation:**
- Automatically generates YAML configuration files for detected CSV properties (e.g., encoding, delimiter, headers).
- Simplifies setup for importing complex or unfamiliar datasets, with advanced detection for robust configurations.

4. **Efficient Handling of Multi-Gigabyte Files:**
- Optimized import process to handle massive CSV files (several gigabytes) efficiently, with minimal memory overhead.
- Ensures stability and performance for large-scale data ingestion.

---

💡 **How to Upgrade:**

To upgrade to the latest version, run:

bash
pip install pgmonkey --upgrade


Thank you for your continued support of `pgmonkey`! If you encounter any issues or have suggestions, please open an issue on our GitHub page. Your feedback is essential as we strive to make `pgmonkey` the best PostgreSQL management tool for your needs.