Flatforge

Added
- Comprehensive testing documentation in the `docs/testing` directory
- Main testing guide with overview of testing infrastructure
- Detailed unit testing documentation with best practices
- Error handling testing guide with sample files explanation
- CLI testing documentation with command examples
- Sample files documentation detailing test data structure
- Debugging guide for library development
- Debug scripts for local development and troubleshooting
- `debug_main.py` for core processing functionality
- `debug_cli.py` for CLI interface testing
- `debug_cli_chunked.py` for chunked processing testing
- `debug_cli_convert.py` for file format conversion testing
- `debug_cli_click.py` for Click-based CLI testing
- Development mode installation instructions for library debugging
- Global rules system for validating relationships between records
- Support for global rules that can alter field values (e.g., inserting calculated sums or counts)
- New global rule types: Count, Sum, Checksum, and Uniqueness
- Ability to validate uniqueness of fields or combinations of fields across records
- Documentation for global rules in the user guide
- Sample configuration and test script for global rules
- Comprehensive rules guide documenting all rule types and their parameters

Changed
- Renamed `abort_after_n_errors` to `abort_after_n_failed_records` to better reflect its purpose
- Updated validation processor to track failed records separately from error count
- Modified abort logic to count failed records instead of individual errors
- Added unit tests for the abort functionality
- Improved documentation with references to the new rules guide
- Fixed CLI entry point in setup.py to ensure proper command execution

Fixed
- Fixed CLI entry point in setup.py to ensure proper command execution
- Resolved issue with FileFormat.from_yaml method in CLI implementation
- Improved error handling in validation processor
- Enhanced CLI output with more detailed processing statistics

Fixed
- Fixed documentation links in README.md to use absolute URLs for PyPI compatibility

Added
- Renamed library from FlatMagic to FlatForge
- Chunked processing for large files (>1GB) with configurable chunk size
- Progress reporting for long-running operations
- CLI options `--chunk-size` and `--show-progress` for all commands
- Memory-efficient processing of large datasets
- Example script `samples/large_file_processing.py` demonstrating chunked processing
- Documentation for large file processing in the user guide

Changed
- Updated base `Processor` class to support chunked processing
- Modified `ValidationProcessor`, `ConversionProcessor`, and `CounterProcessor` to implement chunked processing
- Improved error handling for file operations
- Updated CLI interface to support new options
- Enhanced documentation with examples of chunked processing

Fixed
- Fixed handling of None values for output files
- Improved newline handling in output files
- Fixed unit tests to work with the new chunked processing feature

Added
- Initial release of FlatForge (formerly FlatMagic)
- Support for fixed-length and delimited file formats
- Validation, conversion, and counting of records
- CLI interface for easy integration into workflows
- Comprehensive documentation
- Unit tests for core functionality

Authors
- Akram Zaki (azpythonprojectsgmail.com, [akram0zaki](https://github.com/akram0zaki))