Releases: FSUDRS/cetamura_python_script
Releases · FSUDRS/cetamura_python_script
Cetamura Batch Ingest Tool 1.3.0
Changelog
1.3.0 - 2026-04-20
Added
- Photo and patent workflow selection from the GUI.
- Non-mutating staging and production packaging for source folders.
- Patent batch packaging with shared manifest validation and optional PDF fallback roots.
- Post-processing ZIP validation, reconciliation reporting, and pre-flight checks.
- Expanded regression coverage for multi-file photo sets, patent batches, and validation logic.
- Security scanning in CI with Bandit and dependency auditing.
- Reproducible release helper scripts under
scripts/build/.
Changed
- Production output now writes only to
output/; staging output writes only tostaging_output/. - Photo TIFF conversion now runs in output-side scratch space during current batch workflows.
- Development requirements can be installed from either
requirements-dev.txtorrequirements/requirements-dev.txt. - The production deployment helper now includes
validation.py, which is required bymain.py.
Fixed
- Local
mainis fast-forwarded toorigin/mainso the release includes newline, degree-symbol, and validation assertion fixes. - Tracked utility scripts are Black and flake8 clean.
- Removed a NUL-corrupted line from
.gitignore.
Verified
python -m pytest tests/ -v --tb=short: 65 passed.python tests/run_tests.py: 65 passed plus import and quick checks.python -m black --check ...: passing for tracked Python release files.python -m flake8 --jobs 1 ...: passing for tracked Python release files.python -m bandit -r src -ll: no medium or high severity issues identified.python -m pip_audit -r requirements/requirements.txt: no known vulnerabilities found.
v1.2.0: Expanded File Support & Safety Nets
Release v1.2.0
Major Features
- Expanded File Support: Native processing for PDF and TIFF formats using PyMuPDF and Pillow.
- Enhanced Validation: Improved file pairing and manifest validation logic.
- Safety Nets:
- Dry-Run Mode: Preview changes without modifying files.
- Staging Mode: Safe output to a staging directory.
- Pre-Flight Checks: Disk space and orphan file detection.
Improvements
- CSV Reporting: Comprehensive timestamped processing logs.
- UX Polish: User-friendly processing options dialog.
- Error Handling: Graceful failures with clear feedback.
Technical Details
- New Dependency:
PyMuPDF(for PDF processing). - Core Update: Refactored
main.pyto support new file types and validation flows. - Validation: Full test coverage for new expanded support features.
Installation
pip install -r requirements.txt
python main.pyv2025.10.06: Validation System & Import Improvements
Release v2025.10.06
Major Features
- Comprehensive post-processing validation system with 52 automated tests
- Pre-flight checks for input validation before processing
- Post-processing validation with detailed reconciliation reports
- Dry-run mode for safe testing without modifying files
Improvements
- Fixed import system for better portability across execution contexts
- Enhanced sys.path modification for robust absolute imports
- Organized validation documentation to docs/ directory
- Supports direct execution from any directory
Bug Fixes
- Resolved relative import issues when running script directly
- Fixed module resolution for validation imports
Testing
- All 76 photo sets processed successfully with 0 errors
- Validation system verified with real dataset
- Import mechanism tested across multiple execution contexts
Documentation
- Added comprehensive validation plan and summary
- Updated system flow documentation
- Added NO EMOJIS RULE to documentation guidelines
Commits in this Release
- f2f32e1 - feat: Enhance sys.path modification for robust absolute imports
- cd6e793 - fix: Change relative imports to absolute imports in main.py
- b8add6d - docs: Move VALIDATION_PLAN.md and VALIDATION_SUMMARY.md to docs directory
- 183affc - feat: Add comprehensive post-processing validation system (#5)
bug fix and test suite enhancement
Critical bug fix and test suite enhancement:
- Fixed 'tuple object has no attribute iid' error in batch processing
- Updated 14 comprehensive regression tests (total 25 tests)
- Enhanced CI/CD pipeline with regression-tests job
- Created TEST_COVERAGE.md documentation
- Updated SYSTEM_FLOW.md Prd file
- Updated .gitignore to exclude manual test files
Key regression tests prevent 'only first file processed' bug:
- test_batch_process_multi_file_dry_run
- test_batch_process_multi_file_staging
- test_no_files_skipped_in_multi_file_set
Image Rotation fix & CI Infrastructure
Cetamura Batch Tool - Release v2025.09.19
Enhanced Testing & CI Infrastructure
This release significantly improves the testing infrastructure and continuous integration pipeline for the Cetamura Batch Tool.
New Features
-
Enhanced Test Runner (
tests/run_tests.py)- Added
--no-pytestflag for quick local testing without running full test suite - Improved import validation with better error handling
- Centralized imports with informative fallback stubs
- Added
-
Upgraded CI/CD Pipeline
- Enhanced GitHub Actions workflow to test custom test runner
- Added validation for newer enhanced functions:
find_photo_sets_enhancedbatch_process_with_safety_netsextract_iid_from_xml_enhanced
- Multiple test runner flag validation in CI
Improvements
- Test Suite Consolidation
- Merged redundant test files into unified
tests/test_main.py - Removed
tests/test_utils.pyandtests/test_pairing_improvements.py - Added comprehensive integration test (
test_full_workflow)
- Merged redundant test files into unified
# Run all tests (default)
python tests/run_tests.py
# Quick functionality check only
python tests/run_tests.py --quick
# Import validation only
python tests/run_tests.py --imports
# Skip pytest, run quick checks only
python tests/run_tests.py --no-pytest
---
**Full Changelog**: https://github.com/FSUDRS/cetamura_python_script/compare/v2025.08.26-7e386f2...v2025.09.19-485d658Safe Batch Processing v2025.08.26
Artifact built from commit 7e386f2 (pushed from main). Canonical release: 2025.08.25-safe-batch (merged).