Dataset Tools for Metadata & Captioning

PR: Major Overhaul - Parsing, Stability, UI, Security, and DocsThis pull request introduces a significant set of improvements and features, representing a substantial leap forward in the development of Dataset-Tools. It focuses on enhancing core stability, overhauling the metadata parsing pipeline, adding key usability features like drag-and-drop, integrating new custom parsers, and updating project documentation for clarity and accuracy.⚡ Key Highlights &amp; New Features<ul><li>Drag and Drop Support: Users can now drag and drop image/model files or entire folders directly onto the main application window for easier loading. Dropped single files are auto-selected.</li><li>New Custom Parsers:<ul><li><code>RuinedFooocusFormat</code>: Added support for RuinedFooocus JSON metadata.</li><li><code>CivitaiComfyUIFormat</code>: Added support for Civitai's ComfyUI-based UserComment metadata, including mojibake decoding.</li><li><code>Enabled GGUFParser</code>: Basic metadata extraction from <code>.gguf</code> model files is now functional.</li></ul></li><li>Major Stability Improvements: Addressed numerous critical bugs related to imports, attribute access, and type errors across the application.</li><li>Enhanced Vendored Code: Significantly refactored the adapted <code>sd-prompt-reader</code> components for better status handling, error reporting, and integration.</li><li>Security Hardening: Fixed XML parsing vulnerabilities by integrating <code>defusedxml</code>.</li><li>Improved Code Quality: Applied extensive linting fixes using Ruff, adhering more closely to PEP 8 and improving maintainability.</li><li>Updated Documentation: <code>README.md</code> and <code>SECURITY.MD</code> have been overhauled; <code>NOTICE.md</code> added for vendored code attribution.</li></ul>🐛 Core Stability &amp; Bug Fixes<ul><li>Resolved critical import errors (<code>ModuleNotFoundError</code>, <code>NameError</code>) across <code>ui.py</code>, <code>logger.py</code>, <code>correct_types.py</code>, and <code>vendored_sdpr/*</code> by correcting import paths and resolving circular dependencies.</li><li>Fixed <code>AttributeError: 'str' object has no attribute 'value'</code> by refactoring <code>EmptyField</code>, <code>UpField</code>, <code>DownField</code> in <code>correct_types.py</code> to be proper <code>enum.Enum</code> classes. UI and parsers now correctly use <code>.value</code> and <code>get_ordered_labels()</code>.</li><li>Fixed <code>AttributeError</code> in <code>widgets.py</code> related to <code>ExtensionType</code> by using correct attribute names (e.g., <code>SCHEMA_FILES</code>, <code>MODEL_FILES</code>).</li><li>Resolved <code>TypeError</code> for parser <code>__init__</code> calls (e.g., for <code>A1111</code>) in <code>ImageDataReader</code> by ensuring passed arguments match parser signatures.</li><li>Fixed <code>ValueError: not enough values to unpack</code> in <code>A1111._sd_format()</code> by correcting regex match unpacking.</li><li>Addressed <code>NameError: name 'Path' is not defined</code> in <code>ImageDataReader</code> by adding the <code>pathlib.Path</code> import.</li><li>Eliminated <code>F811 Redefinition of unused __init__</code> in <code>access_disk.py</code>.</li><li>Corrected <code>F821 Undefined name traceback</code> in <code>access_disk.py</code> by importing <code>traceback</code>.</li></ul>⚙️ Vendored SD-Prompt-Reader Enhancements &amp; Fixes<ul><li>Refactored <code>ImageDataReader._try_parser()</code> helper for clearer instantiation and more robust status checking of individual format parsers.</li><li>Ensured <code>ImageDataReader.status</code> is accurately updated based on the success/failure of sub-parsers, resolving previously misleading <code>FORMAT_ERROR</code> reports.</li><li>Improved status and error message handling within individual format parsers (e.g., <code>A1111._process()</code> now reliably sets its own success/failure status).</li><li>Standardized logger names within the <code>vendored_sdpr</code> components to use the <code>"DSVendored_SDPR"</code> prefix.</li><li>Pruned <code>vendored_sdpr/format/utility.py</code> to essential functions, removing unused GUI dependencies.</li><li>Integrated <code>defusedxml</code> for safer XML parsing in <code>ImageDataReader</code> (for DrawThings XMP data), addressing Bandit-flagged vulnerabilities (B408, B318). Added <code>defusedxml</code> as a project dependency.</li></ul>✨ New Parser Integrations(Covered in Key Highlights)🎨 Code Quality &amp; Linting (Ruff)Applied extensive linting fixes across the codebase using Ruff (<code>ruff format .</code> and <code>ruff check . --fix</code>):<ul><li>Resolved numerous <code>E701</code>, <code>E702</code>, <code>E703</code> style issues (multiple statements per line, semicolons).</li><li>Removed many <code>F401</code> (unused imports) and <code>F841</code> (unused local variables) after careful review.</li><li>Corrected <code>F403</code>/<code>F405</code> related to star imports.</li><li>Fixed <code>E741</code> (ambiguous variable names).</li><li>Resolved <code>E722</code> (bare <code>except</code>).</li><li>Corrected <code>F541</code> (f-strings without placeholders).</li></ul>These changes significantly improve code readability, maintainability, and adherence to PEP 8.🔊 Logging System Improvements<ul><li>Resolved the <code>WARNING</code> in <code>main.py</code> regarding logger reconfiguration by aligning the function call to <code>reconfigure_all_loggers</code>. CLI log level setting is now fully effective.</li><li>Enhanced debug logging in key areas for better diagnostics.</li></ul>📚 Documentation &amp; Project Files<ul><li><code>README.md</code>: Overhauled with details on new features (drag &amp; drop, new parsers), revised installation instructions (reflecting <code>pyproject.toml</code>), updated license information, and improved overall structure and formatting.</li><li><code>SECURITY.md</code>: Updated to be more user-friendly, clearly state the project's GPL-3.0 license, define support for the current main branch, and list security tools now in use (<code>pip-audit</code>, Bandit, Ruff).</li><li><code>NOTICE.md</code>: Created to provide proper attribution and license information for vendored code, particularly the MIT-licensed components from <code>sd-prompt-reader</code>.</li></ul>🔬 Testing Notes (Brief)<ul><li>Manual testing performed for A1111/Forge PNGs, showing correct parsing and status reporting.</li><li>Drag and drop functionality tested with single files and folders.</li><li>Civitai ComfyUI JPGs and RuinedFooocus JPEGs now correctly identified by their respective parsers.</li><li>(Add any other key tests you performed).</li></ul>👀 Areas for Particular Review (Optional)<ul><li>Verification of <code>__init__</code> signatures for <code>NovelAI(info=...)</code> and <code>ComfyUI(info=...)</code> calls within <code>ImageDataReader.py</code> (regarding <code>width</code>/<code>height</code> arguments) to ensure they match the actual definitions in those parsers.</li><li>The robustness of the regex in <code>metadata_parser.py</code>'s <code>make_paired_str_dict</code> for diverse A1111 settings strings (this is an ongoing refinement).</li><li>The refactored ComfyUI graph traversal logic in <code>vendored_sdpr/format/comfyui.py</code> for correctness and completeness with varied workflows.</li></ul><a target="_blank" rel="ugc" href="https://github.com/Ktiseos-Nyx/Dataset-Tools/releases/tag/0.58.5">https://github.com/Ktiseos-Nyx/Dataset-Tools/releases/tag/0.58.5</a>

datasetToolsForMetadata_v0585.zip

V0.58.5

v0.70.1-Main

v0.70.1-AlphaDev

v0.70-AlphaDev

v0.66

v0.65-Dev

v0.61-DEV

v.0.60.2-DEV

v0.60-Dev

v0.60-Main

v0.59

v0.55

Files with SHA256: 5dbe0cb7718eb9aca27f61625e5451008fc2ed87ce83bede004ad87f3fe9fce4