Large Language Model for Audit
Dec 2024 ~ Apr 2025
AITA and Henan Provincial Audit Department, China
The primary objective is to design, fine-tune and deploy a secure, internally-facing Large Language Model for auditors (ALLM) at Henan Provincial Audit Department. Built on Qwen2.5-VL, ALLM need deliver intelligent support for audit Q&A, regulatory compliance and table-data analysis. In this project, I worked with Lutong Zhang and Haonan Zhang to finish:
- Data Collection: Aggregating amounts of audit documentation, historical audit reports, government financial regulations (national and provincial level), accounting standards (e.g., Chinese GAAP), policy directives, compliance manuals, and best practice guidelines.
- Data Processing: Implementing data processing pipelines for heterogeneous audit sources, including: text extraction that applies PaddleOCR with regex-based digit correction for scanned documents, pdfplumber for layout-aware PDF, python-docx for DOCX files; spaCy + FinBERT for entity normalization of regulations/financial terms; DeepSeek-V2 classification for document categorization and UIE model for sensitivity tagging; LayoutLMv3 for context-aware semantic segmentation to preserve audit logic.
- QA Generation and Expert Annotation: Using Qwen-72B-Chat to produce question-answer pairs reflecting common audit scenarios, enriching the fine-tuning dataset; collaborating with senior auditors to annotate real audit cases, identifying key entities, risks, compliance issues, and generating relevant queries/responses.
