Overview of the OrangeForms import process
The OrangeForms import process is designed for high runtime performance through four key stages:
- Parsing: Uses SAX mode to read Excel files efficiently.
- Translation: Uses a general reflection-based approach for reverse dictionary translation (e.g., converting a text value like 'Grade 2' to its corresponding dictionary ID
2). - Validation: Implements batch validation to minimize database interactions (e.g., avoiding individual queries for every dictionary field across thousands of rows).
- Insertion: Uses small-batch insertion to improve performance and prevent memory or timeout issues associated with oversized single transactions.