0012542: IDL validation process (for at least the product price entity) executes too many (duplicate) database-queries

Openbravo Issue Tracking System - Modules

View Issue Details

Project

Category

View Status

Date Submitted

Last Update

0012542

Modules

Initial data load

public

2010-03-03 17:46

2011-07-20 18:09

Reporter

shuehner

Assigned To

jonalegriaesarte

Priority

normal

Severity

minor

Reproducibility

have not tried

Status

new

Resolution

open

Platform

OS Version

Product Version

Target Version

Fixed in Version

Merge Request Status

Regression date

Regression introduced by commit

Regression level

Review Assigned To

Support ticket

OBNetwork customer

Regression introduced in release

Summary

0012542: IDL validation process (for at least the product price entity) executes too many (duplicate) database-queries

Description

Logging the db-queries done while executing the IDL validation process shows that about 12* select queries are issued for each validate line from the import-csv-file.

This could be reduced greatly by caching and not re-executing queries for data unchanged during the validation process.

Breakdown of queries (per imported line):
- select on product
- select on ad_org
- select on ad_role_orgaccess
- select on discountschema
- 4* select on idl_entity imported
- 4* select on idl_field imported

A prototype change to cache (ad_org,ad_role_orgaccess,idl_entity,idl_field) lookup based on same input parameters did lead to a 4*speedup of the validation (10k import lines, before ca. 400s, after 100s)

Steps To Reproduce

Proposed Solution

Introduce caching (or reading the unchanged data into some context object for at least idl_entity, idl_field) and perhaps more to reduce the number of queries issued greatly.

Additional Information

Tags

No tags attached.

Relationships

related to

defect

0012401

2.50MP14

closed

shuehner

Openbravo ERP

After a while execuing a process the session is closed before return any result of the execution