Anonymous | Login
Project:
RSS
  
News | My View | View Issues | Roadmap | Summary

View Issue DetailsJump to Notes ] Issue History ] Print ]
ID
0012542
TypeCategorySeverityReproducibilityDate SubmittedLast Update
defect[Modules] Initial data loadminorhave not tried2010-03-03 17:462011-07-20 18:09
ReportershuehnerView Statuspublic 
Assigned Tojonalegriaesarte 
PrioritynormalResolutionopenFixed in Version
StatusnewFix in branchFixed in SCM revision
ProjectionnoneETAnoneTarget Version
OSAnyDatabaseAnyJava version
OS VersionDatabase versionAnt version
Product VersionSCM revision 
Regression date
Regression introduced by commit
Regression level
Review Assigned To
Regression introduced in release
Summary

0012542: IDL validation process (for at least the product price entity) executes too many (duplicate) database-queries

DescriptionLogging the db-queries done while executing the IDL validation process shows that about 12* select queries are issued for each validate line from the import-csv-file.

This could be reduced greatly by caching and not re-executing queries for data unchanged during the validation process.

Breakdown of queries (per imported line):
- select on product
- select on ad_org
- select on ad_role_orgaccess
- select on discountschema
- 4* select on idl_entity imported
- 4* select on idl_field imported

A prototype change to cache (ad_org,ad_role_orgaccess,idl_entity,idl_field) lookup based on same input parameters did lead to a 4*speedup of the validation (10k import lines, before ca. 400s, after 100s)
Proposed SolutionIntroduce caching (or reading the unchanged data into some context object for at least idl_entity, idl_field) and perhaps more to reduce the number of queries issued greatly.
TagsNo tags attached.
Attached Filestxt file icon validate_10k_pgsql84_grouped.txt [^] (15,738 bytes) 2010-03-03 17:46 [Show Content]

- Relationships Relation Graph ] Dependency Graph ]
related to defect 00124012.50MP14 closedshuehner Openbravo ERP After a while execuing a process the session is closed before return any result of the execution 

-  Notes
There are no notes attached to this issue.

- Issue History
Date Modified Username Field Change
2010-03-03 17:46 shuehner New Issue
2010-03-03 17:46 shuehner Assigned To => mirurita
2010-03-03 17:46 shuehner File Added: validate_10k_pgsql84_grouped.txt
2010-03-03 17:47 shuehner Relationship added related to 0012401
2011-06-03 11:11 dalsasua Assigned To mirurita => dalsasua
2011-07-20 18:09 dalsasua Assigned To dalsasua => jonalegriaesarte


Copyright © 2000 - 2009 MantisBT Group
Powered by Mantis Bugtracker