Anonymous | Login
Project:
RSS
  
News | My View | View Issues | Roadmap | Summary

View Issue DetailsJump to Notes ] Issue History ] Print ]
ID
0032119
TypeCategorySeverityReproducibilityDate SubmittedLast Update
defect[Openbravo ERP] Y. DBSourceManagerminorhave not tried2016-02-04 10:252016-12-16 18:39
ReporteralostaleView Statuspublic 
Assigned Toalostale 
PriorityhighResolutionfixedFixed in Version3.0PR17Q1
StatusclosedFix in branchFixed in SCM revisiondc75c9d2829f
ProjectionnoneETAnoneTarget Version
OSAnyDatabaseOracleJava version
OS VersionDatabase versionAnt version
Product VersionSCM revision 
Review Assigned Tocaristu
Web browser
ModulesCore
Regression level
Regression date
Regression introduced in release
Regression introduced by commit
Triggers an Emergency PackNo
Summary

0032119: Oracle: importing big sample data is very slow

DescriptionWhen having a big sample data, install.source in Oracle is very slow.

It takes ages to complete the "Enabling foreign keys" process. In tested environment it was stopped after 3(!) days without being fully finished.
Steps To Reproduce1. In a fresh pi (just sources)
2. Add org.openbravo.retail.sampledata.hgvol module which includes a big amount of sample data (29GB)
3. Run ant install.source in Oracle
  -> After some time (~4hr) the "Enabling foreign keys" section of the process starts. After 3 days the process continues working, it is not stuck but each constraint takes hours to be enabled.
Proposed SolutionUpdate DB statistics after importing data in order to make constraint enablement faster.
TagsPerformance
Attached Filesdiff file icon issue32119-WiP.diff [^] (4,769 bytes) 2016-02-04 10:42 [Show Content]

- Relationships Relation Graph ] Dependency Graph ]
related to defect 0034696 acknowledgedTriage Platform Base inconsistent DB statistics update after importing sample data 
related to defect 0043247 closedalostale Importing translation for table AD_ELEMENT_TRL takes huge amount of time (especially on oracle) 

-  Notes
(0083919)
alostale (manager)
2016-02-04 10:42

Attached WiP diff
(0092159)
alostale (manager)
2016-12-07 09:40
edited on: 2016-12-07 09:41

Currently implemented only for Oracle

(0092160)
hgbot (developer)
2016-12-07 10:09

Repository: erp/devel/dbsm-main
Changeset: daf6217b3b79f4f84d5baf35ee7c79ac3ac76049
Author: Asier Lostalé <asier.lostale <at> openbravo.com>
Date: Wed Dec 07 09:42:23 2016 +0100
URL: http://code.openbravo.com/erp/devel/dbsm-main/rev/daf6217b3b79f4f84d5baf35ee7c79ac3ac76049 [^]

fixed bug 32119: Oracle: importing big sample data is very slow

  Update Oracle statistics after importing sample data so that activating FKs
  can use optimized plans.

---
M src/org/apache/ddlutils/Platform.java
M src/org/apache/ddlutils/platform/PlatformImplBase.java
M src/org/apache/ddlutils/platform/oracle/Oracle8Platform.java
M src/org/openbravo/ddlutils/task/ImportSampledata.java
---
(0092161)
hgbot (developer)
2016-12-07 10:09

Repository: erp/devel/pi
Changeset: dc75c9d2829f9dfd5546fc58b7f9135ab4399563
Author: Asier Lostalé <asier.lostale <at> openbravo.com>
Date: Wed Dec 07 10:09:08 2016 +0100
URL: http://code.openbravo.com/erp/devel/pi/rev/dc75c9d2829f9dfd5546fc58b7f9135ab4399563 [^]

fixed bug 32119: Oracle: importing big sample data is very slow

  Update Oracle statistics after importing sample data so that activating FKs
  can use optimized plans.

---
M src-db/database/lib/dbsourcemanager.jar
---
(0092331)
hgbot (developer)
2016-12-14 08:57

Repository: erp/devel/dbsm-main
Changeset: a9667fafca39a9875a3e1ea9c575f422ae7ee5ad
Author: Carlos Aristu <carlos.aristu <at> openbravo.com>
Date: Wed Dec 14 08:57:02 2016 +0100
URL: http://code.openbravo.com/erp/devel/dbsm-main/rev/a9667fafca39a9875a3e1ea9c575f422ae7ee5ad [^]

related to issue 32119: updated copyright year

---
M src/org/openbravo/ddlutils/task/ImportSampledata.java
---
(0092332)
caristu (developer)
2016-12-14 09:01

Code review + testing OK. Tested here[1]. Build Successful after 133 minutes and 56 seconds.

[1] https://ci.openbravo.com/view/retail/job/ret-higvol-oracle/485/consoleText [^]
(0092692)
hudsonbot (developer)
2016-12-16 18:39

A changeset related to this issue has been promoted main and to the
Central Repository, after passing a series of tests.

Promotion changeset: https://code.openbravo.com/erp/devel/main/rev/dc8bf00badd0 [^]
Maturity status: Test

- Issue History
Date Modified Username Field Change
2016-02-04 10:25 alostale New Issue
2016-02-04 10:25 alostale Assigned To => platform
2016-02-04 10:25 alostale Modules => Core
2016-02-04 10:25 alostale Triggers an Emergency Pack => No
2016-02-04 10:40 alostale Priority normal => urgent
2016-02-04 10:40 alostale Status new => acknowledged
2016-02-04 10:42 alostale File Added: issue32119-WiP.diff
2016-02-04 10:42 alostale Note Added: 0083919
2016-02-05 07:28 alostale Tag Attached: Performance
2016-02-05 12:59 shuehner Issue Monitored: shuehner
2016-12-01 13:24 alostale Priority urgent => normal
2016-12-01 14:01 alostale Priority normal => high
2016-12-01 14:14 alostale Assigned To platform => caristu
2016-12-02 09:32 alostale Assigned To caristu => alostale
2016-12-07 09:40 alostale Review Assigned To => caristu
2016-12-07 09:40 alostale Proposed Solution updated
2016-12-07 09:40 alostale Note Added: 0092159
2016-12-07 09:41 alostale Note Edited: 0092159 View Revisions
2016-12-07 10:09 hgbot Checkin
2016-12-07 10:09 hgbot Note Added: 0092160
2016-12-07 10:09 hgbot Status acknowledged => resolved
2016-12-07 10:09 hgbot Resolution open => fixed
2016-12-07 10:09 hgbot Fixed in SCM revision => http://code.openbravo.com/erp/devel/dbsm-main/rev/daf6217b3b79f4f84d5baf35ee7c79ac3ac76049 [^]
2016-12-07 10:09 hgbot Checkin
2016-12-07 10:09 hgbot Note Added: 0092161
2016-12-07 10:09 hgbot Fixed in SCM revision http://code.openbravo.com/erp/devel/dbsm-main/rev/daf6217b3b79f4f84d5baf35ee7c79ac3ac76049 [^] => http://code.openbravo.com/erp/devel/pi/rev/dc75c9d2829f9dfd5546fc58b7f9135ab4399563 [^]
2016-12-07 10:47 alostale Relationship added related to 0034696
2016-12-14 08:57 hgbot Checkin
2016-12-14 08:57 hgbot Note Added: 0092331
2016-12-14 09:01 caristu Note Added: 0092332
2016-12-14 09:01 caristu Status resolved => closed
2016-12-14 09:01 caristu Fixed in Version => 3.0PR17Q1
2016-12-16 18:39 hudsonbot Checkin
2016-12-16 18:39 hudsonbot Note Added: 0092692
2022-03-02 10:48 alostale Relationship added related to 0043247


Copyright © 2000 - 2009 MantisBT Group
Powered by Mantis Bugtracker