Openbravo Issue Tracking System - Openbravo ERP
View Issue Details
IDProjectCategoryView StatusDate SubmittedLast Update
0032119Openbravo ERPY. DBSourceManagerpublic2016-02-04 10:252016-12-16 18:39
Reporteralostale 
Assigned Toalostale 
PriorityhighSeverityminorReproducibilityhave not tried
StatusclosedResolutionfixed 
PlatformOS5OS Version
Product Version 
Target VersionFixed in Version3.0PR17Q1 
Merge Request Status
Review Assigned Tocaristu
OBNetwork customer
Web browser
ModulesCore
Support ticket
Regression level
Regression date
Regression introduced in release
Regression introduced by commit
Triggers an Emergency PackNo
Summary0032119: Oracle: importing big sample data is very slow
DescriptionWhen having a big sample data, install.source in Oracle is very slow.

It takes ages to complete the "Enabling foreign keys" process. In tested environment it was stopped after 3(!) days without being fully finished.
Steps To Reproduce1. In a fresh pi (just sources)
2. Add org.openbravo.retail.sampledata.hgvol module which includes a big amount of sample data (29GB)
3. Run ant install.source in Oracle
  -> After some time (~4hr) the "Enabling foreign keys" section of the process starts. After 3 days the process continues working, it is not stuck but each constraint takes hours to be enabled.
Proposed SolutionUpdate DB statistics after importing data in order to make constraint enablement faster.
Additional Information
TagsPerformance
Relationships
related to defect 0034696 acknowledged Triage Platform Base inconsistent DB statistics update after importing sample data 
related to defect 0043247 closed alostale Importing translation for table AD_ELEMENT_TRL takes huge amount of time (especially on oracle) 
Attached Filesdiff issue32119-WiP.diff (4,769) 2016-02-04 10:42
https://issues.openbravo.com/file_download.php?file_id=9019&type=bug
Issue History
Date ModifiedUsernameFieldChange
2016-02-04 10:25alostaleNew Issue
2016-02-04 10:25alostaleAssigned To => platform
2016-02-04 10:25alostaleModules => Core
2016-02-04 10:25alostaleTriggers an Emergency Pack => No
2016-02-04 10:40alostalePrioritynormal => urgent
2016-02-04 10:40alostaleStatusnew => acknowledged
2016-02-04 10:42alostaleFile Added: issue32119-WiP.diff
2016-02-04 10:42alostaleNote Added: 0083919
2016-02-05 07:28alostaleTag Attached: Performance
2016-02-05 12:59shuehnerIssue Monitored: shuehner
2016-12-01 13:24alostalePriorityurgent => normal
2016-12-01 14:01alostalePrioritynormal => high
2016-12-01 14:14alostaleAssigned Toplatform => caristu
2016-12-02 09:32alostaleAssigned Tocaristu => alostale
2016-12-07 09:40alostaleReview Assigned To => caristu
2016-12-07 09:40alostaleProposed Solution updated
2016-12-07 09:40alostaleNote Added: 0092159
2016-12-07 09:41alostaleNote Edited: 0092159bug_revision_view_page.php?bugnote_id=0092159#r13960
2016-12-07 10:09hgbotCheckin
2016-12-07 10:09hgbotNote Added: 0092160
2016-12-07 10:09hgbotStatusacknowledged => resolved
2016-12-07 10:09hgbotResolutionopen => fixed
2016-12-07 10:09hgbotFixed in SCM revision => http://code.openbravo.com/erp/devel/dbsm-main/rev/daf6217b3b79f4f84d5baf35ee7c79ac3ac76049 [^]
2016-12-07 10:09hgbotCheckin
2016-12-07 10:09hgbotNote Added: 0092161
2016-12-07 10:09hgbotFixed in SCM revisionhttp://code.openbravo.com/erp/devel/dbsm-main/rev/daf6217b3b79f4f84d5baf35ee7c79ac3ac76049 [^] => http://code.openbravo.com/erp/devel/pi/rev/dc75c9d2829f9dfd5546fc58b7f9135ab4399563 [^]
2016-12-07 10:47alostaleRelationship addedrelated to 0034696
2016-12-14 08:57hgbotCheckin
2016-12-14 08:57hgbotNote Added: 0092331
2016-12-14 09:01caristuNote Added: 0092332
2016-12-14 09:01caristuStatusresolved => closed
2016-12-14 09:01caristuFixed in Version => 3.0PR17Q1
2016-12-16 18:39hudsonbotCheckin
2016-12-16 18:39hudsonbotNote Added: 0092692
2022-03-02 10:48alostaleRelationship addedrelated to 0043247

Notes
(0083919)
alostale   
2016-02-04 10:42   
Attached WiP diff
(0092159)
alostale   
2016-12-07 09:40   
(edited on: 2016-12-07 09:41)
Currently implemented only for Oracle
(0092160)
hgbot   
2016-12-07 10:09   
Repository: erp/devel/dbsm-main
Changeset: daf6217b3b79f4f84d5baf35ee7c79ac3ac76049
Author: Asier Lostalé <asier.lostale <at> openbravo.com>
Date: Wed Dec 07 09:42:23 2016 +0100
URL: http://code.openbravo.com/erp/devel/dbsm-main/rev/daf6217b3b79f4f84d5baf35ee7c79ac3ac76049 [^]

fixed bug 32119: Oracle: importing big sample data is very slow

  Update Oracle statistics after importing sample data so that activating FKs
  can use optimized plans.

---
M src/org/apache/ddlutils/Platform.java
M src/org/apache/ddlutils/platform/PlatformImplBase.java
M src/org/apache/ddlutils/platform/oracle/Oracle8Platform.java
M src/org/openbravo/ddlutils/task/ImportSampledata.java
---
(0092161)
hgbot   
2016-12-07 10:09   
Repository: erp/devel/pi
Changeset: dc75c9d2829f9dfd5546fc58b7f9135ab4399563
Author: Asier Lostalé <asier.lostale <at> openbravo.com>
Date: Wed Dec 07 10:09:08 2016 +0100
URL: http://code.openbravo.com/erp/devel/pi/rev/dc75c9d2829f9dfd5546fc58b7f9135ab4399563 [^]

fixed bug 32119: Oracle: importing big sample data is very slow

  Update Oracle statistics after importing sample data so that activating FKs
  can use optimized plans.

---
M src-db/database/lib/dbsourcemanager.jar
---
(0092331)
hgbot   
2016-12-14 08:57   
Repository: erp/devel/dbsm-main
Changeset: a9667fafca39a9875a3e1ea9c575f422ae7ee5ad
Author: Carlos Aristu <carlos.aristu <at> openbravo.com>
Date: Wed Dec 14 08:57:02 2016 +0100
URL: http://code.openbravo.com/erp/devel/dbsm-main/rev/a9667fafca39a9875a3e1ea9c575f422ae7ee5ad [^]

related to issue 32119: updated copyright year

---
M src/org/openbravo/ddlutils/task/ImportSampledata.java
---
(0092332)
caristu   
2016-12-14 09:01   
Code review + testing OK. Tested here[1]. Build Successful after 133 minutes and 56 seconds.

[1] https://ci.openbravo.com/view/retail/job/ret-higvol-oracle/485/consoleText [^]
(0092692)
hudsonbot   
2016-12-16 18:39   
A changeset related to this issue has been promoted main and to the
Central Repository, after passing a series of tests.

Promotion changeset: https://code.openbravo.com/erp/devel/main/rev/dc8bf00badd0 [^]
Maturity status: Test