Project:
View Issue Details[ Jump to Notes ] | [ Issue History ] [ Print ] | |||||||
ID | ||||||||
0042370 | ||||||||
Type | Category | Severity | Reproducibility | Date Submitted | Last Update | |||
defect | [Openbravo ERP] A. Platform | major | always | 2019-11-21 18:28 | 2024-11-05 16:36 | |||
Reporter | mauricio_peccorini | View Status | public | |||||
Assigned To | AugustoMauch | |||||||
Priority | high | Resolution | fixed | Fixed in Version | PR22Q3 | |||
Status | closed | Fix in branch | Fixed in SCM revision | |||||
Projection | none | ETA | none | Target Version | ||||
OS | Any | Database | Any | Java version | ||||
OS Version | Database version | Ant version | ||||||
Product Version | SCM revision | |||||||
Review Assigned To | ||||||||
Web browser | ||||||||
Modules | Core | |||||||
Regression level | ||||||||
Regression date | ||||||||
Regression introduced in release | ||||||||
Regression introduced by commit | ||||||||
Triggers an Emergency Pack | No | |||||||
Summary | 0042370: Unnecessary executions of a query that loads the complete organizational structure of a client | |||||||
Description | Creation of new OBContexts or reinitialization of OrganizationStructureProviders cause many unnecessary executions of the query that loads the organizational tree of a client. | |||||||
Steps To Reproduce | - Set a breakpoint on line 95 of org.openbravo.dal.security.OrganizationStructureProvider (List<Object[]> treeNodes = qry.list();) - Perform regular actions like logging in from different accounts even on the same terminal, creating tickets and waiting for Import Entries to be processed. The breakpoint is hit for many of the actions and, for some of them, several times. | |||||||
Proposed Solution | Since Import Entry reinitializes the available OrganizationStructureProviders it is not enough to cache those instances. Instead, the internal Map or organization nodes should be cached by client Id. To manage the cases when the organization structure changes, a Business Entity Event Observer should be developed to listen changes to Organization and clear the cached maps when organizations are created, deleted or its relevant properties are updated. The properties are: PeriodControlAllowedOrganization, CalendarOwnerOrganization, BusinessUnitOrganization and LegalEntityOrganization. Attached diffs with the proposed implementation. | |||||||
Tags | Performance | |||||||
Attached Files | OrganizationStructureProvider.diff [^] (6,948 bytes) 2019-11-21 18:45 [Show Content] | |||||||
Relationships [ Relation Graph ] [ Dependency Graph ] | ||||||||
|
Notes | |
(0134069) ioritzCia (developer) 2021-12-30 10:56 |
I would like to raise this issue again. We looked in two of hour biggest customers taking a look at pg_stat_statements and in one of them is the 2nd query reading the most and in the other the 9th. It is not that it is bad performant but it gets executed too often. In the first of the two customers around 200 times per minute, which does not make sense because the organization tree does not change as often. |
(0135593) ioritzCia (developer) 2022-03-09 15:16 edited on: 2022-03-09 15:17 |
In another review of the statistics. It was the 2nd in two of our biggest customers, the 9th in another. In on of the first two, analyzing the peak hour of the peak day it was 1st most reading query, it had read almost 6.5TB in that hour and it had an average execution of 72 times per second. |
(0136491) hgbot (developer) 2022-04-12 14:26 |
Merge Request created: https://gitlab.com/openbravo/product/openbravo/-/merge_requests/559 [^] |
(0136895) hgbot (developer) 2022-05-03 08:57 |
Directly closing issue as related merge request is already approved. Repository: https://gitlab.com/openbravo/product/openbravo [^] Changeset: 2e14b5c56ecce6699486a10c6f8072b29cdabad8 Author: Augusto Mauch <augusto.mauch@openbravo.com> Date: 03-05-2022 06:39:21 URL: https://gitlab.com/openbravo/product/openbravo/-/commit/2e14b5c56ecce6699486a10c6f8072b29cdabad8 [^] Fixes ISSUE-42370: OrganizationStructureProvider caches the organization node data Now the organization node data will be stored in a TimeInvalidatedCache so that it is cached but periodically recalculated (current periodicity is 5 minutes). Users of OrganizationStructureProvider that used to invoke the reinitialize method no longer do it unless they really require an updated org info (only use cases were tests that invoked assertPersistOrgInfo to ensure the OrganizationStructureProvider reflected the changes they just did to the organization structure and InitialOrgSetup, right after creating a new organization). --- A src/org/openbravo/dal/security/OrganizationNodeCache.java M src/org/openbravo/dal/security/OrganizationStructureProvider.java M src/org/openbravo/erpCommon/ad_forms/InitialOrgSetup.java M src/org/openbravo/service/importprocess/ImportEntryProcessor.java --- |
(0136896) hgbot (developer) 2022-05-03 08:57 |
Merge request merged: https://gitlab.com/openbravo/product/openbravo/-/merge_requests/559 [^] |
(0171445) hgbot (developer) 2024-11-05 16:36 |
Merge request closed: https://gitlab.com/openbravo/product/openbravo/-/merge_requests/25 [^] |
Issue History | |||
Date Modified | Username | Field | Change |
2019-11-21 18:28 | mauricio_peccorini | New Issue | |
2019-11-21 18:28 | mauricio_peccorini | Assigned To | => platform |
2019-11-21 18:28 | mauricio_peccorini | File Added: OrganizationStructureProvider.diff | |
2019-11-21 18:28 | mauricio_peccorini | Modules | => Core |
2019-11-21 18:28 | mauricio_peccorini | Triggers an Emergency Pack | => No |
2019-11-21 18:45 | mauricio_peccorini | File Deleted: OrganizationStructureProvider.diff | |
2019-11-21 18:45 | mauricio_peccorini | File Added: OrganizationStructureProvider.diff | |
2019-12-26 11:18 | AugustoMauch | Assigned To | platform => mauricio_peccorini |
2020-08-14 16:41 | ALopetegui | Issue Monitored: ALopetegui | |
2020-08-14 16:43 | ALopetegui | Tag Attached: Performance | |
2021-12-30 10:38 | AugustoMauch | Assigned To | mauricio_peccorini => AugustoMauch |
2021-12-30 10:56 | ioritzCia | Note Added: 0134069 | |
2022-02-01 07:24 | alostale | Assigned To | AugustoMauch => Triage Platform Base |
2022-03-09 15:16 | ioritzCia | Note Added: 0135593 | |
2022-03-09 15:17 | ioritzCia | Note Edited: 0135593 | View Revisions |
2022-03-10 07:30 | alostale | Relationship added | related to 0048756 |
2022-03-11 13:05 | AugustoMauch | Assigned To | Triage Platform Base => cberner |
2022-03-11 13:05 | AugustoMauch | Status | new => scheduled |
2022-04-07 15:51 | AugustoMauch | Assigned To | cberner => AugustoMauch |
2022-04-12 14:26 | hgbot | Note Added: 0136491 | |
2022-05-03 08:57 | hgbot | Resolution | open => fixed |
2022-05-03 08:57 | hgbot | Status | scheduled => closed |
2022-05-03 08:57 | hgbot | Fixed in Version | => PR22Q3 |
2022-05-03 08:57 | hgbot | Note Added: 0136895 | |
2022-05-03 08:57 | hgbot | Note Added: 0136896 | |
2024-11-05 16:36 | hgbot | Note Added: 0171445 |
Copyright © 2000 - 2009 MantisBT Group |