Openbravo Issue Tracking System - Openbravo ERP
View Issue Details
IDProjectCategoryView StatusDate SubmittedLast Update
0048418Openbravo ERPA. Platformpublic2022-01-18 14:222022-01-19 08:24
Reporteralostale 
Assigned ToTriage Platform Conn 
PrioritynormalSeveritymajorReproducibilityrandom
StatusnewResolutionopen 
PlatformOS5OS Version
Product Version 
Target VersionFixed in Version 
Merge Request Status
Review Assigned To
OBNetwork customer
Web browser
ModulesCore
Support ticket
Regression level
Regression date
Regression introduced in release
Regression introduced by commit
Triggers an Emergency PackNo
Summary0048418: import entries can be processed twice if their key is not deterministic
DescriptionIf an ImportEntryProcessor can return different keys for the same import entry, ie. it returns a random number between 1 and 10 to distribute entries in 10 threads, and an entry is takes long to be processed since it was initially scheduled, it can be processed more than once.
Steps To ReproduceCreate an import entry which key is always different and takes long to execute and schedule it ensuring there is no other entries processing at the same time (to ensure no more time is awaited between cycle executions).
-> Check it gets processed 3 times.

This behavior can be emulated with Import Entry Load Simulator [1] and the following config:

** Import Entry config
  import.batch.size                     5000
  import.number.of.threads              11
  import.max.task.queue.size            1000
  import.wait.time                      600
  import.processing.capacity.per.second 330
** OBUIELS_Data1
  Num of Entries 1
  Period         100
  Cycles         1
  Delay          0
  Exec Time      5000
  # of Keys      1000

---

[1] https://gitlab.com/openbravo/tools/platform/org.openbravo.util.ieloadsim [^]
Proposed Solution
Additional Information
TagsNo tags attached.
Relationships
related to defect 0048427 closed alostale Openbravo ERP high load of low priority import entries can cause higher priority entries not to be processed 
related to defect 0047219 closed caristu Modules Use different runnables for EDL processes that should be executed in a specific thread 
Attached Files
Issue History
Date ModifiedUsernameFieldChange
2022-01-18 14:22alostaleNew Issue
2022-01-18 14:22alostaleAssigned To => Triage Platform Conn
2022-01-18 14:22alostaleModules => Core
2022-01-18 14:22alostaleTriggers an Emergency Pack => No
2022-01-19 08:24hgbotNote Added: 0134374
2022-01-19 13:06alostaleRelationship addedrelated to 0048427
2022-04-04 14:17rafarodaRelationship addedrelated to 0047219

Notes
(0134374)
hgbot   
2022-01-19 08:24   
Merge Request created: https://gitlab.com/openbravo/product/openbravo/-/merge_requests/503 [^]