0052415: Error importing text files: Input length = 1

Openbravo Issue Tracking System - Openbravo ERP

View Issue Details

Project

Category

View Status

Date Submitted

Last Update

0052415

Openbravo ERP

A. Platform

public

2023-05-10 23:20

2023-05-29 10:13

Reporter

jlopez

Assigned To

frank_gonzalez

Priority

normal

Severity

minor

Reproducibility

sometimes

Status

acknowledged

Resolution

open

Platform

OS Version

Product Version

Target Version

Fixed in Version

Merge Request Status

Review Assigned To

OBNetwork customer

Web browser

Modules

Core

Support ticket

Regression level

Regression date

Regression introduced in release

Regression introduced by commit

Triggers an Emergency Pack

Summary

0052415: Error importing text files: Input length = 1

Description

It has been detected that when importing text files, depending on the operating system with which the file was generated, it can generate the following exception:

java.nio.charset.MalformedInputException: Input length = 1

Specifically, for now the error has been located when importing text files that are then processed reading line by line, since depending on the operating system that generated the file, it could use a different line break character than the default for UNIX systems (LF).

Creating BufferedReader from Files.newBufferedReader, when running the application it may throw the exception mentioned above. Example:

Files.newBufferedReader(Paths.get("a.txt"), StandardCharsets.UTF_8);

But if we replace the above with this, it works well:

new BufferedReader(new InputStreamReader(new FileInputStream("a.txt"),"utf-8"));

The different is that, the former uses CharsetDecoder default action (The default action for malformed-input and unmappable-character errors is to report them), while the latter uses the REPLACE action:

cs.newDecoder().onMalformedInput(CodingErrorAction.REPLACE).onUnmappableCharacter(CodingErrorAction.REPLACE)

Tests have been done in this regard and it has been verified that using the replacement avoids the error and imports the file correctly (at least for the specific case of line breaks).

The use of the same case has been detected in the following files:
- src/org/openbravo/retail/discounts/bytotal/actionhandler/ImportFreeProductInDiscount.java
- src/org/openbravo/retail/discounts/actionhandler/ImportFreeProductInDiscount.java
- src/org/openbravo/pos2/process/ImportCrossStoreWithPriority.java
- src/org/openbravo/pos2/process/ImportStoreSet.java
- src/org/openbravo/reporting/tools/task/ImportLabelsTask.java
- src/org/openbravo/reporting/tools/task/GenerateJasperPropertyFileTask.java

So perhaps it would be necessary to check if it is necessary to apply any correction.

Steps To Reproduce

Proposed Solution

Replace this:

Files.newBufferedReader(Paths.get(file.getAbsolutePath()))

For this:

new BufferedReader(new InputStreamReader(new FileInputStream(file.getAbsolutePath())))

Additional Information