7. on-the-fly processing

[BerkvensNick]

SoilWise Repository will enable user to manually upload data for their on-the-fly processing within the SWR. Capacity of the SWR will be significantly limited; however, a demonstration of manual data upload and their processing, e.g. transformation of coordinate systems or measurements units.

Origin: D1.3 Repository architecture

• manually upload ingest data
• on-the-fly processing within the SWR: transformation of coordinate systems
• on-the-fly processing within the SWR: transformation of measurements units

---

With acceptance criteria:

• Manually Upload Ingest Data

• Users should be able to access a clearly labeled "Upload Data" button or menu option from the main interface.

• The upload interface should accept common file formats such as CSV, JSON, XML, and Excel.

• A progress indicator should be displayed during the upload process to inform users of the status.

• Users can select and upload files from their local system.

• The system should validate the uploaded file's format and content before processing. If the file is invalid, an informative error message should be displayed.

• Uploaded data should be ingested and stored in the central database for further processing.

• Upon successful upload, the system should display a confirmation message.

• If the upload fails, the system should provide a clear and actionable error message.

• Ensure that only authenticated users can upload data.

• Uploaded files should be scanned for viruses and malware.

• Provide user documentation or tooltips within the UI to guide users on how to use the upload and transformation features.

• Include detailed error messages and troubleshooting steps.

• On-the-Fly Processing Within the SWR: Transformation of Coordinate Systems

• Users should have the option to specify the desired coordinate system transformation when uploading data or from a settings menu.

• An alignment-configuration can be stored for each distribution in a dataset metadata

• Users can contribute an alignment-configuration

• A transformation process can process the alignment-configuration to produce a transformed dataset

• The system should accurately transform coordinates from the source coordinate system to the target coordinate system during the upload process.

• Transformed data should be stored correctly in the central database with the appropriate coordinate system metadata.

• Display a message confirming the successful transformation of coordinate systems after processing.

• If the transformation fails, the system should provide an informative error message indicating the reason for the failure.

• The transformation process should be efficient and not significantly delay the upload process.

• On-the-Fly Processing Within the SWR: Transformation of Measurements Units

• Users should have the option to specify the desired measurement units for data transformation when uploading data or from a settings menu.

• An alignment-configuration can be stored for each distribution in a dataset metadata

• Users can contribute an alignment-configuration

• A transformation process can process the alignment-configuration to produce a transformed dataset

• The system should accurately transform measurement units from the source units to the target units during the upload process.

• Transformed data should be stored correctly in the central database with the appropriate units metadata.

• Display a message confirming the successful transformation of measurement units after processing.

• If the transformation fails, the system should provide an informative error message indicating the reason for the failure.

• The transformation process should be efficient and not significantly delay the upload process.

[pvgenuchten]

I wonder if this functionality is needed (in the first iteration) it makes sense as part of #6, but on any file uploaded by users?

Same comment here as in #6, they should also upload a alignment configuration, if they want to apply a model transformation.

For sure for a simple format or projection configuration, online gdal may be sufficient?