How does StockIQ process data? – StockIQ Technologies

Summary

StockIQ processes data from your ERP in three distinct steps:

Import Data to Staging
Import Data to Internal Tables
Run Calculations

Steps/Process

Import to Staging

The final product of this step is data loaded into StockIQ's staging tables. This is data in its raw format as extracted from the ERP (or as uploaded by your IT department). Only basic data checks are run here, to ensure that the input data is well-formed, does not have duplicates, matches the correct data types, and does not have any illegal values.

Any malformed or duplicate records will fail the database check constraints and will be thrown out, and an associated error message will be shown.

This step typically only takes a few minutes. If there are many (millions) of error messages generated due to bad data, this can take much longer to log all the messages, which is a sign that significant data cleanup should be done on the data files being sent to StockIQ.

Import to StockIQ

In this step, data is moved from the staging tables into the StockIQ internal tables. In this step, much more rigorous data-quality checks are run, ensuring that there is solid referential integrity in all data (e.g. all items referred to in all files match with a record in the Item table). Records failing this second level of testing will be thrown out, and error messages will be generated.

Once the data has made it into the internal StockIQ tables, it is clean enough to begin running inventory calculations on.

Calculate

In this step, StockIQ takes the data you have provided, and runs the various calculations according to your configuration, such as the forecasting, replenishment planning, ABC stratification, and so on. This is typically the longest step, and is very CPU, memory, and disk intensive, as many values are being calculated, read, stored, and saved across your entire inventory set.

For more information, see the Calculate Screen topic.

Summary

Steps/Process

Related articles