This page summarizes possibilities on applying chemometric models from 3rd party software onto hyperspectral data for off-line or in-line purposes.
Chemometric modelling is a very essential step when investigating to chemically or physically material properties. Typically, experts like to overcome this job with their familiar environment (software).
This natural behavior is supported by the export of data (spectra, cubes) and by the back import of models into the Perception Studio software program. When configuring the real-time processing core (Perception Core) by the Perception Studio, a data processing system is obtained, allowing to do multiples of predictions per spatial object pixel in industrial real-time.
Data Processing Steps
When doing predictions in the industrial environment, a number of data processing steps must be considered:
- Sensor Data Preprocessing
- Hyperspectral Preprocessing
- Feature Extraction
- (e.g.) Feature Operation
The sensor data processing aims to a "standardization" of the instrument.
Therefore electrically and optically disorder (like sensor noise, optically distortions, etc.) are corrected by this data processing step. Data from different instruments (same type but different batch) ought to get comparable to each other.
The hyperspectral preprocessing aims a form of spectra best suited for further investigation like analysis.
The feature extraction aims the extraction of a certain value out from spectroscopic data. This value can be the prediction value obtained by applying a linear model onto spectral data. Since this step is typically done in parallel, per spatial object pixel multiple predictions can be obtained simultaneously.
Sometimes also feature operation is an important step. By feature operation a number of features (output of the feature extraction), like predictions, are mathematically combined with each other.
Applying models from 3rd party software is possible without any restrictions, when
- the modelling process was done on spectra preprocessed by the Studio program
- the model is linear (Y=B*X+B0)
- and the model file (exported from the 3rd party software) is readable by the Perception Studio program.
Preprocessed means: sensor data preprocessing as well as hyperspectral preprocessing was applyed to the spectra using the Perception Studio program (not the 3rd party software).
A linear model is described by the vector B and the scalar B0. X is a matrix of spectra (input) and Y is a vector of predictors (output).
The typically workflow on getting and applying a linear model is:
- Setup the instrument and get measurement data from your sample matrix (sensor data preprocessing is applied automatically)
- Explore the measurement data to check the quality
- Apply hyperspectral preprocessing to the data in the Perception Studio program
- Select spectra from the hyperspectral data measured
- E.g. find out the spectral region of interest by using the crop functionality together with the Model tool
- Export the data in a format of your choice (e.g. ASCII).
- Import the data into the 3rd party software of your choice.
- Do the modelling work.
- Export the model(s) from the 3rd party software in a format readable by the Perception Studio program
- Import the model(s) into the Perception Studio program
- Apply the model(s) to your measurement data and verify the quality of the model(s)
In case of real-time processing:
- Configure the Real-time processing core in the Setup perspective
- View the instruments predictions of new measurements live in the Perception Studio program.
The content of this page and any attached files are confidential and intended solely for the addressee(s). Any publication, transmission or other use of the information by a person or entity other than the intended addressee is prohibited. If you receive this in error please contact Perception Park and delete copied material. Perception Park GmbH, Nikolaiplatz 4 / 3, A-8020 Graz; Austria; FN 400381x