Remove linear infill

Step 1: Select the data from the left file tree or from “files” tab which needs to be manipulated.

Step 2: Once you select the file, it will be opened in the “Data Wrangler”.

Step 3: Click on the “Remove linear infill” and a popup will appear.

Step 4: Click on the columns in which you want to apply remove linear infill under “Select data”.

Step 5: After selecting the columns, there are three options to consider in applying remove linear infill.

  1. Consider periods greater than: this allows you to ignore short periods of potential linear infilling, or short periods where the actual data may have been linear in nature.

For example, in environmental data, the longer the period, the more unlikely that the observed data follows a completely linear trend.

  1. Ignore values less than: this allows you to ignore values at the lower end of the detection range.

For example, for flow records, there may be months of zero flow, this is linear, but it probably isn’t a result of linear infilling but a real period of zero flow.

  1. Tolerance on linearity: The Tolerance on linearity is the measure of deviation from the line. The default value of 0.01% means that if a value has a deviation of the cell value from a line of perfect linearity joining the preceding and subsequent values of less than 0.01% of the cell value then we assume linearity.

For example, if we have three values, 10.00, 20.002, and 30.00. To be perfectly linear the second value would have to be 20.000.

The deviation from linearity is 0.002/20 x 100 = 0.01% – or right on the border of acceptably linear according to the default settings.

Step 6: The default “Result” is to overwrite the original file with the updated file.

Select what you want to save as your output file from the “output” drop down menu.

If you want to keep the original file along with your updated file then, click on “Keep all columns” or “only keep selected columns” under “create new file”. Click “run”. The new file will be saved in the same folder as original file.