Files

Click Add to add an existing file to the Project.

a. Browse

Use the file browser to select the required file.

This file should be present in the FTP folder of the current project. See also Projects.

b. Frequency

Frequency indicates the time interval in which the assigned action (UPLOAD, COPY or APPEND) is performed on the file.

• Hourly Action is attempted every hour
• Daily Action is attempted every day during a specified hour.
• Weekly Action is attempted on specified week day during specified hour
• Monthly Action is attempted on specified day in month during specified hour

Note: In the Monthly option, actions on day 31 will be attempted on day 30 and day 28 (and day 29) in February. Similarly, actions on day 30 will be attempted on day 28 (and day 29) in February.

c. Action

• APPEND – Data is appended to an existing table in PostGIS or SQL Server (for CSV files only).
• COPY – Files are copied to the specified location (any file type).
• UPLOAD – Files are uploaded into PostGIS or SQL Server (for spatial files excluding CSV).
• UPDATE – Existing table is dropped and a new one created (for CSV files only).

Note: If an UPLOAD of a data file fails, the service will ‘Simplify’ the data and try again. (This does not apply to overlay datasets from a SWD upload.)

d. GeognoSIS stops and restarts

Before a file can be uploaded, the relevant table has to be included in PostGIS or SQL Server. However GeognoSIS will have locked the table if data in a SWD is being displayed.

If the actions for the current period include an upload, GeognoSIS will be stopped as part of the first upload. GeognoSIS will then be restarted after all operations for the current ‘period’ have been completed.

Note: Requests for GeognoSIS restarts are bundled; if multiple files require a GeognoSIS restart in any one action ‘period’, there will be only one GeognoSIS restart attempted.

e. Database

Select PostGIS or SQL Server and fill in the relevant details.

Click Edit to make changes to an existing file.

Simply type in the changes in the respective fields- for e.g. change Frequency to Hourly or Weekly or select Action to change folder name (COPY) or server details (UPLOAD).

Enable Pause for individual imports/exports to be paused/disabled.

Click Save.

Different file types support different functions. Related Topics

If a CSV file is selected, you can configure these additional settings. Click ‘CSV columns’ to configure how CSV data is loaded into a database.

In this form you can set:

• Header rows for the data file
• A primary key from the csv data or add your own.
• Suggestions for database data types (based on the 1st 100 lines of data)
• Specific Excel columns to be ignored (Skip) in the import or Indexed.
• Set whether there is a column for which a tsvector column will be created and indexed (Note the tsvector column is the same name with “_vector” appended.)

Multiple files can be easily added in a single operation. Simply press CTRL when selecting files in the browser.

Note:

1. Files must be of the same type, e.g. all TAB.
2. Multiple CSV files cannot be added in a single operation due to the column configuration required.
3. If multiple files are added for UPLOAD, the table name is auto-generated (if required, this can be changed by editing the records.)

• All CSV files now have date/time included in their name in the archive.
• The number of versions maintained is configured by a new parameter in Cadcorp.SIS.ETL.config:
  • <csvHistoryVersions>5</csvHistoryVersions>
• If this parameter is not defined by the user, the service will default to 5 versions.
• To revert to having just one version with no date/time stamp, specify
  • <csvHistoryVersions>0</csvHistoryVersions>
• bigint and boolean support are offered as standard for CSV files.
• Numbers in scientific (exponential) notation are interpreted automatically in CSV files.