Scheduling Imports from SFTP

Imports can be set to be picked up automatically from the /incoming/ directory on the SFTP server.  For any source format, an import mask can be specified on the Import Automation tab of the source format. This enables other systems to deliver files directly to the SFTP that are processed as if uploaded through Upload Dataset.  These files go through the same import scripts and remappings as when they are uploaded directly.

  Files not coming in?

Check the Import Path/Mask field: it needs to include the name of the subfolder your file is stored in if you're using one.

So, for example, if your files are stored in a subfolder labeled "Banner," then the Import Path/Mask should be Banner/SisToSlate_*.txt

If an import mask has been specified, Slate scans the /incoming/ directory at least once per hour to determine if one or more files match the specified mask.

Accepted wildcard characters are:

    • A question mark (?) - denotes a single wildcard character, and
    • An asterisk (*) - denotes any number of characters.

For example, to identify all files that start with "SisToSlate_" and end with ".txt", the import mask could be "SisToSlate_*.txt".  A prefix or suffix should always be specified (for example, never use only "*.txt" as a mask) to ensure that you're specifically targeting the files, and no spaces or special characters except for an underscore should be used.

When Slate picks up and processes a file, the file is moved into a /processed/ subdirectory within the /incoming/ directory.  If a file with that name already exists, the existing file within the /processed/ directory is overwritten.

Test Environment SFTP

Use the test folder and subfolders to test an upload from the SFTP site into a test environment. A subfolder for /test/outgoing is created automatically when a scheduled export is manually run from a test environment. 

Because test environments do not perform scheduled file imports, when files are dropped off into the /test/incoming folder or one of its subfolders, you must:

  1. Select Database from the main navigation.
  2. In the section Import and Data Processing, select Force Process Pickup.
  3. Use your browser navigation to return to the previous page.
  4. In the same section as before, select Force Process Import.

A subfolder for /test/incoming is created automatically when a source format includes this subfolder path as an Import Path/Mask. The Force Process Pickup process is run in a test environment.

Was this article helpful?
14 out of 19 found this helpful