Modify an SFTP (external) pickup

After you create an external SFTP pickup, you can view and modify the fields that define the object.

An external SFTP server resides outside of Activator and is not managed from the Activator user interface. You can use an external SFTP server to consume messages from partners or from back-end applications.

SFTP settings tab

  • SFTP server – The name of the SFTP server.
  • Port – The port on which the server listens for incoming connections. The default is 22.
  • Current public key – The RSA or DSA public key for the SFTP server. Activator uses the key to authenticate the server.
  • New public key – Select this option to display to select a new RSA or DSA public key for the SFTP server. Activator uses the key to authenticate the server. If the server is modified to use a new public-private key pair, the public key must be updated.
    • Retrieve public key from server – Click Get Key to have Activator retrieve the public key for the SFTP server. The server name and port number entered on this page must be correct for this option to work.
    • Server public key file – Type the path to the file containing the public key for the SFTP server or click Browse to locate the file. You may have to ask the server administrator for the file path. See Public-private key and password authentication.
  • Use password authentication – Password authentication requires entering the user name and password for connecting to the server. The user name and password are sent over an encrypted connection to authenticate the user to the server. Although this option offers ease of administration, the password is vulnerable because it is sent every time a connection is made. The password could be compromised if the server is ever compromised.
  • See Public-private key and password authentication.
  • Use public/private key pair authentication – Public-private key pair authentication requires entering the user name of the server here.
  • If this exchange is for a community, add the private key to the community. If this exchange is for a partner, add the public key to any community that will be trading with the partner.
  • To add a key, click Certificates in the navigation graphic at the top of the community summary page. Select the SSH keys tab. Click Add an SSH key, follow the prompts and click Add. Select the key as the default SSH key after it has been added. For more information see Public-private key and password authentication.
  • Use host-based authentication – This is not used.

Directories tab

  • Pickup directory – Type the path of the directory on the external server where messages are picked up. When Activator polls the server for files, it only looks in the pickup directory, not an inbox directory.
  • Use temporary files to avoid read/write collisions – We recommend using this option to prevent Activator from attempting to retrieve partially written files. When this is selected, you must select one of the two following options.
    • Use separate directory for temporary files – Type the full path of an inbox directory (for example, c:\data\inbox). Files are uploaded to this directory. When fully written, files are moved to the pickup directory for retrieval.
    • Do not put the inbox under the pickup directory unless you use a period at the beginning of the inbox name. Activator and other applications ignore directories and files that begin with periods.
    • For example, do not use the following directory structure:
    • c:\data\pickup\inbox
    • But you can use the following because a period is the first character of the inbox directory name:
    • c:\data\pickup\.inbox
    • When receiving files from a partner, we recommend that your partner write files to the inbox directory first and then move them to the pickup directory when they are ready to be retrieved. This process is automatic if your partner also uses Axway products B2Bi, Interchange or Activator. If the partner uses other software to upload files to your server, the software should be configured to initially upload the files to the inbox directory and move them to the pickup directory when they are ready to be retrieved.
    • For outbound from back-end applications, the back-end system must write the message to the inbox and then move it to the pickup directory.
    • For inbound to the back end and for sending outbound to partners, Activator writes to the inbox and then moves the message to the pickup directory.
    • Use special extension in pickup directory for temporary files – If you prefer not to use an inbox, select this option. While a file is being written to the pickup directory, a temporary extension is added so the system knows not to retrieve it because the file is only partially written. Once fully written, the temporary extension goes away and the file can be retrieved.

Filenames tab

  • Preserve original filenames – Select this if you want original file names to be preserved when Activator delivers messages. For binary messages, we recommend that you preserve original file names. Otherwise, Activator assigns a unique file name that does not readily identify the contents of the file. Preserving original file names also allows your back-end application to process binary messages based on their file names. This field applies to both application and partner deliveries.
  • Overwrite duplicate filenames – An option when you choose to preserve original file names. If duplicate file names are detected, Activator overwrites the existing file.
  • Sequentially number duplicate filenames – An option when you choose to preserve original file names. If duplicate file names are detected, Activator appends a number to the new file. For most transports, the appended number is consecutively numbered. For FTP and SFTP, however, the appended number is hexadecimal and looks like this: filename_c4.
  • Generate unique filenames – Select to have the system provide a unique file name instead of using the original name. This field applies to both application and partner deliveries. When selected, files are given arbitrary names. The names always have less than 30 characters and often have less than 20 characters.
  • Appended to the file name is a hex representation of a monotonically increasing file name counter that is maintained in the database and guaranteed to be unique across all nodes in a cluster. In addition, if the original file name had an extension, the same extension is appended to the unique name the system generates.
  • The following are examples of unique file names generated by the system, one with the original file extension and one without:
    • dabeed45_4cb.edi
    • z47e4120_4ce

Advanced tab

  • Maximum concurrent connections – Default = 10. The maximum number of concurrent connections Activator can open to the external SFTP server to pick up files.
  • Use this setting to control the rate at which you consume polled files from the server.
  • Read timeout (seconds) – How long in seconds that Activator waits to read data from the delivery exchange before terminating the connection.
  • Maximum block size per downloading packet – Sets the maximum size of the packets that can be downloaded from an external SFTP server by the SFTP client within Activator. The minimum packet size is 512 and the maximum size is 32768 data packet units. The default value is compatible with most SFTP servers.
  • The client downloads messages in a series of data packets. By default the maximum But when handling messages of a certain size (2-3 megabytes or larger), some servers cannot process many packets of the default size and downloading hangs. If this occurs, reduce the packet size maximum. Adjusting the value is a trial-and-error process. You may have to test several values depending on the size of the messages being processed. For example, when messages are approximately 3 MB in size, the maximum packet size can be set at 4096. This field is available only on the trading and application pickup exchanges.
  • Enable file filtering – Available for some exchanges used for application pickups and for receiving from partners, file filtering allows Activator to discriminate which files to consume based on file names. In the file name filter pattern field, type the formats of the files you want the transport to consume or ignore. Use conventional wildcard characters for file names or extensions or both. The following describes the supported characters and symbols:
  • *

    One or more characters.

    ?

    Any single character.

    [ ]

    Matches any single character within the brackets. For example, r[aou]t matches rat, rot and rut.

    ,

    Commas can be used as and/or operators within brackets (for example, r[a,o,u]t).

    -

    Use hyphens within brackets to specify ranges of letters or numbers. For example, [0-9] is for any number between 0 and 9, and [A-Za-z] is for any upper- or lower-case letter.

    .

    Use the character dot to separate the file name and extension. For example, *.txt.

    |

    Use the pipe character to separate multiple file-name formats. For example, *.edi|*.txt|[a,b,c]?.xml.

 

  • Specify with the radio buttons whether the filter pattern is inclusive or exclusive. If inclusive, only files matching the pattern are consumed. If exclusive, files matching the pattern are ignored, but all other files are consumed.
  • Activator ignores files that do not meet filtering conditions. Ignored files are not reported in Message Tracker. Such files also do not generate log messages unless the following property is set to debug in conf\log4j2.xml:
  • log4j.category.com.cyclonecommerce.tradingengine
  • Sequence consumed messages based on their delivery exchange – Select this option if you want messages that are consumed by this pickup to be delivered in their original consumption order per resolved destination delivery. When Activator consumes messages on this pickup that are delivered over multiple delivery exchanges, the messages are filtered and ordered in their consumed sequence for each delivery, and processed in parallel per delivery. For details about this functionality, see Sequential message delivery.
    • Timeout to apply for out of sequence messages (seconds) – Default = 60 seconds. Enter a time limit for Activator to wait for missing messages of a sequence before taking the appropriate action. This feature avoids the blocking of processing when a sequenced message is not available.
  • Backup files that go through this transport – Indicates whether the system backs up copies of the messages it consumes from the external SFTP server.
  • Backing up files is strongly recommended. This is required for the system to perform fail-over operations such as attempting to send messages again (retries) in case of a transport connection failure. Without backups, a message in process cannot be recovered if the server or a processing node stops or restarts. Backups also are needed if you want the ability to resubmit messages to back-end applications or resend messages to partners. Backup files are stored in <Activator_common_directory>\data\backup, unless you specify otherwise.
  • Encrypt backup files and prevent storage of non-encrypted data initiated through this transport – Select this option if you want to prevent the storage of non-encrypted backups of messages processed through the system.
  • Restrict maximum file size for this transport – Optionally lets you specify the maximum size of files a transport can handle.
  • If Activator receives a file larger than the maximum, the file is rejected and a message is written to the events log. If received via HTTP, a 413 response also is sent and the connection is closed. A 413 message is Request Entity Too Large. The maximum size must be expressed in bytes. Do not use commas. For instance, a kilobyte is 1024 bytes, a megabyte is 1048576 bytes, a gigabyte is 1073741824 bytes. The smallest maximum allowed is 1000 bytes. On the opposite extreme, you can enter the largest number the field can accommodate. This control is available only for transports used for picking up messages from the back end or receiving messages from partners.
  • See Post-processing of consumed messages.
  • Maximum files per polling interval – The highest number of messages the system can retrieve each time it polls.
  • Polling interval (seconds) – The interval in seconds Activator waits before polling for messages to retrieve.
  • Maximum messages per connection – This value specifies the maximum number of messages to be consumed over a single connection before the connection is closed and reopened on another processing node. This setting effectively controls load balancing. The default setting of 1 achieves optimal load balancing at the cost of greater overhead per message. Depending on your message volume and the load on each node, this value could be increased to avoid the overhead associated with reconnecting to the transport server, at the cost of a less well-balanced cluster.
  • This setting is applicable in clustered environments when more than one Activator node is configured.

Related Links