Connector Details

Connector AttributesDetails
NameSFTP
DescriptionSFTP, or Secure File Transfer Protocol, is a network protocol that provides secure file transfer capabilities over an encrypted connection. Unlike FTP, SFTP incorporates SSH (Secure Shell) to encrypt both data and authentication information, protecting against interception and unauthorized access. SFTP operates over a single, secure channel, eliminating the need for separate control and data channels as in FTP. This single-channel design enhances security and simplifies firewall configuration, making SFTP suitable for environments where data confidentiality and integrity are critical. With support for directory browsing, file uploads, downloads, and permission management, SFTP is widely used in industries that require stringent data security, such as finance, healthcare, and government. By combining file transfer functionality with secure data handling, SFTP provides a robust solution for safely exchanging sensitive information over the internet.
Connector TypeClass C

Features

Feature NameFeature Details
Load StrategiesFull Load, Incremental Load
Metadata ExtractionSupported
Data AcquisitionSupported
Data PublishingNot Supported
Automated Schema Drift HandlingNot Supported

Source Connection Attributes

Connection ParametersData TypeExample
Connection NameStringSFTP Server
HostnameString
PortNumeric22
UsernameString
Password (Optional)String
Remote PathString
Open SSH Key (Optional)String
PGP Private Key (Optional)String
PGP Passphrase (Optional)String
Bronze Schema (Optional)String
Silver Schema (Optional)String

Connector Specific Configuration Details


Connection Types Supported

  1. Regular SFTP Connection
    Standard SFTP connections can be established using basic credentials like host, user, password, and port.

  2. SFTP Connection for SAP Concur File Drops (via DDS Service)
    Encryption & Security Requirements:

    Files are encrypted using a PGP key and passphrase. An SSH key is required to establish the SFTP connection.
    PGP Key and Passphrase are necessary for decrypting the downloaded files. The password is optional but
    can be included if available. The private keys are securely stored in Key Vault with line escapes to enhance security.

    Example credentials required for testing:

    Hostname: mft-us2.concursolutions.com
    Username: p0001590rwa7
    Remote path: /out
    Port: 22
    Open SSH key: SFTP-PK-Key
    PGP Private key: SFTP-Decrypt-Key
    PGP passphrase: SFTP-PGP-Passphrase

  3. Supported File Types
    The connector supports the following data source formats:

    CSV
    JSON
    PGP
    XLSX
    XLS

  4. Mandatory conditions for the SFTP static CSV files:

    1. File Format
      The connector is designed to handle files only in the CSV/JSON format. Ensure all files used or processed by the system are in .csv format for compatibility with the connector.
    2. Use of Separator
      Always use a comma , as the separator in your data files. This ensures consistency and compatibility across different systems and processes.
    3. Encoding Standard
      Ensure that all files are saved and processed using theUTF-8 encoding. This is crucial to maintain character integrity, especially when working with international data or special characters.
    4. File Movement or Renaming
      When you move or rename a file, it is essential to update the associated metadata. This ensures that all references to the file are accurate and that no processes relying on this data are disrupted.
    5. Replacing a File
      If you are replacing a file but not dropping and creating a new one, you can continue to use the same table name. This allows for a seamless transition and minimal disruption to the existing data structure.
    6. Dropping and Creating a New File
      When you drop and create a new file with the same name, it is necessary to update the metadata. This ensures that the system properly references and recognizes the new file, preventing potential issues with outdated information.
  5. Mandatory conditions for the SFTP static JSON files:

    1. Encoding Standard
      Ensure that all files are saved and processed using theUTF-8 encoding. This is crucial to maintain character integrity, especially when working with international data or special characters.
    2. File Movement or Renaming
      When you move or rename a file, it is essential to update the associated metadata. This ensures that all references to the file are accurate and that no processes relying on this data are disrupted.
    3. Replacing a File
      If you are replacing a file but not dropping and creating a new one, you can continue to use the same table name. This allows for a seamless transition and minimal disruption to the existing data structure.
    4. Dropping and Creating a New File
      When you drop and create a new file with the same name, it is necessary to update the metadata. This ensures that the system properly references and recognizes the new file, preventing potential issues with outdated information.
  6. Mandatory conditions for the SFTP PGP files:

    1. Encoding Standard
      Ensure that all files are saved and processed using theUTF-8 encoding. This is crucial to maintain character integrity, especially when working with international data or special characters.
    2. File Movement or Renaming
      When you move or rename a file, it is essential to update the associated metadata. This ensures that all references to the file are accurate and that no processes relying on this data are disrupted.
    3. Replacing a File
      If you are replacing a file but not dropping and creating a new one, you can continue to use the same table name. This allows for a seamless transition and minimal disruption to the existing data structure.
    4. Dropping and Creating a New File
      When you drop and create a new file with the same name, it is necessary to update the metadata. This ensures that the system properly references and recognizes the new file, preventing potential issues with outdated information.
  7. The connector demands a few mandatory options for regular SFTP connection: RemoteHost, User, Password, and RemotePort. Let's review the free service to generate these connection properties for our testing:
    (for an example)

Hostname: eu-central-1.sftpcloud.io
Username: 9b9972c6e85f49259457d4c2145eadc1
Password: HXbGQdyghvY0kgQAdEGEpNiaRpmP6J15
Port: 22


Screenshot To Use Connector