Connector Details

Connector AttributesDetails
NameSFTP
DescriptionSFTP, or Secure File Transfer Protocol, is a network protocol that provides secure file transfer capabilities over an encrypted connection. Unlike FTP, SFTP incorporates SSH (Secure Shell) to encrypt both data and authentication information, protecting against interception and unauthorized access. SFTP operates over a single, secure channel, eliminating the need for separate control and data channels as in FTP. This single-channel design enhances security and simplifies firewall configuration, making SFTP suitable for environments where data confidentiality and integrity are critical. With support for directory browsing, file uploads, downloads, and permission management, SFTP is widely used in industries that require stringent data security, such as finance, healthcare, and government. By combining file transfer functionality with secure data handling, SFTP provides a robust solution for safely exchanging sensitive information over the internet.
Connector TypeClass C

Features

Feature NameFeature Details
Load StrategiesFull Load, Incremental Load
Metadata ExtractionSupported
Data AcquisitionSupported
Data PublishingNot Supported
Automated Schema Drift HandlingNot Supported

Source Connection Attributes

Connection ParametersData TypeExample
Connection NameStringSFTP Server
HostnameStringeu-central-1.sftpcloud.io
PortNumeric22
UsernameString
PasswordString
Remote PathString
Bronze Schema (Optional)String
Silver Schema (Optional)String

Connector Specific Configuration Details

  1. SFTP connector has optional values such as Bronze Schema and Silver Schema
  2. Connector accepted only CSV/JSON files like sources of data.
    1. Mandatory conditions for the Sharepoint static CSV files:
      1. File Format
        The connector is designed to handle files only in theCSV/JSON format. Ensure all files used or processed by the system are in .csv format for compatibility with the connector.
      2. Use of Separator
        Always use a comma , as the separator in your data files. This ensures consistency and compatibility across different systems and processes.
      3. Encoding Standard
        Ensure that all files are saved and processed using theUTF-8 encoding. This is crucial to maintain character integrity, especially when working with international data or special characters.
      4. File Movement or Renaming
        When you move or rename a file, it is essential to update the associated metadata. This ensures that all references to the file are accurate and that no processes relying on this data are disrupted.
      5. Replacing a File
        If you are replacing a file but not dropping and creating a new one, you can continue to use the same table name. This allows for a seamless transition and minimal disruption to the existing data structure.
      6. Dropping and Creating a New File
        When you drop and create a new file with the same name, it is necessary to update the metadata. This ensures that the system properly references and recognizes the new file, preventing potential issues with outdated information.
    2. Mandatory conditions for the Sharepoint static JSON files:
      1. Encoding Standard
        Ensure that all files are saved and processed using theUTF-8 encoding. This is crucial to maintain character integrity, especially when working with international data or special characters.
      2. File Movement or Renaming
        When you move or rename a file, it is essential to update the associated metadata. This ensures that all references to the file are accurate and that no processes relying on this data are disrupted.
      3. Replacing a File
        If you are replacing a file but not dropping and creating a new one, you can continue to use the same table name. This allows for a seamless transition and minimal disruption to the existing data structure.
      4. Dropping and Creating a New File
        When you drop and create a new file with the same name, it is necessary to update the metadata. This ensures that the system properly references and recognizes the new file, preventing potential issues with outdated information.
  3. The connector demands a few mandatory options: RemoteHost, User, Password, and RemotePort. Let's review the free service to generate these connection properties for our testing:

Hostname: eu-central-1.sftpcloud.io
Username: 9b9972c6e85f49259457d4c2145eadc1
Password: HXbGQdyghvY0kgQAdEGEpNiaRpmP6J15
Port: 22

  1. More details around this connector)

Screenshot To Use Connector