You can use the IBM Secure Gateway to establish a secure connection between your on-cloud Planning Analytics environment and your on-premises data sources and easily move and manage data files in your on-cloud shared folder either remotely or directly within a desktop session on the IBM cloud. If you have multiple cloud environments, you can also move files between the shared folders of each environment.

If you are not ready to take on setting up a secure gateway, and don’t want to bother with using a Remote Desktop Connection (RDC), a simple solution exists using a File Transfer Protocol Secure (FTPS) application.

File Transfer Protocol (FTP)

FTP is a way of exchanging data between two computers or a computer and a server. In effect, the IBM Cloud is a (secured) computer server. FTP or file transfer protocol works by following commands to upload and download individual files. FTP is enabled when the server command port 21 is opened on the receiving server. FTP establishes a connection between the client (where the source file resides) and the FTP server (in this case the IBM Cloud).

Client Computer

To perform a file transfer, you will first need your IBM Planning Analytics system account information (available in your Planning Analytics Welcome Kit). This information consists of HOST name and the username and password assigned to the on-cloud shared folder that you want to access. For an FTP application, you can use most any FTP client software, but two good choices are FileZilla (https://filezilla-project.org/download.php?type=client) or WinSCP. (https://winscp.net/eng/index.php)

Once you have the (FTP) software installed on your local computer, set the proper “configuration settings” to establish a connection to the IBM Cloud. In FileZilla, there is a “Quickconnect” toolbar (shown below) to access your settings:

WinSCP provides a similar dialog to enter your connection settings:

Refer to the FTP software documentation you choose to use on how to setup a connection and perform a transfer.

Recommendations

On the IBM Cloud server, the shared folder(s) typically use the following structure: prodtm1 and then the subfolders “Data”, “InputFiles” and “Logs”:

The “InputFiles” folder is where data files should be transferred. The Data and Logs folders are restricted as they contain the runtime Planning Analytics database files on the server and related log files, respectively. It is recommended subfolders be established under the InputFiles folder to organize files by source and/or purpose.

Transfer the File

To copy or “transfer” a file on your local computer, open the FTP application you installed and verify the information for the connection: Host, username, password and port (Note: make sure you select the option to use File Transfer Protocol Secure (FTPS)). Next, use the FTP application to select and move files between your local computer and the desired location on your IBM Planning Analytics system. Finally, make sure you “Log out” of the FTP session and close the FTP application.

Automation

To maintain the utmost control, the task of transferring files can remain a manual process. The process, however, may easily be automated. For example, if you are using WinSCP, commands similar to the following may be used as a “template” to automate the transfer of a file (here named sampleFile.txt):

open ftpes://username:password@ftpes.example.come/

lcd “C:MyLocalDataData Files”

cd /prod/tm1/InputFiles

put “sampleFile.txt”

exit

To execute a WinSCP automation script, use a command similar to:

“C:Program Files (x86)WinSCPWinSCP.exe” /log=”C:writablepathtologWinSCP.log” /ini=nul /script=”C:pathtoscriptscript.txt”

Security and Other Concerns

Keep in mind that the IBM Cloud “FileShare” user ID (and password) allows read/write access to the shared folder (and subfolders). If the folder is to be accessed by external personnel, it is recommended additional security be implemented (setup via IBM Support request). This information should also be tightly controlled by system administrators.

PGP Encryption

All data transferred to and from the IBM cloud is automatically encrypted in transit, however for a deeper level of security, you may use PGP encryption to encrypt files you want to transfer to the cloud or to encrypt files on the cloud you want to transfer back to your location.  To use PGP, you’ll need to install a PGP application, for example GnuPGP (from https://www.gnupg.org/download) or Symantec Encryption Desktop (from https://www.symantec.com), in your local environment (look for a working example of using PGP encryption in an upcoming Blog post!).

Overwriting

One more thing. Before you start uploading (performing a file transfer), take a moment to determine if you want to always use the same file name and overwrite any previous uploaded files of that name or, use a new file name each time. If you choose to use new/unique file names, it is recommended that a naming convention be established, preferably a convention that uses a common name with a timestamped suffix. For example, MyFileName_YYYY_MM_DD.

Ask QueBIT

Sound complicated? Don’t worry! To automate an FTP process, create sub folders, outline additional security for external personnel, enable PGP Encryption or create an IBM support request – all aligned to industry best practices – you can always rely on QueBIT for assistance. We’re here to help!