I am using Toad Data Point to automate SFTP download. I am "Moving" the files so that they get deleted from the ftp site when the files are downloaded. I have found that several times per day files are "Removed" but never "downloaded" I am losing several files per day. I can see this in the log when reviewing the issue:
-- 10/19/2020 2:21:19 PM: MEMO_POST_IMPORT.log: COH_MEMOPOST_10192020_676334_CC.TXT succesfully downloaded
-- 10/19/2020 2:21:20 PM: MEMO_POST_IMPORT.log: COH_MEMOPOST_10192020_676335_ACH.TXT succesfully downloaded
-- 10/19/2020 2:21:21 PM: MEMO_POST_IMPORT.log: COH_MEMOPOST_10192020_676336_CC.TXT succesfully downloaded
-- 10/19/2020 2:21:22 PM: MEMO_POST_IMPORT.log: COH_MEMOPOST_10192020_676334_CC.TXT successfully removed.
-- 10/19/2020 2:21:23 PM: MEMO_POST_IMPORT.log: COH_MEMOPOST_10192020_676335_ACH.TXT successfully removed.
-- 10/19/2020 2:21:24 PM: MEMO_POST_IMPORT.log: COH_MEMOPOST_10192020_676336_CC.TXT successfully removed.
-- 10/19/2020 2:21:24 PM: MEMO_POST_IMPORT.log: COH_MEMOPOST_10192020_676337_CC.TXT successfully removed.
-- 10/19/2020 2:21:25 PM: MEMO_POST_IMPORT.log: Successfully downloaded files using wildcard COH_MEMOPOST_*.TXT
File COH_MEMOPOST_10192020_676337_CC.TXT was REMOVED but never DOWNLOADED. What can be done to ensure that this does not happen?