Skip to main content

Move Files from one folder to another folder in SSIS

Problem: Suppose we have a source directory where more than one tab-delimited files exist and we need to move files in archive folder one by one after reading and transform the data from these files.

Solution: SSIS is the best option for this operation. We can use foreach loop container to get files one by one to perform the operation. In this article, I am explaining only how to move files from one directory to another directory. 

Step 1: Drag and drop ForEach loop container from tool to control flow. 

Step 2: Create to variable at package level. 1- Destination 2- FileName

Note: Set the value of Destination (path of destination folder).

Step 3: Right-click on ForEach Loop Container and click on edit.

In General option, you can change the name of the container.

Step 4: Click on Collection tab in editor wizard and browse the source folder.

Note: in file option, you can set file extension mean if you want to read and move .txt file only from the source folder. 

Step 5: This step is important, click on Variable mapping Tab, in variable option choose FileName variable and set index zero.

Now everything is fine to click on OK button.

Step 6: Drag and drop File System Task within Foreach Loop Container.
Step 7: Right click and Edit File System Task. There you will find many options.

1-Destination Connection: Select true option for IsDestinationPathVariable and select Destination (user variable) option for DestinationVariable. 
  2-General: Here you can set the name of file system task.

 3-Operation: This is important, there are many options, and you can choose the option as per your objectives. We will choose the option Move file.
  4-Source Connection: Choose <New Connection> as below. You can choose an existing connection also. 
  5-Now source connection is created now right click on source connection and select property option.
7-The property will open and click on expression a window will open choose option ConnectionString and click on side button a new expression window will open choose FileName variable and click on OK.

Now your package is ready to execute.


Popular posts from this blog

Add day to ISODate in MongoDB

We can use $add operator to add days in ISODate in mongodb, $add is the Arithmetic Aggregation Operator which adds number and date in mongodb.

{ $add: [ <expression1>, <expression2>, ... ] }

Note:  If one of the argument is date $add operator treats to other arguments as milliseconds to add to the date.
Example: Suppose we have a Test collection as below.

{"Title" : "Add day to ISODate in MongoBD","CreatedDate" : ISODate("2016-07-07T08:00:00.000Z")}

Query to add 2 days in CreatedDate

db.Test.aggregate([      { $project: { Title: 1, AddedDate: { $add: [ "$CreatedDate", 2*24*60*60000 ] } } }    ])


{ "_id" : ObjectId("579a1567ac1b3f3732483de0"), "Title" : "Add day to ISODate in MongoBD", "AddedDate" : ISODate("2016-07-09T08:00:00.000Z") }

Note: As mentioned in above note we have to convert days in millisecond because $add operator treat to other arg…

Remove special characters from string in SQL server

I faced many times an issue to remove special characters from a string. Suppose you are working on searching concept and you have to remove the special characters from search string due to query performance, there are many solution are available but T-SQL is easily resolved this issue.
Following query may help you to resolve your issue.

DECLARE@strVARCHAR(400) DECLARE@expresVARCHAR(50)='%[~,@,#,$,%,&,*,(,),.,!]%' SET@str='(remove) ~special~ *characters. from string in sql!' WHILEPATINDEX(@expres,@str)> 0 BEGIN SET@str=Replace(REPLACE(@str,SUBSTRING(@str,PATINDEX(@expres,@str), 1 ),''),'-',' ') END SELECT@str

What is difference between UNION and UNION ALL in SQL Server

We use UNION and UNION ALL operator to combine multiple results set into one result set.
UNION operator is used to combining multiple results set into one result set but removes any duplicate rows. Basically, UNION is used to performing a DISTINCT operation across all columns in the result set. UNION operator has the extra overhead of removing duplicate rows and sorting result.
UNION ALL operator use to combine multiple results set into one result set but it does not remove any duplicate result. Actually, this does not remove duplicate rows so it is faster than the UNION operator. If you want to combine multiple results and without duplicate records then use UNION otherwise UNION ALL is better.
Following some rules for using UNION/UNION ALL operator
1.The number of the column should be the same in the query's when you want to combine them. 2.The column should be of the same data type. 3.ORDER BY clause can be applied to the overall result set not within each result set.
4.Column name of …