Getting files which are created after a specific time from Unix Directory Using Touch and Find Commands

Generally, we all know that we can create a file using “touch” command in UNIX. If the given file does not exist then “touch” command will create that file, otherwise it will change the modification time of that file.

Syntax:

touch filename

Suppose, in our project, we will get source files with the naming convention “SOURCE_FILE_YYYYMMDD.dat”. And today we have received SOURCE_FILE_20140117.dat and tomorrow, we will get SOURCE_FILE_20140118.dat etc. Every day we will receive one file.

We may have a requirement that to take all the files which are created after a specific time based on file created time from UNIX directory.

Step 1: create a dummy file with specific time using TOUCH command.

Syntax:

touch -t 'YYYYMMDDHH24MM.SS' dummy.dat

We should pass the date in YYYYMMDDHH24MM.SS format.

Example:

1) If you give touch -t '201401240134.55' dummy.dat then the dummy file will be created and created time will be Jan 24, 2014.

2) If you give touch -t '201401070134.55' dummy.dat then the dummy file will be created and created time will be Jan 07, 2014.

We can see the created/modification time using ls –ltr command in UNIX.

If we want to take all the files which are created after Jan 7^th, 2014 01:34.55, then we can use

touch -t '201401070134.55' dummy.dat

Step 2: After done with the step 1, now we have to find the files which are created after Jan 7^th, 2014 01:34.55. We can find using “find” command in UNIX.

For the above requirement, we can use below command.

If we are in the directory where we have source files then use

find ./SOURCE_FILE_*.dat –newer dummy.dat

If we are not in the directory where we have source files and source files are there in /infa/sourcefiles then use find /infa/sourcefiles /SOURCE_FILE_*.dat –newer dummy.dat

Comments

Comparing Objects in Informatica

We might face a scenario where there may be difference between PRODUCTION v/s SIT version of code or any environment or between different folders in same environment. In here we go for comparison of objects we can compare between mappings,sessions,workflows In Designer it would be present under "Mappings" tab we can find "Compare" option. In workflow manger under "Tasks & Workfows" tab we can find "Compare" option for tasks and workflows comparison respectively. However the easiest and probably the best practice would be by doing using Repository Manager.In Repository Manager under "Edit" tab we can find "Compare" option. The advantage of using Repository manager it compares all the objects at one go i.e. workflow,session and mapping. Hence reducing the effort of individually checking the mapping and session separately. Once we select the folder and corresponding workflow we Can click compare for checking out ...

Types of Joins in Oracle/Teradata

In Data warehousing, irrespective of schema (snow flake schema or star schema) we are using, we should join dimension and fact tables to analyze the business. Below are the frequently used joins: Inner join Left outer Join Right outer Join Cross join Inner Join: Inner join will give you the matching rows from both the tables. If the join condition is not matching then zero records will return. We should use ON keyword to give join condition. Example: Table1: ID Name 1 Krishna 2 Anirudh 4 Ashok Table2: ID Location 1 Bangalore 3 Chennai 4 Chennai We can join above two tables using inner join based on key column ID. SELECT T1.ID, T1.Name, T2.Location FROM Table1 T1 INNER JOIN Table2 T2 ON T1.ID = T2.ID If we are using inner join, it will give us matching rows from both the table. Here in this example, we have 2 matching rows i.e. ID 1 and 4. Below will be the result set for the above exa...

Looping using Expression Transformation in Informatica

One of the most common used transformation in Informatica is Expression transformation. In Expression transformation we can perform various operations such as data conversions i.e to_date,to_char, string manipulation such as substr,instr etc. Now coming to one of the widely and prominent task which we perform using Expression transformation is looping a value. Expression transformation has three types of ports i.e. input,variable and output.Only output port values can be propagated to next transformations. So in order to pass values of input and variable ports to next level of transformation these must be assigned to output ports.The order of execution in Expression transformation is top to bottom and first input then variable and finally output ports are processed. let us consider the following scenario The files should be generated with employee name as file name and that particular file should have the details of that respective employee only, if the employee has more t...

IT Pandora (ETL,DB,UNIX,AWS,NodeJS,Github etc.)

Search This Blog