Audit Strategy in ETL #1
Atul Singh
February 26, 2016
The Audit service will provide simple measures on the ETL process: number of records input/output, number of rejected records, number of r...
Friday, February 26, 2016
Tuesday, February 23, 2016
DataStage Scenario #15 - Get First & Last Date of Last Month
Unknown
February 23, 2016
Design a job which can generate the First and Last date of Last Month and pass this into an SQL which executes inside a parallel job? ...
Monday, February 22, 2016
Python Points #10d - Writing into Files
Unknown
February 22, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.googl...
Tuesday, February 16, 2016
Python Points #10c - File Methods
Atul Singh
February 16, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.googl...
Monday, February 15, 2016
5 Tips For Better DataStage Design #9
Unknown
February 15, 2016
#1. Always save the metadata (for source, target or lookup definitions) in the repository to ensure re-usability and consistency. #2. M...
Saturday, February 6, 2016
Python Points #10b - Reading Files
Atul Singh
February 06, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plu...
Friday, February 5, 2016
Python Points #10a - Reading Files
Atul Singh
February 05, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.go...
DataStage Scenario #14 - Get Day specific file
Atul Singh
February 05, 2016
Hi Guys, Design jobs for one more realtime scenario - Requirement- Job will run once in a day, which read a file from a folder, but...
Thursday, February 4, 2016
DataStage Scenario #13 - Validate Decimals
Unknown
February 04, 2016
Input: Data 1 2 3 4. 345 423 4w 4232.23 42342.43243 56765.74 545 4 4o 646. 4343 3232. 4232 ...
Wednesday, February 3, 2016
Python Points #9 - Tuples
Atul Singh
February 03, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.goog...
Monday, February 1, 2016
5 Tips For Better DataStage Design #8
Atul Singh
February 01, 2016
#1. Templates have to be created to enhance reusability and enforce coding standard. Jobs should be created using templates. #2. The temp...
Sunday, January 31, 2016
Create a Daemon to Trace New Processes
Atul Singh
January 31, 2016
Description The following code can be used to create a daemon that will watch for processes that show up in the "ps -ef" output...
Friday, January 29, 2016
Where to get DataStage Scheduled jobs ?
Atul Singh
January 29, 2016
Did you guys ever try to find out how the scheduler works when we schedule jobs by DataStage scheduler? Interesting na !! So, let's h...
Wednesday, January 27, 2016
How to get table list used in DataStage jobs ?
Atul Singh
January 27, 2016
While developing jobs in DataStage, sometimes we face this requirement to get all the table list which was used by our DataStage jobs, but ...
Python Points #8 - Dictionary
Atul Singh
January 27, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.googl...
Sunday, January 24, 2016
ps command #4 - Sorting with sort command
Atul Singh
January 24, 2016
We can sort the ps command output by unix sort also which is easy to use. Need to pass ps command output to sort command with proper argum...
Friday, January 22, 2016
Shell Script for getting lines after and before of search String
Atul Singh
January 22, 2016
Sometime when we search some text string in Unix environment we need those strings also which come before or after that searched string. ...
Wednesday, January 20, 2016
Import your own python library
Atul Singh
January 20, 2016
How to use your own written functions or routines when code in python?? Follow below steps for auto import - 1. Create a folder where ...
Tuesday, January 19, 2016
Python Points #7 - Loops
Atul Singh
January 19, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.goog...
Sunday, January 17, 2016
Count of Jobs - A Quick DataStage Recipe
Atul Singh
January 17, 2016
What to Cook: How to count number of jobs in DS project Ingredients: Use dsjobs "-ljobs" command How to Cook: Go to D...
Thursday, January 14, 2016
Data Wrangling Cheatsheet
Atul Singh
January 14, 2016
Data Wrangling Cheatsheet Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/d...
Wednesday, January 13, 2016
DataStage Scenario #12 - Combine data column wise
Atul Singh
January 13, 2016
Col1 Col2 Col3 1 2 3 4 5 6 7 8 9 Col4 Col5 Col6 a b ...
Monday, January 11, 2016
Python Points #6 - Strings
Atul Singh
January 11, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.goog...
Sunday, January 10, 2016
Cartesian Join - A Quick DataStage Recipe
Atul Singh
January 10, 2016
What to Cook: How to do Cartesian join -> Join every row of a table to every row of other table Ingredients: Use "column...
A Quick DataStage Recipe
Atul Singh
January 10, 2016
Under this series, I am trying to cook some quick solution for DataStage problems, issues, technical implementation of re-usable logics whi...
Friday, January 8, 2016
5 Tips For Better DataStage Design #7
Atul Singh
January 08, 2016
#1. In case the partition type for the next immediate stage is to be changed then the ‘Propagate partition’ should be set to ‘Clear’ in th...
Monday, January 4, 2016
Monitoring Memory by DataStage Processes #2
Atul Singh
January 04, 2016
You can find other parts here -> Monitoring Memory by DataStage Processes #1 Continuously capturing memory usage of all osh proc...
Monday, December 28, 2015
Python Points #5 - Lists
Atul Singh
December 28, 2015
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.goog...
Thursday, December 24, 2015
Python Points #4 - Conditions
Atul Singh
December 24, 2015
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.goog...
Wednesday, December 23, 2015
5 Tips For Better DataStage Design #6
Atul Singh
December 23, 2015
#1. If you are using a copy or a filter stage either immediately after or immediately before a transformer stage, you are reducing the eff...
Tuesday, December 22, 2015
Notepad++ tip - Find out the non-ascii characters
Atul Singh
December 22, 2015
Working on some code and when try to compile or run arrrrrr, got a non-ascii char error ????? Now how to resolve this, here is the way if ...
