IBM InfoSphere Platform provides all the foundational building blocks of trusted information, including data integration, data warehousing, master data management, big data and information governance.
Questions tagged [ibm-infosphere]
87 questions
3
votes
2 answers
'Load Property...' An internal error has occured. java.lang.StackOverfrlowError
I cannot ALTER table in Data Studio for last few days.. Nothing really was updated (I guess it is Eclipse environment error). Any ideas what's going on? Note: it happens when I do right-click on the table then select Alter. But it happens only to…

VladP
- 881
- 2
- 13
- 37
2
votes
1 answer
Steps to generate OAuth2 token in hierarchical stage in Datastage
How to generate OAuth2 token in hierarchical stage in Datastage job. What are the steps to do this?

Rishabh Tyagi
- 81
- 1
- 7
2
votes
1 answer
Assigning an SQL result to a Job Parameter in DataStage
I just started using Datastage (version 11.5) and I am trying to assign the value of a simple SQL query (select max(date_col) from Table) into a Job Parameter so that I can use it as a part of a file produced from the job.
Can anyone point out a…

Panos Georgopoulos
- 21
- 1
- 3
1
vote
1 answer
Unsure about InfoSphere 11.7 nulls handling
At work I've come across with an old process written in InfoSphere 11.7, I'm trying to migrate it to another framework but no one seems to know how it works (including me, of course).
The ETL process takes as input a fixed length .txt UTF-8 file.…

imatiasmb
- 113
- 7
1
vote
1 answer
How to aggregate strings in multiple rows in IBM InfoSphere DataStage grouped by a given ID
I am given a table like the following of a attendece of employees at a company. The data should be extracted from a sequenctial file which has comma seperated…

Sahan Aloka Mendis
- 23
- 8
1
vote
2 answers
Bulk edit DataStage jobs?
We are repointing a large number (>1000) DataStage jobs from one database to another. As part of this, we will need to make the same changes to a single stage for many jobs.
So far, we have been able to export jobs to XML, edit and reimport. This…

quannabe
- 367
- 1
- 4
- 11
1
vote
1 answer
Can CDC technology replicate changes into Kafka?
We need to capture and share changes from our DB2 z/OS environment into a Kafka based information hub. We have tried ETL tools to do similar but we are concerned about the impact of ETL on our source DB2 z/OS environment.

Kevin Wei
- 165
- 11
1
vote
1 answer
Will IGC allow me to trace where data has been sourced from or how data is being consumed, for any ETL or Data Transformation Tool?
As part of our Governance initiative and regulatory requirement, we need to produce a Lineage (tractability) report, outlining the flow of data into our Warehouse, and the Reports or Services consuming its data. We are aware that Information…

Kevin Wei
- 165
- 11
1
vote
1 answer
Kafka and IIDR CDC
I am trying to build a CDC pipeline using : DB2--IBM CDC --Kafka
and I am trying to figure out the right way to setup this .
I tried below things -
1.Setup a 3 node kafka cluster on linux on prem
2.Installed IIDR CDC software on linux on prem…

Tony
- 671
- 1
- 9
- 29
1
vote
0 answers
Load compressed data from Amazon S3 to Postgres using datastage
I am trying to load data which is stored in .gz format in S3 to PostgreSQL server using Datastage. I am using the ODBC connector on the target (database) side. I am able to load uncompressed data from S3 to PostgreSQL but no luck with compressed…

devd
- 370
- 10
- 28
1
vote
0 answers
Fatal Error: Added field has duplicate identifier(): APT_TRinput0Rec99 (ALR_DATIBAS3.FilterFieldError)
I have a job with 181 columns, I'm getting this error while compiling on a transformer before a funnel.
Fatal Error: Added field has duplicate identifier(): APT_TRinput0Rec99 (ALR_DATIBAS3.FilterFieldError)
The transformer has 181 constraints and…
1
vote
1 answer
How to solve the below scenario using transformer loop or anything in datastage
My data is like below in one column coming from a file.
Source_data---(This is column name)
CUSTOMER 15
METER 8
METERStatement 1
READING 1
METER 56
Meterstatement 14
Reading 5
Reading 6
Reading 7
CUSTOMER 38
METER 24
METERStatement 1
READING…

Sean
- 37
- 4
1
vote
1 answer
CWSAL0053E: The EBA file cannot be installed
I was not able to execute madconfig.sh redeploy_EBA:
$ ./madconfig.sh redeploy_EBA
Buildfile: build.xml
Trying to override old definition of task executeUpdateScript
redeploy_EBA:
The osgi bundles will be redeployed at the following profile:
Cell…

Betlista
- 10,327
- 13
- 69
- 110
1
vote
2 answers
IBM DataStage: Evaluate string as code/expression
I have a complex transformation where a lookup stage specifies one of approximately 30 different/specific string operations that has to be done on a row. I am wondering how to do this efficiently in DataStage?
The requirement is something like…

Jens Külpmann
- 11
- 3
1
vote
0 answers
Reading hex value in datastage
We have a mainframe file which we are trying to read using Complex Flat File Stage. The column has data type PIC X(1) which we are reading as char(1) and assigning to char (10). Problem is it converts to value "26" when the value should be 30. The…

dna
- 483
- 3
- 10
- 32