Questions tagged [ibm-infosphere]

IBM InfoSphere Platform provides all the foundational building blocks of trusted information, including data integration, data warehousing, master data management, big data and information governance.

87 questions
3
votes
2 answers

'Load Property...' An internal error has occured. java.lang.StackOverfrlowError

I cannot ALTER table in Data Studio for last few days.. Nothing really was updated (I guess it is Eclipse environment error). Any ideas what's going on? Note: it happens when I do right-click on the table then select Alter. But it happens only to…
VladP
  • 881
  • 2
  • 13
  • 37
2
votes
1 answer

Steps to generate OAuth2 token in hierarchical stage in Datastage

How to generate OAuth2 token in hierarchical stage in Datastage job. What are the steps to do this?
Rishabh Tyagi
  • 81
  • 1
  • 7
2
votes
1 answer

Assigning an SQL result to a Job Parameter in DataStage

I just started using Datastage (version 11.5) and I am trying to assign the value of a simple SQL query (select max(date_col) from Table) into a Job Parameter so that I can use it as a part of a file produced from the job. Can anyone point out a…
1
vote
1 answer

Unsure about InfoSphere 11.7 nulls handling

At work I've come across with an old process written in InfoSphere 11.7, I'm trying to migrate it to another framework but no one seems to know how it works (including me, of course). The ETL process takes as input a fixed length .txt UTF-8 file.…
imatiasmb
  • 113
  • 7
1
vote
1 answer

How to aggregate strings in multiple rows in IBM InfoSphere DataStage grouped by a given ID

I am given a table like the following of a attendece of employees at a company. The data should be extracted from a sequenctial file which has comma seperated…
1
vote
2 answers

Bulk edit DataStage jobs?

We are repointing a large number (>1000) DataStage jobs from one database to another. As part of this, we will need to make the same changes to a single stage for many jobs. So far, we have been able to export jobs to XML, edit and reimport. This…
quannabe
  • 367
  • 1
  • 4
  • 11
1
vote
1 answer

Can CDC technology replicate changes into Kafka?

We need to capture and share changes from our DB2 z/OS environment into a Kafka based information hub. We have tried ETL tools to do similar but we are concerned about the impact of ETL on our source DB2 z/OS environment.
Kevin Wei
  • 165
  • 11
1
vote
1 answer

Will IGC allow me to trace where data has been sourced from or how data is being consumed, for any ETL or Data Transformation Tool?

As part of our Governance initiative and regulatory requirement, we need to produce a Lineage (tractability) report, outlining the flow of data into our Warehouse, and the Reports or Services consuming its data. We are aware that Information…
Kevin Wei
  • 165
  • 11
1
vote
1 answer

Kafka and IIDR CDC

I am trying to build a CDC pipeline using : DB2--IBM CDC --Kafka and I am trying to figure out the right way to setup this . I tried below things - 1.Setup a 3 node kafka cluster on linux on prem 2.Installed IIDR CDC software on linux on prem…
Tony
  • 671
  • 1
  • 9
  • 29
1
vote
0 answers

Load compressed data from Amazon S3 to Postgres using datastage

I am trying to load data which is stored in .gz format in S3 to PostgreSQL server using Datastage. I am using the ODBC connector on the target (database) side. I am able to load uncompressed data from S3 to PostgreSQL but no luck with compressed…
devd
  • 370
  • 10
  • 28
1
vote
0 answers

Fatal Error: Added field has duplicate identifier(): APT_TRinput0Rec99 (ALR_DATIBAS3.FilterFieldError)

I have a job with 181 columns, I'm getting this error while compiling on a transformer before a funnel. Fatal Error: Added field has duplicate identifier(): APT_TRinput0Rec99 (ALR_DATIBAS3.FilterFieldError) The transformer has 181 constraints and…
1
vote
1 answer

How to solve the below scenario using transformer loop or anything in datastage

My data is like below in one column coming from a file. Source_data---(This is column name) CUSTOMER 15 METER 8 METERStatement 1 READING 1 METER 56 Meterstatement 14 Reading 5 Reading 6 Reading 7 CUSTOMER 38 METER 24 METERStatement 1 READING…
Sean
  • 37
  • 4
1
vote
1 answer

CWSAL0053E: The EBA file cannot be installed

I was not able to execute madconfig.sh redeploy_EBA: $ ./madconfig.sh redeploy_EBA Buildfile: build.xml Trying to override old definition of task executeUpdateScript redeploy_EBA: The osgi bundles will be redeployed at the following profile: Cell…
Betlista
  • 10,327
  • 13
  • 69
  • 110
1
vote
2 answers

IBM DataStage: Evaluate string as code/expression

I have a complex transformation where a lookup stage specifies one of approximately 30 different/specific string operations that has to be done on a row. I am wondering how to do this efficiently in DataStage? The requirement is something like…
1
vote
0 answers

Reading hex value in datastage

We have a mainframe file which we are trying to read using Complex Flat File Stage. The column has data type PIC X(1) which we are reading as char(1) and assigning to char (10). Problem is it converts to value "26" when the value should be 30. The…
dna
  • 483
  • 3
  • 10
  • 32
1
2 3 4 5 6