Live Datastage Scenario

What are the different ways I can retrieve detail records from a file of the type Header-Detail-Trailer records - Header Record 1 Detail Record 1 Detail Record 2 Detail Record 3 Detail Record 1 Detail Record 2 Detail Record 3 ;;;;;;;;; ;;;;;;;;; ;;;;;;;;; Trailer Record 1

I need to be able to join the detail records 1 2 and 3 in order to generate a single detail record. The metadata in each one of them is different so I cannot funnel it. Right now I am splitting the file in detail records 1 2 and 3 and assigning a unique sequential number to each one of them and then joining them using that number (since it will be sequential). But I am getting a performance hit since it is sequential. Is there any other (parallel) way to implement this?

No comments:

Post a Comment