What changes in server can improve the performance of DataStage server?

2 comments:

  1. If you have large parallel jobs (8.1) running in Windows environment then it is worth checking the servers event log. You could find an error related to Nutcracker.exe. An administrator with access right on the server can see the events logs.

    Nutcracker error could come up while running very heavy jobs where total cpu utilization is upto or above 90% and server starts using virtual memory. This is just an example of the impact of running large parallel jobs in Windows server. Hence to make the system somewhat full proof following changes can be done in Windows registry. The idea is to tune the TCP/IP buffer, increase the heap size and set the virtual memory to the recommended amount.

    To tune TCP/IP settings go to registry editor and check if MaxUserPort and TcpNumConnections keys are present in the TCP/IP buffer and connection registry. Generally they will not be there. TcpNumConnections settings will impact on number of Osh processes.

    To change the settings
    Go to registry editor
    Go to HKEY_LOCAL_MACHINE > SYSTEM > CurrentControlSet > Services > Tcpip > Parameters.
    Now on the right pane modify the values:
    Value Name: MaxUserPort
    Value Type: DWORD
    Value data: 65534
    More information on MaxUserPort click here.

    Value Name: TcpNumConnections
    Value Type: DWORD
    Value data: 65534
    More information on TcpNumConnections click here.

    To change the heap size
    Go to registry editor and change the non interactive desktop heap size.
    Go to HKEY_LOCAL_MACHINE > SYSTEM > CurrentControlSet > Control > Session Manager > SubSystems.
    Click on windows on the right pane.
    Now edit the ShareSection parameter in the value box
    Change the last value from 512 to 1024.

    ReplyDelete
  2. Virtual memory can be configured by right clicking on "My Computer" and going to Advance tab's performance section. Now change the virtual memory to the recommended size. For example if you have 8GB of RAM then recommended size would be 12 GB.

    However all above setting can overcome issues related to large jobs but patches recommended for Nutcracker issue should also be installed.

    ReplyDelete