4 May 2012

Parallel commit using ODBC connection (Informatica)


During our GreenPlum integration with Informatica PowerCenter, we tried testing the ODBC connection (instead of Native) to cross check the performance. As usual ODBC performance was bad compare to Native connection. 

But with below custom property, we were able to overwrite the multiple commit property of a driver and almost gave Native connection throughput.





OptimizeODBCWrite=No à
When Informatica connects it queries the driver to ask if it supports array reads/writes. Some drivers say yes but they may not have a large enough array. Example we were using the Greenplum target database, by setting this flag PowerCenter doesn’t uses the array set to write to the target, hence it will process more number of records.  

OptimizeODBCRead=No 

this is for reading the data for source. 



15 comments:

  1. Hello,

    Does the native driver that we can use with informatica to read with greenplum exists? If so how we can acquire it? I do not see anything online. Please guide me.

    We are currently using odbc connection to greenplum. It is not going more then 1500 rows per second. Are you recommending:

    OptimizeODBCRead=No
    OptimizeODBCWrite=No

    Please clarify

    ReplyDelete
  2. I appreciate you sharing this article. Really thank you! Much obliged.
    This is one awesome blog article. Much thanks again.

    sap online training
    software online training
    sap sd online training
    hadoop online training
    sap-crm-online-training

    ReplyDelete

  3. Truly enjoyed surfing around your weblog posts.If u r interested visit
    http://www.tekclasses.com/

    ReplyDelete
  4. Truly enjoyed surfing around your weblog posts.If u r interested visit
    http://www.tekclasses.com/

    ReplyDelete
  5. Excellent blog you’ve got here..

    http://www.tekclasses.com/

    ReplyDelete
  6. Excellent blog you’ve got here..

    http://www.tekclasses.com/

    ReplyDelete
  7. Its a very good site to visit.

    http://www.tekclasses.com/

    ReplyDelete
  8. Its a very good site to visit.

    http://www.tekclasses.com/

    ReplyDelete
  9. too good piece of information, I had come to know about your site from my friend sajid, bangalore,i have read atleast 7 posts of yours by now, and let me tell you, your web-page gives the best and the most interesting information. This is just the kind of information that i had been looking for, i'm already your rss reader now and i would regularly watch out for the new post, once again hats off to you! Thanks a lot once again, Regards, informatica mdm training in hyderabad

    ReplyDelete
  10. Hiya,

    Thanks for the post, it’s a great piece of article.
    Really saved my day
    .

    Would like to Hard delete the template from the database as well so if you can tell the table where these Export templates are saved in the data base will be much helpful or you can say will be helpful for our learning.



    But nice Article Mate! Great Information! Keep up the good work!
    Obrigado,
    Morgan

    ReplyDelete
  11. Hi There,

    Allow me to show my gratitude bloggers. You guys are like unicorns. Never seen but always spreading magic. Your content is yummy. So satisfied.

    Oracle OpenWorld combines product information and strategy with customer stories to help attendees discover and chart their journey to the cloud Driven by over 180 sessions led by independent user groups and Oracle, the theme will focus on customer choice and how customers can modernize and extend their on premise solutions through Oracle Cloud and community engagement with user groups. Below is a sampling of some of the content themes taking place on Sunday at OpenWorld.

    Follow my new blog if you interested in just tag along me in any social media platforms!


    Thank you,
    Yamuna

    ReplyDelete
  12. Hey Brother,

    Awesome article. Thanks for making that available. I've been using your help to build my own POC and will publish the steps in another blog soon.

    I agree with your logic but it might be that PT is considering the system columns also as normal columns and giving the functionality (just blind guess) .
    And yes I tried replicating your issue its same even for me.

    Are you using IDD to search records?

    Very useful article, if I run into challenges along the way, I will share them here.

    Thanks,
    Irene Hynes

    ReplyDelete
  13. Hi There,

    This is one awesome blog. Much thanks again. Fantastic.
    I am working MDM 10.2 provisioning tool. I need to add a filter to consolidation indicator in provisioning tool. I am able to add the filter. But while publishing change list is blank. PFA for snapshots.
    How can I set filter on consolidation indicator(System variable)? Could anyone please help me.

    Anyways great write up, your efforts are much appreciated.

    Muchas Gracias,
    Preethi.

    ReplyDelete
  14. Hi There,

    Thanks so much! This is a great time saver. You explained it very clearly:)

    Even if you change trust score in hub it will affect the existing
    record also. If you need to override trust score only for specific rowid
    then use Merge manager and override the trust score accordingly. Informatica MDM Training Hope it
    answer your question if i understand correctly !


    By the way do you have any YouTube videos, would love to watch it. I would like to connect you on LinkedIn, great to have experts like you in my connection (In case, if you don’t have any issues).
    Please keep providing such valuable information.
    Obrigado,
    Irene Hynes

    ReplyDelete