tag:blogger.com,1999:blog-15319370.post824115688560580731..comments2024-03-29T12:51:32.931+01:00Comments on Roland Bouman's blog: Pentaho Data Integration: Javascript Step Performancerpboumanhttp://www.blogger.com/profile/13365137747952711328noreply@blogger.comBlogger15125tag:blogger.com,1999:blog-15319370.post-37788897291598427272012-07-26T00:25:22.947+02:002012-07-26T00:25:22.947+02:00konatham prasad,
I don't think your question...konatham prasad, <br /><br />I don't think your questions have anything to do with this blog article. please post this kind of stuff in a public forum.rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-40588429831725805052012-07-25T16:20:43.339+02:002012-07-25T16:20:43.339+02:00Hi Roland,
I have created 2 jobs as per requireemn...Hi Roland,<br />I have created 2 jobs as per requireemnt my query is am getting the error message like Stack over flow (Buffer Issue) even i was increased heap memory size upto 1024 but still am getting the error Please suggest me <br /><br />Thanks <br />Prasada Konathamkonatham prasadhttps://www.blogger.com/profile/08068116223019340898noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-14598135901868155522012-07-25T16:06:05.122+02:002012-07-25T16:06:05.122+02:00Hi Dear,
Could you help us we are facing big issue...Hi Dear,<br />Could you help us we are facing big issue in pentaho kettle..<br /><br />My Query is :<br />We are running parallel instance job(The job contains multiple sub level jobs & Sub level also contains multiple transformations) If i run the job am getting Stack.overflow issue even i was increased stack heap memory size 1024 but still am getting the error please suggest mekonatham prasadhttps://www.blogger.com/profile/08068116223019340898noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-63038309800326072862009-12-21T23:47:54.695+01:002009-12-21T23:47:54.695+01:00Hello Roland,
Similar way I need an help in ...Hello Roland, <br /><br /> Similar way I need an help in pick up all *.gz files in different location from one of the linux servers using a Java script and ZIP those files and load it into a common location in a different serverVINAYnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-7212518152814114272009-12-07T15:59:35.080+01:002009-12-07T15:59:35.080+01:00Hi Tom! Well, not exactly. The typical blog spam g...Hi Tom! Well, not exactly. The typical blog spam goes like this: <br /><br />"<br />Pravesh Balasubramanian left a comment on your blog:<br /><br />Hi friends,<br />Let me know how to [link]search jobs[/link] in Chennai , please forward the same. <br />"<br /><br />or <br /><br />"<br />Kishore Vijayakuma has left a comment on your blog:<br /><br />Thanks for this site, really is good. <br /><br />U also interested maybe in [link]new style dog grooming[/link], site really good too!<br />"<br /><br />and in many cases, they will actually use their google profile whilst commenting. From there, I try to find their blog or website, and then I do WHOIS, or if that fails some general googling. It is amazing that usually you will find some contact details within 10 or so minutes. I then call them by phone, and usually I get the owner of the website to which the spammers themselves are afilliated. You should try it, it has worked for me so far.rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-69764590724574611662009-12-07T15:41:15.771+01:002009-12-07T15:41:15.771+01:00spam spam spam spam
Like that?spam spam spam spam<br /><br />Like that?Tom Barberhttps://www.blogger.com/profile/01235592103851265420noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-11107068546784913192009-11-17T19:09:23.408+01:002009-11-17T19:09:23.408+01:00Daniel, Thanks for the correction.
Actually you&#...Daniel, Thanks for the correction.<br /><br />Actually you're saying that it is not going to save much in terms of performance, but by doing this I reduced the execution time from 9.7 seconds to 8.1 seconds and from 103,018.4 r/s to 122,850.1 r/s in the 4th correction that Roland did, the one that starts as "Eliminating unncessary code" making it almost 20% better in terms of performance!!!Rodrigo Hacesnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-35176351710660171192009-11-17T15:54:31.478+01:002009-11-17T15:54:31.478+01:00Rodrigo:
Note that the performance tip you mentio...Rodrigo:<br /><br />Note that the performance tip you mention isn't talking about creating a new JS step, but just a new JS script tab inside the existing one.<br />A JS startup script is great if you need to construct some heavy-weight and long-lived objects such as a regular expression or a big lookup hashmap.<br /><br />In this case, you still have to create new string values for every row, so you aren't really going to save much in terms of performance if you just declare the holder of those values in a startup script.Daniel Einspanjerhttps://www.blogger.com/profile/09217451216749647422noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-11359846408640464502009-11-17T10:22:55.406+01:002009-11-17T10:22:55.406+01:00Rodrigo: thanks, great tip. And thanks for the lin...Rodrigo: thanks, great tip. And thanks for the link: this is ignorance on my part, but I did't know this one existed. <br /><br />If I can find some time over the weekend, I will do another post and add a few more optimizations Daniel Einspanjer showed in his video, as well as show the effect of multiple threads. <br /><br />Regards,<br />Roland.rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-76631149348069849302009-11-17T05:08:38.897+01:002009-11-17T05:08:38.897+01:00Roland, refering to the PDI Performance tuning che...Roland, refering to the PDI Performance tuning check-list ( http://wiki.pentaho.com/display/COM/PDI+Performance+tuning+check-list ) you could also add as the first step a JavaScript to create the vars you're using and then at the real javascript step take out the "var xxxx", that will also optimize the script:<br /><br />"JavaScript: variable creation<br /><br />If you have variables that can be declared once at the start of the transformation, make sure you put them in a separate script and mark that script as a startup script (right click on the script name in the tab).<br /><br />Javascript object creation is very expensive so if you can avoid creating a new object for every row you are transforming, this will translate to a performance boost for the step."Rodrigo Hacesnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-35029516605422616992009-11-16T18:03:21.969+01:002009-11-16T18:03:21.969+01:00It's very interesting to see the difference in...It's very interesting to see the difference in execution time between the various methods! Thanks for posting this!Anonymoushttps://www.blogger.com/profile/05683544764949933581noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-32483817198177117272009-11-16T16:42:37.833+01:002009-11-16T16:42:37.833+01:00Hi all,
thanks for your kind words. I'm glad ...Hi all,<br /><br />thanks for your kind words. I'm glad it was useful :)<br /><br />@Paul: thanks for you mentioning me in your blog, and thanks for the link to the documentation of the java expression step. I modified my post to link to the documentation.<br /><br />Kind regards,<br /><br />Rolandrpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-23362468002746639552009-11-16T16:10:37.430+01:002009-11-16T16:10:37.430+01:00Java Expression is great. I hope we have documenta...Java Expression is great. I hope we have documentation soon.Paulo Sobreirahttp://sowbreira.appspot.com/noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-32716843060157624272009-11-16T16:09:41.580+01:002009-11-16T16:09:41.580+01:00Ouaw ! Thanks Roland.
Very deep and very detailed....Ouaw ! Thanks Roland.<br />Very deep and very detailed.<br />Superb post. I'm going to change / improve my routines by using yours.<br />;)<br />VincentVincentnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-12781192339937712892009-11-16T10:14:06.189+01:002009-11-16T10:14:06.189+01:00Fantastic post. Very useful to see confirmed what ...Fantastic post. Very useful to see confirmed what we have known for a long time. If you don't have to use javascript, Don't. <br /><br />Also very interesting about the Java expression step. Going to have to play with that one. <br /><br />Wilwselwoodhttps://www.blogger.com/profile/16621705703685178577noreply@blogger.com