tag:blogger.com,1999:blog-15319370.post4511851733438291199..comments2024-03-05T11:16:00.846+01:00Comments on Roland Bouman's blog: A Generic Normalizer for Pentaho Data integration - Revisitedrpboumanhttp://www.blogger.com/profile/13365137747952711328noreply@blogger.comBlogger15125tag:blogger.com,1999:blog-15319370.post-71550475518114147882016-08-12T10:25:56.420+02:002016-08-12T10:25:56.420+02:00"Can your java class be altered in such a way..."Can your java class be altered in such a way that i could it could fit my scenario. BTW how do i read the excel data without defining the columns prior. Please help." <br /><br />This has been a while, and I'm not entirely up to date on the latest state of affairs re. Kettle. In the mean while, many improvements have been added to metadata injection - please check it out: <br /><br />http://wiki.pentaho.com/display/EAI/ETL+Metadata+Injection<br /><br />Perhaps you can use metadata injection for both of your requirements?rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-53471338339148373762016-08-12T10:09:36.163+02:002016-08-12T10:09:36.163+02:00Hey Bouman,
I'm using Kettle for...Hey Bouman, <br /> I'm using Kettle for sometime(not a java guy), i got a scenario where i get an excel consider i have 10 columns where first 4 columns are fixed and after 4th column i need to unpivot. Can your java class be altered in such a way that i could it could fit my scenario. BTW how do i read the excel data without defining the columns prior. Please help.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-89698547341042490892016-03-09T15:25:09.800+01:002016-03-09T15:25:09.800+01:00Anonymous, sounds like off-topic? Use the kettle A...Anonymous, sounds like off-topic? Use the kettle API if you don't have metadata injection.rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-21207439901510327742016-03-09T12:15:19.378+01:002016-03-09T12:15:19.378+01:00How can i use this mapping step with the ktr devel...How can i use this mapping step with the ktr developed by using metadata injection,as mapping doesn't support metadata injection<br />Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-3554630931494967182015-10-01T13:22:31.028+02:002015-10-01T13:22:31.028+02:00It looks like there is a small bug: the output dat...It looks like there is a small bug: the output data has a column called "fieldname" but actually it holds the "fieldtype" and vice versa...Koenhttps://www.blogger.com/profile/05915719511842472301noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-64507962481806383852015-05-04T16:09:54.668+02:002015-05-04T16:09:54.668+02:00Thank you very much!Thank you very much!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-26051637761239911612015-04-14T12:54:35.705+02:002015-04-14T12:54:35.705+02:00Normunds, I'm glad this was of some use to you...Normunds, I'm glad this was of some use to you.<br /><br />Regarding Excel, It could be argued either way: if the format changes, many people will want to know and not accidentally and silently import or export data they don't know about. But I can feel your pain when you really need it to work dynamicallly.<br /><br />Best regards<br /><br />Rolandrpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-86883608745836577812015-04-14T09:54:26.745+02:002015-04-14T09:54:26.745+02:00Thanks for excelent job.
Finally made my dynamic...Thanks for excelent job. <br /><br />Finally made my dynamic excel import with unknown colum count, sequence and name, by combining your normalizer and Metadata Injection step. <br />It was a real pain before, when customers changed order or added new columns etc in their import spreadsheets. I wonder why generic Microsoft Excel input step doesn't handle it automatically out of the box.<br /><br /><br />NormundsAnonymoushttps://www.blogger.com/profile/14406733549978719303noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-84984117942336638912015-03-26T14:40:42.852+01:002015-03-26T14:40:42.852+01:00Anonymous, no problem. I was confused to and I had...Anonymous, no problem. I was confused to and I had to check it first before deciding to set it up like this. <br /><br />Of course, it should not be a problem if you do check that box but the fields will then presumably be re-ordered.rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-35700324512327674072015-03-26T13:29:14.938+01:002015-03-26T13:29:14.938+01:00You're absolutely correct Sir. I receive all t...You're absolutely correct Sir. I receive all the fields either way. Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-59062904969800868272015-03-26T03:35:33.553+01:002015-03-26T03:35:33.553+01:00I mean, even if I don't check that box, I stil...I mean, even if I don't check that box, I still receive all fields form the incoming stream.rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-54266768969196353502015-03-26T03:34:57.424+01:002015-03-26T03:34:57.424+01:00"Also, in order to make it truly generic, che..."Also, in order to make it truly generic, check the "Include unspecified fields, ordered by name" check box." <br /><br />Yes, you'd think that. <br /><br />But for me, it works without checking that. (checked on kettle 5.3) Does it not work for you that way?<br /><br />Checking the checkbox implies order of the fields will be changed, which I would rather avoid if possible.rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-45575699712283375372015-03-26T02:02:27.395+01:002015-03-26T02:02:27.395+01:00Also, in order to make it truly generic, check the...Also, in order to make it truly generic, check the "Include unspecified fields, ordered by name" check box. That way you don't have to specify any fields in the Mapping Input Specification. <br />;-)<br />Thanks Roland!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-15319370.post-71934327334569974172015-03-26T00:13:02.177+01:002015-03-26T00:13:02.177+01:00Thanks for the kind words, and thanks for the head...Thanks for the kind words, and thanks for the heads-up re the images. I used to use Flickr for those and apparently they stopped supporting direct linking. So now I'm using my google drive for it, but I had to struggle a bit before I could find out to do direct linking from there. Images should be showing now. rpboumanhttps://www.blogger.com/profile/13365137747952711328noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-74235061970493819942015-03-26T00:06:20.025+01:002015-03-26T00:06:20.025+01:001st: Thank you so much for this awesome article. ...1st: Thank you so much for this awesome article. I'm going to implement this right away. <br />2nd: FYI the images in this article are giving 403 errors and don't display currently.<br />Thanks and I'll be checking this blog frequently! Anonymousnoreply@blogger.com