tag:blogger.com,1999:blog-15319370.post3110806468379653967..comments2024-03-05T11:16:00.846+01:00Comments on Roland Bouman's blog: Calpont opens up: InfiniDB Open Source Analytical Database (based on MySQL)rpboumanhttp://www.blogger.com/profile/13365137747952711328noreply@blogger.comBlogger2125tag:blogger.com,1999:blog-15319370.post-21077197847450512662009-10-29T16:14:12.680+01:002009-10-29T16:14:12.680+01:00Justin - thanks for the comments; good observation...Justin - thanks for the comments; good observations. We don't formally support replication yet, but it's not going to be difficult for us to do so. And you're correct, our bulk loader doesn't write to the txn log, but standard DML statements are written. <br /><br />When it comes to loading data, the fastest method is our cpimport utility (see FAQ on using it), but we also do LOAD DATA INFILE just fine.<br /><br />Hope you guys at KF are doing well...<br /><br />--RobinRobin Schumacherhttps://www.blogger.com/profile/11562847430249266928noreply@blogger.comtag:blogger.com,1999:blog-15319370.post-60658322696447336262009-10-28T20:19:06.356+01:002009-10-28T20:19:06.356+01:00Infobright and InfiniDB may both be column stores ...Infobright and InfiniDB may both be column stores but they operate very differently. <br /><br />InfiniDB takes a very proven strategy of "divide and conquer" using partitioning and a distributed hash join to do the "heavy lifting". They also appear to actually use the MySQL storage engine interface for storing data instead of using a custom loader pretending to be LOAD DATA INFILE. <br /><br />Infobright packages data into packets and uses "rough set theory" to eliminate packets from inspection, and using preaggregated metadata from the "knowledge grid" to answer questions.<br /><br />It never ceases to amaze me that IB's LDI doesn't even support the basic MySQL syntax for mapping column input, skipping input lines, etc. <br /><br />I wonder if InfiniDB supports writing binary log files for DML? Given the FAQ on their website about Point-in-time recovery, it looks like they don't write transaction logs for bulk inserts so they probably don't write binlogs in that case either.<br /><br />AFAIK Infobright's LDI doesn't populate binary logs for any calls.Justin Swanharthttp://swanhart.livejournal.comnoreply@blogger.com