After updating Pentaho PDI 4.3 to 5.0.1, I noticed that my ETL process took 45 minutes longer to execute. So I ask myself if the new version is really slower than the old one ..
I compared the two kettle versions with the same transformation (a single Table Input to Ouput a Table). Same database, same table, same driver, same everything except PDI release (4.3 and 5.0.1).
Here is the result:
5.0.1 | 5.0.1 | 4.3 | 4.3 | |
Rows/Sec | Total Sec | Rows/Sec | Total Sec | |
Run #1 | 33712 | 50 | 35864 | 47 |
Run #2 | 31804 | 53 | 36643 | 46 |
Run #3 | 33051 | 51 | 37458 | 45 |
Run #4 | 33712 | 50 | 37458 | 45 |
Run #5 | 33712 | 50 | 36643 | 46 |
Run #6 | 31804 | 53 | 38309 | 44 |
Run #7 | 33712 | 50 | 36643 | 46 |
Run #8 | 32415 | 52 | 36643 | 46 |
Run #9 | 31804 | 53 | 37458 | 45 |
Run #10 | 31215 | 54 | 36643 | 46 |
Yes, Pentaho Kettle 5.0.1 is slower than 4.3. Sad but true, but this is not a deal breaker considering the new features that come with it.
[…] last things I noticed is a bit disappointing. I explained it in a previous post. PDI 5.0.1 is a little bit slower than […]