Hi,
i doing some etl transformation on postgres db (i'm writing to this db) - i use pentaho tool (kettle) to do this.
Sometimes, randomly process is interrupted.
Full stack trace from kettle:
Code:
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Unexpected error
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException:
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Couldn't get field info from [SELECT * FROM xxx limit 1]
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : An I/O error occured while sending to the backend.
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.pentaho.di.core.database.Database.getQueryFieldsFallback(Database.java:2378)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.pentaho.di.core.database.Database.getQueryFields(Database.java:2292)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.pentaho.di.core.database.Database.getQueryFields(Database.java:1994)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.pentaho.di.core.database.Database.getTableFields(Database.java:1989)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.pentaho.di.trans.steps.databaselookup.DatabaseLookup.processRow(DatabaseLookup.java:421)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.pentaho.di.trans.step****nThread****n(RunThread.java:40)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at java.lang.Thread****n(Thread.java:662)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Caused by: org.postgresql.util.PSQLException: An I/O error occured while sending to the backend.
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:283)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:498)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:386)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:271)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.pentaho.di.core.database.Database.getQueryFieldsFallback(Database.java:2370)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      ... 6 more
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Caused by: java.io.IOException: Stream closed
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at sun.nio.cs.StreamEncoder.ensureOpen(StreamEncoder.java:26)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:121)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:212)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.postgresql.core.PGStream.flush(PGStream.java:507)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.postgresql.core.v3.QueryExecutorImpl.sendSync(QueryExecutorImpl.java:1117)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:256)
2012/01/05 12:00:41 - Database lookup.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :      ... 10 more
If I i have info postgres level of logging i didn't see nothing important. I change level to debug5. I retrieve (maybe important this linea):
Code:
2012-01-09 15:30:48 CET DEBUG:  shmem_exit(0): 7 callbacks to make
2012-01-09 15:30:48 CET DEBUG:  proc_exit(0): 2 callbacks to make
2012-01-09 15:30:48 CET DEBUG:  exit(0)
2012-01-09 15:30:48 CET DEBUG:  shmem_exit(-1): 0 callbacks to make
2012-01-09 15:30:48 CET DEBUG:  proc_exit(-1): 0 callbacks to make
2012-01-09 15:30:48 CET DEBUG:  reaping dead processes
2012-01-09 15:30:48 CET DEBUG:  server process (PID 11616) exited with exit code 0