1 Reply Latest reply on Nov 18, 2015 2:48 PM by pjhavariotis

    ResourceException: IJ000461: Could not enlist in transaction on entering meta-aware object

    mirela-roksandic-b846361

      HI All,

       

      Im doing insert to Oracle database, two schemas and two tables, I have created two XA datasources in Jboss 6.3.2, with same URL but different users,

      For each call I create new transaction, and what happens is that sometimes (aproximatly half the time) i get this error.

      Tried all kinds of solution - setting Pad Xid to false, adding <no-tx-separate-pools/> tag inside <xa-pool>, increasing number of minimum connections etc.

      I tried also to work with only one datasource, and only one method, and this error happend no matter that.

      I don't know what else to do.

       

      Exception stack trace:

      [#|2015-11-18 10:32:59,810|WARN |[com.arjuna.ats.jta]|(ThreadId: sc-http-executor-threads - 89)|ARJUNA016061: TransactionImple.enlistResource - XAResource.start returned: XAException.XAER_RMFAIL for < formatId=131077, gtrid_length=29, bqual_length=36, tx_uid=0:ffffac1564ab:-422f4503:56435b24:16de29bc, node_name=1, branch_uid=0:ffffac1564ab:-422f4503:56435b24:16de2a59, subordinatenodename=null, eis_name=unknown eis name >: oracle.jdbc.xa.OracleXAException
        at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:1188)
        at oracle.jdbc.xa.client.OracleXAResource.start(OracleXAResource.java:253)
        at org.jboss.jca.adapters.jdbc.xa.XAManagedConnection.start(XAManagedConnection.java:259)
        at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:646)
        at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:407)
        at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.enlist(TxConnectionListener.java:704)
        at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:350)
        at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:483)
        at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:626)
        at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:494)
        at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:143)
        at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111)
        at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77)
        at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:575)
        at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:617)
        at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:890)
        at com.ericsson.iptv.portal.avalanche.tt.rr.iap.RegulatoryRatingBean.saveChannelRatingEvents(RegulatoryRatingBean.java:196)
        at com.ericsson.iptv.portal.avalanche.tt.rr.iap.RegulatoryRatingBean.sendChannelEvents(RegulatoryRatingBean.java:320)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_85]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_85]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_85]
        at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_85]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)
        at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)
        at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at com.sun.proxy.$Proxy2054.sendChannelEvents(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_85]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_85]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_85]
        at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_85]
        at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:215)
        at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132)
        at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
        at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743)
        at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672)
        at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82)
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:919)
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:851)
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:953)
        at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:855)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:754)
        at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:829)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)
        at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:78)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:68)
        at com.ericsson.iptv.portal.fw.cors.AbstractCorsRequestFilter.doFilter(AbstractCorsRequestFilter.java:130)
        at com.ericsson.iptv.portal.iap.cors.CorsRequestFilter.doFilter(CorsRequestFilter.java:55)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalFilter(ServletFilterManager.java:79)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalPerformAction(ServletFilterManager.java:89)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)
        at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:76)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:68)
        at com.ericsson.iptv.portal.fw.backend.gzip.GZIPServletFilter.doFilter(GZIPServletFilter.java:88)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)
        at com.ericsson.iptv.portal.fw.backend.startup.DisableDirectoryListings.doFilter(DisableDirectoryListings.java:114)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)
        at com.ericsson.iptv.portal.fw.backend.cache.StaticDataCacheControl.doFilter(StaticDataCacheControl.java:83)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalFilter(ServletFilterManager.java:79)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalPerformAction(ServletFilterManager.java:89)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)
        at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:76)
        at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter.doFilter(PortalServletFilter.java:93)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)
        at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:832)
        at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:620)
        at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:553)
        at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:482)
        at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.internalForwardRequest(ArtifactBase.java:325)
        at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.internalPerformAction(ArtifactBase.java:351)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$4.invokeOn(MBeanManagerBase.java:619)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.invokeOnSingleManager(MBeanManagerBase.java:514)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.broadcast(MBeanManagerBase.java:616)
        at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.forwardRequest(ArtifactBase.java:424)
        at com.ericsson.iptv.portal.proxy.ProxyServlet.service(ProxyServlet.java:130)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:231)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149)
        at org.jboss.modcluster.container.jbossweb.JBossWebContext$RequestListenerValve.event(JBossWebContext.java:91)
        at org.jboss.modcluster.container.jbossweb.JBossWebContext$RequestListenerValve.invoke(JBossWebContext.java:72)
        at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97)
        at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466)
        at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:559)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:344)
        at org.apache.coyote.http11.Http11AprProcessor.process(Http11AprProcessor.java:876)
        at org.apache.coyote.http11.Http11AprProtocol$Http11ConnectionHandler.process(Http11AprProtocol.java:607)
        at org.apache.tomcat.util.net.AprEndpoint$SocketWithOptionsProcessor.run(AprEndpoint.java:2505)
        at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
        at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:808) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
        at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
        at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:849) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_85]
        at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
      |#]
      [#|2015-11-18 10:32:59,812|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)|oracle.jdbc.xa.OracleXAException|#]
      [#|2015-11-18 10:32:59,812|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:1188)|#]
      [#|2015-11-18 10:32:59,813|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at oracle.jdbc.xa.client.OracleXAResource.start(OracleXAResource.java:253)|#]
      [#|2015-11-18 10:32:59,813|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.jca.adapters.jdbc.xa.XAManagedConnection.start(XAManagedConnection.java:259)|#]
      [#|2015-11-18 10:32:59,814|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:646)|#]
      [#|2015-11-18 10:32:59,814|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:407)|#]
      [#|2015-11-18 10:32:59,815|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.enlist(TxConnectionListener.java:704)|#]
      [#|2015-11-18 10:32:59,815|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:350)|#]
      [#|2015-11-18 10:32:59,816|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:483)|#]
      [#|2015-11-18 10:32:59,816|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:626)|#]
      [#|2015-11-18 10:32:59,816|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:494)|#]
      [#|2015-11-18 10:32:59,817|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:143)|#]
      [#|2015-11-18 10:32:59,817|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111)|#]
      [#|2015-11-18 10:32:59,818|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77)|#]
      [#|2015-11-18 10:32:59,818|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:575)|#]
      [#|2015-11-18 10:32:59,819|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:617)|#]
      [#|2015-11-18 10:32:59,819|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:890)|#]
      [#|2015-11-18 10:32:59,820|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.avalanche.tt.rr.iap.RegulatoryRatingBean.saveChannelRatingEvents(RegulatoryRatingBean.java:196)|#]
      [#|2015-11-18 10:32:59,820|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.avalanche.tt.rr.iap.RegulatoryRatingBean.sendChannelEvents(RegulatoryRatingBean.java:320)|#]
      [#|2015-11-18 10:32:59,820|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)|#]
      [#|2015-11-18 10:32:59,821|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)|#]
      [#|2015-11-18 10:32:59,821|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)|#]
      [#|2015-11-18 10:32:59,822|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at java.lang.reflect.Method.invoke(Method.java:606)|#]
      [#|2015-11-18 10:32:59,822|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)|#]
      [#|2015-11-18 10:32:59,823|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)|#]
      [#|2015-11-18 10:32:59,823|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)|#]
      [#|2015-11-18 10:32:59,824|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)|#]
      [#|2015-11-18 10:32:59,824|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)|#]
      [#|2015-11-18 10:32:59,825|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)|#]
      [#|2015-11-18 10:32:59,826|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)|#]
      [#|2015-11-18 10:32:59,826|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)|#]
      [#|2015-11-18 10:32:59,826|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.sun.proxy.$Proxy2054.sendChannelEvents(Unknown Source)|#]
      [#|2015-11-18 10:32:59,827|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)|#]
      [#|2015-11-18 10:32:59,827|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)|#]
      [#|2015-11-18 10:32:59,828|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)|#]
      [#|2015-11-18 10:32:59,828|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at java.lang.reflect.Method.invoke(Method.java:606)|#]
      [#|2015-11-18 10:32:59,829|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:215)|#]
      [#|2015-11-18 10:32:59,829|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132)|#]
      [#|2015-11-18 10:32:59,830|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)|#]
      [#|2015-11-18 10:32:59,830|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743)|#]
      [#|2015-11-18 10:32:59,830|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672)|#]
      [#|2015-11-18 10:32:59,831|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82)|#]
      [#|2015-11-18 10:32:59,831|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:919)|#]
      [#|2015-11-18 10:32:59,832|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:851)|#]
      [#|2015-11-18 10:32:59,832|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:953)|#]
      [#|2015-11-18 10:32:59,833|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:855)|#]
      [#|2015-11-18 10:32:59,833|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at javax.servlet.http.HttpServlet.service(HttpServlet.java:754)|#]
      [#|2015-11-18 10:32:59,834|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:829)|#]
      [#|2015-11-18 10:32:59,834|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)|#]
      [#|2015-11-18 10:32:59,835|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295)|#]
      [#|2015-11-18 10:32:59,835|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)|#]
      [#|2015-11-18 10:32:59,835|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:78)|#]
      [#|2015-11-18 10:32:59,836|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:68)|#]
      [#|2015-11-18 10:32:59,836|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.cors.AbstractCorsRequestFilter.doFilter(AbstractCorsRequestFilter.java:130)|#]
      [#|2015-11-18 10:32:59,837|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.iap.cors.CorsRequestFilter.doFilter(CorsRequestFilter.java:55)|#]
      [#|2015-11-18 10:32:59,837|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)|#]
      [#|2015-11-18 10:32:59,838|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalFilter(ServletFilterManager.java:79)|#]
      [#|2015-11-18 10:32:59,838|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalPerformAction(ServletFilterManager.java:89)|#]
      [#|2015-11-18 10:32:59,838|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)|#]
      [#|2015-11-18 10:32:59,839|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)|#]
      [#|2015-11-18 10:32:59,839|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)|#]
      [#|2015-11-18 10:32:59,840|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)|#]
      [#|2015-11-18 10:32:59,840|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:76)|#]
      [#|2015-11-18 10:32:59,841|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:68)|#]
      [#|2015-11-18 10:32:59,841|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.backend.gzip.GZIPServletFilter.doFilter(GZIPServletFilter.java:88)|#]
      [#|2015-11-18 10:32:59,842|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)|#]
      [#|2015-11-18 10:32:59,842|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.backend.startup.DisableDirectoryListings.doFilter(DisableDirectoryListings.java:114)|#]
      [#|2015-11-18 10:32:59,842|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)|#]
      [#|2015-11-18 10:32:59,843|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.backend.cache.StaticDataCacheControl.doFilter(StaticDataCacheControl.java:83)|#]
      [#|2015-11-18 10:32:59,843|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)|#]
      [#|2015-11-18 10:32:59,844|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalFilter(ServletFilterManager.java:79)|#]
      [#|2015-11-18 10:32:59,844|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalPerformAction(ServletFilterManager.java:89)|#]
      [#|2015-11-18 10:32:59,845|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)|#]
      [#|2015-11-18 10:32:59,845|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)|#]
      [#|2015-11-18 10:32:59,846|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)|#]
      [#|2015-11-18 10:32:59,846|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)|#]
      [#|2015-11-18 10:32:59,847|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:76)|#]
      [#|2015-11-18 10:32:59,847|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter.doFilter(PortalServletFilter.java:93)|#]
      [#|2015-11-18 10:32:59,847|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246)|#]
      [#|2015-11-18 10:32:59,848|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)|#]
      [#|2015-11-18 10:32:59,849|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:832)|#]
      [#|2015-11-18 10:32:59,849|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:620)|#]
      [#|2015-11-18 10:32:59,849|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:553)|#]
      [#|2015-11-18 10:32:59,850|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:482)|#]
      [#|2015-11-18 10:32:59,850|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.internalForwardRequest(ArtifactBase.java:325)|#]
      [#|2015-11-18 10:32:59,851|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.internalPerformAction(ArtifactBase.java:351)|#]
      [#|2015-11-18 10:32:59,851|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)|#]
      [#|2015-11-18 10:32:59,852|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)|#]
      [#|2015-11-18 10:32:59,852|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)|#]
      [#|2015-11-18 10:32:59,853|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)|#]
      [#|2015-11-18 10:32:59,853|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$4.invokeOn(MBeanManagerBase.java:619)|#]
      [#|2015-11-18 10:32:59,854|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.invokeOnSingleManager(MBeanManagerBase.java:514)|#]
      [#|2015-11-18 10:32:59,854|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.broadcast(MBeanManagerBase.java:616)|#]
      [#|2015-11-18 10:32:59,855|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.forwardRequest(ArtifactBase.java:424)|#]
      [#|2015-11-18 10:32:59,855|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at com.ericsson.iptv.portal.proxy.ProxyServlet.service(ProxyServlet.java:130)|#]
      [#|2015-11-18 10:32:59,856|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)|#]
      [#|2015-11-18 10:32:59,856|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295)|#]
      [#|2015-11-18 10:32:59,857|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)|#]
      [#|2015-11-18 10:32:59,857|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:231)|#]
      [#|2015-11-18 10:32:59,858|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149)|#]
      [#|2015-11-18 10:32:59,859|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.modcluster.container.jbossweb.JBossWebContext$RequestListenerValve.event(JBossWebContext.java:91)|#]
      [#|2015-11-18 10:32:59,859|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.modcluster.container.jbossweb.JBossWebContext$RequestListenerValve.invoke(JBossWebContext.java:72)|#]
      [#|2015-11-18 10:32:59,859|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169)|#]
      [#|2015-11-18 10:32:59,860|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145)|#]
      [#|2015-11-18 10:32:59,860|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97)|#]
      [#|2015-11-18 10:32:59,861|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466)|#]
      [#|2015-11-18 10:32:59,861|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:559)|#]
      [#|2015-11-18 10:32:59,862|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102)|#]
      [#|2015-11-18 10:32:59,862|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:344)|#]
      [#|2015-11-18 10:32:59,863|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.coyote.http11.Http11AprProcessor.process(Http11AprProcessor.java:876)|#]
      [#|2015-11-18 10:32:59,863|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.coyote.http11.Http11AprProtocol$Http11ConnectionHandler.process(Http11AprProtocol.java:607)|#]
      [#|2015-11-18 10:32:59,864|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.apache.tomcat.util.net.AprEndpoint$SocketWithOptionsProcessor.run(AprEndpoint.java:2505)|#]
      [#|2015-11-18 10:32:59,864|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33)|#]
      [#|2015-11-18 10:32:59,864|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:808)|#]
      [#|2015-11-18 10:32:59,865|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45)|#]
      [#|2015-11-18 10:32:59,865|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:849)|#]
      [#|2015-11-18 10:32:59,866|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at java.lang.Thread.run(Thread.java:745)|#]
      [#|2015-11-18 10:32:59,866|ERROR|[stderr]|(ThreadId: sc-http-executor-threads - 89)| at org.jboss.threads.JBossThread.run(JBossThread.java:122)|#]
      [#|2015-11-18 10:32:59,867|ERROR|[com.ericsson.iptv.portal.avalanche.tt.rr.iap.RegulatoryRatingBean]|(ThreadId: sc-http-executor-threads - 89)|Failed to insert channel regulatory rating events from petra.kirin: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3d6cb34e[state=DESTROYED managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@2b6fe563 connection handles=0 lastUse=1447779656009 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@2b9aa5f1 pool internal context=SemaphoreArrayListManagedConnectionPool@469fd40d[pool=jdbc_tivibu_ott] xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@2b6fe563 txSync=null]
        at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:80)
        at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:575)
        at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:617)
        at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:890)
        at com.ericsson.iptv.portal.avalanche.tt.rr.iap.RegulatoryRatingBean.saveChannelRatingEvents(RegulatoryRatingBean.java:196)
        at com.ericsson.iptv.portal.avalanche.tt.rr.iap.RegulatoryRatingBean.sendChannelEvents(RegulatoryRatingBean.java:320)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_85]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_85]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_85]
        at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_85]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)
        at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)
        at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at com.sun.proxy.$Proxy2054.sendChannelEvents(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_85]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_85]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_85]
        at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_85]
        at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:215)
        at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132)
        at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
        at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743)
        at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672)
        at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82)
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:919)
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:851)
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:953)
        at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:855)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:754)
        at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:829)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)
        at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:78)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:68)
        at com.ericsson.iptv.portal.fw.cors.AbstractCorsRequestFilter.doFilter(AbstractCorsRequestFilter.java:130)
        at com.ericsson.iptv.portal.iap.cors.CorsRequestFilter.doFilter(CorsRequestFilter.java:55)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalFilter(ServletFilterManager.java:79)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalPerformAction(ServletFilterManager.java:89)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)
        at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:76)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:68)
        at com.ericsson.iptv.portal.fw.backend.gzip.GZIPServletFilter.doFilter(GZIPServletFilter.java:88)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)
        at com.ericsson.iptv.portal.fw.backend.startup.DisableDirectoryListings.doFilter(DisableDirectoryListings.java:114)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)
        at com.ericsson.iptv.portal.fw.backend.cache.StaticDataCacheControl.doFilter(StaticDataCacheControl.java:83)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager$FilterChainImpl.doFilter(ServletFilterManager.java:66)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalFilter(ServletFilterManager.java:79)
        at com.ericsson.iptv.portal.fw.servlet.mbean.ServletFilterManager.internalPerformAction(ServletFilterManager.java:89)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)
        at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter$FilterChainImpl.doFilter(PortalServletFilter.java:76)
        at com.ericsson.iptv.portal.fw.servlet.PortalServletFilter.doFilter(PortalServletFilter.java:93)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)
        at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:832)
        at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:620)
        at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:553)
        at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:482)
        at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.internalForwardRequest(ArtifactBase.java:325)
        at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.internalPerformAction(ArtifactBase.java:351)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.performAction(MBeanManagerBase.java:534)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:547)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$1.compareTo(MBeanManagerBase.java:544)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$Manager.invoke(MBeanManagerBase.java:317)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase$4.invokeOn(MBeanManagerBase.java:619)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.invokeOnSingleManager(MBeanManagerBase.java:514)
        at com.ericsson.iptv.portal.fw.mbean.MBeanManagerBase.broadcast(MBeanManagerBase.java:616)
        at com.ericsson.iptv.portal.fw.artifact.ArtifactBase.forwardRequest(ArtifactBase.java:424)
        at com.ericsson.iptv.portal.proxy.ProxyServlet.service(ProxyServlet.java:130)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:231)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149)
        at org.jboss.modcluster.container.jbossweb.JBossWebContext$RequestListenerValve.event(JBossWebContext.java:91)
        at org.jboss.modcluster.container.jbossweb.JBossWebContext$RequestListenerValve.invoke(JBossWebContext.java:72)
        at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97)
        at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466)
        at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:559)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:344)
        at org.apache.coyote.http11.Http11AprProcessor.process(Http11AprProcessor.java:876)
        at org.apache.coyote.http11.Http11AprProtocol$Http11ConnectionHandler.process(Http11AprProtocol.java:607)
        at org.apache.tomcat.util.net.AprEndpoint$SocketWithOptionsProcessor.run(AprEndpoint.java:2505)
        at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
        at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:808) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
        at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
        at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:849) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_85]
        at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.1.Final-redhat-1.jar:2.1.1.Final-redhat-1]
      Caused by: java.sql.SQLException: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3d6cb34e[state=DESTROYED managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@2b6fe563 connection handles=0 lastUse=1447779656009 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@2b9aa5f1 pool internal context=SemaphoreArrayListManagedConnectionPool@469fd40d[pool=jdbc_tivibu_ott] xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@2b6fe563 txSync=null]
        at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:151)
        at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111)
        at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77)
        ... 104 more
      Caused by: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3d6cb34e[state=DESTROYED managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@2b6fe563 connection handles=0 lastUse=1447779656009 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@2b9aa5f1 pool internal context=SemaphoreArrayListManagedConnectionPool@469fd40d[pool=jdbc_tivibu_ott] xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@2b6fe563 txSync=null]
        at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:631)
        at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:494)
        at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:143)
        ... 106 more
      Caused by: javax.resource.ResourceException: IJ000461: Could not enlist in transaction on entering meta-aware object
        at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:490)
        at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:626)
        ... 108 more
      Caused by: javax.transaction.SystemException: IJ000356: Failed to enlist: java.lang.Throwable: Unabled to enlist resource, see the previous warnings. tx=TransactionImple < ac, BasicAction: 0:ffffac1564ab:-422f4503:56435b24:16de29bc status: ActionStatus.ABORT_ONLY >
        at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.checkEnlisted(TxConnectionListener.java:669)
        at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:368)
        at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:483)
        ... 109 more
      |#]
      

       

       

      Interface:

      @RequestMapping
      @Transactional
      public interface RRStatisticsService {
      
          @Cache(CacheType.NO_CACHE)
          @AuthRequired(AuthType.USER)
          @Transactional(propagation = Propagation.REQUIRES_NEW)
          @RequestMapping(value = "/private/rr/sendChannelEvents.ajax", method = RequestMethod.POST)
          public @ResponseBody void sendChannelEvents(@Valid @RequestBody ChannelRatingEvents events,
                  @SubscriberId String subscriberId, @UserId String userId, @DeviceId String deviceId) throws PortalException;
      
          @Cache(CacheType.NO_CACHE)
          @AuthRequired(AuthType.USER)
          @Transactional(propagation = Propagation.REQUIRES_NEW)
          @RequestMapping(value = "/private/rr/sendVodEvents.ajax", method = RequestMethod.POST)
          public @ResponseBody void sendVodEvents(@Valid @RequestBody VodRatingEvents events,
                  @SubscriberId String subscriberId, @UserId String userId, @DeviceId String deviceId) throws PortalException;
      }
      

       

      Bean:

       

      
      
      
      @Controller
      public class RRBean implements RRStatisticsService {
      
      
       @Override
          public void sendChannelEvents(ChannelRatingEvents events, String subscriberId, String userId, String deviceId)
                  throws PortalException {
              saveChannelRatingEvents(events, subscriberId, userId, deviceId);
          }
      
      
      
       @Override
          public void sendVodEvents(VodRatingEvents events, String subscriberId, String userId, String deviceId)
                  throws PortalException {
              saveVodRatingEvents(events, subscriberId, userId, deviceId);
          }
          
      
      v
      private void saveChannelRatingEvents(ChannelRatingEvents events, String subscriberId, String userId,
              String deviceId) throws SomeException {  
              try {    
                  JdbcTemplate template = getJdbcTemplate(userId, deviceId, events.getClientType());         
                  insertChannelRating(events, subscriberId, userId, template);
              } catch (Exception e) {
                 //Handle exception
              }
          }
      
      
      
      private void insertChannelRating(ChannelRatingEvents events, String subscriberId, String userId, JdbcTemplate template){    
                template.batchUpdate(SQL_CHANNEL_RATING, new BatchPreparedStatementSetter() {
                    @Override
                    public void setValues(PreparedStatement ps, int i) throws SQLException {
                        ChannelRatingEvent event = rrevents.get(i);
                        ps.setString(1, event.getChannelViewID());
                        ps.setString(2, event.getChannelName());
                        ps.setInt(3, event.getChannelID());
                        ps.setInt(4, event.getStreamFlag());
                        ps.setInt(5, events.getClientType());
                        ps.setDate(6, event.Date());
                        ps.setString(7, userId);
                        ps.setString(8, subscriberId);
                        ps.setString(9, "0");
                        ps.setDate(10, event.Date());
                    }
                    @Override
                    public int getBatchSize() {
                        return rrevents.size();
                    }
                });
          }
      
      
      
      private void saveVodRatingEvents(VodRatingEvents events, String subscriberId, String userId, String deviceId)
                  throws SomeException {
              try {
                  JdbcTemplate template = getJdbcTemplate(userId, deviceId, events.getClientType());
                  insertVodRating(events, subscriberId, userId, template);
              } catch (Exception e) {
        //HANDLE EXCEPTION
              }
          }
      
      
      
      private void insertVodRating(VodRatingEvents events, String subscriberId, String userId, JdbcTemplate template){
         
              template.batchUpdate(SQL_VOD_RATING, new BatchPreparedStatementSetter() {
                  @Override
                  public void setValues(PreparedStatement ps, int i) throws SQLException {
                      VodRatingEvent event = rrevents.get(i);
                      ps.setString(1, event.getVodViewID());
                      ps.setString(2, event.getVodName());
                      ps.setString(3, event.getAssetID());
                      ps.setInt(4, event.getVodType());
                      ps.setInt(5, event.getVodSegment());
                      ps.setInt(6, clientType);
                      ps.setDate(7, event.getDate());
                      ps.setString(8, userId);
                      ps.setString(9, subscriberId);
                      ps.setString(10, "0");
                      ps.setDate(11, event.getDate());
                  }
                  @Override
                  public int getBatchSize() {
                      return rrevents.size();
                  }     
              });
          }
      
      
      
       private JdbcTemplate getJdbcTemplate(String userId, String deviceId, Integer clientType) {       
          DataSource dataSource = null;
              JndiTemplate jndi = new JndiTemplate();      
              String dataSourceJndi;
              if (clientType.intValue() == 0) {
              dataSourceJndi = getUserPreferences(userId, deviceId).get(STB_DS_PREF_KEY); 
                  }
              } else {
              dataSourceJndi = getUserPreferences(userId, deviceId).get(OTT_DS_PREF_KEY); 
                  }
              }
             
              try {
                  dataSource = (DataSource) jndi.lookup(dataSourceJndi);
              } catch (NamingException e) {
                  logger.error("NamingException for " + dataSourceJndi, e);
                  return null;
              }
              
              return new JdbcTemplate(dataSource);
          }
      }
      
      
      
      
      
      
      

       

      Datasource definition:

      <xa-datasource jndi-name="java:/jdbc/tivibu_stb" pool-name="jdbc_tivibu_stb" enabled="true" use-ccm="false">
                              <xa-datasource-property name="User">
                                  USER2
                              </xa-datasource-property>
                              <xa-datasource-property name="Password">
                                  PWD2
                              </xa-datasource-property>
                              <xa-datasource-property name="URL">
                                  jdbc:oracle:thin:@hostip2:1521:TTEST2
                              </xa-datasource-property>
                              <xa-datasource-class>oracle.jdbc.xa.client.OracleXADataSource</xa-datasource-class>
                              <driver>ojdbc</driver>
                              <transaction-isolation>TRANSACTION_READ_COMMITTED</transaction-isolation>
                              <xa-pool>
                                  <min-pool-size>30</min-pool-size>
                                  <max-pool-size>80</max-pool-size>
                                  <use-strict-min>true</use-strict-min>
                                  <is-same-rm-override>false</is-same-rm-override>
                                  <interleaving>false</interleaving>
                                  <no-tx-separate-pools>true</no-tx-separate-pools>
                                  <pad-xid>false</pad-xid>
                                  <wrap-xa-resource>false</wrap-xa-resource>
                              </xa-pool>
                              <validation>
                                  <validate-on-match>false</validate-on-match>
                                  <background-validation>false</background-validation>
                              </validation>
                              <timeout>
                                  <set-tx-query-timeout>false</set-tx-query-timeout>
                                  <blocking-timeout-millis>0</blocking-timeout-millis>
                                  <idle-timeout-minutes>1</idle-timeout-minutes>
                                  <query-timeout>0</query-timeout>
                                  <use-try-lock>0</use-try-lock>
                                  <allocation-retry>0</allocation-retry>
                                  <allocation-retry-wait-millis>0</allocation-retry-wait-millis>
                                  <xa-resource-timeout>0</xa-resource-timeout>
                              </timeout>
                              <statement>
                                  <share-prepared-statements>false</share-prepared-statements>
                              </statement>
                          </xa-datasource>
                          <xa-datasource jndi-name="java:/jdbc/tivibu_ott" pool-name="jdbc_tivibu_ott" enabled="true" use-ccm="false">
                              <xa-datasource-property name="User">
                                  USER1
                              </xa-datasource-property>
                              <xa-datasource-property name="Password">
                                  PWD1
                              </xa-datasource-property>
                              <xa-datasource-property name="URL">
                                  jdbc:oracle:thin:@hostip1:1521:TTEST1
                              </xa-datasource-property>
                              <xa-datasource-class>oracle.jdbc.xa.client.OracleXADataSource</xa-datasource-class>
                              <driver>ojdbc</driver>
                              <transaction-isolation>TRANSACTION_READ_COMMITTED</transaction-isolation>
                              <xa-pool>
                                  <min-pool-size>30</min-pool-size>
                                  <max-pool-size>80</max-pool-size>
                                  <prefill>false</prefill>
                                  <use-strict-min>true</use-strict-min>
                                  <flush-strategy>FailingConnectionOnly</flush-strategy>
                                  <is-same-rm-override>false</is-same-rm-override>
                                  <interleaving>false</interleaving>
                                  <no-tx-separate-pools>true</no-tx-separate-pools>
                                  <pad-xid>false</pad-xid>
                                  <wrap-xa-resource>false</wrap-xa-resource>
                              </xa-pool>
                              <validation>
                                  <validate-on-match>false</validate-on-match>
                                  <background-validation>false</background-validation>
                              </validation>
                              <timeout>
                                  <set-tx-query-timeout>false</set-tx-query-timeout>
                                  <blocking-timeout-millis>0</blocking-timeout-millis>
                                  <idle-timeout-minutes>1</idle-timeout-minutes>
                                  <query-timeout>0</query-timeout>
                                  <use-try-lock>0</use-try-lock>
                                  <allocation-retry>0</allocation-retry>
                                  <allocation-retry-wait-millis>0</allocation-retry-wait-millis>
                                  <xa-resource-timeout>0</xa-resource-timeout>
                              </timeout>
                              <statement>
                                  <share-prepared-statements>false</share-prepared-statements>
                              </statement>
                          </xa-datasource>
      
        • 1. Re: ResourceException: IJ000461: Could not enlist in transaction on entering meta-aware object
          pjhavariotis

          First of all you have to understand the error.

          This error means that the transaction in which the connection request is issued, has already aborted (the transaction status is ABORT_ONLY).

          Have you tried to enable transaction logging? I would recommend to do so in order to identify the transaction start time and check whether it has been reaped.

          After enabling the transaction logging, you can search the server.log for the transaction ID which can be found in the "Unable to enlist" message.

          From your log, the transaction ID is 0:ffffac1564ab:-422f4503:56435b24:16de29bc