1 Reply Latest reply on May 17, 2012 7:56 AM by yohanliyanage

    JBoss 4.2.3 GA - Old Gen getting full

    yohanliyanage
    yohanliyanage May 17, 2012 4:49 AM

      Hi,

       

      Recently I have noticed that one of my JBoss AS 4.2.3.GA instances are getting slow and sometimes hang. When I checked the heap, the Old Gen (Tenured) was almost full, and so was the Perm Gen. When I analyzed the heap dump using Eclipse MAT, the Leak Suspects report pointed the following (note. Heap Size is ~ 4GB).

       

      According to the below report, over 3 GB of the Heap is allocated for UnifiedClassLoader3.

       

      Problem Suspect 1

      44 instances of "org.jboss.mx.loading.UnifiedClassLoader3", loaded by "org.jboss.system.server.NoAnnotationURLClassLoader @ 0x2aaaee22eff8" occupy 3,381,949,216 (73.91%) bytes.

       

      Biggest instances:

       

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaf09765e0 - 144,395,336 (3.16%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee25ddc8 - 143,835,968 (3.14%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee69c248 - 141,180,456 (3.09%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee701540 - 140,538,048 (3.07%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee74af40 - 140,534,488 (3.07%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6af868 - 71,081,728 (1.55%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee72d430 - 70,505,240 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6857e8 - 70,375,704 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee28be30 - 70,285,376 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6731a8 - 70,284,352 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee66f1d8 - 70,281,136 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee66cac8 - 70,280,248 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6aa298 - 70,278,928 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee675f60 - 70,278,864 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee674888 - 70,278,344 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee671b00 - 70,278,328 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee683380 - 70,274,872 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaf7365818 - 70,270,960 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6abb38 - 70,267,664 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee67e9e8 - 70,267,104 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee67bb50 - 70,267,016 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6ad3d8 - 70,266,808 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6aedc8 - 70,266,760 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee67dea0 - 70,266,616 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6810e8 - 70,266,616 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6ae0d8 - 70,266,608 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee67b0d8 - 70,266,568 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6805c0 - 70,266,472 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee6828e8 - 70,266,424 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee67cab0 - 70,266,416 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee677680 - 70,266,376 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee678010 - 70,266,376 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee678998 - 70,266,376 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee679330 - 70,266,376 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee679cb8 - 70,266,376 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee67a640 - 70,266,376 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaf09adf88 - 70,266,288 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee66c1b0 - 70,266,280 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaf09a3a40 - 70,266,280 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaf09ab780 - 70,266,280 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaee681c08 - 70,266,272 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaf0e81268 - 70,266,232 (1.54%) bytes.

      org.jboss.mx.loading.UnifiedClassLoader3 @ 0x2aaaf73b57b8 - 70,263,264 (1.54%) bytes.

       

       

      Keywords

      org.jboss.system.server.NoAnnotationURLClassLoader @ 0x2aaaee22eff8

      org.jboss.mx.loading.UnifiedClassLoader3

       

      Dominator Tree :

      DominatorTree.png

       

      HashMap.png

      Any pointers towards identifying the root cause is appreciated.

       

      Thanks in advance.