BREKEKE PBX Failing to startup, causing total failure.

nico-adenc 2017-09-28 00:30 UTC Original post

1. Brekeke Product Name and Version:
3....
2. Java version:
sun-8, tomcat 8.0.46
3. OS type and the version:
Linux Debian
4. UA (phone), gateway or other hardware/software involved:

5. Your problem:

PBX fails to start with:
17/09/28 00:04:39 PBXADMIN INFO Web Server initializing.
17/09/28 00:04:39 PBXADMIN FATAL Unknown Error. - java.lang.NumberFormatException: For input string: "
17/09/28 00:33:30 PBXADMIN INFO Web Server initializing.
17/09/28 00:33:30 PBXADMIN FATAL Unknown Error. - java.lang.NumberFormatException: For input string: "
17/09/28 00:34:50 PBXADMIN INFO Web Server initializing.
17/09/28 00:34:50 PBXADMIN FATAL Unknown Error. - java.lang.NumberFormatException: For input string: "
17/09/28 00:35:29 PBXADMIN INFO Web Server initializing.
17/09/28 00:35:29 PBXADMIN FATAL Unknown Error. - java.lang.NumberFormatException: For input string: "

Where on the /pbx/gate login page stays blank with java error stack instersperced in the js. code like:

function lic( wsname ){
Brekeke.License.start( "pbx" , licdone, "Error \r\njava.lang.NumberFormatException: For input string: \"\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\",0\n\tat com.brekeke.util.StringUtil.parseLongAsLongAsDigit(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.initLineCountAndId(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.init(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.<init>(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.<init>(Unknown Source)\n\tat com.brekeke.sipadmin.SipAdminBase.initEmailQueue(Unknown Source)\n\tat com.brekeke.sipadmin.SipAdminBase.initializeAdmins(Unknown Source)\n\tat com.brekeke.pbxadmin.PbxAdminBase.initApp(Unknown Source)\n\tat com.brekeke.pbxadmin.web.PbxInitializer.initialize(Unknown Source)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat

So how to proceed.....
System was able to restart regularly, just fails to do so since today.

I did find an entry on the wiki telling to install a recent tomcat..., that has been done. still no cigar.

nico-adenc 2017-09-28 01:41 UTC

Version is 3.6.3.0.

llucy 2017-09-28 17:02 UTC

Hi nico-adenc,

One of the email log file might be broken.

Could you try removing all the files under the WEB-INF/work/sv/etc/email folder and restart it?

Lucy

nico-adenc 2017-09-28 17:23 UTC

Hi the emaildirectory was non existant.
So no log files at all, definitely no bad ones.

I created the directory.

nico-adenc 2017-09-28 20:25 UTC

Still no starting service

nico-adenc 2017-09-28 22:08 UTC

After clean some logfiles out:

2017-09-28 23:48:42,036 [localhost-startStop-1] DEBUG (?:?) - 2 ptnRemoteIP=null
2017-09-28 23:48:42,037 [localhost-startStop-1] DEBUG (?:?) - 2 ptnRemoteIP3PCC=null
2017-09-28 23:48:42,101 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/en/message_en.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:42,102 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/en/message_en.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:42,108 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/ja/message_ja.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:42,108 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/ja/message_ja.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:42,116 [localhost-startStop-1] DEBUG (?:?) - java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2017-09-28 23:48:42,116 [localhost-startStop-1] DEBUG (?:?) - libjsig=null
2017-09-28 23:48:42,124 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/null/message_null.properties!!!!!!!!!!!!!!false
2017-09-28 23:48:42,125 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/en/message_en.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:50,572 [http-nio-8080-exec-1] DEBUG (?:?) - !!! scope size is 0.
2017-09-28 23:48:50,573 [http-nio-8080-exec-1] DEBUG (?:?) - ******** execBean Bean Created. beanname=pbxadmin.web.PbxLogin
2017-09-28 23:48:57,758 [http-nio-8080-exec-5] DEBUG (?:?) - !!! scope size is 0.
2017-09-28 23:48:57,759 [http-nio-8080-exec-5] DEBUG (?:?) - ******** execBean Bean Created. beanname=pbxadmin.web.PbxLogin

and on the /pbx/gate page:

function licdone(){
_LOGIN_PAGE.submitForm( document.flicdone );
}

function lic( wsname ){
Brekeke.License.start( "pbx" , licdone, "Error \r\njava.lang.NumberFormatException: For input string: \"\",0\n\tat com.brekeke.util.StringUtil.parseLongAsLongAsDigit(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.initLineCountAndId(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.init(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.<init>(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.<init>(Unknown Source)\n\tat com.brekeke.sipadmin.SipAdminBase.initEmailQueue(Unknown Source)\n\tat com.brekeke.sipadmin.SipAdminBase.initializeAdmins(Unknown Source)\n\tat com.brekeke.pbxadmin.PbxAdminBase.initApp(Unknown Source)\n\tat com.brekeke.pbxadmin.web.PbxInitializer.initialize(Unknown Source)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:606)\n\tat com.brekeke.web.GateServlet.init(Unknown Source)\n\tat javax.servlet.GenericServlet.init(GenericServlet.java:158)\n\tat org.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1227)\n\tat org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1140)\n\tat org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:1027)\n\tat org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:5038)\n\tat org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5348)\n\tat org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:145)\n\tat org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:753)\n\tat org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:729)\n\tat org.apache.catalina.core.StandardHost.addChild(StandardHost.java:717)\n\tat org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:976)\n\tat org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1853)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:473)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:262)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)\n\tat java.lang.Thread.run(Thread.java:748)\n", wsname );
}

_LOGIN_PAGE = null;

nico-adenc 2017-09-28 22:09 UTC

After clean some logfiles out:

2017-09-28 23:48:42,036 [localhost-startStop-1] DEBUG (?:?) - 2 ptnRemoteIP=null
2017-09-28 23:48:42,037 [localhost-startStop-1] DEBUG (?:?) - 2 ptnRemoteIP3PCC=null
2017-09-28 23:48:42,101 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/en/message_en.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:42,102 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/en/message_en.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:42,108 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/ja/message_ja.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:42,108 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/ja/message_ja.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:42,116 [localhost-startStop-1] DEBUG (?:?) - java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2017-09-28 23:48:42,116 [localhost-startStop-1] DEBUG (?:?) - libjsig=null
2017-09-28 23:48:42,124 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/null/message_null.properties!!!!!!!!!!!!!!false
2017-09-28 23:48:42,125 [localhost-startStop-1] DEBUG (?:?) - /var/lib/tomcat8/webapps/pbx//WEB-INF/work/pbx/en/message_en.properties!!!!!!!!!!!!!!true
2017-09-28 23:48:50,572 [http-nio-8080-exec-1] DEBUG (?:?) - !!! scope size is 0.
2017-09-28 23:48:50,573 [http-nio-8080-exec-1] DEBUG (?:?) - ******** execBean Bean Created. beanname=pbxadmin.web.PbxLogin
2017-09-28 23:48:57,758 [http-nio-8080-exec-5] DEBUG (?:?) - !!! scope size is 0.
2017-09-28 23:48:57,759 [http-nio-8080-exec-5] DEBUG (?:?) - ******** execBean Bean Created. beanname=pbxadmin.web.PbxLogin

and on the /pbx/gate page:

function licdone(){
_LOGIN_PAGE.submitForm( document.flicdone );
}

function lic( wsname ){
Brekeke.License.start( "pbx" , licdone, "Error \r\njava.lang.NumberFormatException: For input string: \"\",0\n\tat com.brekeke.util.StringUtil.parseLongAsLongAsDigit(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.initLineCountAndId(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.init(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.<init>(Unknown Source)\n\tat com.brekeke.admintool.email.EmailQueue.<init>(Unknown Source)\n\tat com.brekeke.sipadmin.SipAdminBase.initEmailQueue(Unknown Source)\n\tat com.brekeke.sipadmin.SipAdminBase.initializeAdmins(Unknown Source)\n\tat com.brekeke.pbxadmin.PbxAdminBase.initApp(Unknown Source)\n\tat com.brekeke.pbxadmin.web.PbxInitializer.initialize(Unknown Source)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:606)\n\tat com.brekeke.web.GateServlet.init(Unknown Source)\n\tat javax.servlet.GenericServlet.init(GenericServlet.java:158)\n\tat org.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1227)\n\tat org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1140)\n\tat org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:1027)\n\tat org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:5038)\n\tat org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5348)\n\tat org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:145)\n\tat org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:753)\n\tat org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:729)\n\tat org.apache.catalina.core.StandardHost.addChild(StandardHost.java:717)\n\tat org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:976)\n\tat org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1853)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:473)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:262)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)\n\tat java.lang.Thread.run(Thread.java:748)\n", wsname );
}

_LOGIN_PAGE = null;

and in the systemlog:

17/09/28 23:48:42 PBXADMIN INFO Web Server initializing.
17/09/28 23:48:42 PBXADMIN FATAL Unknown Error. - java.lang.NumberFormatException: For input string: "",0 at com.brekeke.u
17/09/28 23:58:16 PBXADMIN INFO Web Server initializing.
17/09/28 23:58:16 PBXADMIN FATAL Unknown Error. - java.lang.NumberFormatException: For input string: "",0 at com.brekeke.u

nico-adenc 2017-09-28 23:34 UTC

Removing ALL logfiles did allow a logon.
After that service restarted, although some configs were broken.

nico-adenc 2017-09-29 08:05 UTC

It obviously is a bug that a java exception would expose itself in the java script generated.

A failing translation probably should leave the keyword untranslated in the text.
Even more so if mere log files (what needs a translation there) can break the system to completely non-functional.

I can't find a an address in the brekeke website where a bug report sould be sent to.
So consider this to be my bug report.

llucy 2017-09-29 21:38 UTC

nico-adenc,

Can you make a zip file of the entire folder of WEB-INF/work folder and send to support@brekeke.com?

Lucy

nico-adenc 2017-09-29 22:54 UTC

mail is underway

nico-adenc 2017-10-12 22:30 UTC

Any news ?

llucy 2017-10-17 19:30 UTC

nico-adenc,

Have you got an answer from the support team?

Lucy

nico-adenc 2017-10-17 19:40 UTC

Yes & No...
Yes i got a mail telling to look into a different file, but that was cleaned by me as a test also, no cigar.

The real problem is the presence of a java stackdump in the HTML code produced... Which stops brekeke being managable. (or producing any thing in the browsers window).

And to be honest, a program should not break on invalid input.
A program should always marshal its input. And optionaly discard it if it doesn't meet the standards.

llucy 2017-10-17 23:42 UTC

nico-adenc

As you say, it is not good to block the operation and it should be improved.

Anyway, the problem should be fixed with later versions.
If possible, please install the latest version.

Lucy