Skip to content
This repository has been archived by the owner on Apr 27, 2022. It is now read-only.

application crashing at run time #3

Open
elmiko opened this issue Oct 16, 2018 · 0 comments
Open

application crashing at run time #3

elmiko opened this issue Oct 16, 2018 · 0 comments
Labels
bug Something isn't working

Comments

@elmiko
Copy link

elmiko commented Oct 16, 2018

when running this application to test other changes, i am getting a nasty looking exception trace.

steps to reproduce

  1. follow instructions in readme to build and deploy
  2. wait for deployment and spark cluster to deploy
  3. oc logs -f dc/wfswarm-sparkpi

expected results

normal operation

observed results

application continually crashes after spark cluster deployment and connection with this output

+ [[ /usr/local/s2i/run == *\/\u\s\r\/\l\o\c\a\l\/\s\2\i* ]]
+ exec /usr/local/s2i/run
oshinko v0.5.6
Default spark image: radanalyticsio/openshift-spark:2.3-latest
Didn't find cluster cluster-18dc6d, creating ephemeral cluster
Using ephemeral cluster cluster-18dc6d
Waiting for spark master http://cluster-18dc6d-ui:8080 to be available ...
Waiting for spark master http://cluster-18dc6d-ui:8080 to be available ...
Waiting for spark master http://cluster-18dc6d-ui:8080 to be available ...
Waiting for spark master http://cluster-18dc6d-ui:8080 to be available ...
Waiting for spark workers (1/1 alive) ...
All spark workers alive
Cluster configuration is - Config:
    ExposeWebUI: "true"
    MastersCount: 1
    Metrics: "false"
    SparkImage: radanalyticsio/openshift-spark:2.3-latest
    WorkersCount: 1
  Ephemeral: wfswarm-sparkpi-1
  Image: radanalyticsio/openshift-spark:2.3-latest
  MasterUrl: spark://cluster-18dc6d:7077
  MasterWebRoute: http://cluster-18dc6d-ui-route-sparkpi.shift.opb.studios
  MasterWebUrl: http://cluster-18dc6d-ui:8080
  Name: cluster-18dc6d
  Namespace: sparkpi
  Status: Running
  href: /clusters/cluster-18dc6d
spark-submit --class org.wildfly.swarm.bootstrap.Main --master spark://cluster-18dc6d:7077 --conf spark.driver.host=wfswarm-sparkpi-headless /opt/app-root/src/wfswarm-sparkpi-1.0-SNAPSHOT-swarm.jar
18/10/16 19:15:33 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/10/16 19:15:42 INFO swarm: WFSWARM0013: Installed fraction:                  Logging - STABLE          org.wildfly.swarm:logging:2018.1.0
18/10/16 19:15:42 INFO swarm: WFSWARM0013: Installed fraction:          Bean Validation - STABLE          org.wildfly.swarm:bean-validation:2018.1.0
18/10/16 19:15:42 INFO swarm: WFSWARM0013: Installed fraction:        CDI Configuration - STABLE          org.wildfly.swarm:cdi-config:2018.1.0
18/10/16 19:15:42 INFO swarm: WFSWARM0013: Installed fraction:                  Elytron - STABLE          org.wildfly.swarm:elytron:2018.1.0
18/10/16 19:15:42 INFO swarm: WFSWARM0013: Installed fraction:             Transactions - STABLE          org.wildfly.swarm:transactions:2018.1.0
18/10/16 19:15:42 INFO swarm: WFSWARM0013: Installed fraction:                      CDI - STABLE          org.wildfly.swarm:cdi:2018.1.0
18/10/16 19:15:42 INFO swarm: WFSWARM0013: Installed fraction:                 Undertow - STABLE          org.wildfly.swarm:undertow:2018.1.0
18/10/16 19:15:42 INFO swarm: WFSWARM0013: Installed fraction:                   JAX-RS - STABLE          org.wildfly.swarm:jaxrs:2018.1.0
18/10/16 19:15:42 INFO Version: WELD-000900: 2.4.3 (Final)
18/10/16 19:15:42 WARN ServiceLoader: Could not load service class org.wildfly.swarm.cdi.config.deployment.InjectConfigViewExtension
18/10/16 19:15:42 INFO Bootstrap: WELD-ENV-000020: Using jandex for bean discovery
18/10/16 19:15:43 INFO Bootstrap: WELD-000101: Transactional services not available. Injection of @Inject UserTransaction not available. Transactional observers will be invoked synchronously.
18/10/16 19:15:43 INFO Event: WELD-000411: Observer method [BackedAnnotatedMethod] org.wildfly.swarm.container.runtime.cdi.ImplicitArchiveExtension.processAnnotatedType(@Observes ProcessAnnotatedType<T>, BeanManager) receives events for all annotated types. Consider restricting events using @WithAnnotations or a generic type with bounds.
18/10/16 19:15:43 WARN Validator: WELD-001471: Interceptor method setupFactories defined on class org.wildfly.swarm.container.runtime.xmlconfig.StandaloneXMLParserProducer is not defined according to the specification. It should not throw java.lang.Exception, which is a checked exception.
	at org.wildfly.swarm.container.runtime.xmlconfig.StandaloneXMLParserProducer.setupFactories(StandaloneXMLParserProducer.java:0)
  StackTrace
18/10/16 19:15:43 WARN Validator: WELD-001471: Interceptor method postConstruct defined on class org.wildfly.swarm.container.runtime.wildfly.ShrinkWrapFileSystem is not defined according to the specification. It should not throw java.io.IOException, which is a checked exception.
	at org.wildfly.swarm.container.runtime.wildfly.ShrinkWrapFileSystem.postConstruct(ShrinkWrapFileSystem.java:0)
  StackTrace
18/10/16 19:15:43 INFO Bootstrap: WELD-ENV-002003: Weld SE container internal initialized
18/10/16 19:15:44 INFO msc: JBoss MSC version 1.2.7.SP1
18/10/16 19:15:44 INFO as: WFLYSRV0049: WildFly Swarm 2018.1.0 (WildFly Core 3.0.8.Final) starting
18/10/16 19:15:44 INFO swarm: WFSWARM0019: Install MSC service for command line args: []
18/10/16 19:15:44 ERROR management-operation: WFLYCTL0013: Operation ("parallel-extension-add") failed - address: ([])
java.lang.RuntimeException: WFLYCTL0079: Failed initializing module org.jboss.as.logging
	at org.jboss.as.controller.extension.ParallelExtensionAddHandler$1.execute(ParallelExtensionAddHandler.java:115)
	at org.jboss.as.controller.AbstractOperationContext.executeStep(AbstractOperationContext.java:980)
	at org.jboss.as.controller.AbstractOperationContext.processStages(AbstractOperationContext.java:726)
	at org.jboss.as.controller.AbstractOperationContext.executeOperation(AbstractOperationContext.java:450)
	at org.jboss.as.controller.OperationContextImpl.executeOperation(OperationContextImpl.java:1402)
	at org.jboss.as.controller.ModelControllerImpl.boot(ModelControllerImpl.java:490)
	at org.jboss.as.controller.AbstractControllerService.boot(AbstractControllerService.java:468)
	at org.jboss.as.controller.AbstractControllerService.boot(AbstractControllerService.java:430)
	at org.jboss.as.server.ServerService.boot(ServerService.java:437)
	at org.jboss.as.server.ServerService.boot(ServerService.java:396)
	at org.jboss.as.controller.AbstractControllerService$1.run(AbstractControllerService.java:370)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: WFLYLOG0078: The logging subsystem requires the log manager to be org.jboss.logmanager.LogManager. The subsystem has not be initialized and cannot be used. To use JBoss Log Manager you must add the system property "java.util.logging.manager" and set it to "org.jboss.logmanager.LogManager"
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.jboss.as.controller.extension.ParallelExtensionAddHandler$1.execute(ParallelExtensionAddHandler.java:107)
	... 11 more
Caused by: java.lang.IllegalStateException: WFLYLOG0078: The logging subsystem requires the log manager to be org.jboss.logmanager.LogManager. The subsystem has not be initialized and cannot be used. To use JBoss Log Manager you must add the system property "java.util.logging.manager" and set it to "org.jboss.logmanager.LogManager"
	at org.jboss.as.logging.LoggingExtension.initialize(LoggingExtension.java:167)
	at org.jboss.as.controller.extension.ExtensionAddHandler.initializeExtension(ExtensionAddHandler.java:131)
	at org.jboss.as.controller.extension.ExtensionAddHandler.initializeExtension(ExtensionAddHandler.java:104)
	at org.jboss.as.controller.extension.ParallelExtensionAddHandler$ExtensionInitializeTask.call(ParallelExtensionAddHandler.java:144)
	at org.jboss.as.controller.extension.ParallelExtensionAddHandler$ExtensionInitializeTask.call(ParallelExtensionAddHandler.java:127)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	at org.jboss.threads.JBossThread.run(JBossThread.java:320)
18/10/16 19:15:44 ERROR server: WFLYSRV0056: Server boot has failed in an unrecoverable manner; exiting. See previous messages for details.
18/10/16 19:15:44 INFO ShutdownHookManager: Shutdown hook called
18/10/16 19:15:44 INFO ShutdownHookManager: Deleting directory /tmp/spark-db32c24f-ab35-4803-91ff-8c4e671309e5
java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.wildfly.swarm.bootstrap.MainInvoker.invoke(MainInvoker.java:53)
	at org.wildfly.swarm.bootstrap.Main.run(Main.java:132)
	at org.wildfly.swarm.bootstrap.Main.main(Main.java:85)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:879)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:197)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: Operation failed
	at org.wildfly.swarm.spi.api.ClassLoading.withTCCL(ClassLoading.java:45)
	at org.wildfly.swarm.container.runtime.ServerBootstrapImpl.bootstrap(ServerBootstrapImpl.java:113)
	at org.wildfly.swarm.Swarm.start(Swarm.java:398)
	at io.radanalytics.examples.wfswarm.SparkPiSwarmDeployment.main(SparkPiSwarmDeployment.java:15)
	... 17 more
Caused by: java.util.concurrent.ExecutionException: Operation failed
	at org.jboss.threads.AsyncFutureTask.operationFailed(AsyncFutureTask.java:74)
	at org.jboss.threads.AsyncFutureTask.get(AsyncFutureTask.java:268)
	at org.wildfly.swarm.internal.wildfly.SelfContainedContainer.start(SelfContainedContainer.java:146)
	at org.wildfly.swarm.container.runtime.RuntimeServer.start(RuntimeServer.java:206)
	at org.wildfly.swarm.container.runtime.RuntimeServer$Proxy$_$$_WeldClientProxy.start(Unknown Source)
	at org.wildfly.swarm.container.runtime.ServerBootstrapImpl.lambda$bootstrap$1(ServerBootstrapImpl.java:159)
	at org.wildfly.swarm.spi.api.ClassLoading.withTCCL(ClassLoading.java:43)
	... 20 more
Caused by: java.lang.Exception: WFLYSRV0056: Server boot has failed in an unrecoverable manner; exiting. See previous messages for details.
	at org.jboss.as.server.BootstrapListener.bootFailure(BootstrapListener.java:87)
	at org.jboss.as.server.ServerService.boot(ServerService.java:417)
	at org.jboss.as.controller.AbstractControllerService$1.run(AbstractControllerService.java:370)
	at java.lang.Thread.run(Thread.java:748)
Exception in thread "main" java.lang.RuntimeException: java.util.concurrent.ExecutionException: Operation failed
	at org.wildfly.swarm.spi.api.ClassLoading.withTCCL(ClassLoading.java:45)
	at org.wildfly.swarm.container.runtime.ServerBootstrapImpl.bootstrap(ServerBootstrapImpl.java:113)
	at org.wildfly.swarm.Swarm.start(Swarm.java:398)
	at io.radanalytics.examples.wfswarm.SparkPiSwarmDeployment.main(SparkPiSwarmDeployment.java:15)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.wildfly.swarm.bootstrap.MainInvoker.invoke(MainInvoker.java:53)
	at org.wildfly.swarm.bootstrap.Main.run(Main.java:132)
	at org.wildfly.swarm.bootstrap.Main.main(Main.java:85)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:879)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:197)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.util.concurrent.ExecutionException: Operation failed
	at org.jboss.threads.AsyncFutureTask.operationFailed(AsyncFutureTask.java:74)
	at org.jboss.threads.AsyncFutureTask.get(AsyncFutureTask.java:268)
	at org.wildfly.swarm.internal.wildfly.SelfContainedContainer.start(SelfContainedContainer.java:146)
	at org.wildfly.swarm.container.runtime.RuntimeServer.start(RuntimeServer.java:206)
	at org.wildfly.swarm.container.runtime.RuntimeServer$Proxy$_$$_WeldClientProxy.start(Unknown Source)
	at org.wildfly.swarm.container.runtime.ServerBootstrapImpl.lambda$bootstrap$1(ServerBootstrapImpl.java:159)
	at org.wildfly.swarm.spi.api.ClassLoading.withTCCL(ClassLoading.java:43)
	... 20 more
Caused by: java.lang.Exception: WFLYSRV0056: Server boot has failed in an unrecoverable manner; exiting. See previous messages for details.
	at org.jboss.as.server.BootstrapListener.bootFailure(BootstrapListener.java:87)
	at org.jboss.as.server.ServerService.boot(ServerService.java:417)
	at org.jboss.as.controller.AbstractControllerService$1.run(AbstractControllerService.java:370)
	at java.lang.Thread.run(Thread.java:748)
Deleting cluster 'cluster-18dc6d'
cluster "cluster-18dc6d" deleted

logs.out.txt

@elmiko elmiko added the bug Something isn't working label Oct 16, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant