We have a fairly complex job which has over 100k pages and we keep getting out of memory even thought I’ve now got it to set to 40gb allocated to the engine. If I look in the weaver engine log I can see the below. This suggests it finishes creating the output to the temp folder but then falls over after. I know it’s not much to go on but has anyone got any ideas on this as I can’t set the allocation to more than 40gb, but I can’t see it’s actually using 40gb anyway as I could see the max it used was 13gb
[2023-10-16 13:16:35,723] INFO [Timer-1] nl.edmond.workflow.components.writers.AbstractWriter.run(k.java) Writing sheet 95,297 to C:\Users\ServicePres\Connect\filestore\16577363352720578827\Inputs\LE02007\ReadyToBatch\T100000633666_0000720_01_047038.pdf, speed: 6,803.195 PPM
[2023-10-16 13:17:35,942] INFO [Timer-1] nl.edmond.workflow.components.writers.AbstractWriter.run(k.java) Writing sheet 102,234 to C:\Users\ServicePres\Connect\filestore\16577363352720578827\Inputs\LE02007\ReadyToBatch\T100000633666_0000720_01_050488.pdf, speed: 6,810.454 PPM
[2023-10-16 13:18:35,948] INFO [Timer-1] nl.edmond.workflow.components.writers.AbstractWriter.run(k.java) Writing sheet 109,380 to C:\Users\ServicePres\Connect\filestore\16577363352720578827\Inputs\LE02007\ReadyToBatch\T100000633666_0000720_01_054034.pdf, speed: 6,831.368 PPM
[2023-10-16 13:19:35,952] INFO [Timer-1] nl.edmond.workflow.components.writers.AbstractWriter.run(k.java) Writing sheet 116,569 to C:\Users\ServicePres\Connect\filestore\16577363352720578827\Inputs\LE02007\ReadyToBatch\T100000633666_0000720_01_057578.pdf, speed: 6,852.365 PPM
[2023-10-16 13:20:06,103] INFO [Thread-14–OutputCreation] nl.edmond.weaver.engine.WeaverEngineImpl.run(WeaverEngineImpl.java) Output creation duration for job 555954088: 00:23:17.805 pages: 119,548 PPM=5,131.531 (Oc_29)
[2023-10-16 13:20:06,903] INFO [Thread-14–OutputCreation] com.objectiflune.weaver.engine.product.internal.WeaverEngineCommandProcessor.a(WeaverEngineCommandProcessor.java) Output creation command completed
[2023-10-16 13:30:16,510] INFO [IPC Input] com.objectiflune.weaver.engine.product.internal.WeaverEngineCommandProcessor.processMessages(WeaverEngineCommandProcessor.java) Shutdown requested
[2023-10-16 13:30:16,613] INFO [IPC Input] com.objectiflune.weaver.engine.product.internal.WeaverEngineCommandProcessor.processMessages(WeaverEngineCommandProcessor.java) Terminating engine
[2023-10-16 13:30:16,613] INFO [IPC Input] com.objectiflune.core.runtime.OLPlatform.stopApplication(OLPlatform.java) Attempting to gracefully exit the application
[2023-10-16 13:30:16,613] INFO [IPC Input] com.objectiflune.weaver.engine.product.internal.WeaverHostApplication.stop(WeaverHostApplication.java) Stopping Weaver…
[2023-10-16 13:30:16,620] INFO [WebSocketClient@219838790-37] com.objectiflune.weaver.engine.product.internal.WeaverHostApplication.onWebSocketClose(EngineThread.java) Lost connection to application, stopping
[2023-10-16 13:30:16,677] INFO [Framework stop - Equinox Container: 9d940b29-839e-4a00-97b4-7539526a8cdf] com.objectiflune.core.runtime.TemporaryFileStore.destroy(TemporaryFileStore.java) Cleaning up the temporary filestore (Core_1402)
[2023-10-16 13:30:16,708] INFO [Framework stop - Equinox Container: 9d940b29-839e-4a00-97b4-7539526a8cdf] org.springframework.scheduling.concurrent.ThreadPoolTaskExecutor.shutdown(ExecutorConfigurationSupport.java) Shutting down ExecutorService ‘taskExecutor’
[2023-10-16 13:30:16,709] INFO [Framework stop - Equinox Container: 9d940b29-839e-4a00-97b4-7539526a8cdf] org.springframework.scheduling.concurrent.ThreadPoolTaskExecutor.shutdown(ExecutorConfigurationSupport.java) Shutting down ExecutorService
James Beal