[KOPRajs]

@garbear So far it seems, that I have tracked the problem down to this commit:
https://github.com/xbmc/xbmc/pull/22694/...65c0039212

It seems, that this commit breaks the PCSX emulator (causing crashes and out-of-memory problems). Currently building LibreELEC with this commit reverted to confirm that. I'll report back when I have tested it.

EDIT: So I've built a LE image with the "Add memory access and alignment" reverted and I can confirm it solves the PCSX issue:
https://github.com/KOPRajs/xbmc/commits/...ess-revert

I've had to revert more commits, but the one causing the issue seems to be the "Add memory access and alignment".

Here is what I've got in "dmesg" in LE when the issue occurs:

Code:

[   56.076937] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   56.092870] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.745625] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.759347] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.771813] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.783967] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.796897] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.810712] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.823998] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.836742] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.885065] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   78.897506] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.748884] cma_alloc: 188 callbacks suppressed
[   83.748892] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.769315] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.783639] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.798985] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.814861] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.830790] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.846920] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.862625] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.878312] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   83.894112] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.768383] cma_alloc: 302 callbacks suppressed
[   88.768392] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.784256] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.800669] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.817918] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.835052] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.851689] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.869180] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.886296] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.903446] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12
[   88.920543] cma: cma_alloc: reserved: alloc failed, req-size: 238 pages, ret: -12

Shortly after this the Kodi crashes. In CoreELEC (with old vendor kernel) there are no such messages in dmesg, but Kodi is allocating a lot of memory and then the system dies on OOM instead. I'd say the difference in behavior is caused by different kernels used by CoreELEC and LibreELEC.