Splash memory limit (scrapy)

user_4454219 0
Viewed 1148

I have splash started from docker. I create big lua script for splash and scrapy, and then it's run i see problem:

Lua error: error in __gc metamethod (/app/splash/lua_modules/sandbox.lua:189: script uses too much memory

How i can encrease memory for splash?

scrapy splash-screen
2 Answers

I solve my problem by optimizing the lua script. It turns out splash:select("a#story-title").node.innerHTML is much heavier than splash:evaljs('document.getElementById("story-title").innerHTML;')

user_15646590
Related