Increase serverless background function memory limit

hey :waving_hand:

I use serverless background function to sync data between different systems once every night.
e.g. it fetches data from A and B creates a local diff and then updates the changes to A.

So far this has been working great and thx to the 30 minute limit of background functions it worked perfectly. :flexed_biceps:

But now I need to add another system and there we have a litte more data so now when creating the diff I hit a memory limit of 1GB. :see_no_evil_monkey:
e.g. I logged the memory usage and it goes up to 1 GB and then it dies.

I know that AWS can be configured with a memory limit of up to 10 GB.

I don’t need nearly as much… I think with the current dataset I would need about 1.5-2 GB…
to be safe can the limit be increased to 3 GB?

Summary:
Please increase the memory limit of background functions to 3 GB for the site id 41e86779-9d21-42d8-9c9c-f492ca92b575.

Unfortunately, this limit is not adjustable. You’ll need to reduce the memory size to stay below that limit.

That’s really unfortunate.

Is there any workaround within the Netlify ecosystem that would let me exceed the 1 GB memory limit? Maybe through special functions, scheduled (cron) jobs, or something similar? :crossed_fingers:

If not, what would be a good alternative? Would spinning up a more traditional server elsewhere make sense—and if so, do you have any recommendations? :thinking:

P.S. I was really hoping to avoid maintaining a “classical” server :see_no_evil_monkey: That’s exactly why I’ve been loving Netlify so far!