Enable allowDiskUse within Stitch functions.
planned
Neil Albiston
Moving the larger slow queries from a data source pipeline to a stitch function would allow the building of summary tables from large datasets which would in turn enable faster charts and reduced large database queries. Unfortunately large slow queries often require AllowDiskUse = true. Which is not supported in Stitch.
Drew DiPalma
planned
Hi Folks – Sorry, I was mistaken about support. That being said, we are now planning to support his option within the next few months.
K
Karlen
Drew DiPalma: o specify this flag in Stitch? I've changed the function to system user ( in the Function Area --> Settings tab, redeployed and still get the same error message. "Failed to group matche
Drew DiPalma
closed
Hi Folks – allowDiskUse is available for Functions running as System in Stitch, due to the load that it can potential incur on a cluster we are not planning on extending it's usage more broadly at this time. However, we believe that availability within System Functions should address most (if not all) use cases.
Neil Albiston
Drew DiPalma: That's great news. Could you please tell me how to specify this flag in Stitch? I've changed the function to system user ( in the Function Area --> Settings tab, redeployed and still get the same error message. "Failed to group matched responses: StitchError: (Location16945) Exceeded memory limit for $group, but didn't allow external sort. Pass allowDiskUse:true to opt in."
Tried ...
return itemsCollection.aggregate(pipeline,{allowDiskUse: true }).toArray()
and also tried adding allowDiskUse to the pipeline. ( allowDiskUse not recognised.)
What syntax or setting should I change?
K
Karlen
Neil Albiston: o specify this flag in Stitch? I've changed the function to system user ( in the Function Area --> Settings tab, redeployed and still get the same error message. "Failed to group matche