there seems to be a major limitation in spark window functions and rangeBetween method.
If I have the following code :
Everything seems ok, while from value is not too large... Even if the rangeBetween() method supports Long parameters.
But.... If i set -2160000000L value to from it does not work !
It is probably related to this part of code in the between() method, of the WindowSpec class, called by rangeBetween()
( look at this .toInt )
Does anybody know it there's a way to solve / patch this behavior ?
Any help will be appreciated