Affects Version/s: None
Fix Version/s: None
tried in following
- docker python:2.7
- repl.it 2.7.0
I have started using Azure Blob Storate provider and found it it just doesn't work for files larger then 4MB, which is actually blob and chunk size limit in code.
I have done some digging/debugging in the code base and found out that uploading files in chunks is not used at all. It was actually added correctly with first version for Azure Blob Provided in 0.12.* version, but during some kind of refactoring it has been removed and for example `_upload_in_chunks` method is not used at all. Practically in method `_upload_object` check if file size is bigger then blob/chunk size but actually chunk upload is not happening.
Try following code to see it's not working
Just downloading some random CSV file (24MB in this case) and trying to upload it. I have found some workaround how to be able to send one chunk/blob, but Azure have restrictions max 100MB per chunk/blob, so in the end i am not able to push files larger then 100MB.
The example code fail with following exception
But if you print out output of the HTTP response it's saying following (sensitive informations truncated)
Let me know if i am doing anything wrong or if you need provide more informations