Forexite provider creates empty files for 201601 and 201701
Author: maximgl
Creation Date: 3/18/2018 1:15 AM
profile picture

maximgl

#1
Used Forexite 2017.04 provider to load Forex data from the beginning of time. I've noticed that among tempYYYYMM.csv files, files for 201601 and 201701 are empty, while underlying XX0116.csv and XX0116.zip files are present and have some data - see attached screenshots. The only suspicious thing is that files specifically for january 1st are empty for both years.

I've cancelled the load after it loaded data up to year 2010 and ran it again and it still produced empty files. Is there a way to work around this issue?
profile picture

maximgl

#2
I was able to work around this issue, by deleting original 010116, 010117 zip and csv files before generation of tempYYYYMM.csv files for these months started, so I believe that the problem for the whole month was caused by incorrect parsing of these individual days.

profile picture

Eugene

#3
Anything could have happened e.g. OS/disk/network/server issue. But the deletion of files would be the solution I'd suggest if the download has stuck or there's a history gap in the middle. The provider should pick up from where the data is empty. Glad you figured it out.
profile picture

maximgl

#4
I still think that this might be a bug in a data parser - a very specific file (csv with just header and no data) coming on a specific day (first day of the month) is disabling the load of the data for the whole month. If loader could be fixed to ignore such files, it would at least allow loading data for the rest of month.
profile picture

Eugene

#5
Yes that's a bug. Thanks for spotting this. I'll fix it in upcoming update as well as bring support for many new symbols.
profile picture

Eugene

#6
What's new in v2018.04:

* Fix: provider creates empty files for months like 2016/01 and 2017/01 (reported by maximgl)
* New: added support for 39 more currencies, their cross rates and cryptocurrencies (Bitcoin, Litecoin, Ethereum)
This website uses cookies to improve your experience. We'll assume you're ok with that, but you can opt-out if you wish (Read more).