HDFS support for import file & temp directory URLs

Hi,

I’ve the data in HDFS. Is it possible to import file from HDFS and use HDFS as temp directory? Looks like there is no support according to this link https://www.cockroachlabs.com/docs/stable/import.html#import-file-temp-directory-urls
Is there any plan to support HDFS?

Regards,
Pavan

There’s an issue tracking HDFS support here: https://github.com/cockroachdb/cockroach/issues/14884

In the mean time, as a workaround, you could potentially point the HTTP storage option at a thin proxy in front of HDFS, but you’d have to find/write that proxy – last I checked, we don’t work with off-the-shelf WebHDFS / HTTPFS endpoints because they use query parameters and a custom API, whereas our HTTP support uses plain HTTP verbs.