Streaming data out of Kusto

user_5057753 0
Viewed 184

There is enough ADX documentation available about streaming ingestion but I don't find anything about streaming it out of Kusto. Even continuous export has minimum limit on export frequency (I think 5 mins) and that is far from being a streaming method of exporting. Is there a way to stream high volume data out of ADX to BLOB or ADLS Gen2?

azure-data-explorer
1 Answers

Continuous export is the recommended approach for continuously exporting high volume of data from Kusto since the exporting is distributed. The minimal frequency is one minute, see the "frequency" section in the doc : enter image description here

For other exports of a large amount of data, use the applicable method in the SDKs. For example, here is the Java SDK and here is the .Net sample:

KustoConnectionStringBuilder kcsb = new KustoConnectionStringBuilder(connectionString);
kcsb.Streaming = true;

using (KustoDataContext context = new KustoDataContext(kcsb))
using (var reader = context.ExecuteQuery(query, requestProperties: requestProperties))
using (var csvStream = new CsvFromDataReaderJitStream(reader, leaveOpen: false, writeHeader: true))
{
  // consume stream here
}
user_101679140
Related