How to select large result set from Google BigQuery using .net api client library without pagination -
i trying select large result set (~200k) google bigquery using .net client library.
i able ~4k rows @ single shot (request & response), google bigquery offers pagetoken next set of results. able select rows big query through multiple request google bigquery (~50 request & response).
my question: if there possibility select large result set in single response? if yes kindly share code (even java code fine).
there no way run query , select large response in single shot. can either paginate results, or if can create job export files, use files generated in app. exporting free.
step run large query , export results files stored on gcs:
1) set allowlargeresults true in job configuration. must specify destination table allowlargeresults flag.
example:
"configuration": { "query": { "allowlargeresults": true, "query": "select uid [project:dataset.table]" "destinationtable": [project:dataset.table] } }
2) data in destination table set. need create new job, , set export property able export table file(s). exporting free, need have google cloud storage activated put resulting files there.
3) in end download large files gcs.
Comments
Post a Comment