Add Data from node.js to Google BigQuery Table

user_12737013 0
Viewed 3432

I am working on Google BigQuery . i want to upload data to BigQuery Table from node.js . but i am facing a trouble here . when i send my json data form node.js app to insert that data in bigQuery table by using this code 

line = {"id":"123", "dttme":"201807012130", "brwsr":"Chrome", "pg_id":"hpv1"};
const datajson=line;

const {BigQuery} = require('@google-cloud/bigquery');
const TableObjectHeader = {
      "tableReference": {
        "projectId": "local-bebop-277417",
        "datasetId": "local-bebop-277417:123",
        "tableId": "local-bebop-277417:123.first",
      }
    }
    const bigqueryClient = new BigQuery();
const dataset = bigqueryClient.dataset(TableObjectHeader['tableReference']['datasetId']);
const table = dataset.table(TableObjectHeader['tableReference']['tableId']);
table.insert(datajson, function(err, response) {
      console.log("error:"+JSON.stringify(err));
      console.log("response:"+JSON.stringify(response));
});

then in console i am getting 

error:{}
response:undefined

and i am not getting my datajson in BigQuery Tble ? Can any one help me how to fix this problem ?

google-bigquery node.js
1 Answers

I've noticed the same error, when my GCP projectID was not defined during Bigquery Node.js Client initialization.

According to the documentation, NodeJS developing environment has to be properly prepared, once you've decided to use @google-cloud/bigquery library, by setting up:

  • Authentication parameters;
  • Google Cloud BigQuery API to be enabled;
  • Target Bigquery GCP ProjectID explicitly via gcloud config set for user shell session on the relevant NodeJS executor's machine or individually initializing for each client const bigquery = new BigQuery({projectId: 'my-project'}); connection attempt to Bigquery REST API.

I've made some correctives in you initial code snippet to fix this issue:

line = {"id":"123", "dttme":"201807012130", "brwsr":"Chrome", "pg_id":"hpv1"};
const datajson=line;

const {BigQuery} = require('@google-cloud/bigquery');
const TableObjectHeader = {
      "tableReference": {
        "datasetId": "datasetId",
        "tableId": "tableId",
      }
    }
    const bigqueryClient = new BigQuery({projectId: 'my-project'});
const dataset = bigqueryClient.dataset(TableObjectHeader['tableReference']['datasetId']);
const table = dataset.table(TableObjectHeader['tableReference']['tableId']);
table.insert(datajson, function(err, response) {
      console.log("error:"+JSON.stringify(err));
      console.log("response:"+JSON.stringify(response));
});

Be also aware and don't share any user sensitive and confidential data across your code examples or/and explanation details to keep them only for private usage.

user_99288090
Related