How to pipe a HTTPS get response into an Object

user_10974240 0
Viewed 3494

I transformed my code so that instead of requiring an extra node_modules, I could just use some HTTPS GET requests, the problem is that when I try to pipe /releases/ which is basically a raw JSON file, my code requires it back and issues occur like SyntaxError: Unexpected end of JSON input, because for some reason, when I console.log() the so called JSON array, the end isn't completed with ] or }. So I try to pipe the response into an array, but now I get an error: dest.on isn't a function,

Code: 

    https.get({hostname: `api.github.com`, path: `/repos/${username}/${reponame}/releases`, headers: {'User-Agent': 'a user agent'}}, async (response) => {
        var file = new Array()
        response.pipe(file)
        response.on('end', async function() { //issue occurs at response.pipe ???
        var releases = JSON.parse(fs.readFileSync('./releases.json', 'utf8'))
        console.log(releases)

The JSON file that I access from Github looks like: https://api.github.com/repos/davidmerfield/randomColor/releases (random repository)

But, my file (releases.json) looks like this

Edit: I did extensive testing. I used the same JSON file my pkg outputted, read it with fs and so on, and everything seems fine. So the issue is most likely with https / response

node.js get https json javascript
3 Answers

I found out how to pipe the HTTP request into an object, instead of piping it into a file. Thanks to this post. I did that and turned the string into a JSON array.

https.get({hostname: `api.github.com`, path: `/repos/${username}/${reponame}/releases`, headers: {'User-Agent': 'agent'}}, async response => {
        var str = ''
        response.on('data', (data) => {
            str += data
        })
        response.on('end', async function() {
        var releases = JSON.parse(str)
//and so on...
user_109742400

You can require JSON files. So, if you need this file, you can do something like:

const releases = require('./releases.json');

You do not need to read it with fs, unless you really want to.

user_66272360

TypeError: dest.on is not a function

This error will be thrown if you try to pipe to non-Writable Stream object. Check here

Which in this case Array is not a Writable Stream. You can create a writable stream using fs.createWriteStream() and pipe the response to it.

https.get(
  { hostname: `api.github.com`, path: `/repos/${username}/${reponame}/releases`, headers: { "User-Agent": "a user agent" } },
  async response => {
    const writableStreamFile = fs.createWriteStream("./releases.json");
    response.pipe(writableStreamFile);
    response.on("end", async function() {
      var releases = JSON.parse(fs.readFileSync("./releases.json", "utf8"));
      console.log(releases);
    });
  }
);
user_63303190
Related