Scraping a website which requires authentication using node.js

Question

I am trying to scrap this website https://www.erobertparker.com/entrance.aspx it requires authentication I am using request module to get authenticated like this,

 request({
        url:"https://www.erobertparker.com/login.aspx",
        method:"POST",
        form:{UNENTRY:"username",PWENTRY:"password"}
    },
    function(error,response,body){
 })

but i am unable to get authenticated what i am doing wrong can someone please guide me I am new to web scraping world :).

Answer 1

It's using an asp.net session cookie. You possibly need to store all cookies in a jar and then send them back on the next request.