Why chrome can't remember previous session with puppeteer?

Question

I'm actually trying to use puppeteer for scraping and I need to use my current chrome to keep all my credentials. However, chrome can't remember previous session and I have to click the login button every time. By contrast, chrome can remember the saved credential. Is there a way to make it?

I'm actually using: Node v12.16.1 chrome 80.0.3987.132 (Official Build) (64-bit) (cohort: Stable) puppeteer-core 2.1.0 // see: https://github.com/puppeteer/puppeteer/blob/v2.1.0/docs/api.md

test.js:

const pptr = require('puppeteer-core');

(async () => {
  const browser = await pptr.launch({
    executablePath: 'C:\\Program Files (x86)\\Google\\Chrome\\Application\\chrome.exe',//path to your chrome
    headless: false,
    args:[
                '--user-data-dir=D:/Users/xxx/AppData/Local/Google/Chrome/User Data2',
        ]
    });
  const page = await browser.newPage();
  await page.goto('https://hostloc.com');
  await page.screenshot({path: 'example.png'});
  await page.waitFor(10000);

  await browser.close();
})();

Answer 1

You should use cookies so that you can get the previous data from them. Here is a link about the set cookie in the puppeteer.

Here below is an example of code for how to set cookies in puppeteer. It Sets the "login_email" property in a Paypal cookie so the login screen is pre-filled with an email address.

const cookie = {
  name: 'login_email',
  value: '[email protected]',
  domain: '.paypal.com',
  url: 'https://www.paypal.com/',
  path: '/',
  httpOnly: true,
  secure: true
}

const puppeteer = require('puppeteer');

(async () => {
  const browser = await puppeteer.launch()
  const page = await browser.newPage()
  await page.setCookie(cookie)
  await page.goto('https://www.paypal.com/signin')
  await page.screenshot({ path: 'paypal_login.png' })
  await browser.close()
})()

Regarding get the cookies, You can create a Chrome DevTools Protocol session on the page target using target.createCDPSession(). Then you can send Network.getAllCookies to obtain a list of all browser cookies.

The page.cookies() function will only return cookies for the current URL. So we can filter out the current page cookies from all of the browser cookies to obtain a list of third-party cookies only.

const client = await page.target().createCDPSession();
const all_browser_cookies = (await client.send('Network.getAllCookies')).cookies;
const current_url_cookies = await page.cookies();
const third_party_cookies = all_browser_cookies.filter(cookie => cookie.domain !== current_url_cookies[0].domain);

console.log(all_browser_cookies); // All Browser Cookies
console.log(current_url_cookies); // Current URL Cookies
console.log(third_party_cookies); // Third-Party Cookies

For example, get all of the cookies

const puppeteer = require('puppeteer');
(async() => {
  const browser = await puppeteer.launch({});
  const page = await browser.newPage();
  await page.goto('https://stackoverflow.com', {waitUntil : 'networkidle2' });

  // Here we can get all of the cookies
  console.log(await page._client.send('Network.getAllCookies'));

})();

I hope this will help you.