Query API with needs authenticate

[kekogomez]

Hi everybody,

I'm trying to check a few data agains an API, but when I use API url it redirects me to login page where I must enter user and pass and then it's redirect me to another page that ask me for a code sent to my mail...

I will like to know how can I catch the first redirect, do 2 step auth and then continues to API query using same cookie (With auth info) for the rest of requests

Thanks in advance.

[janbuchar]

Hi @kekogomez and thank you for your interest in Crawlee! We would need to know more about the site that you're trying to scrape to help you efficiently. Ideally, we'd like to see the code of your scraper 🙂

• do you use a headless browser or a plain http crawler (Cheerio)?
• do you perform the 2-step authentication manually or automatically?
• would it be enough to copy an authentication cookie from a logged-in browser and use that in your scraper?