Tag: jobs

How I scraped 5.3 million jobs (including 5,335 data science jobs) Background During my PhD in Data Science at Stanford, I got sick and tired of ghost jobs & 3rd party offshore agencies on LinkedIn & Indeed. So I wrote a script that fetches jobs from 30k+ company websites’ career pages and uses GPT4o-mini to…

How I scraped 4.1 million jobs with GPT4o-mini Background: During my PhD in Data Science at Stanford, I got sick and tired of ghost jobs & 3rd party offshore agencies on LinkedIn & Indeed. So I wrote a script that fetches jobs from 100k+ company websites’ career pages and uses GPT4o-mini to extract relevant information…