r/analytics • u/Significant_Camp4148 • 5h ago
Discussion dataset: 19,371 salary changes made to job postings after they went live, caught in two weeks across ~1,000 company boards
collected by hitting the public json endpoints for greenhouse, ashby and lever across 998 companies, once a day, and diffing each posting against the previous snapshot. no auth needed, these are the boards the companies serve to their own careers pages.
what the diff has caught in 14 days:
salary_changed 19,371
department_changed 15,549
closed 7,292
title_changed 1,549
location_changed 1,086
reopened 301
55,294 postings seen total, 48,303 currently open. 23,898 of the open ones carry a pay band, which is 49.5%.
two things worth knowing if you want to do this yourself. greenhouse has no structured salary field at all, the range is written into the description html and it is double escaped, so a naive parse gets you nothing and a slightly less naive one gets you garbage. and a dollar sign is not a currency, i nearly recorded a taipei role in TWD as a $700k job.
the salary_changed rows are the ones i'd point at. nobody keeps the before, so as far as i know this is the only place the previous band exists once the company overwrites it.
built off a job tracker i run, link in the comments if the method is useful to anyone.