LLMs Are Cheap Enough to Change How You Work With Data ·
I processed 60,000 job postings with an LLM for $10. That's not a typo. This post walks through how to use OpenAI's Batch API for bulk document processing: building JSONL request files, orchestrating without losing your mind, controlling costs with token limits, and tracking batch state in a database. When AI becomes this cheap, it changes what's possible.