From law to code: where to put the human in the loop
How do you build trust in an LLM-based system when its users are responsible for getting compliance right? At PayFit, we have been iterating over the last two years on a “from law to code” workflow with compliance experts: identifying relevant legal changes, extracting payroll parameters, and translating legal requirements into rules. Our main lesson has been to start with what matters to the business and the experts doing the work: which mistakes have consequences, what they need to verify, and where their judgment is essential. Those priorities shape what we automate, what tool we build, how humans stay involved, and how we evaluate the results. Through concrete examples, I’ll share how we involved compliance experts at the right points in the workflow: deciding what needs their attention, what they need to review, and where they should steer the system. We’ll explore what worked, where we need to iterate, and how these choices helped build trust in the outputs.
-
Thomas Villaren Senior Staff Software Engineer 
