What would it mean to have a robot judge making decisions in courts? How would that judge be built? While artificial intelligence could make decisions more efficient and consistent, there are also risks that automated systems could replicate or amplify existing biases and rigidities. Given the stakes, these technologies force us to think carefully about notions of fairness and justice, and how they should be applied.