Williamson County will hold a groundbreaking ceremony May 14 at 2 p.m., celebrating the beginning of construction on the $90 million administration building that will serve as the new county headquarters.