Sea surface wave spectrum measurements are necessary for a host of basic research questions and for engineering and societal needs. However, most measurement techniques require great investment in infrastructure and time-intensive deployment techniques. We propose a new approach to wave measurement from standard video footage recorded by low-cost unmanned aerial vehicles (UAVs). We address UAV nadir imagery, which is particularly simple to obtain operationally. The method relies on the fact that the optical contrast of surface gravity waves is proportional to their steepness. We present a robust methodology of regularized inversion of the optical imagery spectra, resulting in retrieval of the 3-D wavenumber-frequency sea surface height (SSH) spectrum. The system was tested in several sea trials and in different bathymetric depths and sea state conditions. The resulting wave bulk parameters and spectral characteristics are in good agreement with collocated measurements from wave buoys and bottom-mounted acoustic sensors. Simple deployment, mobility, and flexibility in spatial coverage show the great potential of UAVs to significantly enhance the availability of wave measurements.