Found the problem - I had the wrong footprint for the crystal. Its a 4-pin package and I had the wrong two pins connected to the ESP32, while the actual crystal pins were being grounded on the PCB. Not sure how the ESP32 was seeing any oscillation at all, but I don't care enough to dig into it furth...

Trying again, it seems my previous attempt to post didn't make it... I am trying to program a custom ESP32-C3 board, and the UART seems to be running at 2.5x speed. Instead of 115.2kbaud, its something closer to 288kbaud, which isn't even a valid baud rate. Looking at it on the oscilloscope, it appe...