Automatic metrics for assessing factuality are easy to run and commonly used, but do they work? In < 1 hour, come find the answer at poster 349 in Hall X4, where I’ll be presenting @ameya_godbole1 ‘s work uncovering inconsistencies, errors, and biases of factuality metrics!

I do agree with the open letter that the bill is concerningly vague. There is significant leeway given to the to-be-created Frontier Model Division. I concur with this paragraph from the open letter, for instance. (12/13)