Not quite... two examples from the TypeWriterDataBase:

1906 Continental Standard with exclamation mark:

https://preview.redd.it/ul8r3t4qy9ah1.jpeg?width=550&format=pjpg&auto=webp&s=a400e7376b662cc4e1bcd7dcdf9ed79b162e7a86