The ampersand (&) was so commonly used that for a while it was taught as a letter. British schoolkids in the mid- to late-19th century would include it as the 27th letter on writing work and needlework samplers, usually after “z”.

There’s some discussion that the Alphabet Song ends with “w, x, y & z” specifically to include it.