In addition to his 30 Albums for 30 Years: 1964 - 1994 blog, Sweet has authored multiple books. His first was A History of American Music: An Origin Story 1750-1950 (Kendall Hunt). He is set to release Ray Brown: His Life and Music (Equinox Publishing) in 2024.

As a contributing editor of Jersey Jazz Magazine, Jay keeps a pulse on the history and latest developments in the jazz scene. He has interviewed legends such as George Benson, Ron Carter, Stanley Clarke, and Joshua Redman.