For addresses, phone numbers, etc., check out Carroll's State Directory, the State Yellow Book, or a similar directory. For Internet links, check out State and Local Governments on the Internet, State Blue Books and/or FindLaw. USA.gov post a page of State Agencies by Topic.
Lexis offers a database of state agency news (LEGIS;USSTNW).
See also the entries for individual states.