United States: You can look up a U.S. Zip Code using the Postal Service's ZIP Code Lookup. You could also use the National 5-Digit ZIP Code and Post Office Directory, which you'll find in large libraries and post offices.
You can also look up the zip codes found in each county or city.
Canada: For Canadian postal codes, use the Postal Code Look-Up from Canada Post.