Wikipedia has several articles on color and color vision. Good starting points are at http://en.wikipedia.org/wiki/Color_vision and http://en.wikipedia.org/wiki/Colorblindness.
http://ghr.nlm.nih.gov/condition=colorvisiondeficiency covers the genetic basis of color vision deficiency.
Color Professor J.L. Morton maintains an excellent site on all things color at http://www.colormatters.com.
Aubrey Jaffer's color pages include many examples of color name dictionaries at http://swiss.csail.mit.edu/~jaffer/Color/.
Aubrey Jaffer's site leads to John Foster's dictionary of the NBS/ISCC Centroid Color names at http://tx4.us/nbs-iscc.htm. Color Decoder's color names use a modified version of John Foster's dictionary. Download Color Decoder's NBS/ISCC dictionary here.
Color Decoder's SVG 1.0/CSS3 color name dictionary was derived from the SVG color keywords listed at http://www.w3.org/TR/css3-color/. Download Color Decoder's SVG 1.0/CSS3 dictionary here.
http://www.brucelindbloom.com/ explores the mathematics of colors and color spaces.