Color theory encompasses the rules and guidelines that designers use to create effective color schemes in visual design, combining science and art. It classifies colors into primary, secondary, and tertiary categories and distinguishes between RGB for digital use and CMYK for printing. Understanding the relationships and combinations of colors is crucial for effective branding and communication.