Do I need to remove the plastic cap from the socket on the motherboard before installing the processor?

Yes, the plastic cover on the LGA775 socket must be removed before installing the processor in the 775-land package.

This applies to:

Intel® Celeron® Processor Family Intel® Pentium® 4 Processor Extreme Edition Intel® Pentium® 4 Processors Intel® Pentium® D Processor