A computer's hardware refers to the electrical parts and components inside a computer which power the system. The operating system and other software are then installed upon - and make use of - the hardware.
For example, a hard-drive is a piece of computer hardware which stores data such as the operating system, software, files, pictures, music etc. The CPU (central processing unit, also called processor) is the 'brains' of the computer - it is responsible for carrying out the various instructions and computations of the system.
And the RAM - which stands for Random Access Memory - temporarily stores data generated by the system (for example, if you are typing a letter but haven't saved it yet, the letter data is stored in the RAM).
Once the system is turned off, all the data held in the RAM is erased (unlike the hard-drive which stores the data even after the computer is switched off).
These are just three such computer hardware parts. Other common hardware components include the following:
The picture below shows a custom built computer system which has a motherboard, CPU, RAM, hard-drive, PSU, optical (CD/DVD) drive, graphics card and a case. Some of the components are hard to see or are obscured (such as the CPU which always has a large heatsink/cooler over it due to large heat output), although you can see most of the components in it:
(Sorry about all the cables!) A picture of this same system from another perspective (showing the buttons at the front of a computer) with the case off the front can be seen below:
As can be seen in the following list, this category has various sections relating to different computer hardware. It also covers computer cases, which house the various hardware components. If you are planning on building or customizing your computer, this is the section to read!