A bitcoin wallet is a computer or smartphone app or hardware device that stores one or more private keys that are necessary to sign a transaction and send bitcoin, and generates public keys from those private keys to receive bitcoin. Bitcoin wallets have varying degrees of security and user-friendliness, so choosing your bitcoin wallet is very important.
A bitcoin wallet contains the digital private key(s) needed to send funds from the wallet. Typically, a backup of this private key is made during the setup process so that funds can be restored if something happens to the wallet itself.
The least secure way to store your bitcoin are hosted wallets provided by companies online, like exchanges, and browser-based apps.
A more secure way to store your bitcoin is by using a hardware wallet device, which is a small device that keeps the private key disconnected from the internet at all times, and therefore less prone to attack.
The most secure way to store your bitcoin is by using multisignature, or "multisig," solutions that require two or more keys to send bitcoin. This allows you to distance your keys from each other geographically and greatly reduces the risk of theft.
Ideally, you would use a combination of hardware devices and multisig. Apps like Casa make this easy.