There are two types of lithium batteries, lithium batteries and lithium polymer batteries.
The inside of a common lithium battery is a liquid electrolyte, which must be wrapped with a hard outer casing to achieve structural stability and safety.
Lithium polymer batteries are solid electrolytes. Of course, it's not very hard (it can be done very hard). The shape can be changed arbitrarily to suit different needs.