Yes, they do. Both disposable and non-disposable e-cigarettes contain lithium batteries.
Non-disposable products can be refilled and reused, while disposable products can only be used for about 600 puffs. Disposable e-cigarettes are ready to use, no need to charge or refuel, and can be thrown away after use.
