Hybrids (at least Toyota hybrids; unclear about other brands) don’t just use a smaller engine - it’s a much more efficient engine design. However, this design also requires performance compromises that are only acceptable because there’s an electric motor supplementing it.

Someone else already linked the Technology Connections video that covers it in much greater detail.