Autoencoders, VAEs & learned tokenizers

Как проходит обучение

A reconstruction objective preserves perceptual content. VAEs add a distribution regularizer; vector-quantized models map representations to a discrete codebook and add codebook/commitment objectives.

Как выполняется инференс

Encode for compression or editing; sample or generate a latent/code sequence; decode to the original modality. Reconstruction quality limits the best possible downstream output.

Сильные стороны

• •Reduces the dimensionality of expensive media
• •Creates reusable continuous latents or discrete tokens
• •Separates representation learning from the generative prior

Компромиссы

• •Compression discards detail
• •Latent geometry may not match downstream semantics
• •Quantized codebooks can be underused or introduce artifacts

Использовать, когда

• Raw media is too expensive to model directly
• A generative model needs a compact continuous or discrete space
• Reconstruction failures are measured by content slice

Избегать или пересмотреть, когда

• Lossless reconstruction is mandatory
• The codec domain differs materially from production data
• Decoder artifacts would be mistaken for generator failures