Autoencoders, VAEs & learned tokenizers

训练方式

A reconstruction objective preserves perceptual content. VAEs add a distribution regularizer; vector-quantized models map representations to a discrete codebook and add codebook/commitment objectives.

推理运行方式

Encode for compression or editing; sample or generate a latent/code sequence; decode to the original modality. Reconstruction quality limits the best possible downstream output.

优势

• •Reduces the dimensionality of expensive media
• •Creates reusable continuous latents or discrete tokens
• •Separates representation learning from the generative prior

权衡

• •Compression discards detail
• •Latent geometry may not match downstream semantics
• •Quantized codebooks can be underused or introduce artifacts

适用场景

• Raw media is too expensive to model directly
• A generative model needs a compact continuous or discrete space
• Reconstruction failures are measured by content slice

应避免或质疑的场景

• Lossless reconstruction is mandatory
• The codec domain differs materially from production data
• Decoder artifacts would be mistaken for generator failures