The Maskability Index: Predicting Task-Objective Alignment in Pretrained Language Models

-->

Computer Science > Computation and Language

arXiv:2607.20265v1 (cs)

[Submitted on 22 Jul 2026]

Title: The Maskability Index: Predicting Task-Objective Alignment in Pretrained Language Models

Authors: Ahmad Pouramini , Mahsa Afsharzadeh

View a PDF of the paper titled The Maskability Index: Predicting Task-Objective Alignment in Pretrained Language Models, by Ahmad Pouramini and Mahsa Afsharzadeh

View PDF HTML (experimental)

Abstract: Large-scale pretrained language models such as T5 and BERT have demonstrated strong capabilities for generating structured knowledge. However, their performance depends on how closely the prompting strategy matches the objectives used during pretraining. We introduce the Maskability Index (MI), a quantitative metric that estimates whether a knowledge relation is better suited to masked-style prompting or prefix-style prompting in few-shot generation. MI is computed from differences in DepthRank scores between masked and unmasked templates, providing a principled measure of objective-template alignment. We evaluate MI on a diverse set of relations from the ATOMIC2020 knowledge base completion benchmark and show that it is positively correlated with downstream generation performance. These results indicate that MI can help select appropriate prompting templates and adaptation strategies for extracting relational knowledge from pretrained l

…