DistilBERT

• Original Link : https://keras.io/api/keras_nlp/models/distil_bert/
• Last Checked at : 2024-11-26

Models, tokenizers, and preprocessing layers for DistilBERT, as described in “DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter”.

For a full list of available presets, see the models page.

DistilBertTokenizer

• DistilBertTokenizer class
• from_preset method

DistilBertBackbone model

• DistilBertBackbone class
• from_preset method
• token_embedding property

DistilBertTextClassifier model

• DistilBertTextClassifier class
• from_preset method
• backbone property
• preprocessor property

DistilBertTextClassifierPreprocessor layer

• DistilBertTextClassifierPreprocessor class
• from_preset method
• tokenizer property

DistilBertMaskedLM model

• DistilBertMaskedLM class
• from_preset method
• backbone property
• preprocessor property

DistilBertMaskedLMPreprocessor layer

• DistilBertMaskedLMPreprocessor class
• from_preset method
• tokenizer property