Overview:
--transformers-export
layer_pattern
src/schema.yaml
Specifications:
standard_attn
sigmoid_attn
gqa_attn
retnet
retnet_attn
mamba
ode
titan_attn
engram_attn
sparse_transformer_attn
longformer_attn
bigbird_attn
sparsek_attn
nsa_attn
sparge_attn
fasa_attn
gla_attn
deltanet_attn
gated_deltanet_attn
hgrn2_attn
fox_attn
gated_softmax_attn
cca_attn
ccgqa_attn
ffn_activation_config
train
deploy
quantize
infer
sbert-train
sbert-infer
web-server
transformers-export
similarity
search
cluster
encode
optimizer_class
API Reference:
build_parser()
main()
StreamingMLMDataset
SBERTInference
SimilarityResult
ModelDeployer
FrankensteinInference
interactive_mode()
ActivationQuantizer
BitNetQuantizer
bake_bitnet_weights()
estimate_model_size()
load_quantized_checkpoint()
save_quantized_checkpoint()
SpanishSPMTokenizer
is_mps_available()
resolve_torch_device()
GPUTelemetryError
GPUTempCheckResult
GPUTempSupervisor
GPUTemperatureGuard
read_temperature_from_nvidia_smi()
StorageManager
Bibliography:
Technical Reports:
The full technical report is available as a PDF:
Download PDF