Ugly Alpha 1
rust_tokenizers:7.0.0

total uncompressed bytes

1006.3 KB

total files

72

Fix

NewInclude { include: [ "src/**/*", "README.md", "protos/sentencepiece_model.proto", "build.rs", ], has_build_script: true, }

20 wasted files

total waste: 209.3 KB

  1. tests/test_gpt2_cased.rs : 18.3 KB
  2. tests/test_roberta_cased.rs : 17.0 KB
  3. tests/test_reformer_cased.rs : 15.9 KB
  4. tests/test_t5_cased.rs : 12.3 KB
  5. tests/test_fnet_cased.rs : 12.2 KB
  6. tests/test_sentence_piece.rs : 12.2 KB
  7. tests/test_pegasus_cased.rs : 11.8 KB
  8. tests/test_xlnet_cased.rs : 11.8 KB
  9. tests/test_ctrl_cased.rs : 11.7 KB
  10. tests/test_bert_uncased.rs : 11.2 KB
  11. tests/test_albert_uncased.rs : 11.1 KB
  12. tests/test_prophetnet_uncased.rs : 10.9 KB
  13. tests/test_openai_gpt_uncased.rs : 10.8 KB
  14. tests/test_m2m100_cased.rs : 10.6 KB
  15. tests/test_xlm_roberta_uncased.rs : 10.4 KB
  16. tests/test_mbart50_cased.rs : 10.3 KB
  17. tests/test_sentence_piece_bpe.rs : 10.1 KB
  18. tests/test_utils.rs : 580 B
  19. rustfmt.toml : 34 B
  20. clippy.toml : 31 B