Microsoft.ML.Tokenizers 0.21.1
Microsoft.ML.Tokenizers contains the implmentation of the tokenization used in the NLP transforms.
No packages depend on Microsoft.ML.Tokenizers.
.NET Standard 2.0
- System.Text.Json (>= 6.0.1)
| Version | Downloads | Last updated |
|---|---|---|
| 3.0.0-preview.26160.2 | 3 | 03/16/2026 |
| 2.0.0 | 4 | 03/04/2026 |
| 2.0.0-preview.25527.5 | 3 | 03/05/2026 |
| 2.0.0-preview.25503.2 | 3 | 03/05/2026 |
| 2.0.0-preview.25373.1 | 3 | 03/05/2026 |
| 2.0.0-preview.1.25127.4 | 3 | 03/05/2026 |
| 2.0.0-preview.1.25125.4 | 3 | 03/05/2026 |
| 1.0.3 | 4 | 03/05/2026 |
| 1.0.2 | 3 | 03/05/2026 |
| 1.0.1 | 3 | 03/05/2026 |
| 1.0.0 | 4 | 03/05/2026 |
| 0.22.0 | 3 | 03/05/2026 |
| 0.22.0-preview.24526.1 | 3 | 03/05/2026 |
| 0.22.0-preview.24522.7 | 3 | 03/05/2026 |
| 0.22.0-preview.24378.1 | 3 | 03/05/2026 |
| 0.22.0-preview.24271.1 | 3 | 03/05/2026 |
| 0.22.0-preview.24179.1 | 3 | 03/05/2026 |
| 0.22.0-preview.24162.2 | 3 | 03/05/2026 |
| 0.21.1 | 3 | 03/05/2026 |
| 0.21.0 | 3 | 03/05/2026 |
| 0.21.0-preview.23511.1 | 3 | 03/05/2026 |
| 0.21.0-preview.23266.6 | 3 | 03/05/2026 |
| 0.21.0-preview.22621.2 | 3 | 03/05/2026 |
| 0.20.1 | 3 | 03/05/2026 |
| 0.20.1-preview.22573.9 | 3 | 03/05/2026 |
| 0.20.0 | 3 | 03/05/2026 |
| 0.20.0-preview.22551.1 | 3 | 03/05/2026 |