Web App
NEWPack Token Sequences Into Training Blocks
Build fixed-length token blocks with explicit masks.
Web Application
Try Webapp
Web ApplicationRuns in your browser without installing software. Browser access uses your Sobolsoft account and its current plan.
Processing takes place in your browser, without uploading your files for processing. Results are saved to your device.
The app's ? Help contains instructions, supported formats and browser limits.
Screenshot
Inspect the interface
Description
What is this software?
Build fixed-length token blocks with explicit masks.
Features
- Pack local token IDs or locally tokenized text into fixed-length training blocks.
- Control document boundaries, BOS/EOS insertion, padding, attention masks and masked labels, with source spans.
Build fixed-length token blocks with explicit masks.
Features
- Pack local token IDs or locally tokenized text into fixed-length training blocks.
- Control document boundaries, BOS/EOS insertion, padding, attention masks and masked labels, with source spans.