CLI-TextLines-Hack
The following CLI commands each written as a stand-alone Perl program are provided.
alluniq -- Is every line different from others? If not, how many are $n$-plet occur for each $n$?
idmaker -- Identical numbers are attached to each line. Same ID for the same line contents.
shuffler -- shuffles the lines randomly. With options of taking $n$ lines from the top.
hashtotal -- Calculates the total sum of the first 4 bytes of SHA1 of each line.
ngram -- character-wise $n$-gram ranking (experimental; not fully implemented as planed).
utf8bom -- you can check the existence and add/delete UTF-8 BOM on files.
INSTALLATION
To install this module, run the following commands:
perl Build.PL
./Build
./Build test
./Build install
SUPPORT AND DOCUMENTATION
Only Japanese manual is provided, and you can see them by the following command.
alluniq --help
idmader --help
shuffler --help
hashtotal --help
ngram --help
LICENSE AND COPYRIGHT
Copyright (C) 2018 "Toshiyuki Shimono"
This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.
You should have received a copy of the GNU General Public License
along with this program. If not, see L<
http://www.gnu.org/licenses/>.