CLI-TextLines-Hack


The following CLI commands each written as a stand-alone Perl program are provided.

 alluniq -- Is every line different from others? If not, how many are $n$-plet occur for each $n$?
 idmaker -- Identical numbers are attached to each line. Same ID for the same line contents.
 shuffler -- shuffles the lines randomly. With options of taking $n$ lines from the top.
 hashtotal -- Calculates the total sum of the first 4 bytes of SHA1 of each line.
 ngram -- character-wise $n$-gram ranking (experimental; not fully implemented as planed).
 utf8bom -- you can check the existence and add/delete UTF-8 BOM on files.

INSTALLATION

To install this module, run the following commands:

       perl Build.PL
       ./Build
       ./Build test
       ./Build install

SUPPORT AND DOCUMENTATION

 Only Japanese manual is provided, and you can see them by the following command.

   alluniq --help
   idmader --help
   shuffler --help
   hashtotal --help
   ngram --help



LICENSE AND COPYRIGHT

Copyright (C) 2018 "Toshiyuki Shimono"

This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with this program.  If not, see L<http://www.gnu.org/licenses/>.