From: Sergey Matveev Date: Sat, 30 Nov 2019 12:57:11 +0000 (+0300) Subject: Note about freq indexes X-Git-Tag: v5.1.1^2~1 X-Git-Url: http://www.git.cypherpunks.su/?a=commitdiff_plain;h=e7aa423a71e30a4aa45e42ee77bf54d9bd0a9b59;p=nncp.git Note about freq indexes --- diff --git a/doc/integration.texi b/doc/integration.texi index d1f1af9..8240e2f 100644 --- a/doc/integration.texi +++ b/doc/integration.texi @@ -5,6 +5,7 @@ Here is some examples of how you can solve popular tasks with NNCP, making them store-and-forward friendly. @menu +* Index files for freqing: FreqIndex. * Postfix:: * Web feeds: Feeds. * Web pages: WARCs. @@ -14,6 +15,22 @@ making them store-and-forward friendly. * Multimedia streaming: Multimedia. @end menu +@node FreqIndex +@section Index files for freqing + +In many cases you do not know exact files list on remote machine you +want to freq from. Because files can be updated there. It is useful to +run cron-ed job on it to create files listing you can freq and search +for files in it: + +@verbatim +0 4 * * * cd /storage ; tmp=`mktemp` ; \ + tree -f -h -N --du --timefmt \%Y-\%m-\%d | + zstdmt -19 > $tmp && chmod 644 $tmp && mv $tmp TREE.txt.zst ; \ + tree -J -f --timefmt \%Y-\%m-\%d | + zstdmt -19 > $tmp && chmod 644 $tmp && mv $tmp TREE.json.zst +@end verbatim + @node Postfix @section Integration with Postfix