Cord Beermann 31c96af44b add documentation for the new scripts. 9 years ago
..
bin c45b4164dc add additional input sources. 9 years ago
cgi-bin ca2f50fc39 blocked an excessive and random reporting ip 9 years ago
etc 2f487372f8 Initial check in for archive-spam-removals 13 years ago
README 31c96af44b add documentation for the new scripts. 9 years ago

README

Files:

/org/lists.debian.org/cgi-bin/spam-report.pl
logs info from the 'Report as Spam'-Button to
/org/lists.debian.org/spam-log/spam-report.log

/org/lists.debian.org/archive-spam-removals/bin/review0.cron
moves logfiles around, and runs
/org/lists.debian.org/archive-spam-removals/bin/review1-nominate.pl and
/org/lists.debian.org/archive-spam-removals/bin/msgidreport2spamreport.pl

/org/lists.debian.org/archive-spam-removals/bin/msgidreport2spamreport.pl
reads in msg-id-nomination-files like
/org/lists.debian.org/spam-log/queue-nominator.log (see below)
/var/list/listspam/nominator.log (input from report-listspam-address)
/org/lists.debian.org/spam-log/msgid-nominator.log (input from cgi-bin/nominate-for-review.pl)
and tries to resolve it to links and store
it in /org/lists.debian.org/spam-log/spam-report.log.0
unresolvable msgids are stored in
/org/lists.debian.org/spam-log/queue-nominator.log for the next run

/org/lists.debian.org/archive-spam-removals/bin/review1-nominate.pl
parses /org/lists.debian.org/spam-log/spam-report.log.0
parses /org/lists.debian.org/spam-log/spam-review.log.0
writes a cache-file to
/org/lists.debian.org/archive-spam-removals/review/cache
with all data we ever got from the files above.
writes list-specific data-files with files to review to
/org/lists.debian.org/archive-spam-removals/review/$list
writes $list.spam-files to
/org/lists.debian.org/archive-spam-removals/review/
generates an index.html for links to review2.pl

/org/lists.debian.org/cgi-bin/review/review1.pl
parses /org/lists.debian.org/archive-spam-removals/review/$list
parses /org/lists.debian.org/spam-log/spam-review.log
generates a page with all lists that need reviews and links to
review2.pl

/org/lists.debian.org/cgi-bin/review/review2.pl
parses /org/lists.debian.org/archive-spam-removals/review/$list
generates a page with 10 IFRAMEs of posts needed to review, and
rating-radio-buttons with a link to review3.pl

/org/lists.debian.org/cgi-bin/review/review3.pl
parses input from CGI review2.pl
writes to /org/lists.debian.org/spam-log/spam-review.log

/org/lists.debian.org/archive-spam-removals/bin/review-converter
converts tomv's reportspam.py-results file in cords format.

/org/lists.debian.org/archive-spam-removals/bin/merge-spam-files
picks up the *.spam-files in
/org/lists.debian.org/archive-spam-removals/spam-removals and its
subdirs, checks and warns for no-matches and generates the
/org/lists.debian.org/lists/$list/$year/$list-$year$month.spam-files
for mhonarc and runs mhonarc on the changed archives.

/org/lists.debian.org/archive-spam-removals/cgi-bin/nominate-for-review.pl
interface for spam-reporting. see
https://wiki.debian.org/Teams/ListMaster/ListArchiveSpam#Methods_to_Nominate_Spam_for_the_Review-Process