Subj : Squish dupe detection.
To   : Marc Lewis
From : Dieter Ringhofer
Date : Thu Nov 28 2002 08:55 am

Hi Marc!

 ML> And yes, GIGO is broken in that when it receives an entire group of
 ML> messages from one source, all at the same time and all having the
 ML> same timestamp, it will assign them all the same MSGID, regardless of
 ML> other header (subject:) content.

Gigo is known to be a dupe catapult since many years. Therefore it's 
recommended to get rid of it or to use it only when you are not feeding any 
other system. When using Squish you have some chances to catch real dupes and 
ignore most false ones (AFAIR they are called nopes). Using any other tosser 
you're out of luck.

 ML> I'll try some batch file magic on the incoming .X and .D files to
 ML> stagger each pair's timestamp and see if that helps out.  It will be
 ML> quite tricky though.

I don't believe you will be very successfull. Instead of wasting to much time 
with Gigo you might have a look at Fidogate. You should be able to find 
binaries for Linux, BSD, OS/2 and Win* (and complete source code).

cu, Dieter

---
 * Origin: Wndos s god fr cmnicaton (2:2476/14)

.