how do you setup filters in 40tude dialog?

Discussion in 'Computer Support' started by D Pigeon, Sep 8, 2009.

  1. D Pigeon

    D Pigeon Guest

    Hi all. I'm just trying out 40tude dialog for the first time and want to
    know how da heck do you get rid of the crap spam like in this group?
    The examples given in the action dialog box are basicaly a joke. In Forte
    Agent I can easily set a filter and wipe out the spam with a click. In
    40tude, it seems like nothing is happening. The dialog box doesn't even
    touch on stuff like deleting a post because it contains key words. Like all
    these that have the word "wholesale" in the title. So what are some better
    examples of actions to use to kill the spam with?
    D Pigeon, Sep 8, 2009
    #1
    1. Advertising

  2. D Pigeon wrote:

    > Hi all. I'm just trying out 40tude dialog for the first time and want to
    > know how da heck do you get rid of the crap spam like in this group?
    > The examples given in the action dialog box are basicaly a joke.


    I thought they were rather good ...

    > In Forte Agent I can easily set a filter and wipe out the spam with a
    > click. In 40tude, it seems like nothing is happening. The dialog box
    > doesn't even touch on stuff like deleting a post because it contains
    > key words. Like all these that have the word "wholesale" in the
    > title. So what are some better examples of actions to use to kill the
    > spam with?


    I assume the spam you mean is coming from Google Groups, since I don't
    see any spam in this group, and filtering on specific words in the
    subject seems like too much work.

    Add this to your score file:

    [*]
    # Pick a colour to highlight GG posts
    !setcolor(default;$c0ffc0) Message-ID +googlegroups
    # Mark them as read and don't download bodies, but they can
    # still be seen by pressing Control-F1 (toggle Control-F2)
    !markread Message-ID googlegroups.com

    Also see this:
    http://twovoyagers.com/improve-usenet.org/

    --
    -bts
    -Friends don't let friends drive Windows
    Beauregard T. Shagnasty, Sep 8, 2009
    #2
    1. Advertising

  3. D Pigeon

    VanguardLH Guest

    D Pigeon wrote:

    > Hi all. I'm just trying out 40tude dialog for the first time and want to
    > know how da heck do you get rid of the crap spam like in this group?
    > The examples given in the action dialog box are basicaly a joke. In Forte
    > Agent I can easily set a filter and wipe out the spam with a click. In
    > 40tude, it seems like nothing is happening. The dialog box doesn't even
    > touch on stuff like deleting a post because it contains key words. Like all
    > these that have the word "wholesale" in the title. So what are some better
    > examples of actions to use to kill the spam with?


    Settings -> General Settings -> Misc
    Enable: Watch/Ignore works on subthreads

    This will mark the entire [sub]thread as Ignored when you flag a post as
    ignored. This will eliminate seeing any replies to the unwanted posts.

    Group -> Message Views
    Pick (or define) a view that hides Ignored posts.

    You don't want to delete unwanted posts in your rules. Deletion only
    gets rid of the matching posts. Replies to them will show up. Since
    you probably don't want to see the replies to the unwanted posts, ignore
    those posts, use the option to hide all posts in that subthread, and use
    a view to hide the ignored posts.

    I would suggest adding toolbar buttons to switch between views (rather
    than having to navigate to the Group -> Message Views menu and pick one
    from that list). I have toolbar buttons that select between the
    following views:

    - Show Watched Posts (see note 1)
    - Show All Posts (see note 2)
    - Hide Ignored Posts (only needed if I used Show All Posts)
    - Show Unread Non-Ignored Posts (I defined this view)

    Note 1: Unlike Outlook Express, Dialog has no means of sorting the
    headers list so the watched threads appear at the top of the list. This
    was a failing criteria for Dialog in many trials I made of various
    newsreaders. Not until I took the time to look at the pre-defined
    scripts that could modify Dialog's behaviors and figure out how to
    easily switch views did I decide to continue using it. I flagged
    threads as Watched for a reason, and I want those posts to appear at the
    top of the list to give them priority. Can't do that in Dialog but I
    can easily use toolbar buttons to switch views to show only the Watched
    threads.

    Note 2: Besides allowing Dialog to track replies to unwanted posts (by
    not deleting the unwanted post but ignoring and hiding it along with any
    replies), there may be times when I need to see all posts in a thread.
    I can't do that (unless I reset the group to re-retrieve all articles)
    if I delete unwanted posts. So instead I ignore them and hide them, but
    if I need to see them then I can just switch the view. Someone might
    make reference to a post that I've ignored and hidden and I need to see
    what was said there if the respondent didn't quote enough of it.

    In your rules, don't delete but instead ignore and use a view that hides
    ignored posts. Below is a partial listing of my rules. I didn't
    include blacklists of unwanted posters or posts that name them (flames)
    because everyone needs to compile their own list of trolls, malcontents,
    peuriles, or whomever they don't want to see. Some unwanted posters
    inhabit so many groups that they get ignored across all groups. Some
    inhabit just one or two groups so I just ignore them there. When
    defining a rule to killfile a poster, be as specific as you can to avoid
    inadvertently tagging someone who happens to match on your less specific
    rule and who isn't the one you were trying to ignore. Alas, you'll find
    the limited set of [overview] headers that get normally downloaded to
    provide insufficient filtering criteria for you to uniquely identify an
    unwanted poster. To that end, I configured Dialog to also download the
    bodies of the articles:

    Group -> Default Group Options -> Retrieving
    Enable: Retrieve bodies for all new messages

    I use the default group options in all the groups to which I subscribe.
    You can set group options that are specific to just one group but I
    haven't needed or wanted to use that yet. By downloading the bodies of
    the messages, I get ALL the headers for them. That means I can define
    rules that can test against ANY header, not just the overview headers.
    However, downloading the bodies takes more time. I only visit text
    groups so downloading their bodies doesn't take that long (except when I
    first visit the group and elect to download all messages). If you
    subscribe to binary groups, forget about downloading their bodies since
    that means you are downloading all the content (files) they attached to
    those posts and you'll be waiting near forever. That I download the
    bodies of the posts which gives me access to ALL headers is why some of
    my rules below won't work for you if all you retrieve are the overview
    headers. To see which are the overview headers from your NNTP server:

    telnet <servername> 119
    [user <username>]
    [pass <password>]
    list overview.fmt
    quit

    The optional (bracketed) commands above will be needed if you connect to
    an NNTP server that requires you to login. If you don't configure
    Dialog to download the bodies of the messages (so all headers are
    available), you will have to remove any of my rules that use
    non-overview headers.

    You'll have to judge for yourself which of my rules you will adopt and
    if want the same actions committed on the matching posts. For some,
    like identifying your own posts, you obviously need to edit that rule to
    specify your own moniker (provided you use a unique one so only your
    posts get tagged).

    I ignore posts made through remailers as I often find those posters spew
    content in which I'm not interested in seeing (and the same for anything
    issued from gabrix). For some sources from which spews much unwanted
    content, I just colorize them but do not ignore them. I ignore Google
    Groupers due to the spam that spews from there along with the general
    lack of intelligence from those posters; except I only colorize them in
    the microsoft.* groups since the GG spam is much less a problem there.
    So I first dimly color all Google Groupers and then later ignore them if
    NOT in a microsoft.* group. I colorize posts made by forum-to-Usenet
    gateway users because they fall into the same lackwit category as Google
    Groupers.

    You WILL have to learn some rules of regular expressions to understand
    how the conditions are defined. I removed the tabs in my rules which
    were there to columnize the actions, location, and condition sections of
    each rule to make it easier for me to read. The tabs might not format
    here as columnar data.

    Dialog rules:
    ____________________________________________________________

    ## For all groups:
    [*]
    #
    # Delete newly retrieved posts over 15 days old (same value as the default group Purge option).
    !delete Age %>15
    # Ignore posts over 20KB in size.
    !ignore,markread Bytes %>20000
    # Colorize my posts, mark them as read, and retrieve them
    !setcolor(teal;white),markread,retrieve Header {^From:.*\bVanguardLH <V@nguard\.LH>}
    #
    # Dim posts through Google Groups.
    !setcolor(gray;white) Message-ID {<.+\.googlegroups\.com>}
    # Color posts through Microsoft's webnews interface.
    !setcolor(navy;InfoBk) Header {^X-Newsreader: Microsoft CDO}
    # Warn of attempts to include unwanted newsgroups.
    !setcolor(yellow;red),ignore,markread Header {^(Newsgroups|FollowUp-To):.*\b(2600|kook|warez|test(|en)\b)}
    #
    ## Rules global to all newsgroups.
    #
    # Ignore someone trying to yank the discussion out to e-mail or cull e-mail addresses.
    !setcolor(silver;white),ignore,markread Header {^Followup-To:.*\bposter$}
    !setcolor(silver;white),ignore,markread Header {^Mail-Copies-To:.*$}
    # Ignore posts where Subject has no vowels.
    !setcolor(gray;white),ignore,markread Subject {(^Re:|^)[^aeiouy]*$}
    # Ignore posts with objectionable words in the Subject.
    !setcolor(yellow;white),ignore,markread Subject {\b(s|f)uck|\bshit|\bnigger|\bpersecut(e|ion)|\boperation sudden fall|\ba(ss|$$)h(o|0)le|\barse\b|\bracis|\bkook|\bbastard|\bsmegma}
    # Ignore religious posts.
    !setcolor(yellow;white),ignore,markread Subject {\breligio(n|us)|\bm(o|u)hamm?(a|e)d|\bmuslim|\bislam(|ic)|\bJesus|\bOur Lord|Christ(|ian(s|ity))\b|\bscientol|\bJehovah|\bGod\b|\bQuran|\bKoran|\bchristmas|\bxmas\b|\bNew Year|\bHappy Holiday}
    # Ignore pornographic posts.
    !setcolor(yellow;white),ignore,markread Subject {\bp(o|0)rn|\bwhore|\bslut|\bnude(e|i|y)|\bmast(u|e)rbat|\bsex|\bh(o|0)t girl|\bcum(\b|s|shot|ming)|\creampie|\b(hors|dog).*\bdick|\bpussy|\btwink|\bnaughty.*\bgirl|l(o|0)lita|(\b|pre(|-))teen|\bx.?rate|\bceleb}
    # Ignore political posts.
    !setcolor(yellow;white),ignore,markread Subject {\bobama|\bpres*.\belection|\bclinton|\bmccain|\bpolitic|\bcampaign|\bdemocrat|\breplublic|\bgovernment|\bgovt}
    # Delete pirating posts.
    !setcolor(yellow;white),ignore,markread Subject {\bware?z|\bcrackware|\bpira(c|t)|\bkeygen}
    #
    # Ignore posts with questionable words in the poster's name.
    !setcolor(maroon;white),ignore,markread Header {^From:.*(\bcocksuck|****|\bshit|bollocks|\bDouchebag|\bpissing|\b(i|1)d(i|1)(o|0)t)|\ba(|ss|-)hole|\bPromiscuous|\bSlut|\bNet( |)Cop|\bFormerly}
    #
    # Delete spam posts.
    !setcolor(yellow;white),ignore,markread Subject {\bshoes(\b|$)|\bsneakers(\b|$)|\breplica(\b|$)|\b(swiss|chrono|diamond|mens|womens|ladies|discount|fashion).*\b(|wrist)watch(|es)\b|\bTag Heuer(\b|$)|\bwatch(|es).*discount|\bpaypal(\b|$)|\bwholesale(\b|$)|\bfamous.*brand(|name)(\b|$)}
    !setcolor(yellow;white),ignore,markread Subject {\bshirts(\b|$)|\bair jordan|\bdollars(\b|$)|\bcash[^e]|\b\$.*(day|month|buy|sell)(\b|$)|\bfor sale(\b|$)|\bkeygen|\bshopp(er|ing)|\bpric(es?|ing|less)\b|\$\$\$|\bbarcelon(a|e)|\badidas|\bnike\b|\bwristwatch|\bgucci}
    !setcolor(yellow;white),ignore,markread Subject {\b(earn|make|save).*\$|\bmoney|\bwealth|\bwin a new|\bdiscount|\b(online|bad) credit(\b|$)|\bmortgag|\bantique|\bspecial offer|\bviagra|\bcredit.*\breport|<<<|>>>|store\.(com|net|biz|us)\b|handbag}
    !setcolor(yellow;white),ignore,markread From {\bshop(\b|p)|\bbagsbags|\bhire2hack|wantsex}
    #
    # Warn of FollowUp-To posts
    !setcolor(fuchsia;white) Header {^FollowUp-To:}
    # Warn of posts using the X-No-Archive header
    !setcolor(purple;white) Header {^X-No-Archive:.*yes$}
    #
    # Ignore anonymous posts through remailers.
    !setcolor(red;white),ignore,markread Header {^Path:.+(!mail2news$|\.mixmin\.net(!not-for-mail|$)|!mail2news\.nymu\.eu$)}
    # Warn of posts through Altopia (many are from trolls).
    !setcolor(red;white),markread Header {^Path:.+\!news\.alt\.net($|\!not-for-mail)}
    # Warn of posts through talkaboutcomputing.com (probably spam).
    !setcolor(red;white),markread Message-ID {<.+@.+\.talkaboutcomputing\.com>}
    # Warn of posts through usenet(4|7)all.se (probably trolls).
    !setcolor(red;white),markread Message-ID {<.+@.+\.usenet.+all\.se>}
    # Warn of posts through dimonic.com (probably spam).
    !setcolor(red;white),markread Header {^NNTP-Posting-Host:.*\.dimenoc\.com}
    # Spam/troll server.
    !setcolor(red;white),ignore,markread Header {^NNTP-Posting-Host:.*\.usenetnow\.com}
    !setcolor(red;white),ignore,markread Header {^Path:.+!.+\.gabrix\.ath\.cx(|!not-for-mail)$}
    #
    # Warn of posts from a forum gateway to Usenet
    !setcolor(lime;InfoBk) Header {^X-FUDforum:}
    !setcolor(lime;InfoBk) Message-ID {<.+@pcbanter\.net>}
    !setcolor(lime;InfoBk) Header {^User-Agent:.*(gateway|NewsPortal)}
    # Ignore excessively cross-posted messages
    !setcolor(aqua;white),ignore,markread XPost %>4
    # Ignore posts where the name in From header is all non-alphanumeric
    !setcolor(aqua;white),ignore,markread From {^[^a-z0-9]+(<.*>.*)?$}
    # Ignore test posts not from me.
    !setcolor(aqua;white),ignore,markread Subject {^(|Re: )test} -@From:{\bVanguardLH}
    #
    # Ignore threads by unwanted posters (in all groups).
    .... make your own list here ...
    #
    ## Rules that apply to all groups except for those specified.
    [* -{^microsoft\.(public|private)\..*}]
    # Ignore posts through Google Groups.
    !setcolor(silver;white),ignore,markread Message-ID {<.+\.googlegroups\.com>}
    #
    ## Rules local to only the specified newsgroup.
    #
    [24hoursupport.helpdesk]
    .... make your own list here (vast number of spam and trolls here) ...
    #
    [alt.comp.freeware]
    .... make your own list here (lots of trolls here) ...
    #
    [alt.free.newsservers]
    .... make your own list here (bickering users here) ...
    #
    [{^microsoft\.public\..*}]
    .... make your own short list here (only a few trolls here) ...
    #
    [microsoft.public.windowsxp.hardware]
    .... make your own list here (only a couple here) ...
    #
    [microsoft.public.windows.vista.general]
    .... make your own list here (way too many here) ...
    #
    [{^.+\.test$}]
    # Ignore all posts in test groups but mine:
    !setcolor(silver;white),ignore,markread Header -{^From:.*\bVanguardLH <V@nguard\.LH>}

    ____________________________________________________________

    If you need more help (the above will probably swamp you for awhile,
    especially in having to learn regex if not already familiar with it),
    you might want to ask for further help in the following newsgroup:

    news.software.readers
    VanguardLH, Sep 8, 2009
    #3
  4. D Pigeon

    D Pigeon Guest

    On Tue, 8 Sep 2009 17:36:47 -0500, VanguardLH wrote:

    > D Pigeon wrote:
    >
    >> Hi all. I'm just trying out 40tude dialog for the first time and want to
    >> know how da heck do you get rid of the crap spam like in this group?
    >> The examples given in the action dialog box are basicaly a joke. In Forte
    >> Agent I can easily set a filter and wipe out the spam with a click. In
    >> 40tude, it seems like nothing is happening. The dialog box doesn't even
    >> touch on stuff like deleting a post because it contains key words. Like all
    >> these that have the word "wholesale" in the title. So what are some better
    >> examples of actions to use to kill the spam with?

    >
    > Settings -> General Settings -> Misc
    > Enable: Watch/Ignore works on subthreads
    >
    > This will mark the entire [sub]thread as Ignored when you flag a post as
    > ignored. This will eliminate seeing any replies to the unwanted posts.
    >
    > Group -> Message Views
    > Pick (or define) a view that hides Ignored posts.
    >
    > You don't want to delete unwanted posts in your rules. Deletion only
    > gets rid of the matching posts. Replies to them will show up. Since
    > you probably don't want to see the replies to the unwanted posts, ignore
    > those posts, use the option to hide all posts in that subthread, and use
    > a view to hide the ignored posts.
    >


    I want to delete the spam posts as most people don't reply to them anyway.
    So what is the proper method of doing this? In the examples, they do not
    show what characters to use to do this or that with. Say I want the subject
    that contains the word "wholesale" anywhere in the line to be deleted. How
    is that done exactly?
    And even if some idiot did reply, why couldn't you simply add a second line
    that includes "Re: wholesale"?
    D Pigeon, Sep 9, 2009
    #4
  5. D Pigeon <> pinched out a steaming pile
    of<m71bwdzlt3ws.qmzse6o5u2xt$>:

    >On Tue, 8 Sep 2009 17:36:47 -0500, VanguardLH wrote:
    >
    >> D Pigeon wrote:
    >>
    >>> Hi all. I'm just trying out 40tude dialog for the first time and

    want to
    >>> know how da heck do you get rid of the crap spam like in this

    group?
    >>> The examples given in the action dialog box are basicaly a joke. In

    Forte
    >>> Agent I can easily set a filter and wipe out the spam with a click.

    In
    >>> 40tude, it seems like nothing is happening. The dialog box doesn't

    even
    >>> touch on stuff like deleting a post because it contains key words.

    Like all
    >>> these that have the word "wholesale" in the title. So what are some

    better
    >>> examples of actions to use to kill the spam with?

    >>
    >> Settings -> General Settings -> Misc
    >> Enable: Watch/Ignore works on subthreads
    >>
    >> This will mark the entire [sub]thread as Ignored when you flag a

    post as
    >> ignored. This will eliminate seeing any replies to the unwanted

    posts.
    >>
    >> Group -> Message Views
    >> Pick (or define) a view that hides Ignored posts.
    >>
    >> You don't want to delete unwanted posts in your rules. Deletion

    only
    >> gets rid of the matching posts. Replies to them will show up.

    Since
    >> you probably don't want to see the replies to the unwanted posts,

    ignore
    >> those posts, use the option to hide all posts in that subthread, and

    use
    >> a view to hide the ignored posts.
    >>

    >
    >I want to delete the spam posts as most people don't reply to them

    anyway.
    >So what is the proper method of doing this? In the examples, they do

    not
    >show what characters to use to do this or that with. Say I want the

    subject
    >that contains the word "wholesale" anywhere in the line to be deleted.

    How
    >is that done exactly?
    >And even if some idiot did reply, why couldn't you simply add a second

    line
    >that includes "Re: wholesale"?
    >


    I'd suggest you ask your question in the appropriate newsgroup, mate.
    Xpoasted for you, no charge.

    ^_^

    --
    http://www.youtube.com/watch?v=COaoYqkpkUA
    cageprisoners.com|www.snuhwolf.9f.com|www.eyeonpalin.org
    _____ ____ ____ __ /\_/\ __ _ ______ _____
    / __/ |/ / / / / // // . . \\ \ |\ | / __ \ \ \ __\
    _\ \/ / /_/ / _ / \ / \ \| \| \ \_\ \ \__\ _\
    /___/_/|_/\____/_//_/ \_@_/ \__|\__|\____/\____\_\
    §ñühw¤£f, Sep 9, 2009
    #5
  6. D Pigeon

    D Pigeon Guest

    On Wed, 9 Sep 2009 10:17:40 -0500, VanguardLH wrote:

    > D Pigeon wrote:
    >
    >> I want to delete the spam posts as most people don't reply to them anyway.
    >> So what is the proper method of doing this? In the examples, they do not
    >> show what characters to use to do this or that with. Say I want the subject
    >> that contains the word "wholesale" anywhere in the line to be deleted. How
    >> is that done exactly?
    >> And even if some idiot did reply, why couldn't you simply add a second line
    >> that includes "Re: wholesale"?

    >
    > See the section titled "# Delete spam posts." in the list of my rules in
    > my prior (first) reply. Sorry, but apparently the lines got wrapped
    > which I was trying to avoid.
    >
    > If you're looking for "wholesale" in the Subject header, you don't care
    > if "Re:" is there or not. A rule based on the Subject will still get
    > the replies as long as the respondent doesn't change the Subject.
    >
    > By the way, "wholesale" is one of the keywords that I test for in my
    > spam rules. I look for it within word boundaries (spaces, tabs,
    > start/end of line, or other non-alphanumeric characters). That's why it
    > appears as "\bwholesale\b". \b means a word boundary (actually it means
    > a transition from non-alphanumeric character to an alphanumeric
    > character versus /B which means a transition from alphanumeric or
    > non-alphanumeric). If you want to write rules in Dialog or any NNTP
    > client that supports regex then you'll need to learn regular expression
    > syntax. You could omit regex but then you might match on something
    > unintended.
    >
    > http://www.google.com/search?q=%2Blearn+%2B"regular+expressions"



    Thank You. I copied your example and tried it out. This time when I loaded
    the headers 40tude was showing me it was working on the scoring and zapped
    the spam.
    D Pigeon, Sep 9, 2009
    #6
    1. Advertising

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. Boomer

    "40tude Dialog Beta 29 available" FYI

    Boomer, Oct 11, 2003, in forum: Computer Support
    Replies:
    4
    Views:
    455
    Boomer
    Oct 12, 2003
  2. richard

    40tude dialog not saving groups

    richard, Nov 24, 2007, in forum: Computer Support
    Replies:
    1
    Views:
    513
    Mike Easter
    Nov 24, 2007
  3. richard
    Replies:
    0
    Views:
    479
    richard
    Oct 14, 2008
  4. OldGringo38

    40tude Dialog

    OldGringo38, Jan 10, 2010, in forum: Computer Support
    Replies:
    12
    Views:
    562
    OldGringo38
    Jan 11, 2010
  5. richard

    40tude dialog header filters

    richard, Oct 11, 2010, in forum: Computer Support
    Replies:
    19
    Views:
    671
    John Holmes
    Oct 12, 2010
Loading...

Share This Page