After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 107530 - Mass Leech Mode
Mass Leech Mode
Status: RESOLVED WONTFIX
Product: Pan
Classification: Other
Component: general
pre-1.0 betas
Other Linux
: Normal enhancement
: 1.0
Assigned To: Charles Kerr
Pan QA Team
: 80959 403626 (view as bug list)
Depends on:
Blocks:
 
 
Reported: 2003-03-04 07:29 UTC by cpaludan
Modified: 2015-05-15 07:07 UTC
See Also:
GNOME target: ---
GNOME version: Unversioned Enhancement


Attachments
automatically download watched articles (2.86 KB, patch)
2006-07-09 05:42 UTC, Kenneth Haley
none Details | Review
adds command line option (6.19 KB, patch)
2006-07-29 03:26 UTC, Kenneth Haley
none Details | Review
yet another version (7.00 KB, patch)
2006-07-29 07:17 UTC, Kenneth Haley
none Details | Review
update to .106 (6.84 KB, patch)
2006-08-03 06:55 UTC, Kenneth Haley
none Details | Review
updated to .110 (7.00 KB, patch)
2006-08-27 23:42 UTC, Kenneth Haley
none Details | Review
updated to .111 (7.01 KB, patch)
2006-09-04 06:16 UTC, Kenneth Haley
none Details | Review

Description cpaludan 2003-03-04 07:29:57 UTC
It would be nice if one could select all the subscribed groups in the
group pane, right click and choose Save Article as/Save attachment as.
That way one would not have to open each group independently, select
all  and then save......
The selected filter options should be applied here as well ;)
Comment 1 Charles Kerr 2003-03-04 13:13:34 UTC
Sounds like what would really be good for this kind
of use is Pan without a GUI, no?
Comment 2 cpaludan 2003-03-05 09:54:25 UTC
That might be an option, yes. Sometimes I like to be able to track the progress though - and here the GUI is a nice thing ;)
Comment 3 Charles Kerr 2006-05-16 21:17:37 UTC
Man, I wonder how many people actually use Pan this way --
I think people who want to download entire groups would 
want to automate everything.

IMO this doesn't have much to do with the group pane.

The C++ rewrite has an option for Pan to start up without the
main window at all, but just show the task manager window.

Maybe a startup command-line argument could be passed in to
leech everything down from the subscribed newsgroups.
Comment 4 Kenneth Haley 2006-05-28 08:38:45 UTC
I can see two options here.

1. An preference that tells pan to automatically download any article with a score>0

2. A second scorefile that tells pan which articles to download

Both would be used whenever pan get new overviews whether from a gui command or from the command line.  This would allow pan to be run automatically several times a day to get all the pieces of multiparts.
Comment 5 Charles Kerr 2006-07-06 07:34:05 UTC
*** Bug 80959 has been marked as a duplicate of this bug. ***
Comment 6 Kenneth Haley 2006-07-09 05:42:55 UTC
Created attachment 68652 [details] [review]
automatically download watched articles

This is a start at making pan cron-able.  As each xover task completes, it queues up all watched & unread articles for download.  Two prefs are still needed, one to enable this function & the other to set the minimum score.

Getting the Data, ArticleCache, & Queue like this is definitley a hack.

Aside from the prefs two other things would be needed to finish this.
1. a command line option to retreive new headers from subscribed groups.
2. ipc, possibly named pipes, so that one instance of pan wont step on another.  Perhaps the new instance would add its tasks to the previous instances queue.
Comment 7 Kenneth Haley 2006-07-29 03:26:08 UTC
Created attachment 69859 [details] [review]
adds command line option

This patch updates the previous one to work with .105.  It also adds a command line option "--headers" to automatically retreive the headers.  This function just like nzb support including the --gui option.  Also the code for queueing subscribed groups & watched articles has been moved into a separate file.

At this point all thats left is to add prefs & gui as well as some means to keep multiple instances of pan from stepping on each other.
Comment 8 Kenneth Haley 2006-07-29 07:17:18 UTC
Created attachment 69863 [details] [review]
yet another version

This version fixes a nagging problem with pan not exiting when there are no more tasks.  I've added a timeout to kill pan when athe queue is empty.  I figured there was no need to check more than once every 2 seconds.  This applies to both my new headers command and to nzb files.
Comment 9 Kenneth Haley 2006-08-03 06:55:41 UTC
Created attachment 70113 [details] [review]
update to .106
Comment 10 Kenneth Haley 2006-08-27 23:42:24 UTC
Created attachment 71728 [details] [review]
updated to .110

Decided it was time to update the patch again. Also added an option to get all headers instead of just new headers.
Comment 11 Kenneth Haley 2006-09-04 06:16:54 UTC
Created attachment 72178 [details] [review]
updated to .111
Comment 12 Charles Kerr 2007-02-02 16:31:43 UTC
*** Bug 403626 has been marked as a duplicate of this bug. ***
Comment 13 Duncan 2007-02-03 12:15:20 UTC
Does this download to cache or save the files?  I work from cache to save the files, so would prefer download to cache, so I can avoid that step interactively.

Of course, an option for both would be nice, too, but that's more work, and the ability to work offline shouldn't actually require saving the attachments directly...

Something else to think about... if this is to cache, perhaps a GUI option to set the already implemented config file cache size option might be wise.  10MB won't go far if this is activated to cache, and a gui-only user could end up quite disappointed if he ends up coming back to find only a handful of fragments cached...

If it's decode and save attachments, does it use the pan-global save default location or the per-group locations, or does it pop-up Darren's?? recent NZB save dialog?

Mainly, I was just going to add myself to the CC, but once I started thinking about it, all the above came up. =8^)

Duncan
Comment 14 Charles Kerr 2007-02-04 02:49:54 UTC
It looks like the patch currently just caches the articles, however the
option to decode definitely needs to be a part of this equation if we're
talking about having console-based leeching.

Probably the first step would be to take a survey of BNR2, 
nzbperl, hellanzb, NewsBin Pro, Newsleecher, to see what
options they provide for managing bulk downloads.