Resend my activation email : Register : Log in 
BCF: Bike Chat Forums


Getting recent mail from pop3 server with >100k messages?

Reply to topic
Bike Chat Forums Index -> The Geek Zone
View previous topic : View next topic  
Author Message

G
The Voice of Reason



Joined: 02 Feb 2002
Karma :

PostPosted: 14:49 - 27 Nov 2009    Post subject: Getting recent mail from pop3 server with >100k messages? Reply with quote

Looking to get a specific email from my pop3 server, sent in the last few days (or so I hope, it may not have been sent). This is one I haven't used for a while and has over 100,000 emails on it, mostly spam of course.

I've tried gmail, but it says too many messages.
My normal webmail can't seem to hack it.

I can telnet into it (some of the time), but it seems pop commands are rather limited.
It seems you can only retrieve a single message at a time, so, so far the only option seems to be to retrieve the messages by requesting them one at a time. I can dump the output to a file and search through that, but it's far from ideal.
 Back to top
View user's profile Send private message You must be logged in to rate posts

Alexio
World Chat Champion



Joined: 27 Aug 2009
Karma :

PostPosted: 15:03 - 27 Nov 2009    Post subject: Reply with quote

That's rather unlucky. If it were me that's what I would do, dump them to file and search. Surely that isn't much different from finding a computer to download the emails to and then use an email client to do the searching through anyway?
____________________
will never give up his CG. I look at my fuel gauge more as a progress bar than a fuel gauge.
G: With my GSXR I do often effectively use it as a scooter with a clutch in town.
ms51ves3: why does it need 500 miles? Are you teaching it how to be a piston?
 Back to top
View user's profile Send private message You must be logged in to rate posts

G
The Voice of Reason



Joined: 02 Feb 2002
Karma :

PostPosted: 15:18 - 27 Nov 2009    Post subject: Reply with quote

But generally email clients will start from the beginning of the list - I want it to start from the end, to avoid getting the last year's worth of spam too!
Because you can only download one email at a time, I'd have to write the commands out to download each email individually. I'm not sure how well it caches commands either, though doing three at once did seem to provide three emails, however entering login credentials as one failed.
Unfortunately I can't get back in now, as it's saying 'lock. Mailbox in use' (I presume this is incoming mail).
 Back to top
View user's profile Send private message You must be logged in to rate posts

Alexio
World Chat Champion



Joined: 27 Aug 2009
Karma :

PostPosted: 15:24 - 27 Nov 2009    Post subject: Reply with quote

I admit pop servers I have never delt with before, but by dump to file I was thinking along the lines of having file system access to the database files where the emails are stored and then searching through - like, literally through the file for ASCII etc as if it were a binary file. I don't know how practical that would be but that would be the pro's way Wink

Otherwise, it sounds fairly straight forward to sync an email client, it might just take some time?
____________________
will never give up his CG. I look at my fuel gauge more as a progress bar than a fuel gauge.
G: With my GSXR I do often effectively use it as a scooter with a clutch in town.
ms51ves3: why does it need 500 miles? Are you teaching it how to be a piston?
 Back to top
View user's profile Send private message You must be logged in to rate posts

panrider_uk
World Chat Champion



Joined: 23 Sep 2007
Karma :

PostPosted: 15:26 - 27 Nov 2009    Post subject: Reply with quote

Can you access it via imap instead of pop?

Mark
____________________
Current bikes: Honda ST1100 Pan European. Moto Guzzi V85 TT Travel
 Back to top
View user's profile Send private message You must be logged in to rate posts

Bendy
Mrs Sensible



Joined: 10 Jun 2002
Karma :

PostPosted: 15:51 - 27 Nov 2009    Post subject: Reply with quote

I'd use a client, set it to only get the headers and let it chug over the weekend. You can then delete all the old crap off the server too.
 Back to top
View user's profile Send private message You must be logged in to rate posts

G
The Voice of Reason



Joined: 02 Feb 2002
Karma :

PostPosted: 16:03 - 27 Nov 2009    Post subject: Reply with quote

Alexio - have been reminded I do have file system access, so am doing that now. My tail | grep is taking rather a long time, but as it’s almost a 900mb file it’s also going to be a bit of time to download and do it locally too.
It’s actually basically stored in a single text file, so easy to manipulate, but not the fastest – a ‘proper’ database would make it a lot easier.

Panrider – pretty sure I can’t.

Yea, could do Bendy and will resort to that if all else fails.

Any suggestions on better text searching commands than a combo of tail and grep, or a command line email client with more options than PINE ?
 Back to top
View user's profile Send private message You must be logged in to rate posts

Alexio
World Chat Champion



Joined: 27 Aug 2009
Karma :

PostPosted: 16:13 - 27 Nov 2009    Post subject: Reply with quote

G wrote:
Any suggestions on better text searching commands than a combo of tail and grep, or a command line email client with more options than PINE ?


https://www.unix.com/shell-programming-scripting/119628-alternative-grep.html

Question
____________________
will never give up his CG. I look at my fuel gauge more as a progress bar than a fuel gauge.
G: With my GSXR I do often effectively use it as a scooter with a clutch in town.
ms51ves3: why does it need 500 miles? Are you teaching it how to be a piston?
 Back to top
View user's profile Send private message You must be logged in to rate posts

G
The Voice of Reason



Joined: 02 Feb 2002
Karma :

PostPosted: 17:14 - 27 Nov 2009    Post subject: Reply with quote

Now sorted, ta for the thoughts all Thumbs Up.
Tail wasn't working due to a 'picnic' situation - plenty fast enough when I did it right Smile.
Ended up just tail'ing it, finding the line numbers of the last dates I wanted and copying it locally from the terminal window.
 Back to top
View user's profile Send private message You must be logged in to rate posts

bazza
World Chat Champion



Joined: 27 Aug 2004
Karma :

PostPosted: 22:45 - 27 Nov 2009    Post subject: Reply with quote

For future reference - Fetchmail.
____________________
"That's it. You people have stood in my way long enough. I'm going to clown college."
'98 Ducati 750SS, '08 Suzuki GSX650F ©2004-2014, Bazza's Harmless Banter
 Back to top
View user's profile Send private message You must be logged in to rate posts

G
The Voice of Reason



Joined: 02 Feb 2002
Karma :

PostPosted: 22:59 - 27 Nov 2009    Post subject: Reply with quote

Cheers, though a quick scan doesn't reveal that it can retrieve messages from the end first, or from a specific date. However, quite possible it's in there as there's lots of info/configuration options.
No doubt it would have got mail quicker that outlook or whatever regardless.
 Back to top
View user's profile Send private message You must be logged in to rate posts
Old Thread Alert!

The last post was made 16 years, 305 days ago. Instead of replying here, would creating a new thread be more useful?
  Display posts from previous:   
This page may contain affiliate links, which means we may earn a small commission if a visitor clicks through and makes a purchase. By clicking on an affiliate link, you accept that third-party cookies will be set.

Post new topic   Reply to topic    Bike Chat Forums Index -> The Geek Zone All times are GMT + 1 Hour
Page 1 of 1

 
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Read the Terms of Use! - Powered by phpBB © phpBB Group
 

Debug Mode: ON - Server: birks (www) - Page Generation Time: 0.07 Sec - Server Load: 1.36 - MySQL Queries: 17 - Page Size: 71.58 Kb