automating wget

investmentbnker75 · 09-23-2008, 03:03 PM

I am using a script with wget to get files off a server and put them in a directory on my server. I have two questions:

1. Does anyone know of an option i can add to this script to delete the files on the remote server after wget runs?

2. Does anyone know how i can create the same script on the remote server to put the files on the dest. server with wget. Then i can just add a line to rm the files.

Here is what i have on the dest server that automates wget.

#!/bin/sh

cd /home/userid/
wget ftp://user

asswd@remoteIP:21/*.tgz

billymayday · 09-23-2008, 04:31 PM

For (2) you could look into some type of ftp agent, but I can't recommend one in particular.

Is there some reason why you couldn't use something like rsync in its place?

investmentbnker75 · 09-23-2008, 09:45 PM

Too much to set up. I have the wget script written, i just am looking for that last line to do the delete.

timothyb89 · 09-23-2008, 10:23 PM

Try the wget option --remote-delete
It looks like it was added in 2007, so any recent version of wget should have it.

Edit: looks like my wget doesn't have it. If yours doesn't and you have SSH access to the machine, you might try running RM remotely, for example:
ssh user@host "rm /path/to/directory/*.tgz"

AuroraCA · 09-23-2008, 10:28 PM

'wget --delete-after' will delete a file or files after download

see: http://www.gnu.org/software/wget/man...getrc-Commands

investmentbnker75 · 09-24-2008, 07:33 AM

Aurora read the man page before making a suggestion like that, that option only works on the local machine not the remote...newbies

AuroraCA · 09-24-2008, 07:43 AM

investmentbnker75

Read my post more carefully. I made a correction to my post well before your scolding post which points this out.

Watch your Internet manners.