adrepec@aigtu:~/opt/var/remi$ ~/perl/mirror4remi.pl mirror_a_per package=per all.repec.org:21/pub/RePEc/per -> /home/adrepec/RePEc/remo/per Cannot get remote directory listing because: 500 Illegal PORT command. Cannot get remote directory details (/pub/RePEc/per) Here is the mirror file as generated by remi package=per # our hostname hostname=nep.repec.org # the site we wish to mirror from site=all.repec.org remote_dir=/pub/RePEc/per # Keep all local_dirs relative to here local_dir=/home/adrepec/RePEc/remo/per # get this get_patt= # but not directories starting with underscore (Frontpage) exclude_patt=^_.+/|/_vti_.+/ remote_password=krichel@openlib.org # Don't mirror file modes. Set all dirs/files to these dir_mode=0755 file_mode=0644 # By defaults files are owned by root.zero do_deletes=true # some more defaults max_delete_files=100% max_delete_dirs=100% timeout=300 # this is needed with sites that do not support recursive directory listings # slows down things a little bit recurse_hard=true # security fix name_mappings=s:\.\./:__/:g -- Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel
Sune has no problem: https://econpapers.repec.org/remilogs/mirror_a_per.tmp.log Christian Zimmermann FIGUGEGL! Economic Research Federal Reserve Bank of St. Louis P.O. Box 442 St. Louis MO 63166-0442 USA https://ideas.repec.org/zimm/ @CZimm_economist On Sat, 3 Oct 2020, Thomas Krichel wrote:
adrepec@aigtu:~/opt/var/remi$ ~/perl/mirror4remi.pl mirror_a_per package=per all.repec.org:21/pub/RePEc/per -> /home/adrepec/RePEc/remo/per Cannot get remote directory listing because: 500 Illegal PORT command. Cannot get remote directory details (/pub/RePEc/per)
Here is the mirror file as generated by remi
package=per # our hostname hostname=nep.repec.org # the site we wish to mirror from site=all.repec.org remote_dir=/pub/RePEc/per # Keep all local_dirs relative to here local_dir=/home/adrepec/RePEc/remo/per # get this get_patt= # but not directories starting with underscore (Frontpage) exclude_patt=^_.+/|/_vti_.+/ remote_password=krichel@openlib.org # Don't mirror file modes. Set all dirs/files to these dir_mode=0755 file_mode=0644 # By defaults files are owned by root.zero do_deletes=true # some more defaults max_delete_files=100% max_delete_dirs=100% timeout=300 # this is needed with sites that do not support recursive directory listings # slows down things a little bit recurse_hard=true # security fix name_mappings=s:\.\./:__/:g
--
Cheers,
Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel
_______________________________________________ RAS-run mailing list RAS-run@lists.openlib.org http://lists.openlib.org/cgi-bin/mailman/listinfo/ras-run
Christian Zimmermann writes
Sune has no problem:
Actually, it appears to be running after I run my toggle mirror script #!/usr/bin/perl use strict; use warnings; use File::Slurp; my $file=$ENV{'HOME'}.'/perl/mirror4remi.pl'; if(not -f $file) { die "I don't see $file"; } my $str=File::Slurp::read_file($file); if(not $str=~m|(default\{\s*'passive_ftp'\s*\}\s*=\s*)([0,1])|) { die "I don't see the ftp switch in $file"; } my $statement=$1; my $statement0=$statement.'0'; my $statement1=$statement.'1'; if(not $str=~s|\Q$statement\E1|$statement0|) { $str=~s|\Q$statement\E0|$statement1|; } File::Slurp::write_file($file, $str); As you seed this toggles active and passive modes. I run this once a day to alternatively run passive and active on all archives. It still takes ages to run. It would be good to have such data available via public rsync. -- Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel
Run time is actually very short compared to some of the http-based archives. Christian Zimmermann FIGUGEGL! Economic Research Federal Reserve Bank of St. Louis P.O. Box 442 St. Louis MO 63166-0442 USA https://ideas.repec.org/zimm/ @CZimm_economist On Sat, 3 Oct 2020, Thomas Krichel wrote:
Christian Zimmermann writes
Sune has no problem:
Actually, it appears to be running after I run my toggle mirror script
#!/usr/bin/perl use strict; use warnings; use File::Slurp;
my $file=$ENV{'HOME'}.'/perl/mirror4remi.pl'; if(not -f $file) { die "I don't see $file"; } my $str=File::Slurp::read_file($file); if(not $str=~m|(default\{\s*'passive_ftp'\s*\}\s*=\s*)([0,1])|) { die "I don't see the ftp switch in $file"; } my $statement=$1; my $statement0=$statement.'0'; my $statement1=$statement.'1'; if(not $str=~s|\Q$statement\E1|$statement0|) { $str=~s|\Q$statement\E0|$statement1|; } File::Slurp::write_file($file, $str);
As you seed this toggles active and passive modes. I run this once a day to alternatively run passive and active on all archives.
It still takes ages to run. It would be good to have such data available via public rsync.
--
Cheers,
Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel
participants (2)
-
Christian Zimmermann -
Thomas Krichel