I am trying to use the DownloadFiles channel plugin to harvest the PDF files from this site:https://www.gpo.gov/fdsys/html/FR/todays_toc.html
For the record, it was working fine up until the past few weeks. Now we get this error message:
"HTTPError: HTTP Error 500: Internal Server Error" (see full error log I attached to email).
I'm assuming it's more of an issue of the site's "anti-spidering," since I can't open it through my php scripting (even with changing user agent setting), or through TeleportUltra. However, we can manually navigate to the site and download files one-by-one with no problems. It is time consuming though. So we'd love to keep it automatic through Awasu. Can you help us?