Search found 208 matches
by abwilson
Fri Oct 28, 2005 3:33 pm
Forum: Awasu - General Discussion
Topic: It's working with webscrape setting but the page is blank
Replies: 14
Views: 19155

Thanks and please let me know if there is a way to go around this.


Sorry, but right now I don't have a workaround. Until I can implement the UTCoffset feature with it I cannot use DownloadUrl -- which should solve the cookie problem and allow your scrape to work.

Allan
by abwilson
Fri Oct 28, 2005 3:28 pm
Forum: Awasu - General Discussion
Topic: It's working with webscrape setting but the page is blank
Replies: 14
Views: 19155

I'm comfortable using "normal" DownloadUrl, thanks. UTCoffset is related to the feature in WebScrape and WebScrapeSettings that allows the user to specify a URL that contains elements of date and time -- for example, a cartoon-of-the-day site. I don't know the proper way to pass such a "dynamic" URL...
by abwilson
Thu Oct 27, 2005 10:39 pm
Forum: Awasu - General Discussion
Topic: It's working with webscrape setting but the page is blank
Replies: 14
Views: 19155

I had a look at the WebScrape code. Apparently I never switched to use DownloadUrl because of the UTCoffset-URL feature that was added to WebScrape some time ago.

Taka, what is the right way to use DownloadUrl and support the UTCoffset feature?

Thanks

Allan
by abwilson
Thu Oct 27, 2005 6:53 pm
Forum: Awasu - General Discussion
Topic: It's working with webscrape setting but the page is blank
Replies: 14
Views: 19155

I just did a test.

"HttpHeader_Content-Type=..." is returned in [DownloadUrl Response].

Looks like this requirement is met. :)

(Perhaps a note should be added to the docs.)

Thanks

Allan
by abwilson
Thu Oct 27, 2005 6:44 pm
Forum: Awasu - General Discussion
Topic: It's working with webscrape setting but the page is blank
Replies: 14
Views: 19155

When I tried the URL in my browser, the page that came up wanted an e-mail address to confirm I am one of their subscribers (I am not). Evidently they depend on a cookie, which WebScrape knows nothing about. Taka and I exchanged some forum messages about DownloadUrl some time back. Taka, will cookie...
by abwilson
Fri Oct 21, 2005 5:58 am
Forum: Awasu - General Discussion
Topic: Importing a feed from an email newsletter
Replies: 6
Views: 10794

Why not consider using 'senderfilter' or 'subjectfilter' in the existing e-mail plugin? From the Release Notes: Should you wish to limit displayed messages to those from certain users or confined to particular subjects, you can set senderfilter or subjectfilter in the channel configuration dialog (e...
by abwilson
Thu Oct 20, 2005 2:11 am
Forum: Awasu - General Discussion
Topic: Importing a feed from an email newsletter
Replies: 6
Views: 10794

Could you please post some examples of the kinds of data you have? I'm not exactly sure what you're trying to accomplish.

Thanks

Allan
by abwilson
Wed Oct 19, 2005 2:14 pm
Forum: Awasu - General Discussion
Topic: help on webscrape
Replies: 5
Views: 7855

Great -- I'm glad!

Thanks for the feedback.

Allan
by abwilson
Tue Oct 18, 2005 5:19 pm
Forum: Awasu - General Discussion
Topic: help on webscrape
Replies: 5
Views: 7855

As best I can tell, this works: [ChannelParameters] URL=http://www.in.gr Title=in.gr News Description=News Headlines in Greek BaseUrl=http://www.in.gr/ MaxItems=18 Shorthand= SectionPattern=<span class="newsmain">.*?<td class="Item"><h1>(.*) ItemPattern-1=<li><a href=&quo...
by abwilson
Tue Oct 18, 2005 2:47 pm
Forum: Awasu - Extensions
Topic: Webscrape : item's link and description are not nearby
Replies: 4
Views: 23063

Yes, a page needs to have the right general structure for news items to be found and generated "completely".

I hope you are able to benefit from the scraping as is.
by abwilson
Mon Oct 17, 2005 4:48 pm
Forum: Awasu - General Discussion
Topic: help on webscrape
Replies: 5
Views: 7855

Can you post some of your recent .ini files? Maybe someone will be able to help.

I looked at the Web page and I believe I see some items you might want to extract with WebScrape, but right now it's a guess.

Allan
by abwilson
Fri Oct 14, 2005 8:44 pm
Forum: Awasu - Extensions
Topic: Webscrape : item's link and description are not nearby
Replies: 4
Views: 23063

Oh...another comment:

The site doesn't supply a URL with each news item (so you can click for a more detailed article); in their case, each item is complete as presented. Therefore I set each item's link to "nothing" with "(?P<L>)".
by abwilson
Fri Oct 14, 2005 7:29 pm
Forum: Awasu - Extensions
Topic: Webscrape : item's link and description are not nearby
Replies: 4
Views: 23063

It looked like you were pretty close. Here is what I came up with. Does it accomplish what you want? [ChannelParameters] URL=http://www.planetretail.net/Newsfeed/NewNewsFeed.asp Title=Planet Retail Description=Breaking Retail News BaseUrl= MaxItems=20 Shorthand= SectionPattern=<td class="Headin...
by abwilson
Fri Oct 14, 2005 7:05 pm
Forum: Awasu - Bug Reports
Topic: Feed doesn't highlight new items
Replies: 6
Views: 12701

Or you could just make a GUID from an item's title plus current date/time.

This GUID could be used as <guid> or -- better I think, based on experience with today's Awasu -- tack "/?=GUID" on the end of your link URLs.

Allan
by abwilson
Tue Oct 11, 2005 6:28 pm
Forum: Awasu - Extensions
Topic: Works from WebscrapeSettings but not Webscrape
Replies: 5
Views: 22500

Glad you have something to try for now... :) I have revised WebScrape encoding handling as follows: First, it tries any encoding specified in the Content-Type header; if this is available, it uses it. If it's not available (as in your particular case) WebScrape then looks on the Webpage for a META t...

Go to advanced search