View unanswered posts | View active topics

Reply to topic  [ 8 posts ] 
User avatar

Joined: Mon Feb 26, 2007 2:08 am
Posts: 55
Post Problems with a config for Gamespot.com
I made a config file for the review section of Gamespot.com:



Code:
[ChannelParameters]
URL=http://www.gamespot.com/reviews.html?type=reviews&platform=1024&tag=subnav;reviews
Title=Gamespot PSP Reviews
Description=
BaseUrl=http://www.gamespot.com/psp/
MaxItems=15
Shorthand=
SectionPattern=Latest PSP Reviews(.*)Browse All Reviews
ItemPattern-1=(?P<D><img src.*?alt="
ItemPattern-2=(?P<T>.*?)".*?)<br><a href="(?P<L>.*?)"
ItemPattern-3=


I attached a picture:

CLICK

The problem is that the baseURL only works for the Titel (green arrows). But for the other links(red arrows) it links to my local c:\ disk.

What am I doing wrong?

Thanks! :wink:


Tue Mar 06, 2007 5:13 am
Profile
Site Admin
User avatar

Joined: Fri Feb 07, 2003 8:48 am
Posts: 2897
Location: Melbourne, Australia
Post Re: Problems with a config for Gamespot.com
diabloNL wrote:
The problem is that the baseURL only works for the Titel (green arrows). But for the other links(red arrows) it links to my local c:\ disk.

What am I doing wrong?


I didn't get anything extracted when I ran your config but looking at the source code for the web page, I think I know what's going on.

They're using <u>relative</u> URL's for their links e.g. <tt>[a href="/psp/action/machmodifiedaircombatheroes/review.html"]7.2[/a]</tt> Because WebScrape just extracts text without understanding what it's extracting, these URL's are what gets put into the feed. Awasu converts relative links to absolute but in this case, it doesn't know the original base URL. Plugins generate their feed to a temp file on your local hard disk and since that's all Awasu knows, that's what it uses as the base URL for relative link translation. Hence, links look like they're located on your C: drive :-)

I'll try to get a debug switch in to 2.3.rc2 that will let you manually set the base URL to be used for relative link translation that should work around this problem.


Tue Mar 06, 2007 9:43 am
Profile WWW
User avatar

Joined: Mon Feb 26, 2007 2:08 am
Posts: 55
Post 
Thanks for the reply. I know it has relative URL's but I thought that the setting for "Base URL" took care of that. And it does for the link that I describe with (?P<L>.*?) but it doesn't do it for the links in the "description" (?P<D>.*?) part.

BTW, strange the file doesn't work for you... :?


Tue Mar 06, 2007 9:51 am
Profile
Site Admin
User avatar

Joined: Fri Feb 07, 2003 8:48 am
Posts: 2897
Location: Melbourne, Australia
Post 
diabloNL wrote:
I know it has relative URL's but I thought that the setting for "Base URL" took care of that.

This plugin was written by someone else and I don't have the source so I can't say but I'd be surprised if the plugin does relative link translation.

diabloNL wrote:
And it does for the link that I describe with (?P<L>.*?) but it doesn't do it for the links in the "description" (?P<D>.*?) part.

I guess the plugin does special handling for feed item links (easy) but not for links embedded in the feed item descriptions (hard).

I'm just looking at the Awasu code now and it seems pretty easy to insert a debug switch to force the base URL for relative link translation. If you can get yourself set up with 2.3.rc1 (which edition are you using?), send us an email and I'll send you a pre-release of 2.3.rc2 with the change in it.


Tue Mar 06, 2007 9:55 am
Profile WWW
Site Admin
User avatar

Joined: Fri Feb 07, 2003 8:48 am
Posts: 2897
Location: Melbourne, Australia
Post 
diabloNL wrote:
BTW, strange the file doesn't work for you... :?

You might be logged in or have some other cookie set that causes the page served to be slightly different to what I'm getting :-)


Tue Mar 06, 2007 9:59 am
Profile WWW
User avatar

Joined: Mon Feb 26, 2007 2:08 am
Posts: 55
Post 
support wrote:
diabloNL wrote:
BTW, strange the file doesn't work for you... :?

You might be logged in or have some other cookie set that causes the page served to be slightly different to what I'm getting :-)


Hmm... I'm not logged in so maybe a cookie. :?


I send you an email for version 2.3.rc2. Thanks! :wink:


Tue Mar 06, 2007 10:06 am
Profile
Site Admin
User avatar

Joined: Fri Feb 07, 2003 8:48 am
Posts: 2897
Location: Melbourne, Australia
Post 
diabloNL wrote:
I send you an email for version 2.3.rc2.

I've just sent you a pre-release of 2.3.rc2 ::-):


Tue Mar 06, 2007 11:55 am
Profile WWW
User avatar

Joined: Mon Feb 26, 2007 2:08 am
Posts: 55
Post 
Thanks, will try it tonight! 8)


Tue Mar 06, 2007 12:07 pm
Profile
Display posts from previous:  Sort by  
Reply to topic   [ 8 posts ] 

Who is online
Users browsing this forum: No registered users and 1 guest

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
cron