Onderwerp: »[news] XML Data Improvements

I prefer keep data in mySQL database. It gives more freedom to manipulate with all data.

SM is also keeping the data exactly as downloaded.

I name the files Data Filename mm-dd-yy.xml

IE Babes Data Team.xml, Babes Data Match.xml. Not putting the part in [] in the filename.

and of course i load it as well into the database, just keeping the file for any future reloading or whatever.

A few requests:

1) Could the League ID for the team be provided in the team-[teamID].xml?

2) Could we add a leagues-[countryID].xml file that would dump all of the leagues in the country? Most of the time it's sequential, but there were some deviations with the autonumber...

3) Request from Bluezero: I am also wonderring where can i find the goals, assists and average mark of an player for the actual season. It could be added to players.
(gewijzigd)

XML query provides with basic data only, all calculation should be done by user.

Thanks for that.

Could you now please let me know where i could calculate the league id for a team or the list of valid league ids for a country?

The stuff from bluezero was his request, not mine. My tool stores the historical data.

Could you now please let me know where i could calculate the league id for a team or the list of valid league ids for a country?

some php scripting helps me.

It's not theoretically possible to generate this information given the data we currently have in the XML dude, that's my point.

For calculating goals, assists and average mark of a player for actual season, you need to download all the matches.

This makes:
now we have 3 rounds behind us.
Let's say I want to do top goalscorers for a team from some league = to scan 8 teams.
1. request = league-ID.xml
2.-9. request = team-ID.xml
10.-17 request = players-[team ID].xml
----if it would be added, this would be the end of my requests, but i have to continue:
18. request = matches-league-IDLeague-thisround.xml
OR
the same for all the rounds if i dont have history, this would make 3 request at this time, but 14 requests at the end of the season.
But that's not all, let's continue:
19.-22. request = match-[match ID].xml
for this round
OR
12 requests for 3 rounds, but 56 request at the end of the season.

this makes in the worst case 87 requests for one league instead of 17 requests.

I think it is enough to consider.
But if i want to make top goalscorers for the whole country which has 5 divisions = 213 teams, then it makes 18531 requests instead of 3621.

Yeah, I know this.

On Dream Team web site all data is gathered from XML request.

To update all player stats for 1 round per country with 4 divs takes 2-3 minutes.
(gewijzigd)

My post was not about time, but about server load.

I agree with you. If this data would prepared on sokker server it will release server load greately. More and more peaople starting to pump data from sokker xml server in future, I afraid. Developers should think about how to prepare data to minimize the need for continuous reqests.

mrs

Allright, i'm bumping my head against this now...

I know most of you probably don't use VB or the MSHTML stuff, but i was thinking maybe someone could notice something i'm not. I've never done stuff with cookies before...

Here's my code for that first login.

XMLHttp.Open "POST", LoginURL, False
XMLHttp.setRequestHeader "Content-Type", "application/x-www-form-urlencoded"
'ALSO TRIED THIS: XMLHttp.setRequestHeader "Content-Type", "text/html;charset=UTF-8"
XMLHttp.send "ilogin=" + UserName + "&ipassword=" + Password
MsgBox (XMLHttp.responseText)


After that executes, i don't get the OK or Failed message, this is what responsetext is:

[!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"]
[html]
[head]
[meta http-equiv="content-type" content="text/html;charset=UTF-8"]
[/head]
[frameset border="0" cols="*,796,*" frameborder="no" framespacing="0"]
[frame name="NoName" noresize scrolling="no" src="pusta.html"]
[frameset border="0" framespacing="0" rows="69,*"]
[frame name="glowka" noresize scrolling="no" src="glowa.php"]
[frameset cols='116,*,42']
[frameset rows="*,40"]
[frame name="lewa" noresize scrolling="no" src="lewa.php"]
[frame name="zegar" noresize scrolling="no" src="zegar.php"]
[/frameset]
[frame name="glowna" noresize src="glowna.php" ]
[frame name=prawa noresize scrolling=no src="prawa.php"]
[/frameset]
[/frameset]
[frame name="NoName" noresize scrolling="no" src="pusta.html"]
[noframes]
[body bgcolor="#FFFFFF"]
[p]Przykro nam. Twoja przegladarka nie obsluguje ramek.[/p]
[/body]
[/noframes]
[/frameset]
[/html]


(NOTE: I changed all < to [ and > to ] so it would be displayable...)

I also don't think the XMLSESSID is created, but i may not be getting that right...

I'm not that hot with MSHTML or MSXML...

Any thoughts?
(gewijzigd)

i'm not sure of this part of your program

'ALSO TRIED THIS: XMLHttp.setRequestHeader "Content-Type", "text/html;charset=UTF-8"

the first content type is the right
it should work, the cookie step is before you get the OK and try to fetch one xml page
(gewijzigd)

Cookies come in the http response in the form of Headers with the name "Set-Cookie".

as said before, you have to use XMLHttp.setRequestHeader "Content-Type", "application/x-www-form-urlencoded" to send the Post request.

also, username and password have to be UTF-8 encoded.

don't know what else might help