No suitable way to get all tracks (along with dates)

- kurtrips a dit :...
- Utilisateur
- 27 déc. 2008, 20h09m
No suitable way to get all tracks (along with dates)

For getting all tracks played (along with dates), I tried
1) get the weekly chart lists (but this ends at the last week)
2) get the recent tracks (but this is limited to only 100)

So there seems to be no way of getting the songs between the end of last week and the latest 100 songs played.

i tried library.getTracks too but there are no dates there.

My suggestion: make user.getRecentTracks return all tracks till the end of last week.

I can parse the user's pages itself for this but I'd rather not do that because admins might not like that. :-)

Random Song Statistics and Song Recommendation Tool - http://lastfm.heathaze.org/

[quote][b][user]kurtrips[/user][/b] a dit : For getting all tracks played (along with dates), I tried 1) get the weekly chart lists (but this ends at the last week) 2) get the recent tracks (but this is limited to only 100) So there seems to be no way of getting the songs between the end of last week and the latest 100 songs played. i tried library.getTracks too but there are no dates there. My suggestion: make user.getRecentTracks return all tracks till the end of last week. I can parse the user's pages itself for this but I'd rather not do that because admins might not like that. :-) [/quote]

Lien permanent Citer
- capndesign a dit :...
- Utilisateur
- 2 jan. 2009, 23h31m
Yeah, I'd like to second this request. Another option might be adding an offset parameter. For example: http://ws.audioscrobbler.com/2.0/?method=user.getrecenttracks&user=rj&offset=100&limit=100

[quote][b][user]capndesign[/user][/b] a dit : Yeah, I'd like to second this request. Another option might be adding an offset parameter. For example: http://ws.audioscrobbler.com/2.0/?method=user.getrecenttracks&user=rj&offset=100&limit=100[/quote]

Lien permanent Citer
- tburny a dit :...
- Forum Moderator
- 3 jan. 2009, 13h09m
library.getTracks might be suitable, too, but it contains no dates

Combo.fm: Combine your favourite radio stations! | My Blog | scala-lastfmapi
P.S.: Do not click here
throw new PokemonException(); //Gotta catch 'em all
My forum post reflects my personal opinion :)

[quote][b][user]tburny[/user][/b] a dit : library.getTracks might be suitable, too, but it contains no dates[/quote]

Lien permanent Citer
- kurtrips a dit :...
- Utilisateur
- 8 jan. 2009, 17h26m
More problems with getting all tracks

Seems like the getweeklytrackchart itself does not return all the tracks scrobbled for the week.

Take a look at this page http://www.last.fm/user/Egg21/tracks?page=322 and search for 'Behind Blue Eyes'. You'll notice 1 track scrobbled on 15th Dec 2007.

But when I try this, it does not return the above mentioned track. The date range is from 9-Dec-2007 to 16-Dec-2007
http://ws.audioscrobbler.com/2.0/?method=user.getweeklytrackchart&user=Egg21&from=1197201600&to=1197806400&api_key=b25b959554ed76058ac220b7b2e0a026

I also tried the following url in case the issue was because of time gap between countries, but still no match. The dates for the following range is 16-Dec-2007 to 23-Dec-2007.
http://ws.audioscrobbler.com/2.0/?method=user.getweeklytrackchart&user=Egg21&from=1197806400&to=1198411200&api_key=b25b959554ed76058ac220b7b2e0a026

If I'm wrong somewhere please do let me know, but it seems to me that getweeklytrackchart has some limit for the maximum number of records returned. If this is so, then please mention this on the API doc page for this method and make it return data in paged format.

Random Song Statistics and Song Recommendation Tool - http://lastfm.heathaze.org/

[quote][b][user]kurtrips[/user][/b] a dit : Seems like the getweeklytrackchart itself does not return all the tracks scrobbled for the week. Take a look at this page http://www.last.fm/user/Egg21/tracks?page=322 and search for 'Behind Blue Eyes'. You'll notice 1 track scrobbled on 15th Dec 2007. But when I try this, it does not return the above mentioned track. The date range is from 9-Dec-2007 to 16-Dec-2007 http://ws.audioscrobbler.com/2.0/?method=user.getweeklytrackchart&user=Egg21&from=1197201600&to=1197806400&api_key=b25b959554ed76058ac220b7b2e0a026 I also tried the following url in case the issue was because of time gap between countries, but still no match. The dates for the following range is 16-Dec-2007 to 23-Dec-2007. http://ws.audioscrobbler.com/2.0/?method=user.getweeklytrackchart&user=Egg21&from=1197806400&to=1198411200&api_key=b25b959554ed76058ac220b7b2e0a026 If I'm wrong somewhere please do let me know, but it seems to me that getweeklytrackchart has some limit for the maximum number of records returned. If this is so, then please mention this on the API doc page for this method and make it return data in paged format.[/quote]

Lien permanent Citer
- Egg21 a dit :...
- Utilisateur
- 9 jan. 2009, 8h56m
but it seems to me that getweeklytrackchart has some limit for the maximum number of records returned. I think so. Both the calls you quote returns exactly 1000 tracks. Hardly a coincidence.

It think the most reliable way to get everything would be to strip the tracks from http://www.last.fm/user/user/tracks?page=xxx
Or get the last.fm staff to set the limit at no less than 10,000 tracks if they need a limit (there are 10,080 minutes in a week). On the other hand, extremely rare iPod updates could generate more activity than that or people starting their account by importing listening history from elsewhere.

Recommended Games: [Game] Music Knowledge Challenge and Obscure Music Game.
If you want to find new bands then try joining under 2000 listeners

[quote][b][user]Egg21[/user][/b] a dit : [quote]but it seems to me that getweeklytrackchart has some limit for the maximum number of records returned.[/quote] I think so. Both the calls you quote returns exactly 1000 tracks. Hardly a coincidence. It think the most reliable way to get everything would be to strip the tracks from http://www.last.fm/user/user/tracks?page=xxx Or get the last.fm staff to set the limit at no less than 10,000 tracks if they need a limit (there are 10,080 minutes in a week). On the other hand, extremely rare iPod updates could generate more activity than that or people starting their account by importing listening history from elsewhere. [/quote]

Lien permanent Citer
- m0nkiii a dit :...
- Utilisateur
- 9 jan. 2009, 22h43m
Re: No suitable way to get all tracks (along with dates)

kurtrips
I can parse the user's pages itself for this but I'd rather not do that because admins might not like that. :-)

I don't think they mind if you parse the site ;)
Like you know, I'm a parser :)

But I'd like support in the API instead too. Would be nice.

More LastFMStats
flickr
My Spotify profile

[quote][b][user]m0nkiii[/user][/b] a dit : [quote][b][user]kurtrips[/user][/b] I can parse the user's pages itself for this but I'd rather not do that because admins might not like that. :-) [/quote] I don't think they mind if you parse the site ;) Like you know, I'm a parser :) But I'd like support in the API instead too. Would be nice.[/quote]

Lien permanent Citer
- kurtrips a dit :...
- Utilisateur
- 10 jan. 2009, 2h34m
Parsing the page seems to be the only way of getting all tracks.
However I don't think this is reliable at all because it is slightly dependent on the user-interface unlike the web service which is tied totally to the database, which means that a small change to the design of the web page (like the recent neighbors page change) can cause my application to fail.
Another issue is that parsing the web pages would involve much more web requests than parsing the weekly data. (For ex. 60 weeks vs. 391 pages for Egg21)

So, I hope some admin can take some sort of a call on the getuserweeklytrackchart method or even just inform me if no action is going to be taken on it.

Random Song Statistics and Song Recommendation Tool - http://lastfm.heathaze.org/

[quote][b][user]kurtrips[/user][/b] a dit : Parsing the page seems to be the only way of getting all tracks. However I don't think this is reliable at all because it is slightly dependent on the user-interface unlike the web service which is tied totally to the database, which means that a small change to the design of the web page (like the recent neighbors page change) can cause my application to fail. Another issue is that parsing the web pages would involve much more web requests than parsing the weekly data. (For ex. 60 weeks vs. 391 pages for Egg21) So, I hope some admin can take some sort of a call on the getuserweeklytrackchart method or even just inform me if no action is going to be taken on it.[/quote]

Lien permanent Citer
- TripleF a dit :...
- Abonné
- 19 mars 2009, 15h15m
Re: No suitable way to get all tracks (along with dates)

I'd like to second the request of adding a method to the API to get all track data along with dates. A whole category of possible applications (i.e. ones based on listening histories) is only possible with this kind of data available.

Thanks!

[quote][b][user]TripleF[/user][/b] a dit : I'd like to second the request of adding a method to the API to get all track data along with dates. A whole category of possible applications (i.e. ones based on listening histories) is only possible with this kind of data available. Thanks![/quote]

Lien permanent Citer
- Gredunza a dit :...
- Utilisateur
- 23 mars 2009, 14h47m
As far as I can tell, parsing all user pages sequentially is the only way to get all user tracks. Offhand, as long as you sleep for a few seconds between GETs, I don't see why anybody would mind this being done as it'll be identical to a user clicking 'next' repeatedly. But failing to do so would make it somewhat similar to a DoS attack.
And it'll still take a while for a large amount of tracks.

I wrote some Perl to do this, though it only fetches artist and track name; not dates.

Personally, I don't see why the API couldn't support the OFFSET clause; but I profess to know nothing of how the SQL backend is set up.

[quote][b][user]Gredunza[/user][/b] a dit : As far as I can tell, parsing all user pages sequentially is the only way to get all user tracks. Offhand, as long as you sleep for a few seconds between GETs, I don't see why anybody would mind this being done as it'll be identical to a user clicking 'next' repeatedly. But failing to do so would make it somewhat similar to a DoS attack. And it'll still take a while for a large amount of tracks. I wrote some Perl to do this, though it only fetches artist and track name; not dates. Personally, I don't see why the API couldn't support the OFFSET clause; but I profess to know nothing of how the SQL backend is set up.[/quote]

Lien permanent Citer
- cyclops79 a dit :...
- Utilisateur
- 25 mars 2009, 3h12m
People have complained about this in the past (1, 2), but I get the impression that the staff just chooses to ignore this request.

: /

[quote][b][user]cyclops79[/user][/b] a dit : People have complained about this in the past ([url=http://www.last.fm/group/Last.fm+Web+Services/forum/21604/_/389426]1[/url], [url=http://www.last.fm/group/Last.fm+Web+Services/forum/21604/_/498860]2[/url]), but I get the impression that the staff just chooses to ignore this request. : /[/quote]

Lien permanent Citer
- TripleF a dit :...
- Abonné
- 30 mars 2009, 21h02m
cyclops79 said:
People have complained about this in the past (1, 2), but I get the impression that the staff just chooses to ignore this request. Yes, that's what it seems like. It would be nice to get an official statement on this though, since the reason for leaving this functionality out is not quite obvious.

[quote][b][user]TripleF[/user][/b] a dit : [quote][b][user]cyclops79[/user][/b] said: People have complained about this in the past ([url=http://www.last.fm/group/Last.fm+Web+Services/forum/21604/_/389426]1[/url], [url=http://www.last.fm/group/Last.fm+Web+Services/forum/21604/_/498860]2[/url]), but I get the impression that the staff just chooses to ignore this request.[/quote] Yes, that's what it seems like. It would be nice to get an official statement on this though, since the reason for leaving this functionality out is not quite obvious.[/quote]

Lien permanent Citer
- TripleF a dit :...
- Abonné
- 4 mai 2009, 9h59m
Vote on LastFVS

Vote for this feature on LastFVS: http://lastfvs.matto1990.com/idea/17/

[quote][b][user]TripleF[/user][/b] a dit : Vote for this feature on LastFVS: [url=http://lastfvs.matto1990.com/idea/17/]http://lastfvs.matto1990.com/idea/17/[/url][/quote]

Lien permanent Citer
- Bor81 a dit :...
- Utilisateur
- 2 juin 2009, 8h43m
any progress ?

...chime forever...
http://bor.org.ua

[quote][b][user]Bor81[/user][/b] a dit : any progress ?[/quote]

Lien permanent Citer
- alexmuller a dit :...
- Abonné
- 11 jui. 2009, 17h15m
I set up this and am wondering if there's any way for me to improve the accuracy (ie, go past 100 tracks) just using what's currently available. I think there isn't, so do I need something like this to be implemented?

[quote][b][user]alexmuller[/user][/b] a dit : I set up [url=http://alex.mullr.net/lastfm/graph/]this[/url] and am wondering if there's any way for me to improve the accuracy (ie, go past 100 tracks) just using what's currently available. I think there isn't, so do I need something like this to be implemented?[/quote]

Lien permanent Citer
- placebotaste a dit :...
- Utilisateur
- 24 mars 2010, 23h09m
hola me gustaria dar una sugerencia en mi lista de reproduccion por mes aparen canciones y/o artistas que yo he borrado me podrian ayudar con eso para tener mis estadisticas bien gracias

[quote][b][user]placebotaste[/user][/b] a dit : hola me gustaria dar una sugerencia en mi lista de reproduccion por mes aparen canciones y/o artistas que yo he borrado me podrian ayudar con eso para tener mis estadisticas bien gracias[/quote]

Lien permanent Citer
- cruiseoveride a dit :...
- Utilisateur
- 21 fév. 2011, 5h43m
If only there was a user.getArtistTracks that has an optional "artist" parameter

But I wonder if they're doing it intentionally so that we can't just move our data off the site.

[quote][b][user]cruiseoveride[/user][/b] a dit : If only there was a user.getArtistTracks that has an optional "artist" parameter But I wonder if they're doing it intentionally so that we can't just move our data off the site.[/quote]

Lien permanent Citer
- cruiseoveride a dit :...
- Utilisateur
- 21 fév. 2011, 5h50m
Ah looks like user.getrecenttracks does it now

[quote][b][user]cruiseoveride[/user][/b] a dit : Ah looks like user.getrecenttracks does it now [/quote]

Lien permanent Citer
- lasturtl a dit :...
- Utilisateur
- 13 mars 2011, 17h54m
I'd like to add my vote to this request!

[quote][b][user]lasturtl[/user][/b] a dit : I'd like to add my vote to this request![/quote]

Lien permanent Citer
- marc2003 a dit :...
- Utilisateur
- 13 mars 2011, 23h59m
the answer is in the post above yours. you can parse your entire listening history using user.getrecentttracks (with pagination). so long as you don't break the TOS you agreed to when applying for your API key, it shouldn't be a problem (other than the long wait it will take for your script/program to complete :P)

[quote][b][user]marc2003[/user][/b] a dit : the answer is in the post above yours. you can parse your entire listening history using user.getrecentttracks (with pagination). so long as you don't break the TOS you agreed to when applying for your API key, it shouldn't be a problem (other than the long wait it will take for your script/program to complete :P)[/quote]

Lien permanent Citer