Merun's Pixiv artist name fetcher script

Anything shuushuu related that doesn't fit into the other forums :)
User avatar
Julia
Posts: 970
Joined: Wed Aug 05, 2009 7:45 pm
Location: Texas

Merun's Pixiv artist name fetcher script

Post by Julia » Thu May 12, 2011 2:40 pm

So I figured I'd make a thread for Merun's script which retrieves the artist id from the pixiv page and puts the name below the avatar if the id is in the database.

http://e-shuushuu.net/wiki/index.php/Pixiv_Fetcher

Looks cool.
Image
Image
Mami chibi drawn by Jiino, animated by me. | Sophie sig by Misuzu | My Anime-Planet page
RockRabbit wrote:but you know, not every image has a source and not every character has a name :3

User avatar
Merun
Posts: 2897
Joined: Sat Mar 17, 2007 9:44 am
Location: NoWheRe

Re: Merun's Pixiv artist name fetcher script

Post by Merun » Sat May 14, 2011 5:10 am

I have updated my back end. Nothing to download for you guys, but I should have every PIxiv artists registered on the Wiki now, except for those with mistake in the article ( Some of them have a link to an image of the artist and not the profile page ). In total, there are 11 043 artists in it.

edit: Forget it, I can only export 5000 articles from the wiki. I lack 5000 more!

The update is simple enough that I can let anyone handle it ( as long as they can tell the difference between 2 files ), however only wiki admin have the access to the appropriate page to export the wiki information. Update page is password protected so I will give the password only to them.

I have decided that the wiki will be the only way to edit the database. No interface will be integrated on Pixiv as this would generate conflict and difference between the entry of the wiki and the entry made on Pixiv.

edit: With the help of Evangeline, there is now 16,484 artists !
Merun @ Twitter

User avatar
yong
Posts: 995
Joined: Sat May 03, 2008 8:37 am

Re: Merun's Pixiv artist name fetcher script

Post by yong » Sat May 14, 2011 10:09 am

For those who frequently "import" image from pixiv, Its recommended to install this script, both tagging team and normal users.
It will save us alot of time if the name is already exist on shuu, so we dont have to search the artist name again on shuu, and further prevent creating of duplicate artist tag~
Image

User avatar
Merun
Posts: 2897
Joined: Sat Mar 17, 2007 9:44 am
Location: NoWheRe

Re: Merun's Pixiv artist name fetcher script

Post by Merun » Sat May 14, 2011 12:01 pm

I can add a search button to the wiki as well. And the main goal is indeed to reduce the workload.

Now I still need to work on the export issue...

Also considering that some articles have the link to the tag on Shuu, I might be able to add that link too...

edit: I have added several entries in the To do category.
I'm still not sure about some of them, hence the '?' at the end of some of them. I would like to have some opinion about those.
Merun @ Twitter

User avatar
DoomTay
Posts: 341
Joined: Wed Dec 29, 2010 11:51 am

Re: Merun's Pixiv artist name fetcher script

Post by DoomTay » Sun May 15, 2011 10:12 am

If only this works for those of us who don't have a pixiv account and/or can' be bothered to make one, though obviously that would take a bit of work to determine whether the user is logged in, and would mean a different kind of placement.

User avatar
Merun
Posts: 2897
Joined: Sat Mar 17, 2007 9:44 am
Location: NoWheRe

Re: Merun's Pixiv artist name fetcher script

Post by Merun » Sun May 15, 2011 12:56 pm

I believe most people interested in this script already have a Pixiv account. I don't think it's hard to adapt the script for those without an account, but for now it's not on my TO DO list.
Merun @ Twitter

User avatar
Julia
Posts: 970
Joined: Wed Aug 05, 2009 7:45 pm
Location: Texas

Re: Merun's Pixiv artist name fetcher script

Post by Julia » Mon May 16, 2011 9:03 pm

http://www.pixiv.net/member.php?id=601089
This is the pixiv page for Akaza but it displays the name Nanjou Akimasa. (Nanjou Akimasa's pixiv also displays "Nanjou Akimasa": http://www.pixiv.net/member.php?id=51392)

Do you think this can be adapted for use on Piapro, Tinami, etc?
Image
Image
Mami chibi drawn by Jiino, animated by me. | Sophie sig by Misuzu | My Anime-Planet page
RockRabbit wrote:but you know, not every image has a source and not every character has a name :3

User avatar
Merun
Posts: 2897
Joined: Sat Mar 17, 2007 9:44 am
Location: NoWheRe

Re: Merun's Pixiv artist name fetcher script

Post by Merun » Tue May 17, 2011 6:46 am

Found the bug. The article for Akaza had a weird space which means the line with the name wasn't found by my script. I modified the script to search for just "| name =" instead of "| name = ". Might as well say that the quality of the database depend on how strictly articles are written ^^.

I just took a look at Tinami and Piapro's site, and yes, it should be possible to adapt the script for them. I would rather release separate scripts for them though.
Merun @ Twitter

User avatar
Tensa
Posts: 1265
Joined: Sun Sep 13, 2009 1:53 pm
Location: 絵 収集

Re: Merun's Pixiv artist name fetcher script

Post by Tensa » Thu May 19, 2011 12:24 pm

Just informing you: http://i.imgur.com/Uaigj.png
Server down? Or just a connection failure from my side? Doesn't seem to be the only artist page to give me that.
Image

User avatar
Merun
Posts: 2897
Joined: Sat Mar 17, 2007 9:44 am
Location: NoWheRe

Re: Merun's Pixiv artist name fetcher script

Post by Merun » Thu May 19, 2011 2:04 pm

Working for me at the moment. I don't have much time to mess with the script/backend during week days so I didn't change any part related to displaying since last Saturday. Might be a temporary down of the server on which I host my database.
Merun @ Twitter

User avatar
DoomTay
Posts: 341
Joined: Wed Dec 29, 2010 11:51 am

Re: Merun's Pixiv artist name fetcher script

Post by DoomTay » Wed May 25, 2011 12:44 pm

Well, either way, you might want to use something less...cluttery for an error message. And I think you could simulate the server being down apart from actually taking the server down by changing one line of code or another, so that the script fails to locate the server in the first place.

User avatar
Merun
Posts: 2897
Joined: Sat Mar 17, 2007 9:44 am
Location: NoWheRe

Re: Merun's Pixiv artist name fetcher script

Post by Merun » Wed May 25, 2011 2:05 pm

It's the default error message which was retrieved by the script. I can reformat a bit but it still won't be pretty because I need to keep error message for debugging.
Merun @ Twitter

User avatar
Julia
Posts: 970
Joined: Wed Aug 05, 2009 7:45 pm
Location: Texas

Re: Merun's Pixiv artist name fetcher script

Post by Julia » Fri May 27, 2011 1:06 pm

Can the script handle artists with multiple Pixiv accounts, e.g. http://e-shuushuu.net/wiki/index.php/Santou_Suihei
Image
Image
Mami chibi drawn by Jiino, animated by me. | Sophie sig by Misuzu | My Anime-Planet page
RockRabbit wrote:but you know, not every image has a source and not every character has a name :3

User avatar
Merun
Posts: 2897
Joined: Sat Mar 17, 2007 9:44 am
Location: NoWheRe

Re: Merun's Pixiv artist name fetcher script

Post by Merun » Fri May 27, 2011 2:04 pm

Just tried it out with that wiki article. As expected, it can, even though I didn't think of that possibility xD

Btw, I hope this weekend I can work on my wiki retriever, as I'm still limited to the 5000 first artist of the Pixiv category. This is needed in order to keep the database updated. I'm just ultra busy also with school projects...
Merun @ Twitter

User avatar
Tensa
Posts: 1265
Joined: Sun Sep 13, 2009 1:53 pm
Location: 絵 収集

Re: Merun's Pixiv artist name fetcher script

Post by Tensa » Mon Jun 06, 2011 1:51 pm

It's showing me Arisa for ideolo's Pixiv page. Why? D:
http://www.pixiv.net/member.php?id=61513
Image

Post Reply