Page 1 of 1

Creating an export script for all the sets.

Posted: Tue Oct 28, 2014 4:59 pm
by vampirefrog
Hi guys. I'd like to import all the project2612 sets into a project I'm working on, and instead of writing a scraper that would read the HTML and parsed it, I'd like, instead to just have a script that outputs in an easy to read format data about all the sets.

As an example, you can see here: http://vgmrips.net/dump.php

I can write the script myself, I have FTP access from Monkeymook, from a while ago, when I helped fix some unicode character errors, or whatever it was I did. It is not very resource intensive, and, besides, I only need to access it weekly or monthly.

I just need an admin's permission to do this.

I also need to mention that on my pages I'll add a project2612 logo and link back to the original set, for attribution.

Thanks!

Creating an export script for all the sets.

Posted: Wed Nov 19, 2014 12:39 am
by Monkeymook
ValleyBell is definitely the person to ask so you could write out something like this. He's given me pretty much all permission to handle packs and maintenance (with what limited time I have, haha) using proper access creds on the site.

Also, it was unicode issues. It was for various pages with special characters that weren't being parsed properly. ;)

Creating an export script for all the sets.

Posted: Wed Nov 19, 2014 6:22 am
by vampirefrog
It does seem you two have taken over. Thanks.

Creating an export script for all the sets.

Posted: Thu Nov 20, 2014 4:59 pm
by Monkeymook
VB pretty much has access to almost 100% of the site. I just manage packs and new updates, until I can get backend access to have the site show new updates.

Creating an export script for all the sets.

Posted: Tue Dec 23, 2014 3:43 pm
by vampirefrog
Alright, I've written the script: http://project2612.org /export/

I've added a 7 day cache too, so it doesn't eat up server resources.

Now to write an importer for all those zips ^^

:sonic: