Creating an export script for all the sets.

Everything smooth? Got some comments for us? Feedback? It all goes here.
Post Reply
vampirefrog
Been Here for a Bit
Posts: 30
Joined: Sun Aug 17, 2014 4:19 pm

Creating an export script for all the sets.

Post by vampirefrog »

Hi guys. I'd like to import all the project2612 sets into a project I'm working on, and instead of writing a scraper that would read the HTML and parsed it, I'd like, instead to just have a script that outputs in an easy to read format data about all the sets.

As an example, you can see here: http://vgmrips.net/dump.php

I can write the script myself, I have FTP access from Monkeymook, from a while ago, when I helped fix some unicode character errors, or whatever it was I did. It is not very resource intensive, and, besides, I only need to access it weekly or monthly.

I just need an admin's permission to do this.

I also need to mention that on my pages I'll add a project2612 logo and link back to the original set, for attribution.

Thanks!
Monkeymook
Posts: 120
Joined: Sun Aug 22, 2010 2:33 am
Location: Virginia Beach, VA

Creating an export script for all the sets.

Post by Monkeymook »

ValleyBell is definitely the person to ask so you could write out something like this. He's given me pretty much all permission to handle packs and maintenance (with what limited time I have, haha) using proper access creds on the site.

Also, it was unicode issues. It was for various pages with special characters that weren't being parsed properly. ;)
vampirefrog
Been Here for a Bit
Posts: 30
Joined: Sun Aug 17, 2014 4:19 pm

Creating an export script for all the sets.

Post by vampirefrog »

It does seem you two have taken over. Thanks.
Monkeymook
Posts: 120
Joined: Sun Aug 22, 2010 2:33 am
Location: Virginia Beach, VA

Creating an export script for all the sets.

Post by Monkeymook »

VB pretty much has access to almost 100% of the site. I just manage packs and new updates, until I can get backend access to have the site show new updates.
vampirefrog
Been Here for a Bit
Posts: 30
Joined: Sun Aug 17, 2014 4:19 pm

Creating an export script for all the sets.

Post by vampirefrog »

Alright, I've written the script: http://project2612.org /export/

I've added a 7 day cache too, so it doesn't eat up server resources.

Now to write an importer for all those zips ^^

:sonic:
Post Reply