Project2612

Creating an export script for all the sets.

Everything smooth? Got some comments for us? Feedback? It all goes here.

Creating an export script for all the sets.

Postby vampirefrog » Tue Oct 28, 2014 4:59 pm

Hi guys. I'd like to import all the project2612 sets into a project I'm working on, and instead of writing a scraper that would read the HTML and parsed it, I'd like, instead to just have a script that outputs in an easy to read format data about all the sets.

As an example, you can see here: http://vgmrips.net/dump.php

I can write the script myself, I have FTP access from Monkeymook, from a while ago, when I helped fix some unicode character errors, or whatever it was I did. It is not very resource intensive, and, besides, I only need to access it weekly or monthly.

I just need an admin's permission to do this.

I also need to mention that on my pages I'll add a project2612 logo and link back to the original set, for attribution.

Thanks!
vampirefrog
New Around Here
 
Posts: 29
Joined: Sun Aug 17, 2014 4:19 pm

Creating an export script for all the sets.

Postby Monkeymook » Wed Nov 19, 2014 12:39 am

ValleyBell is definitely the person to ask so you could write out something like this. He's given me pretty much all permission to handle packs and maintenance (with what limited time I have, haha) using proper access creds on the site.

Also, it was unicode issues. It was for various pages with special characters that weren't being parsed properly. ;)
User avatar
Monkeymook
 
Posts: 95
Joined: Sun Aug 22, 2010 2:33 am
Location: Norfolk, VA

Creating an export script for all the sets.

Postby vampirefrog » Wed Nov 19, 2014 6:22 am

It does seem you two have taken over. Thanks.
vampirefrog
New Around Here
 
Posts: 29
Joined: Sun Aug 17, 2014 4:19 pm

Creating an export script for all the sets.

Postby Monkeymook » Thu Nov 20, 2014 4:59 pm

VB pretty much has access to almost 100% of the site. I just manage packs and new updates, until I can get backend access to have the site show new updates.
User avatar
Monkeymook
 
Posts: 95
Joined: Sun Aug 22, 2010 2:33 am
Location: Norfolk, VA

Creating an export script for all the sets.

Postby vampirefrog » Tue Dec 23, 2014 3:43 pm

Alright, I've written the script: http://project2612.org /export/

I've added a 7 day cache too, so it doesn't eat up server resources.

Now to write an importer for all those zips ^^

:sonic:
vampirefrog
New Around Here
 
Posts: 29
Joined: Sun Aug 17, 2014 4:19 pm


Return to Site Feedback

Who is online

Users browsing this forum: No registered users and 2 guests

cron