Makes sense... The name of the band was Tommy Twotone..
It wouldnt be too hard to write a java crawler that can take a root URL then crawl through the pages and create item data from the data it grabs.. Just need to spider your way through the pages, then parse out all the fields it finds with item stats.. If they do it in a standard text format, it wouldnt be bad at all.. I was looking at one of the magelo created sites (nightwatchers).. seems you have to right click on the character profiles to get the item stats, which then come out in a very nice name: value format . Write a spider that can look for the items pages, then do a left click on every item and gather all the resulting html and build it into an SQL string, and you've got a web gathering system...
If it was just flat html, it would be alot easier, with the interface being the way it is, im not 100% sure. I might see if i can make a simple one next week that can go through the eqmaps database (since its just php with a database field id appended in the URL, it wouldnt be hard to do a ++ loop until end of content to hit suck down all of those items. THe problem is of course that there are alot of bogus items in EQMaps. Im not even sure how good Ala. is with validating before they post. I do know that since Magelo is a packet sniffer, all of his data is completely factual..
|