Phaeton!!
- Thread starter Danny
- Start date
That's unbelieveable!, we had so much information on there. Can you place a sticky at the top of the 1st category poiting people to the old forum. I know it's on your website but not everybody will go there first. Is there anyway that the search can be linked over to the old site?
Alan...
Alan...
I'm still working on a script to convert the old forum into a flat file contailing, User name, Forum Name, and forum text.
I have found a way to extract all the forum information in the form of HTML pages using "wget" I am now looking to remove all the HTML crap to turni it back to plane text. I can then look at writing a script to upload the messages to the new forum.
Don't know if anyone else on the forum does and programing, but if they do and anyone already knows of a way to upload without needing everyones username and password it would be useful to know....
Extraction is the easy part, re-population is going to be hard...
I have found a way to extract all the forum information in the form of HTML pages using "wget" I am now looking to remove all the HTML crap to turni it back to plane text. I can then look at writing a script to upload the messages to the new forum.
Don't know if anyone else on the forum does and programing, but if they do and anyone already knows of a way to upload without needing everyones username and password it would be useful to know....
Extraction is the easy part, re-population is going to be hard...
iank
New member
Scraping the data out of the html shouldn't be too challenging. If you use python there is http://www.crummy.com/software/BeautifulSoup/ which does most of the difficult work for you, I'm sure there are perl libraries that do the same thing.
If Danny can get hold of the export format that gossiping have disabled he might be able to import it into this one he controls if you can write that out. However that might not work on a board that has already gone live, and might take a while to get right.
If Danny can get hold of the export format that gossiping have disabled he might be able to import it into this one he controls if you can write that out. However that might not work on a board that has already gone live, and might take a while to get right.
Yes, like I say exporting the info is easy, it's importing it that is hard.... If Danny has full access to the hosting server (command line level via telnet or SSH) it may be posible to write another perl (my preference) or phyton script to call on sql commands to populate the database, but other than that we need to send it all via html, changing users between posts... Would take a long time to do, even if I did get everyones passwords (temporaraly) as each post needs to be replayed in the correct order.
Not if I can get a way to re-post, My method of extracting the old posts is in such a way that they need to be reposted, it produces more of a running script of he said this she said that on a per topic basis, so it would be easy enoght to overcome numbering issues, but I still need to work out how I can script the transactions to populate the old data.
