hatemben/OpenJORT

Opening up Tunisia's Official Gazette OpenJORT ======== Opening up Tunisia's Official Gazette How to use these scripts : 1- First you need to download JORT PDF files from official website www.iort.gov.tn Visit iort website and search publication by year, then copy paste and run the script getJORT.js in firebug The script will download Jort PDF files inside a webpage (10 at a time) Then jump to next page :) Make sure you hit save download file location by default, to start download immediately instead of showing the download menu 2- Now you can convert PDF to text using the PDFtotext utility : (if you don't have it run : $sudo apt-get install pdftotext) $ for file in *.pdf; do pdftotext "$file" "$file.txt";done 3- Configure OpenJORT path variable to the location of your txt files converted without trailing slash in the end // for example : $path = "annonces"; 4- Then create a MySQL database with the structure below : CREATE TABLE `announcements` ( `id` varchar(255) NOT NULL, `content` text NOT NULL, `gazette` int(10) NOT NULL, `json` text NOT NULL, FULLTEXT KEY `content` (`content`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1; CREATE TABLE `gazettes` ( `id` int(10) NOT NULL AUTO_INCREMENT, `title` varchar(255) NOT NULL, `number` int(10) NOT NULL, `pubdate` date NOT NULL, `pubyear` int(4) NOT NULL, `pdflink` varchar(255) NOT NULL, `textlink` varchar(255) NOT NULL, PRIMARY KEY (`id`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 AUTO_INCREMENT=1 ; 5- Finally run the PHP script : $ php OpenJORT.php 6- That's all !! Once the database is populated you can export data to any format you want using PHPMyAdmin for example. If you are curious to know how this script is written check this link (No sign-in required): docs.google.com Feel free to fork, use and reuse ! - Hatem hbyconsultancy.com