| OLD | NEW |
| 1 ***** Current status |
| 2 |
| 3 Currently it runs all the way through, but the database.json has all |
| 4 members[] lists empty. Most entries are skipped for "Suspect title"; |
| 5 some have ".pageText not found". |
| 6 |
| 7 Currently only works on Linux; OS X (or other) will need minor path changes. |
| 8 |
| 9 You will need a reasonably modern node.js installed. |
| 10 0.5.9 is too old; 0.8.8 is not too old. |
| 11 |
| 12 I needed to add my own "DumpRenderTree_resources/missingImage.gif", |
| 13 for some reason. |
| 14 |
| 15 ***** Overview |
| 16 |
| 1 Here's a rough walkthrough of how this works. The ultimate output file is | 17 Here's a rough walkthrough of how this works. The ultimate output file is |
| 2 database.filtered.json. | 18 database.filtered.json. |
| 3 | 19 |
| 4 full_run.sh executes all of the scripts in the correct order. | 20 full_run.sh executes all of the scripts in the correct order. |
| 5 | 21 |
| 6 search.js | 22 search.js |
| 7 - read data/domTypes.json | 23 - read data/domTypes.json |
| 8 - for each dom type: | 24 - for each dom type: |
| 9 - search for page on www.googleapis.com | 25 - search for page on www.googleapis.com |
| 10 - write search results to output/search/<type>.json | 26 - write search results to output/search/<type>.json |
| (...skipping 29 matching lines...) Expand all Loading... |
| 40 - xhr output/extract/<type><index>.html.json | 56 - xhr output/extract/<type><index>.html.json |
| 41 - all sorts of shenanigans to actually pull the content out of the html | 57 - all sorts of shenanigans to actually pull the content out of the html |
| 42 - build a JSON object with the results | 58 - build a JSON object with the results |
| 43 - do a postmessage with that object so extractRunner.js can pull it out | 59 - do a postmessage with that object so extractRunner.js can pull it out |
| 44 | 60 |
| 45 - run postProcess.dart | 61 - run postProcess.dart |
| 46 - go through the results for each type looking for the best match | 62 - go through the results for each type looking for the best match |
| 47 - write output/database.html | 63 - write output/database.html |
| 48 - write output/examples.html | 64 - write output/examples.html |
| 49 - write output/obsolete.html | 65 - write output/obsolete.html |
| 50 - write output/database.filtered.json which is the best matches | 66 - write output/database.filtered.json which is the best matches |
| 67 |
| 68 ***** Process for updating database.json using these scripts. |
| 69 |
| 70 TODO(eub) when I get the scripts to work all the way through. |
| OLD | NEW |