2018-02-08 15:10:06,412: INFO : collecting all words and their counts
2018-02-08 15:10:06,415: INFO : reading file WOTclean/CrossroadsOfTwilight.txt
2018-02-08 15:10:06,458: INFO : PROGRESS: at sentence #0, processed 0 words, keeping 0 word types
2018-02-08 15:10:06,521: INFO : reading file WOTclean/CrownOfSwords.txt
2018-02-08 15:10:06,622: INFO : reading file WOTclean/DragonReborn.txt
2018-02-08 15:10:06,705: INFO : reading file WOTclean/EyeOfTheWorld.txt
2018-02-08 15:10:06,801: INFO : reading file WOTclean/FiresOfHeaven.txt
2018-02-08 15:10:06,919: INFO : reading file WOTclean/GatheringStorm.txt
2018-02-08 15:10:07,022: INFO : reading file WOTclean/GreatHunt.txt
2018-02-08 15:10:07,117: INFO : reading file WOTclean/KnifeOfDreams.txt
2018-02-08 15:10:07,234: INFO : reading file WOTclean/LordOfChaos.txt
2018-02-08 15:10:07,370: INFO : reading file WOTclean/MemoryOfLight.txt
2018-02-08 15:10:07,487: INFO : reading file WOTclean/PathOfDaggers.txt
2018-02-08 15:10:07,571: INFO : reading file WOTclean/ShadowRising.txt
2018-02-08 15:10:07,699: INFO : reading file WOTclean/TowersOfMidnight.txt
2018-02-08 15:10:07,825: INFO : reading file WOTclean/WintersHeart.txt
2018-02-08 15:10:07,918: INFO : collected 49549 word types from a corpus of 4333369 raw words and 442 sentences
2018-02-08 15:10:07,919: INFO : Loading a fresh vocabulary
2018-02-08 15:10:07,985: INFO : min_count=5 retains 17928 unique words (36% of original 49549, drops 31621)
2018-02-08 15:10:07,985: INFO : min_count=5 leaves 4284902 word corpus (98% of original 4333369, drops 48467)
2018-02-08 15:10:08,051: INFO : deleting the raw counts dictionary of 49549 items
2018-02-08 15:10:08,055: INFO : sample=0.001 downsamples 50 most-common words
2018-02-08 15:10:08,056: INFO : downsampling leaves estimated 3218001 word corpus (75.1% of prior 4284902)
2018-02-08 15:10:08,057: INFO : estimated required memory for 17928 words and 200 dimensions: 37648800 bytes
2018-02-08 15:10:08,116: INFO : resetting layer weights
2018-02-08 15:10:08,419: INFO : training model with 3 workers on 17928 vocabulary and 200 features, using sg=0 hs=0 sample=0.001 negative=5 window=5
2018-02-08 15:10:08,431: INFO : reading file WOTclean/CrossroadsOfTwilight.txt
2018-02-08 15:10:08,587: INFO : reading file WOTclean/CrownOfSwords.txt
2018-02-08 15:10:08,834: INFO : reading file WOTclean/DragonReborn.txt
2018-02-08 15:10:09,107: INFO : reading file WOTclean/EyeOfTheWorld.txt
2018-02-08 15:10:09,399: INFO : reading file WOTclean/FiresOfHeaven.txt
2018-02-08 15:10:09,457: INFO : PROGRESS: at 4.93% examples, 773062 words/s, in_qsize 3, out_qsize 0
2018-02-08 15:10:09,881: INFO : reading file WOTclean/GatheringStorm.txt
2018-02-08 15:10:10,248: INFO : reading file WOTclean/GreatHunt.txt
2018-02-08 15:10:10,469: INFO : PROGRESS: at 8.73% examples, 686828 words/s, in_qsize 6, out_qsize 0
2018-02-08 15:10:10,549: INFO : reading file WOTclean/KnifeOfDreams.txt
2018-02-08 15:10:10,866: INFO : reading file WOTclean/LordOfChaos.txt
2018-02-08 15:10:11,236: INFO : reading file WOTclean/MemoryOfLight.txt
2018-02-08 15:10:11,470: INFO : PROGRESS: at 13.80% examples, 730942 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:11,502: INFO : reading file WOTclean/PathOfDaggers.txt
2018-02-08 15:10:11,698: INFO : reading file WOTclean/ShadowRising.txt
2018-02-08 15:10:11,979: INFO : reading file WOTclean/TowersOfMidnight.txt
2018-02-08 15:10:12,229: INFO : reading file WOTclean/WintersHeart.txt
2018-02-08 15:10:12,427: INFO : reading file WOTclean/CrossroadsOfTwilight.txt
2018-02-08 15:10:12,512: INFO : PROGRESS: at 19.68% examples, 777162 words/s, in_qsize 6, out_qsize 2
2018-02-08 15:10:12,796: INFO : reading file WOTclean/CrownOfSwords.txt
2018-02-08 15:10:13,114: INFO : reading file WOTclean/DragonReborn.txt
2018-02-08 15:10:13,400: INFO : reading file WOTclean/EyeOfTheWorld.txt
2018-02-08 15:10:13,531: INFO : PROGRESS: at 23.62% examples, 745543 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:13,811: INFO : reading file WOTclean/FiresOfHeaven.txt
2018-02-08 15:10:14,082: INFO : reading file WOTclean/GatheringStorm.txt
2018-02-08 15:10:14,320: INFO : reading file WOTclean/GreatHunt.txt
2018-02-08 15:10:14,511: INFO : reading file WOTclean/KnifeOfDreams.txt
2018-02-08 15:10:14,560: INFO : PROGRESS: at 29.14% examples, 764296 words/s, in_qsize 6, out_qsize 2
2018-02-08 15:10:14,765: INFO : reading file WOTclean/LordOfChaos.txt
2018-02-08 15:10:15,162: INFO : reading file WOTclean/MemoryOfLight.txt
2018-02-08 15:10:15,413: INFO : reading file WOTclean/PathOfDaggers.txt
2018-02-08 15:10:15,568: INFO : PROGRESS: at 34.93% examples, 787428 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:15,589: INFO : reading file WOTclean/ShadowRising.txt
2018-02-08 15:10:15,902: INFO : reading file WOTclean/TowersOfMidnight.txt
2018-02-08 15:10:16,143: INFO : reading file WOTclean/WintersHeart.txt
2018-02-08 15:10:16,449: INFO : reading file WOTclean/CrossroadsOfTwilight.txt
2018-02-08 15:10:16,574: INFO : PROGRESS: at 39.91% examples, 789062 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:16,828: INFO : reading file WOTclean/CrownOfSwords.txt
2018-02-08 15:10:17,155: INFO : reading file WOTclean/DragonReborn.txt
2018-02-08 15:10:17,370: INFO : reading file WOTclean/EyeOfTheWorld.txt
2018-02-08 15:10:17,578: INFO : PROGRESS: at 44.75% examples, 787033 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:17,588: INFO : reading file WOTclean/FiresOfHeaven.txt
2018-02-08 15:10:17,870: INFO : reading file WOTclean/GatheringStorm.txt
2018-02-08 15:10:18,217: INFO : reading file WOTclean/GreatHunt.txt
2018-02-08 15:10:18,460: INFO : reading file WOTclean/KnifeOfDreams.txt
2018-02-08 15:10:18,579: INFO : PROGRESS: at 49.64% examples, 786549 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:18,716: INFO : reading file WOTclean/LordOfChaos.txt
2018-02-08 15:10:19,023: INFO : reading file WOTclean/MemoryOfLight.txt
2018-02-08 15:10:19,289: INFO : reading file WOTclean/PathOfDaggers.txt
2018-02-08 15:10:19,462: INFO : reading file WOTclean/ShadowRising.txt
2018-02-08 15:10:19,586: INFO : PROGRESS: at 55.61% examples, 802163 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:19,761: INFO : reading file WOTclean/TowersOfMidnight.txt
2018-02-08 15:10:20,007: INFO : reading file WOTclean/WintersHeart.txt
2018-02-08 15:10:20,186: INFO : reading file WOTclean/CrossroadsOfTwilight.txt
2018-02-08 15:10:20,440: INFO : reading file WOTclean/CrownOfSwords.txt
2018-02-08 15:10:20,589: INFO : PROGRESS: at 61.54% examples, 814182 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:20,680: INFO : reading file WOTclean/DragonReborn.txt
2018-02-08 15:10:20,858: INFO : reading file WOTclean/EyeOfTheWorld.txt
2018-02-08 15:10:21,072: INFO : reading file WOTclean/FiresOfHeaven.txt
2018-02-08 15:10:21,316: INFO : reading file WOTclean/GatheringStorm.txt
2018-02-08 15:10:21,526: INFO : reading file WOTclean/GreatHunt.txt
2018-02-08 15:10:21,589: INFO : PROGRESS: at 68.05% examples, 831913 words/s, in_qsize 6, out_qsize 0
2018-02-08 15:10:21,722: INFO : reading file WOTclean/KnifeOfDreams.txt
2018-02-08 15:10:21,960: INFO : reading file WOTclean/LordOfChaos.txt
2018-02-08 15:10:22,251: INFO : reading file WOTclean/MemoryOfLight.txt
2018-02-08 15:10:22,490: INFO : reading file WOTclean/PathOfDaggers.txt
2018-02-08 15:10:22,591: INFO : PROGRESS: at 74.62% examples, 847760 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:22,667: INFO : reading file WOTclean/ShadowRising.txt
2018-02-08 15:10:22,934: INFO : reading file WOTclean/TowersOfMidnight.txt
2018-02-08 15:10:23,168: INFO : reading file WOTclean/WintersHeart.txt
2018-02-08 15:10:23,350: INFO : reading file WOTclean/CrossroadsOfTwilight.txt
2018-02-08 15:10:23,539: INFO : reading file WOTclean/CrownOfSwords.txt
2018-02-08 15:10:23,603: INFO : PROGRESS: at 81.04% examples, 859599 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:23,764: INFO : reading file WOTclean/DragonReborn.txt
2018-02-08 15:10:23,945: INFO : reading file WOTclean/EyeOfTheWorld.txt
2018-02-08 15:10:24,160: INFO : reading file WOTclean/FiresOfHeaven.txt
2018-02-08 15:10:24,413: INFO : reading file WOTclean/GatheringStorm.txt
2018-02-08 15:10:24,604: INFO : PROGRESS: at 87.65% examples, 871700 words/s, in_qsize 5, out_qsize 0
2018-02-08 15:10:24,626: INFO : reading file WOTclean/GreatHunt.txt
2018-02-08 15:10:24,831: INFO : reading file WOTclean/KnifeOfDreams.txt
2018-02-08 15:10:25,053: INFO : reading file WOTclean/LordOfChaos.txt
2018-02-08 15:10:25,355: INFO : reading file WOTclean/MemoryOfLight.txt
2018-02-08 15:10:25,594: INFO : reading file WOTclean/PathOfDaggers.txt
2018-02-08 15:10:25,632: INFO : PROGRESS: at 94.12% examples, 880445 words/s, in_qsize 6, out_qsize 0
2018-02-08 15:10:25,762: INFO : reading file WOTclean/ShadowRising.txt
2018-02-08 15:10:26,030: INFO : reading file WOTclean/TowersOfMidnight.txt
2018-02-08 15:10:26,264: INFO : reading file WOTclean/WintersHeart.txt
2018-02-08 15:10:26,493: INFO : worker thread finished; awaiting finish of 2 more threads
2018-02-08 15:10:26,495: INFO : worker thread finished; awaiting finish of 1 more threads
2018-02-08 15:10:26,500: INFO : worker thread finished; awaiting finish of 0 more threads
2018-02-08 15:10:26,501: INFO : training on 21666845 raw words (16089620 effective words) took 18.1s, 890377 effective words/s