

{"id":135,"date":"2020-05-05T17:14:47","date_gmt":"2020-05-05T15:14:47","guid":{"rendered":"https:\/\/grammarlearning.org\/?page_id=135"},"modified":"2020-05-05T17:45:39","modified_gmt":"2020-05-05T15:45:39","slug":"pautomac","status":"publish","type":"page","link":"https:\/\/grammarlearning.org\/fr\/pautomac\/","title":{"rendered":"PAutomAC"},"content":{"rendered":"<p>The Probabilistic Automata learning Competition (PAutomaC) was the first on-line challenge about learning non-deterministic probabilistic finite state machines (HMM, PFA, &#8230;). It happened in the context of ICGI 2012 and its official website was <a href=\"http:\/\/ai.cs.umbc.edu\/icgi2012\/challenge\/Pautomac\/\">here<\/a>.<\/p>\n<p>As this site is sometime down, you can find most of the information on this page.<\/p>\n<h5>Article<\/h5>\n<p>The paper describing the competition, its context, the data, and its results can be found <a href=\"https:\/\/hal.archives-ouvertes.fr\/file\/index\/docid\/873981\/filename\/competition.pdf\">here<\/a>\u00a0(the corresponding <a href=\"https:\/\/dblp.uni-trier.de\/rec\/bibtex\/journals\/ml\/VerwerEH14\">bibtex<\/a>\u00a0to cite it).<\/p>\n<h5>Data<\/h5>\n<p>The data, now a highly referred benchmark, is available <a href=\"https:\/\/grammarlearning.org\/files\/2020\/05\/PAutomaC-competition_sets.tar.gz\">here<\/a>.<\/p>\n<h5>Results<\/h5>\n<p>Each submission was evaluated using the perplexity over a test set :<\/p>\n\\( Score(C, S)=2^{- \\sum_{x \\in S} P_{\\mathrm{T}}(x) * \\log_2 (P_{\\mathrm{C}}(x)) }\\)\n<p>where \\(P_{\\mathrm{T}}(x)\\) is the normalized probability of \\(x\\) in the target and \\(P_{\\mathrm{C}}(x)\\) is the normalized candidate probability for \\(x\\) submitted by the participant. The normalization process is the usual one when perplexity is considered: it consists in modifying the probabilities so that they sum to 1 on the set \\(S\\).  A consequence of this normalization was that adding probability to one of the test strings removed probability from the others. Therefore, this perplexity score measured how well the differences in the assigned probabilities matched with the target probabilities.<\/p>\n<p>To decide the final overall rank of each participant, we attributed points for each data set: the leader of a problem at the end of the competition scored 5 points, the second 3, the third 2 and the fourth 1. In case of equality on a problem (we considered the 10 first digits of the perplexity score), the earliest submission wins. The winner is the participant whose score was the highest.<\/p>\n<p>Here is the final results:<\/p>\n<p>&nbsp;<\/p>\n<table class=\"gridtable\" border=\"1\" align=\"center\">\n<tbody>\n<tr>\n<td>Rank<\/td>\n<td>Team name<\/td>\n<td>Overall score<\/td>\n<\/tr>\n<tr>\n<td>1<\/td>\n<td>Shibata Yoshinaka<\/td>\n<td>212<\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>Mans Hulden<\/td>\n<td>124<\/td>\n<\/tr>\n<tr>\n<td>3<\/td>\n<td>David Llorens<\/td>\n<td>122<\/td>\n<\/tr>\n<tr>\n<td>4<\/td>\n<td>Raphael Bailly<\/td>\n<td>75<\/td>\n<\/tr>\n<tr>\n<td>5<\/td>\n<td>Fabio Kepler<\/td>\n<td>14<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>And here is the details for each dataset:<\/p>\n<table class=\"gridtable\" border=\"1\" align=\"center\">\n<tbody>\n<tr>\n<td>Problem 1<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 29.8978935527<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (29.9942067897)<br \/>\n<strong>Second<\/strong>: Mans Hulden (30.1311274219)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (30.1470533439)<br \/>\n<strong>Fourth<\/strong>: David Llorens (30.3945552209)<\/td>\n<td><\/td>\n<td>Problem 2<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 168.330805339<br \/>\n<strong>First<\/strong>: David Llorens (168.420077615)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (168.429251783)<br \/>\n<strong>Third<\/strong>: Shibata Yoshinaka (168.430021868)<br \/>\n<strong>Fourth<\/strong>: Mans Hulden (168.455164033)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 3<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 49.956082986<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (50.0418507948)<br \/>\n<strong>Second<\/strong>: Mans Hulden (50.0436956232)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (50.1738154718)<br \/>\n<strong>Fourth<\/strong>: David Llorens (50.6745782951)<\/td>\n<td><\/td>\n<td>Problem 4<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 80.8184226132<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (80.8273603669)<br \/>\n<strong>Second<\/strong>: Mans Hulden (80.8366169447)<br \/>\n<strong>Third<\/strong>: David Llorens (80.8428256389)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (80.8444904746)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 5<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 33.2352988504<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (33.2372712605)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (33.2374213986)<br \/>\n<strong>Third<\/strong>: David Llorens (33.2375906271)<br \/>\n<strong>Fourth<\/strong>: Mans Hulden (33.2407049655)<\/td>\n<td><\/td>\n<td>Problem 6<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 66.9849579244<br \/>\n<strong>First<\/strong>: David Llorens (66.999870186)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (67.0071283713)<br \/>\n<strong>Third<\/strong>: Mans Hulden (67.0435371541)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (67.0591279193)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 7<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 51.2242694583<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (51.2490257063)<br \/>\n<strong>Second<\/strong>: David Llorens (51.259252935)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (51.2638591454)<br \/>\n<strong>Fourth<\/strong>: Mans Hulden (51.2652735083)<\/td>\n<td><\/td>\n<td>Problem 8<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 81.3750634047<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (81.4030796991)<br \/>\n<strong>Second<\/strong>: Mans Hulden (81.7101718832)<br \/>\n<strong>Third<\/strong>: David Llorens (81.7106926455)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (81.7993032504)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 9<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 20.8395901703<br \/>\n<strong>First<\/strong>: David Llorens (20.8504042224)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (20.8556889232)<br \/>\n<strong>Third<\/strong>: Mans Hulden (20.8890396115)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (25.2291177014)<\/td>\n<td><\/td>\n<td>Problem 10<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 33.3030058501<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (33.3340448672)<br \/>\n<strong>Second<\/strong>: Mans Hulden (33.4013200502)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (33.7240544494)<br \/>\n<strong>Fourth<\/strong>: David Llorens (34.039402651)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 11<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 31.8113642161<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (31.8527663573)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (32.1377252373)<br \/>\n<strong>Third<\/strong>: Mans Hulden (32.1380609252)<br \/>\n<strong>Fourth<\/strong>: David Llorens (32.5464384875)<\/td>\n<td><\/td>\n<td>Problem 12<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 21.655287002<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (21.6634964464)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (21.6709158854)<br \/>\n<strong>Third<\/strong>: Mans Hulden (21.6710198077)<br \/>\n<strong>Fourth<\/strong>: David Llorens (21.7690034354)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 13<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 62.8058396015<br \/>\n<strong>First<\/strong>: David Llorens (62.8162371307)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (62.8201155862)<br \/>\n<strong>Third<\/strong>: Mans Hulden (63.0727402033)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (100.680861723)<\/td>\n<td><\/td>\n<td>Problem 14<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 116.791881846<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (116.83624651)<br \/>\n<strong>Second<\/strong>: David Llorens (116.839012269)<br \/>\n<strong>Third<\/strong>: Mans Hulden (116.840857711)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (116.913796957)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 15<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 44.2420495474<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (44.2742933327)<br \/>\n<strong>Second<\/strong>: Mans Hulden (44.2845628737)<br \/>\n<strong>Third<\/strong>: David Llorens (44.7006913136)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (45.2081312742)<\/td>\n<td><\/td>\n<td>Problem 16<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 30.7110624887<br \/>\n<strong>First<\/strong>: David Llorens (30.7185779881)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (30.718658311)<br \/>\n<strong>Third<\/strong>: Mans Hulden (30.8442547844)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (31.8085930297)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 17<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 47.3112160937<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (47.3523770757)<br \/>\n<strong>Second<\/strong>: Mans Hulden (47.3543279913)<br \/>\n<strong>Third<\/strong>: David Llorens (47.9215129705)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (48.1088694268)<\/td>\n<td><\/td>\n<td>Problem 18<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 57.3288608287<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (57.3315532127)<br \/>\n<strong>Second<\/strong>: David Llorens (57.3319679745)<br \/>\n<strong>Third<\/strong>: Mans Hulden (57.3391495076)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (57.53358215)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 19<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 17.8768660563<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (17.879926413)<br \/>\n<strong>Second<\/strong>: David Llorens (17.9194921096)<br \/>\n<strong>Third<\/strong>: Mans Hulden (17.9298641387)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (18.816377518)<\/td>\n<td><\/td>\n<td>Problem 20<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 90.9717263176<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (90.9992603081)<br \/>\n<strong>Second<\/strong>: Mans Hulden (91.016087013)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (91.351157888)<br \/>\n<strong>Fourth<\/strong>: David Llorens (93.5036207506)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 21<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 30.518860165<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (30.5683255996)<br \/>\n<strong>Second<\/strong>: Mans Hulden (30.6048696431)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (30.7140208919)<br \/>\n<strong>Fourth<\/strong>: David Llorens (32.2169198508)<\/td>\n<td><\/td>\n<td>Problem 22<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 25.9815361778<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (25.988088295)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (26.0103173257)<br \/>\n<strong>Third<\/strong>: Mans Hulden (26.0775047173)<br \/>\n<strong>Fourth<\/strong>: David Llorens (26.080426128)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 23<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 18.4081615041<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (18.4131290179)<br \/>\n<strong>Second<\/strong>: Mans Hulden (18.4176370219)<br \/>\n<strong>Third<\/strong>: David Llorens (18.4473506829)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (18.5473422635)<\/td>\n<td><\/td>\n<td>Problem 24<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 38.7287795405<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (38.7317292927)<br \/>\n<strong>Second<\/strong>: David Llorens (38.7321511272)<br \/>\n<strong>Third<\/strong>: Mans Hulden (38.7367779951)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (38.7529827589)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 25<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 65.7350539501<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (65.7831272154)<br \/>\n<strong>Second<\/strong>: Mans Hulden (65.9783424361)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (66.0692698647)<br \/>\n<strong>Fourth<\/strong>: David Llorens (67.2655744007)<\/td>\n<td><\/td>\n<td>Problem 26<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 80.7427626831<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (80.83304279)<br \/>\n<strong>Second<\/strong>: David Llorens (80.8368259964)<br \/>\n<strong>Third<\/strong>: Mans Hulden (82.6574456624)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (111.502198108)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 27<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 42.427078513<br \/>\n<strong>First<\/strong>: David Llorens (42.4558720951)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (42.4643259335)<br \/>\n<strong>Third<\/strong>: Mans Hulden (42.4731370395)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (42.7120658143)<\/td>\n<td><\/td>\n<td>Problem 28<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 52.7435104626<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (52.8408850963)<br \/>\n<strong>Second<\/strong>: Mans Hulden (52.8554872243)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (53.0842735756)<br \/>\n<strong>Fourth<\/strong>: David Llorens (53.1975964081)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 29<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 24.0308339109<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (24.0415850092)<br \/>\n<strong>Second<\/strong>: David Llorens (24.1059251738)<br \/>\n<strong>Third<\/strong>: Mans Hulden (24.1993622441)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (24.817229785)<\/td>\n<td><\/td>\n<td>Problem 30<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 22.925985377<br \/>\n<strong>First<\/strong>: Mans Hulden (22.9324399616)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (22.9342971336)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (22.959864738)<br \/>\n<strong>Fourth<\/strong>: David Llorens (23.2114632503)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 31<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 41.2136431636<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (41.2334334527)<br \/>\n<strong>Second<\/strong>: Mans Hulden (41.242875789)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (41.4169157107)<br \/>\n<strong>Fourth<\/strong>: David Llorens (41.6228893864)<\/td>\n<td><\/td>\n<td>Problem 32<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 32.6134162732<br \/>\n<strong>First<\/strong>: David Llorens (32.6193653586)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (32.6215722582)<br \/>\n<strong>Third<\/strong>: Mans Hulden (32.7427172024)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (38.2998438203)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 33<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 31.8650289444<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (31.8708456878)<br \/>\n<strong>Second<\/strong>: Mans Hulden (31.8720393486)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (31.9204127484)<br \/>\n<strong>Fourth<\/strong>: David Llorens (32.0299349334)<\/td>\n<td><\/td>\n<td>Problem 34<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 19.9546848395<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (19.9685424755)<br \/>\n<strong>Second<\/strong>: Mans Hulden (20.4280156428)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (20.4758085653)<br \/>\n<strong>Fourth<\/strong>: David Llorens (20.5422570638)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 35<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 33.776935538<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (33.8003689017)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (33.835031553)<br \/>\n<strong>Third<\/strong>: David Llorens (34.2954696648)<br \/>\n<strong>Fourth<\/strong>: Mans Hulden (34.3258837259)<\/td>\n<td><\/td>\n<td>Problem 36<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 37.985692906<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (38.0178533505)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (38.175541431)<br \/>\n<strong>Third<\/strong>: Mans Hulden (38.2025866842)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (38.2061985438)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 37<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 20.9797622037<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (21.0009797709)<br \/>\n<strong>Second<\/strong>: Mans Hulden (21.0159257337)<br \/>\n<strong>Third<\/strong>: David Llorens (21.0159990401)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (21.0254753292)<\/td>\n<td><\/td>\n<td>Problem 38<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 21.4457989928<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (21.4586574169)<br \/>\n<strong>Second<\/strong>: Mans Hulden (21.4938249892)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (21.5143686533)<br \/>\n<strong>Fourth<\/strong>: David Llorens (21.5957107834)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 39<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 10.0020442634<br \/>\n<strong>First<\/strong>: Mans Hulden (10.0029067359)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (10.0033975406)<br \/>\n<strong>Third<\/strong>: David Llorens (10.0036814974)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (10.0047386563)<\/td>\n<td><\/td>\n<td>Problem 40<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 8.2009545433<br \/>\n<strong>First<\/strong>: David Llorens (8.2056273558)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (8.2065172057)<br \/>\n<strong>Third<\/strong>: Mans Hulden (8.2552841778)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (8.3657560064)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 41<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 13.9124713717<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (13.9209608465)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (13.9322712597)<br \/>\n<strong>Third<\/strong>: David Llorens (13.9401938505)<br \/>\n<strong>Fourth<\/strong>: Mans Hulden (13.9406884683)<\/td>\n<td><\/td>\n<td>Problem 42<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 16.0037636643<br \/>\n<strong>First<\/strong>: David Llorens (16.005128979)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (16.0065476587)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (16.0080509451)<br \/>\n<strong>Fourth<\/strong>: Mans Hulden (16.0080772707)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 43<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 32.6370243149<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (32.7230067617)<br \/>\n<strong>Second<\/strong>: Mans Hulden (32.7467889092)<br \/>\n<strong>Third<\/strong>: David Llorens (32.7765507902)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (32.8174850182)<\/td>\n<td><\/td>\n<td>Problem 44<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 11.7089059654<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (11.7252949184)<br \/>\n<strong>Second<\/strong>: Raphael Bailly (11.7780498805)<br \/>\n<strong>Third<\/strong>: Mans Hulden (11.7981937504)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (11.9197914258)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 45<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 24.0422109361<br \/>\n<strong>First<\/strong>: David Llorens (24.0447630792)<br \/>\n<strong>Second<\/strong>: Mans Hulden (24.0481772965)<br \/>\n<strong>Third<\/strong>: Shibata Yoshinaka (24.0499661118)<br \/>\n<strong>Fourth<\/strong>: Raphael Bailly (24.0837116426)<\/td>\n<td><\/td>\n<td>Problem 46<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 11.9819819343<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (11.987760725)<br \/>\n<strong>Second<\/strong>: Mans Hulden (11.9985351577)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (12.0815197404)<br \/>\n<strong>Fourth<\/strong>: David Llorens (12.1060872896)<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>Problem 47<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 4.1189756456<br \/>\n<strong>First<\/strong>: David Llorens (4.1191471501)<br \/>\n<strong>Second<\/strong>: Shibata Yoshinaka (4.1191548104)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (4.1195914266)<br \/>\n<strong>Fourth<\/strong>: Mans Hulden (4.1244230576)<\/td>\n<td><\/td>\n<td>Problem 48<\/td>\n<td><strong>Minimal perplexity<\/strong> (solution): 8.0362199917<br \/>\n<strong>First<\/strong>: Shibata Yoshinaka (8.0386767334)<br \/>\n<strong>Second<\/strong>: Mans Hulden (8.0415999503)<br \/>\n<strong>Third<\/strong>: Raphael Bailly (8.0449144221)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (8.1827678063)<\/td>\n<td><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h4>Real data ranking<\/h4>\n<p>&nbsp;<\/p>\n<p>Here are the leading participants for the real data problem.<\/p>\n<table class=\"gridtable\" border=\"1\" align=\"center\">\n<tbody>\n<tr>\n<td>Problem 1<\/td>\n<td><strong>First<\/strong>: Mans Hulden (70.5808700051)<br \/>\n<strong>Second<\/strong>: David Llorens (70.5992773102)<br \/>\n<strong>Third<\/strong>: 3-gram Baseline (70.6452538406)<br \/>\n<strong>Fourth<\/strong>: Fabio Kepler (70.6588545428)<\/td>\n<td><\/td>\n<td>Problem 2<\/td>\n<td><strong>First<\/strong>: David Llorens (5.1242718819)<br \/>\n<strong>Second<\/strong>: Mans Hulden (5.1263087907)<br \/>\n<strong>Third<\/strong>: Fabio Kepler (5.1281949353)<br \/>\n<strong>Fourth<\/strong>: 3-gram Baseline (5.1281949436)<\/td>\n<td><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"<p>The Probabilistic Automata learning Competition (PAutomaC) was the first on-line challenge about learning non-deterministic probabilistic finite state machines (HMM, PFA, &#8230;). It happened in the context of ICGI 2012 and its official website was here. As this site is sometime down, you can find most of the information on this\u2026<\/p>\n<p> <a class=\"continue-reading-link\" href=\"https:\/\/grammarlearning.org\/fr\/pautomac\/\"><span>Continue reading<\/span><i class=\"crycon-right-dir\"><\/i><\/a> <\/p>\n","protected":false},"author":1685,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":"","_members_access_role":[],"_members_access_error":""},"class_list":["post-135","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/grammarlearning.org\/fr\/wp-json\/wp\/v2\/pages\/135","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/grammarlearning.org\/fr\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/grammarlearning.org\/fr\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/grammarlearning.org\/fr\/wp-json\/wp\/v2\/users\/1685"}],"replies":[{"embeddable":true,"href":"https:\/\/grammarlearning.org\/fr\/wp-json\/wp\/v2\/comments?post=135"}],"version-history":[{"count":10,"href":"https:\/\/grammarlearning.org\/fr\/wp-json\/wp\/v2\/pages\/135\/revisions"}],"predecessor-version":[{"id":148,"href":"https:\/\/grammarlearning.org\/fr\/wp-json\/wp\/v2\/pages\/135\/revisions\/148"}],"wp:attachment":[{"href":"https:\/\/grammarlearning.org\/fr\/wp-json\/wp\/v2\/media?parent=135"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}